Method and device for correcting strokes using electronic pen

Abstract

A method for displaying a stroke by using an electronic pen on an electronic device according to one embodiment comprises the steps of: receiving stroke data related to the stroke by using the electronic pen; detecting a missing stroke, where the missing stroke is a stroke by using the electronic pen outside a displayable area of the electronic device; missing stroke data of the detected missing strokes are obtained; adjusting the layout of the displayable area based on the missing stroke data; and displaying the missing strokes in the displayable area according to the adjusted layout.

Description

TECHNICAL FIELD

[0001] Various embodiments relate to a method and an apparatus for correcting strokes made with an electronic pen. BACKGROUND

[0002] Electronic devices have been developed to receive various inputs from a user through a specific input device connected to the electronic device via wireless communication. The electronic device can recognize a position on which a position designated by an input device having a pen function is designated, and perform a corresponding function.

[0003] The electronic device can detect a magnetic field generated by an electronic pen by using an electromagnetic induction method. The electronic device can recognize a position of the electronic pen based on an induced electromotive force generated by the magnetic field per channel.

[0004] The electronic pen can be connected to the electronic device via short distance communication. For example, the electronic pen can transmit information about a press state of a button provided on a housing of the electronic pen to the electronic device via short distance communication, and the electronic device can perform a designated operation based on the received information. SUMMARY

[0005] TECHNICAL PROBLEM When a user uses an electronic pen on an electronic device, strokes made with the electronic pen (hereinafter, strokes using the electronic pen) can be displayed on the electronic device. Even when the electronic pen is outside a display area of the electronic device, the user can use the electronic pen. The electronic device can not display strokes outside the display area of the electronic device. Strokes outside the display area of the electronic device can be missing and not displayed on the display of the electronic device.

[0006] According to various embodiments, when strokes made with the electronic pen are missing, the missing strokes can be displayed on the display of the electronic device by obtaining missing stroke data and adjusting a layout of the display.

[0007] TECHNICAL SOLUTION According to an embodiment, a method for displaying strokes made with an electronic pen on an electronic device can include receiving stroke data related to strokes made with the electronic pen.

[0008] According to an embodiment, a method for displaying strokes made with an electronic pen on an electronic device can include detecting missing strokes, wherein the missing strokes are strokes made with the electronic pen outside a displayable area of the electronic device.

[0009] According to an embodiment, a method for displaying strokes made with an electronic pen on an electronic device can include obtaining missing stroke data about the detected missing strokes.

[0010] According to an embodiment, a method for displaying strokes made with an electronic pen on an electronic device can include adjusting a layout of the displayable area based on the missing stroke data.

[0011] According to an embodiment, a method for displaying strokes made with an electronic pen on an electronic device can include displaying the missing strokes in the displayable area according to the adjusted layout.

[0012] An electronic device for displaying strokes made with an electronic pen according to an embodiment can include a display, a memory storing at least one instruction, and at least one processor.

[0013] The at least one processor can be configured to execute the at least one instruction to receive stroke data related to strokes made with the electronic pen.

[0014] The at least one processor can be configured to execute the at least one instruction to detect a missing stroke, wherein the missing stroke is a stroke made with the electronic pen outside a displayable area of an electronic device.

[0015] The at least one processor can be configured to execute the at least one instruction to obtain missing stroke data about the detected missing stroke.

[0016] The at least one processor can be configured to execute the at least one instruction to adjust a layout of the displayable area based on the missing stroke data.

[0017] The at least one processor can be configured to execute the at least one instruction to display the missing strokes in the displayable area according to the adjusted layout.

[0018] A computer-readable recording medium according to an embodiment can store thereon a program for executing a method for displaying strokes made with an electronic pen on an electronic device according to an embodiment. BRIEF DESCRIPTION OF DRAWINGS

[0019] Figure 1 is a diagram illustrating a process for correcting a missing stroke according to an embodiment.

[0020] Figure 2 is a flowchart of a method for displaying strokes made with an electronic pen on an electronic device according to an embodiment.

[0021] Figure 3 is a flowchart of a method for detecting a missing stroke according to an embodiment.

[0022] Figure 4 is a diagram illustrating a method for activating a missing stroke detection mode according to an embodiment.

[0023] Figure 5 is a diagram illustrating a process for detecting a missing stroke returning from outside of a display area to a displayable area according to an embodiment.

[0024] Figure 6 is a diagram illustrating a method for obtaining missing stroke data after detecting that a missing stroke has occurred completely outside of a displayable area according to an embodiment.

[0025] Figure 7 is a flowchart of a method for obtaining missing stroke data according to an embodiment.

[0026] Figure 8 is a diagram illustrating a method for calculating a pen tip position of an electronic pen according to an embodiment.

[0027] Figure 9 is a diagram illustrating a method for calculating a pen tip position of an electronic pen on a virtual display area according to an embodiment.

[0028] Figure 10 is a diagram illustrating a method for calculating a pen tip position of an electronic pen on a virtual display area according to an embodiment.

[0029] Figure 11 is a flowchart of a method for adjusting a layout of a displayable area of an electronic device according to an embodiment.

[0030] Figure 12 is a diagram illustrating a method for moving an entire set of strokes to a blank space according to an embodiment.

[0031] Figure 13 is a diagram illustrating a method for adjusting a size of an entire set of strokes according to a ratio between a virtual display area and a displayable area according to an embodiment.

[0032] Figure 14 is a diagram illustrating a method for calculating a pen tip position of an electronic pen by using a position of a beacon according to an embodiment.

[0033] Figure 15 is a diagram illustrating a method for calculating a pen tip position of an electronic pen by using a position of a beacon according to an embodiment.

[0034] Figure 16 is a diagram illustrating a method for adjusting a layout of a displayable area based on a blank space between each stroke according to an embodiment.

[0035] Figure 17 is a diagram illustrating a method for obtaining missing stroke data by using at least one of a smart glass, a smart ring, and a smart watch according to an embodiment.

[0036] Figure 18 is a diagram illustrating a method for correcting a missing stroke according to an embodiment.

[0037] Figure 19 is a block diagram of a configuration of an electronic device according to an embodiment.

[0038] Figure 20 is a diagram illustrating a configuration of an electronic pen according to an embodiment. DETAILED DESCRIPTION

[0039] Embodiments will be described more fully below with reference to the accompanying drawings, in which embodiments can be easily carried out by a person of ordinary skill in the art to which the present disclosure pertains, so that the embodiments can be easily implemented by a person of ordinary skill in the art. However, the present disclosure can be implemented in various different forms, and is not limited to the embodiments described herein. Also, portions unrelated to the description of the present disclosure are omitted in the drawings so as to clearly explain the present disclosure, and like reference numerals denote like elements throughout.

[0040] The terms used in the present disclosure can be general terms widely used at present in consideration of functions in the art, but can vary according to the intention of a person of ordinary skill in the art, the precedents, the appearance of new technologies, and the like. Also, specific terms can be chosen by the applicant, and in this case, the meanings of the selected terms will be described in the relevant description in detail. Therefore, the terms used herein should be defined not by the simple names thereof but based on the meanings of the terms and the overall description of the present disclosure.

[0041] Also, in the specification, when a component is referred to as being "connected" or "coupled" to another component, this includes the case where the component is directly connected to the other component, and the case where the component is coupled to the other component with another intervening component therebetween. Also, when a component "includes" or "comprises" another component, unless there is a particular description contrary thereto, it should be understood that the component can further include other components, rather than excluding the other components.

[0042] Also, although terms including ordinal numbers such as "first," "second," etc. can be used herein to describe various elements or components, the elements or components should not be limited by the terms. The terms are only used to distinguish one element or component from another element or component.

[0043] Figure 1 is a diagram illustrating a process for correcting a missing stroke 140 according to an embodiment.

[0044] Referring to Figure 1The electronic device 110 can be implemented in various forms including a display, such as a TV, a smart monitor, a mobile phone, a tablet PC, a digital camera, a camcorder, a laptop computer, a desktop computer, an e-book reader, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, an MP3 player, a wearable device, etc. Also, the electronic device 110 can be a stationary electronic device located in a fixed position or a mobile electronic device having a portable form, and can be a digital broadcasting receiver capable of receiving digital broadcasting. However, the electronic device 110 is not limited thereto.

[0045] In an embodiment, the electronic pen 120 is a pen-shaped tool for controlling the electronic device 110, and can include a stylus or a stylus pen. For example, the electronic pen 120 can be an S-pen. However, the electronic pen 120 is not limited thereto.

[0046] In an embodiment, a user can control the electronic device 110 by performing an action such as directly tapping or dragging the electronic pen 120 on the display of the electronic device 110 or clicking a button on the electronic pen 120.

[0047] In an embodiment, the electronic device 110 can transmit and receive data to and from the electronic pen 120 via wired or wireless communication. For example, the electronic pen 120 can perform communication to transmit stroke data or missing stroke data.

[0048] In an embodiment, the electronic device 110 and the electronic pen 120 can be communicatively connected to each other via a wired or wireless communication interface. For example, the wired communication interface can include a high-definition multimedia interface (HDMI), a universal serial bus (USB), an optical interface, a D-subminiature (D-sub), a digital video interface (DVI), a display port, etc. Also, the wireless communication interface can include a wireless fidelity (WiFi) module, a Bluetooth module, etc.

[0049] In an embodiment, the electronic device 110 and the electronic pen 120 can share data with each other by using a network real-time communication (RTC) scheme. For example, Web RTC is a point-to-point (P2P) communication scheme that enables direct data transfer without a central server, thereby allowing real-time sharing of audio, video, data, etc. on a network without a separate plug-in or software. However, the present disclosure is not limited thereto, and the electronic device 110 can communicate with the electronic pen 120 by using various wired or wireless communication methods.

[0050] In an embodiment, a stroke can refer to an action or a result of generating a line, a dot, a character, or a drawing on a display of the electronic device 110 by using the electronic pen 120. However, the stroke is not limited thereto.

[0051] In an embodiment, the electronic device 110 can display strokes made with the electronic pen 120 (hereinafter, strokes with the electronic pen 120) on the electronic device 110. In an embodiment, a user can generate strokes on the electronic device 110 by using the electronic pen 120.

[0052] In an embodiment, the electronic device 110 can display strokes with the electronic pen 120 on the display of the electronic device 110. In an embodiment, the electronic device 110 can display strokes with the electronic pen 120 in the displayable area 130 of the electronic device 110.

[0053] In an embodiment, the displayable area 130 can refer to an area on the display in which the electronic device 110 is capable of displaying strokes. In an embodiment, the displayable area 130 can refer to an area of the display of the electronic device 110 in which strokes with the electronic pen 120 are to be displayed.

[0054] In an embodiment, a user can generate strokes on the display of the electronic device 110 by using the electronic pen 120. In an embodiment, a user can generate strokes on the displayable area 130 of the electronic device 110 by using the electronic pen 120. For example, a user can generate strokes of "Hello! Sam" on the displayable area 130 of the electronic device 110 by using the electronic pen 120.

[0055] In an embodiment, strokes can be displayed on the display of the electronic device 110. In an embodiment, strokes can be displayed in the displayable area 130 of the electronic device 110. For example, strokes of "Hello! Sam" can be displayed in the displayable area 130 of the electronic device 110.

[0056] In an embodiment, in a case where strokes with the electronic pen 120 occur outside the display of the electronic device 110, the electronic device 110 can not display strokes that occur outside the display on the electronic device 110. In an embodiment, in a case where strokes with the electronic pen 120 occur outside the displayable area 130 of the electronic device 110, the electronic device 110 can not display strokes that occur outside the displayable area 130 on the electronic device 110.

[0057] In an embodiment, strokes that occur outside the displayable area 130 can be missing strokes 140. In an embodiment, the missing strokes 140 can not be displayed on the display of the electronic device 110. In an embodiment, the missing strokes 140 can not be displayed in the displayable area 130 of the electronic device 110. For example, in a complete set of strokes of "Hello! Sam", the end portion of "m" can occur outside the displayable area, resulting in a missing stroke.

[0058] In an embodiment, the electronic device 110 can not be able to display the missing stroke 140 on the display of the electronic device 110. In an embodiment, the electronic device 110 can not be able to display the missing stroke 140 in the displayable area 130 of the electronic device 110.

[0059] In an embodiment, the electronic device 110 can detect the missing stroke 140, wherein the missing stroke 140 is a stroke made outside the displayable area 130 of the electronic device 110 using the electronic pen 120.

[0060] In an embodiment, the electronic device 110 can obtain missing stroke data regarding the detected missing stroke 140. In an embodiment, the electronic device 110 can obtain the missing stroke data regarding the detected missing stroke 140 from the electronic pen 120. In an embodiment, the electronic pen 120 can transmit the missing stroke data to the electronic device 110.

[0061] In an embodiment, the electronic device 110 can adjust the layout of the displayable area 130 based on the missing stroke data.

[0062] In an embodiment, when there is a blank space in the displayable area 130 based on at least one of the usage direction of the electronic pen 120, the virtual display area, and the displayable area 130, the electronic device 110 can move the entire set of strokes to the blank space. For example, in the case where the electronic pen 120 is used from left to right and the size of the missing stroke 140 is smaller than the size of the left blank space in the displayable area 130, the entire set of strokes "Hello! Sam" can be moved to the left.

[0063] In an embodiment, the electronic device 110 can display the missing stroke 140 in the displayable area 130 according to the adjusted layout. For example, when "Hello! Sam" as the entire set of strokes is moved to the left, the end portion of "m" as the missing stroke 140 can be displayed in the displayable area 130 to be connected to the entire set of strokes.

[0064] Figure 2 is a flowchart of a method for displaying strokes using an electronic pen 120 on an electronic device 110 according to an embodiment.

[0065] Referring to Figure 2 , the electronic device 110 can receive stroke data related to strokes using the electronic pen 120 (210).

[0066] In an embodiment, the electronic device 110 can receive the stroke data related to the strokes using the electronic pen 120 from the electronic pen 120. In an embodiment, the electronic pen 120 can transmit the stroke data to the electronic device 110.

[0067] In an embodiment, by using the received stroke data, the electronic device 110 can display the stroke using the electronic pen 120 on the electronic device 110. In an embodiment, by using the received stroke data, the electronic device 110 can display the stroke using the electronic pen 120 on the display of the electronic device 110. In an embodiment, by using the received stroke data, the electronic device 110 can display the stroke using the electronic pen 120 in the displayable area of the electronic device 110.

[0068] In an embodiment, the stroke data can include at least one of pressure sensor data, infrared sensor data, ultrasonic sensor data, electrical signal data, magnetic signal data, electrostatic signal data, accelerometer data, gyroscope data, magnetometer data, stylus tip position data, tilt data, and beacon position of the electronic pen 120. However, the stroke data is not limited thereto.

[0069] In an embodiment, by using the stroke data, the electronic device 110 can detect (or recognize, or identify) the stroke using the electronic pen 120 in the displayable area of the electronic device 110. In an embodiment, when the electronic device 110 detects the stroke using the electronic pen 120 in the displayable area of the electronic device 110, the electronic device 110 can display the stroke in the displayable area of the electronic device 110.

[0070] In an embodiment, the electronic device 110 can detect (or recognize, or identify) a missing stroke (220), wherein the missing stroke is a stroke made using the electronic pen 120 outside the displayable area of the electronic device 110.

[0071] In an embodiment, when the electronic device 110 detects the stroke using the electronic pen 120 at the edge of the displayable area of the electronic device 110, the electronic device 110 can activate a missing stroke detection mode.

[0072] In an embodiment, the missing stroke detection mode can be a system for detecting a stroke made using the electronic pen 120 outside the displayable area of the electronic device 110. In an embodiment, the missing stroke detection mode can use stroke data related to the stroke using the electronic pen 120.

[0073] In an embodiment, the electronic device 110 can detect a missing stroke via the missing stroke detection mode, wherein the missing stroke is a stroke using the electronic pen 120 outside the displayable area of the electronic device 110.

[0074] In an embodiment, by using the stroke data, the electronic device 110 can detect a missing stroke, wherein the missing stroke is a stroke made using the electronic pen 120 outside the displayable area of the electronic device 110.

[0075] In an embodiment, the electronic device 110 can not be able to display the missing stroke on the electronic device 110. In an embodiment, the electronic device 110 can not be able to display the missing stroke on the display of the electronic device 110. In an embodiment, the electronic device 110 can not be able to display the missing stroke in the displayable area of the electronic device 110.

[0076] In an embodiment, by using the stroke data, the electronic device 110 can determine whether the use of the electronic pen 120 outside the displayable area of the electronic device 110 is a stroke. In an embodiment, when the electronic device 110 determines that the use of the electronic pen 120 outside the displayable area of the electronic device 110 is not a stroke, the electronic device 110 can not recognize it as a missing stroke.

[0077] In an embodiment, the electronic device 110 can obtain missing stroke data regarding the detected missing stroke (230). In an embodiment, the electronic device 110 can obtain the missing stroke data regarding the detected missing stroke from the electronic pen 120.

[0078] In an embodiment, the missing stroke data can include at least one of stylus position data, accelerometer data, gyroscope data, magnetometer data, tilt data, time data, sensor data, and direction (or orientation) data of the electronic pen 120. However, the missing stroke data is not limited thereto.

[0079] In an embodiment, the electronic device 110 can obtain the missing stroke data while the missing stroke is occurring. In an embodiment, the electronic device 110 can stop obtaining the missing stroke data while the missing stroke is not occurring.

[0080] In an embodiment, the electronic device 110 can determine whether the missing stroke occurs by using the missing stroke data. In an embodiment, by using the missing stroke data, the electronic device 110 can measure whether at least one of the acceleration and coordinates of the electronic pen 120 exceeds a threshold value. In an embodiment, in the case where at least one of the acceleration and coordinates of the electronic pen 120 exceeds the threshold value, the electronic device 110 can determine that the missing stroke does not occur, and stop obtaining the missing stroke data.

[0081] In an embodiment, the electronic device 110 can generate a virtual display area, in which the virtual display area extends beyond the displayable area in the direction in which the missing stroke is detected. In an embodiment, the electronic device 110 can obtain the missing stroke data by calculating the stylus position of the electronic pen 120 on the virtual display area.

[0082] In an embodiment, the virtual display area can be an arbitrary two-dimensional (2D) plane created (or generated) by extending from the edge of the display of the electronic device 110 in the direction in which the missing stroke is detected. However, the virtual display area is not limited thereto.

[0083] In an embodiment, the virtual display area can be a virtual 2D plane generated for calculating the tip position of the electronic pen 120. In an embodiment, the virtual display area can be a virtual 2D plane generated for obtaining the missing strokes.

[0084] In an embodiment, the electronic device 110 can obtain the missing strokes by using the missing stroke data. In an embodiment, by using the missing stroke data, the electronic device 110 can obtain the missing strokes connected by calculating the tip position of the electronic pen 120 on the virtual display area. In an embodiment, the missing strokes can be the strokes connected by calculating the tip position of the electronic pen 120 on the virtual display area.

[0085] In an embodiment, the electronic device 110 can adjust the layout of the displayable area based on the missing stroke data (240).

[0086] In an embodiment, the electronic device 110 can adjust the layout of the displayable area so that the missing strokes obtained using the missing stroke data can be displayed in the displayable area of the electronic device 110.

[0087] In an embodiment, when there is a blank space (or area) in the displayable area based on at least one of the use direction of the electronic pen 120, the virtual display area, and the displayable area, the electronic device 110 can move the entire set of strokes to the blank space.

[0088] In an embodiment, the blank space can refer to a blank space in the displayable area in a direction opposite to the use direction of the electronic pen 120.

[0089] In an embodiment, the electronic device 110 can determine whether there is a blank space by comparing the size of the virtual display area including the missing strokes with the size of the blank space.

[0090] In an embodiment, when there is no blank space in the displayable area, the electronic device 110 can adjust the size of the entire set of strokes according to the ratio between the virtual display area and the displayable area.

[0091] In an embodiment, the ratio between the virtual display area and the displayable area can refer to a reduction ratio that allows the missing strokes to be displayed in the displayable area.

[0092] In an embodiment, the electronic device 110 can display the missing strokes in the displayable area according to the adjusted layout (250).

[0093] In an embodiment, when the electronic device 110 moves the entire set of strokes to the blank space in the displayable area, the electronic device 110 can display the missing strokes as being connected to the entire set of strokes.

[0094] In an embodiment, when the electronic device 110 adjusts the size of the entire set of strokes, the electronic device 110 can proportionally adjust the size of the missing stroke and display the missing stroke as being connected to the entire set of strokes.

[0095] In an embodiment, the missing stroke can be displayed such that the missing stroke is connected to the entire set of strokes to complete a single letter (or text) or a drawing (or picture). In an embodiment, the missing stroke can be added to the missing portion in the entire set of strokes and connected to the missing portion in the entire set of strokes.

[0096] Figure 3 is a flowchart of a method for detecting a missing stroke according to an embodiment.

[0097] Referring to Figure 3 , the electronic device 110 can receive stroke data related to strokes using the electronic pen 120 (310). In an embodiment, the electronic device 110 can receive the stroke data related to the strokes using the electronic pen 120 from the electronic pen 120.

[0098] In an embodiment, by using the stroke data, the electronic device 110 can detect the strokes using the electronic pen 120 in the displayable area of the electronic device 110. In an embodiment, when the electronic device 110 detects the strokes using the electronic pen 120 in the displayable area of the electronic device 110, the electronic device 110 can display the strokes in the displayable area of the electronic device 110.

[0099] In an embodiment, by using the received stroke data, the electronic device 110 can display the strokes using the electronic pen 120 in the displayable area of the electronic device 110.

[0100] In an embodiment, the electronic device 110 can detect the strokes using the electronic pen 120 at the edge of the displayable area of the electronic device 110 (320).

[0101] In an embodiment, when the electronic device 110 does not detect the strokes made using the electronic pen 120 at the edge of the displayable area of the electronic device 110, the electronic device 110 can continuously receive the stroke data.

[0102] In an embodiment, when the electronic device 110 detects the strokes using the electronic pen 120 at the edge of the displayable area of the electronic device 110, the electronic device 110 can activate a missing stroke detection mode (330).

[0103] In an embodiment, the missing stroke detection mode can be a system for detecting strokes made using the electronic pen 120 outside the displayable area of the electronic device 110. In an embodiment, the missing stroke detection mode can use the stroke data related to the strokes using the electronic pen 120.

[0104] In an embodiment, the electronic device 110 can detect a missing stroke via a missing stroke detection mode, where the missing stroke is a stroke of the electronic pen 120 outside of the displayable area of the electronic device 110.

[0105] In an embodiment, the electronic device 110 can detect a missing stroke by using stroke data, where the missing stroke is a stroke made by the electronic pen 120 outside of the displayable area of the electronic device 110.

[0106] In an embodiment, when the missing stroke mode is activated, the electronic pen 120 can detect whether a stroke of the electronic pen 120 occurs outside of the displayable area.

[0107] In an embodiment, when the missing stroke mode is activated, the electronic pen 120 can transmit a signal indicating whether a missing stroke is occurring to the electronic device 110.

[0108] In an embodiment, the electronic device 110 can determine whether a stroke of the electronic pen 120 has moved from the displayable area of the electronic device 110 to the edge of the displayable area (340).

[0109] In an embodiment, the electronic pen 120 can transmit a signal indicating whether a stroke of the electronic pen 120 has moved from the displayable area of the electronic device 110 to the edge of the displayable area to the electronic device 110.

[0110] In an embodiment, the electronic device 110 can determine whether a stroke of the electronic pen 120 has moved from the displayable area of the electronic device 110 to the edge of the displayable area by the tip position information of the electronic pen 120.

[0111] In an embodiment, the electronic pen 120 can inform a trajectory of a stroke of the electronic pen 120 by transmitting the tip position information of the electronic pen 120 to the electronic device 110. In an embodiment, by transmitting the tip position information of the electronic pen 120 to the electronic device 110, the electronic pen 120 can inform the electronic device 110 whether a stroke of the electronic pen 120 has moved from the displayable area of the electronic device 110 to the edge of the displayable area.

[0112] In an embodiment, when it is determined that a stroke has not moved from the displayable area of the electronic device 110 to the edge of the displayable area, the electronic device 110 can consider that a stroke of the electronic pen 120 is not occurring and end the operation.

[0113] In an embodiment, when it is determined that a stroke has moved from the displayable area of the electronic device 110 to the edge of the displayable area, the electronic device 110 can consider that a stroke of the electronic pen 120 is occurring.

[0114] In an embodiment, the electronic device 110 can determine whether the missing stroke returns from outside the displayable area to the displayable area of the electronic device 110 (350).

[0115] In an embodiment, the electronic device 110 can determine whether the missing stroke returns from outside the displayable area to the displayable area of the electronic device 110 by using the stroke data.

[0116] In an embodiment, the electronic pen 120 can transmit a signal indicating whether the missing stroke returns from outside the displayable area to the displayable area of the electronic device 110 to the electronic device 110.

[0117] In an embodiment, the electronic device 110 can determine whether the missing stroke returns from outside the displayable area to the displayable area of the electronic device 110 through the pen tip position information of the electronic pen 120.

[0118] In an embodiment, the electronic pen 120 can inform the electronic device 110 of whether the missing stroke returns from outside the displayable area to the displayable area of the electronic device 110 by transmitting the pen tip position information of the electronic pen 120 to the electronic device 110.

[0119] In an embodiment, when the missing stroke returns from outside the displayable area to the displayable area, the electronic device 110 can display the stroke after the stroke returns to the displayable area in the displayable area of the electronic device 110.

[0120] In an embodiment, the stroke that returns from outside the displayable area to the displayable area can take the form of a character or a drawing (or a picture) that is truncated with respect to the edge of the displayable area of the electronic device 110.

[0121] In an embodiment, when the electronic device 110 detects that the missing stroke returns from outside the displayable area to the displayable area, the electronic device 110 can obtain missing stroke data about the missing stroke outside the displayable area (360).

[0122] In an embodiment, the electronic pen 120 can transmit the missing stroke data about the missing stroke outside the displayable area to the electronic device 110.

[0123] In an embodiment, the electronic device 110 can obtain the missing stroke data during a time period from when the stroke exits the displayable area to when the stroke returns to the displayable area. In an embodiment, the electronic device 110 can stop obtaining the missing stroke data from when the stroke returns to the displayable area.

[0124] In an embodiment, the electronic pen 120 can transmit the missing stroke data during a time period from when the stroke exits the displayable area to when the stroke returns to the displayable area to the electronic device 110.

[0125] In an embodiment, when the electronic device 110 determines that the missing stroke does not return to the displayable area from the outside of the displayable area, the electronic device 110 can consider that the missing stroke has occurred completely outside of the displayable area.

[0126] In an embodiment, by using the stroke data, the electronic device 110 can determine whether the use of the electronic pen 120 outside of the displayable area of the electronic device 110 is a stroke. In an embodiment, when the electronic device 110 determines that the use of the electronic pen 120 (or writing using the electronic pen 120) outside of the displayable area of the electronic device 110 is not a stroke, the electronic device 110 can not recognize it as a missing stroke.

[0127] In an embodiment, the electronic device 110 can determine whether the acceleration of the electronic pen 120 exceeds a threshold value (370).

[0128] In an embodiment, the accelerometer can refer to a sensor capable of measuring the acceleration of the electronic pen 120 along three-dimensional (3D) coordinate axes.

[0129] In an embodiment, the threshold value can refer to a maximum value of an error range in which it can be determined that a stroke using the electronic pen 120 is occurring. In an embodiment, the threshold value can be a value arbitrarily set by the user.

[0130] In an embodiment, the electronic device 110 can receive data of an accelerometer included in the electronic pen 120 from the electronic pen 120 and determine whether the acceleration of the electronic pen 120 exceeds a threshold value.

[0131] In an embodiment, the electronic pen 120 can transmit data of an accelerometer included in the electronic pen 120 to the electronic device 110.

[0132] In an embodiment, the data of the accelerometer included in the electronic pen 120 can be data obtained by measuring the acceleration of the electronic pen 120 along 3D coordinate axes.

[0133] In an embodiment, when the electronic device 110 determines that the acceleration of the electronic pen 120 exceeds the threshold value, the electronic device 110 can consider that a stroke using the electronic pen 120 is not occurring and end the operation.

[0134] In an embodiment, when it is determined that the acceleration of the electronic pen 120 exceeds the threshold value, the electronic device 110 can consider that the user has stopped using the electronic pen 120 to generate a stroke.

[0135] In an embodiment, when the electronic device 110 determines that the acceleration of the electronic pen 120 does not exceed the threshold value, the electronic device 110 can determine whether the coordinates of the electronic pen 120 exceed a threshold value (380).

[0136] In an embodiment, the gyro can refer to a sensor capable of measuring a direction of rotation, a rotation angle, and an angular velocity of the electronic pen 120 in three dimensions.

[0137] In an embodiment, the electronic device 110 can receive data of a gyro included in the electronic pen 120 from the electronic pen 120, and determine whether a coordinate of the electronic pen 120 exceeds a threshold value.

[0138] In an embodiment, the electronic pen 120 can transmit data of a gyro included in the electronic pen 120 to the electronic device 110.

[0139] In an embodiment, the data of the gyro included in the electronic pen 120 can be data obtained by measuring a direction of rotation, a rotation angle, and an angular velocity of the electronic pen 120 in three dimensions.

[0140] In an embodiment, the electronic device 110 can determine whether a z-axis coordinate of the electronic pen 120 exceeds a threshold value. In an embodiment, the electronic device 110 can receive data of a gyro included in the electronic pen 120 from the electronic pen 120, and determine whether a z-axis coordinate of the electronic pen 120 exceeds a threshold value.

[0141] In an embodiment, when the electronic device 110 determines that the z-axis coordinate of the electronic pen 120 exceeds the threshold value, the electronic device 110 can consider that a stroke using the electronic pen 120 is not being generated, and terminate the operation.

[0142] In an embodiment, when it is determined that the z-axis coordinate of the electronic pen 120 exceeds the threshold value, the electronic device 110 can consider that the user has stopped generating a stroke using the electronic pen 120.

[0143] In an embodiment, when the electronic device 110 determines that the coordinate of the electronic pen 120 does not exceed the threshold value, the electronic device 110 can obtain missing stroke data (390).

[0144] In an embodiment, when the electronic device 110 detects that the missing stroke has completely occurred outside the displayable area, the electronic device 110 can obtain the missing stroke data by using data of at least one of an accelerometer and a gyro included in the electronic pen 120 until at least one of acceleration and a coordinate of the electronic pen 120 does not exceed a corresponding threshold value.

[0145] In an embodiment, when the electronic device 110 detects that the missing stroke has completely occurred outside the displayable area, the electronic device 110 can receive data from at least one of an accelerometer and a gyro included in the electronic pen 120 from the electronic pen 120.

[0146] In an embodiment, the electronic pen 120 can transmit data from at least one of an accelerometer and a gyroscope included in the electronic pen 120 to the electronic device 110.

[0147] In an embodiment, the electronic device 110 can receive the missing stroke data from the electronic pen 120 until at least one of the acceleration and the coordinates of the electronic pen 120 does not exceed the corresponding threshold value.

[0148] In an embodiment, the electronic pen 120 can transmit the missing stroke data to the electronic device 110 until at least one of the acceleration and the coordinates of the electronic pen 120 does not exceed the corresponding threshold value.

[0149] In an embodiment, the electronic device 110 can stop obtaining the missing stroke data when at least one of the acceleration and the coordinates of the electronic pen 120 exceeds the threshold value. In an embodiment, the electronic device 110 can consider that the user has stopped generating (or creating) a stroke using the electronic pen 120 when at least one of the acceleration and the coordinates of the electronic pen 120 exceeds the threshold value.

[0150] In an embodiment, the electronic device 110 can obtain the missing stroke data from a point in time at which a stroke using the electronic pen 120 exits a displayable area of the electronic device 110 to a point in time at which at least one of the acceleration and the coordinates of the electronic pen 120 exceeds the threshold value.

[0151] In an embodiment, the electronic device 110 can receive the missing stroke data from the electronic pen 120 from a point in time at which a stroke using the electronic pen 120 exits a displayable area of the electronic device 110 to a point in time at which at least one of the acceleration and the coordinates of the electronic pen 120 exceeds the threshold value.

[0152] In an embodiment, the electronic device 110 can transmit the missing stroke data to the electronic device 110 from a point in time at which a stroke using the electronic pen 120 exits a displayable area of the electronic device 110 to a point in time at which at least one of the acceleration and the coordinates of the electronic pen 120 exceeds the threshold value.

[0153] Figure 4 is a diagram illustrating a method for activating a missing stroke detection mode according to an embodiment.

[0154] Referring to Figure 4 , the electronic device 110 can receive stroke data related to a stroke using the electronic pen 120. In an embodiment, the electronic device 110 can receive the stroke data related to the stroke using the electronic pen 120 from the electronic pen 120.

[0155] In an embodiment, the electronic device 110 can detect a stroke using the electronic pen 120 in the displayable area of the electronic device 110 by using the stroke data. In an embodiment, when the electronic device 110 detects a stroke using the electronic pen 120 in the displayable area of the electronic device 110, the electronic device 110 can display the stroke in the displayable area of the electronic device 110.

[0156] In an embodiment, the electronic device 110 can display a stroke using the electronic pen 120 in the displayable area of the electronic device 110 by using the received stroke data.

[0157] In an embodiment, the electronic device 110 can detect a stroke using the electronic pen 120 at the edge 410 of the displayable area.

[0158] In an embodiment, the edge 410 of the displayable area can refer to an area up to a certain distance from the left and right ends of the electronic device 110. For example, the edge 410 of the displayable area can be an area of a distance m from the left and right ends of the electronic device 110.

[0159] In an embodiment, the electronic pen 120 can detect whether a stroke using the electronic pen 120 has occurred at the edge 410 of the displayable area. In an embodiment, when the electronic pen 120 detects that a stroke using the electronic pen 120 has occurred at the edge 410 of the displayable area, the electronic pen 120 can transmit a signal to the electronic device 110.

[0160] In an embodiment, the electronic device 110 can detect a stroke using the electronic pen 120 at the edge 410 of the displayable area by receiving a signal from the electronic pen 120.

[0161] In an embodiment, when the electronic device 110 detects a stroke using the electronic pen 120 at the edge 410 of the displayable area, the electronic device 110 can activate a missing stroke detection mode. For example, when the electronic device 110 detects a stroke of the electronic pen 120 in an area of a distance m from the left and right ends of the electronic device 110, the electronic device 110 can activate the missing stroke detection mode.

[0162] In an embodiment, the missing stroke detection mode can be a system for detecting a stroke made using the electronic pen 120 outside the displayable area of the electronic device 110. In an embodiment, the missing stroke detection mode can use stroke data related to a stroke made using the electronic pen 120.

[0163] In an embodiment, the electronic device 110 can detect a missing stroke via the missing stroke detection mode, where the missing stroke is a stroke of the electronic pen 120 outside the displayable area of the electronic device 110.

[0164] In an embodiment, by using the stroke data, the electronic device 110 can detect a missing stroke, wherein the missing stroke is a stroke using the electronic pen 120 outside of the displayable area of the electronic device 110.

[0165] In an embodiment, when the missing stroke mode is activated, the electronic pen 120 can detect whether a stroke using the electronic pen 120 occurs outside of the displayable area.

[0166] In an embodiment, when the missing stroke mode is activated, the electronic pen 120 can transmit a signal indicating whether a missing stroke is occurring to the electronic device 110.

[0167] In an embodiment, the electronic device 110 can detect a missing stroke by receiving a signal from the electronic pen 120.

[0168] In an embodiment, the electronic device 110 can not be able to display a missing stroke occurring outside of the displayable area of the electronic device 110 on the displayable area of the electronic device 110.

[0169] In an embodiment, when the electronic device 110 detects a missing stroke via the missing stroke detection mode, the electronic device 110 can obtain missing stroke data regarding the detected missing stroke.

[0170] In an embodiment, when the electronic device 110 detects a missing stroke via the missing stroke detection mode, the electronic device 110 can obtain missing stroke data from the electronic pen 120.

[0171] Figure 5 is a diagram illustrating a process for detecting a missing stroke returning from outside 510 of a displayable area to a displayable area 520 according to an embodiment.

[0172] Referring to Figure 5 , the electronic device 110 can receive stroke data related to a stroke using the electronic pen 120. In an embodiment, the electronic device 110 can receive stroke data related to a stroke using the electronic pen 120 from the electronic pen 120.

[0173] In an embodiment, by using the stroke data, the electronic device 110 can detect a stroke using the electronic pen 120 in the displayable area 520 of the electronic device 110. In an embodiment, when the electronic device 110 detects a stroke using the electronic pen 120 in the displayable area 520 of the electronic device 110, the electronic device 110 can display the stroke in the displayable area of the electronic device 110.

[0174] In an embodiment, the electronic device 110 can display strokes using the electronic pen 120 in a displayable area of the electronic device 110 by using the received stroke data. For example, the electronic device 110 can display "Hello" (i.e., strokes using the electronic pen 120) in the displayable area of the electronic device 110 by using the received stroke data.

[0175] In an embodiment, the electronic device 110 can detect a missing stroke, wherein the missing stroke is a stroke using the electronic pen 120 on the outside 510 of the displayable area of the electronic device 110. For example, the electronic device 110 can detect that the end portion of the last letter "o" is missing in "Hello" as strokes using the electronic pen.

[0176] In an embodiment, the electronic device 110 can detect the missing stroke by receiving a signal from the electronic pen 120.

[0177] In an embodiment, the electronic device 110 can detect a missing stroke via a missing stroke detection mode, wherein the missing stroke is a stroke using the electronic pen 120 on the outside 510 of the displayable area of the electronic device 110.

[0178] In an embodiment, the electronic device 110 can obtain missing stroke data about the detected missing stroke. In an embodiment, the electronic device 110 can receive the missing stroke data from the electronic pen 120. In an embodiment, the electronic pen 120 can transmit the missing stroke data to the electronic device 110.

[0179] In an embodiment, the electronic device 110 can detect that the missing stroke returns to the displayable area 520 from the outside 510 of the displayable area. For example, the electronic device 110 can detect that the end portion of "o" as the missing stroke returns to the displayable area 520 from the outside 510 of the displayable area.

[0180] In an embodiment, the electronic device 110 can determine whether the missing stroke returns to the displayable area 520 of the electronic device 110 from the outside 510 of the displayable area by using the stroke data.

[0181] In an embodiment, the electronic device 110 can receive stroke data from the electronic pen 120. For example, the electronic device 110 can receive data about a first stroke 530 and a second stroke 540 from the electronic pen 120.

[0182] For example, the first stroke 530 can be in a direction in which it leaves the displayable area 520 toward the outside 510 of the displayable area 510. The second stroke 540 can be in a direction in which it returns to the displayable area 520 from the outside 510 of the displayable area 510.

[0183] In an embodiment, the first stroke 530 and the second stroke 540 can be continuous strokes. In an embodiment, the first stroke 530 and the second stroke 540 can be overlapping or closely spaced strokes.

[0184] In an embodiment, by using data about the first stroke 530 and the second stroke 540, the electronic device 110 can detect whether the missing stroke is returned to the displayable area 520 of the electronic device 110 from the outside 510 of the displayable area.

[0185] In an embodiment, the electronic device 110 can determine whether the missing stroke is returned to the displayable area 520 of the electronic device 110 from the outside 510 of the displayable area, by the stylus tip position information of the electronic pen 120. In an embodiment, the electronic pen 120 can transmit the stylus tip position information of the electronic pen 120 to the electronic device 110.

[0186] In an embodiment, when the missing stroke is returned to the displayable area 520 from the outside 510 of the displayable area, the electronic device 110 can display the stroke after the stroke is returned to the displayable area 520 in the displayable area 520 of the electronic device 110.

[0187] In an embodiment, the stroke returned to the displayable area 520 from the outside 510 of the displayable area can take the form of a character or a drawing that is truncated with respect to the edge of the displayable area of the electronic device 110. For example, the last letter "o" in the stroke "Hello" can be truncated with respect to the edge of the displayable area of the electronic device 110, so that only the shape of "c" can be displayed in the displayable area 520.

[0188] In an embodiment, when the electronic device 110 detects that the missing stroke is returned to the displayable area 520 from the outside 510 of the displayable area, the electronic device 110 can obtain missing stroke data about the missing stroke on the outside 510 of the displayable area.

[0189] In an embodiment, the electronic pen 120 can transmit the missing stroke data about the missing stroke on the outside 510 of the displayable area to the electronic device 110.

[0190] In an embodiment, the electronic device 110 can obtain the missing stroke data during a time period from when the stroke goes to the outside 510 of the displayable area to when the stroke is returned to the displayable area 520. In an embodiment, the electronic device 110 can stop obtaining the missing stroke data from when the stroke is returned to the displayable area 520.

[0191] In an embodiment, the electronic device 110 can receive the missing stroke data during a time period from when the stroke goes to the outside 510 of the displayable area to when the stroke is returned to the displayable area 520, from the electronic pen 120.

[0192] In an embodiment, the electronic pen 120 can transmit, to the electronic device 110, missing stroke data during a time period from when a stroke goes outside the displayable area 510 to when the stroke returns to the displayable area 520.

[0193] For example, if a last letter "o" of the stroke "Hello" is missing, the electronic device 110 can obtain missing stroke data of a portion of the "o" excluding a portion of the "o" that is not missing.

[0194] In an embodiment, the electronic device 110 can obtain a missing stroke by using the missing stroke data.

[0195] Figure 6 is a diagram illustrating a method for obtaining missing stroke data after detecting that a missing stroke has completely occurred outside a displayable area, according to an embodiment.

[0196] Referring to Figure 6 The electronic device 110 can receive stroke data related to a stroke using the electronic pen 120. In an embodiment, the electronic device 110 can receive, from the electronic pen 120, stroke data related to a stroke generated using the electronic pen 120.

[0197] In an embodiment, by using the stroke data, the electronic device 110 can detect a stroke using the electronic pen 120 in the displayable area 520 of the electronic device 110. In an embodiment, when the electronic device 110 detects a stroke using the electronic pen 120 in the displayable area 520 of the electronic device 110, the electronic device 110 can display the stroke in the displayable area of the electronic device 110.

[0198] In an embodiment, by using the received stroke data, the electronic device 110 can display a stroke using the electronic pen 120 in the displayable area of the electronic device 110.

[0199] In an embodiment, the electronic device 110 can detect that a missing stroke does not return to the displayable area from outside the displayable area.

[0200] In an embodiment, the electronic device 110 can detect that a missing stroke has completely occurred outside the displayable area.

[0201] In an embodiment, when the electronic device 110 detects that a missing stroke has completely occurred outside the displayable area, the electronic device 110 can receive, from the electronic pen 120, data of at least one of an accelerometer and a gyroscope included in the electronic pen 120.

[0202] In an embodiment, when the missing stroke has occurred completely outside the displayable area, the electronic pen 120 can transmit data of at least one of an accelerometer and a gyroscope included in the electronic pen 120 to the electronic device 110.

[0203] In an embodiment, the accelerometer can refer to a sensor capable of measuring acceleration of the electronic pen 120 along 3D coordinate axes. In an embodiment, the data of the accelerometer included in the electronic pen 120 can be data obtained by measuring acceleration of the electronic pen 120 along 3D coordinate axes.

[0204] In an embodiment, the gyroscope can refer to a sensor capable of measuring a direction of rotation, a rotation angle, and an angular velocity of the electronic pen 120 in three dimensions. In an embodiment, the data of the gyroscope included in the electronic pen 120 can be data obtained by measuring a direction of rotation, a rotation angle, and an angular velocity of the electronic pen 120 in three dimensions.

[0205] In an embodiment, the electronic device 110 can obtain acceleration of a stroke using the electronic pen 120. For example, a first stroke 610 using the electronic pen 120 can have acceleration a1. The first stroke 610 can be a stroke generated on a displayable area of the electronic device 110.

[0206] In an embodiment, the electronic device 110 can determine whether acceleration of the electronic pen 120 exceeds a threshold value. In an embodiment, the electronic device 110 can receive data of an accelerometer included in the electronic pen 120 from the electronic pen 120 and determine whether acceleration of the electronic pen 120 exceeds a threshold value.

[0207] In an embodiment, the threshold value can refer to a maximum value of an error range in which it can be determined that a stroke using the electronic pen 120 is occurring. In an embodiment, the threshold value can be a value arbitrarily set by a user.

[0208] In an embodiment, the electronic device 110 can determine whether acceleration of a stroke using the electronic pen 120 exceeds a threshold value. For example, a second stroke 620 using the electronic pen 120 can have acceleration a2. The second stroke 620 can be a stroke occurring outside a displayable area of the electronic device 110.

[0209] For example, a2, which is acceleration of the second stroke 620, can have an error range within the threshold value compared to a1, which is acceleration of the first stroke 610. A point separating the first stroke 610 and the second stroke 620 can be T1.

[0210] In an embodiment, when the electronic device 110 determines that acceleration of the electronic pen 120 exceeds a threshold value, the electronic device 110 can consider that a stroke using the electronic pen 120 is not occurring.

[0211] In an embodiment, when the electronic device 110 determines that the acceleration of the electronic pen 120 exceeds a threshold value, the electronic device 110 can consider that the user has stopped using the electronic pen 120 to generate strokes.

[0212] In an embodiment, when the electronic device 110 determines that the acceleration of the electronic pen 120 exceeds a threshold value, the electronic device 110 can stop obtaining missing stroke data. In an embodiment, when the electronic device 110 determines that the acceleration of the electronic pen 120 exceeds a threshold value, the electronic device 110 can not receive missing stroke data from the electronic pen 120.

[0213] In an embodiment, the electronic device 110 can determine whether the acceleration of a stroke using the electronic pen 120 exceeds a threshold value. For example, the third stroke 630 using the electronic pen 120 can have an acceleration a3. The user can generate strokes only up to the second stroke 620 and then stop using the electronic pen 120.

[0214] For example, when the user stops using the electronic pen 120 after the second stroke 620, the acceleration a3 of the third stroke 630 can have an error range exceeding the threshold value compared to a1. The point separating the second stroke 620 and the third stroke 630 can be T2.

[0215] For example, when the user stops using the electronic pen 120 after the second stroke 620, the point T2 can be a point at which the user does not generate a stroke or the user stops using the electronic pen 120.

[0216] In an embodiment, after the point T2, the electronic device 110 can stop obtaining missing stroke data. In an embodiment, after the point T2, the electronic device 110 can not receive missing stroke data from the electronic pen 120.

[0217] In an embodiment, when the electronic device 110 determines that the acceleration of the electronic pen 120 does not exceed a threshold value, the electronic device 110 can determine whether the coordinates of the electronic pen 120 exceed a threshold value.

[0218] In an embodiment, the acceleration of the electronic pen 120 can not exceed a threshold value even when the user stops generating a stroke. In an embodiment, in order to determine when the user stops generating a stroke, a gyroscope of the electronic pen 120 can be used to determine whether the coordinates of the electronic pen 120 exceed a threshold value.

[0219] In an embodiment, the electronic device 110 can receive data of a gyroscope included in the electronic pen 120 from the electronic pen 120 and determine whether the coordinates of the electronic pen 120 exceed a threshold value.

[0220] In an embodiment, the electronic device 110 can determine whether the z-axis coordinate of the electronic pen 120 exceeds a threshold value. In an embodiment, the electronic device 110 can receive data of a gyroscope included in the electronic pen 120 from the electronic pen 120, and determine whether the z-axis coordinate of the electronic pen 120 exceeds a threshold value.

[0221] In an embodiment, the electronic device 110 can obtain coordinates of strokes made using the electronic pen 120. For example, the electronic device 110 can obtain coordinates of the fourth stroke 640 made using the electronic pen 120. The fourth stroke 640 can occur from the displayable area of the electronic device 110 to outside of the displayable area.

[0222] For example, the electronic device 110 can obtain the z-axis coordinate of the fourth stroke 640. The z-axis coordinate of the fourth stroke 640 outside of the displayable area can have an error range exceeding the threshold value compared to the z-axis coordinate of the fourth stroke 640 in the displayable area.

[0223] In an embodiment, when the electronic device 110 determines that the coordinates of the electronic pen 120 exceed a threshold value, the electronic device 110 can consider that a stroke using the electronic pen 120 does not occur. In an embodiment, when the electronic device 110 determines that the z-axis coordinate of the electronic pen 120 exceeds a threshold value, the electronic device 110 can consider that a stroke using the electronic pen 120 does not occur.

[0224] In an embodiment, when it is determined that the coordinates of the electronic pen 120 exceed a threshold value, the electronic device 110 can consider that the user has stopped generating a stroke using the electronic pen 120. In an embodiment, when it is determined that the z-axis coordinate of the electronic pen 120 exceeds a threshold value, the electronic device 110 can consider that the user has stopped generating a stroke using the electronic pen 120.

[0225] In an embodiment, when the electronic device 110 determines that the coordinates of the electronic pen 120 exceed a threshold value, the electronic device 110 can stop obtaining missing stroke data. In an embodiment, when the electronic device 110 determines that the coordinates of the electronic pen 120 exceed a threshold value, the electronic device 110 can not receive missing stroke data from the electronic pen 120.

[0226] In an embodiment, when the electronic device 110 determines that the z-axis coordinate of the electronic pen 120 exceeds a threshold value, the electronic device 110 can stop obtaining missing stroke data. In an embodiment, when the electronic device 110 determines that the z-axis coordinate of the electronic pen 120 exceeds a threshold value, the electronic device 110 can not receive missing stroke data from the electronic pen 120.

[0227] For example, the electronic device 110 can stop obtaining missing stroke data from a point in time at which the z-axis coordinate of the fourth stroke 640 exceeds a threshold value. The electronic device 110 can not receive missing stroke data from the electronic pen 120 from a point in time at which the z-axis coordinate of the fourth stroke 640 exceeds a threshold value.

[0228] In an embodiment, when the electronic device 110 determines that at least one of the acceleration and the coordinates of the electronic pen 120 does not exceed the corresponding threshold value, the electronic device 110 can obtain the missing stroke data. In an embodiment, when the electronic device 110 determines that at least one of the acceleration and the coordinates of the electronic pen 120 does not exceed the corresponding threshold value, the electronic device 110 can receive the missing stroke data from the electronic pen 120.

[0229] In an embodiment, when the electronic device 110 detects that the missing stroke has occurred completely outside the displayable area, the electronic device 110 can obtain the missing stroke data by using data from at least one of the accelerometer and the gyroscope included in the electronic pen 120 until at least one of the acceleration and the coordinates of the electronic pen 120 does not exceed the corresponding threshold value.

[0230] In an embodiment, the electronic device 110 can receive the missing stroke data from the electronic pen 120 until at least one of the acceleration and the coordinates of the electronic pen 120 does not exceed the corresponding threshold value.

[0231] In an embodiment, the electronic pen 120 can transmit the missing stroke data to the electronic device 110 until at least one of the acceleration and the coordinates of the electronic pen 120 does not exceed the corresponding threshold value.

[0232] In an embodiment, the electronic device 110 can stop obtaining the missing stroke data when at least one of the acceleration and the coordinates of the electronic pen 120 exceeds the threshold value. In an embodiment, the electronic device 110 can consider that the user has stopped using the electronic pen 120 to generate a stroke when at least one of the acceleration and the coordinates of the electronic pen 120 exceeds the threshold value.

[0233] For example, the electronic device 110 can stop obtaining the missing stroke data when the stroke of the electronic pen 120 exceeds the threshold value compared to the acceleration a1, or when the z-axis coordinates of the stroke of the electronic pen 120 exceed the threshold value.

[0234] In an embodiment, the electronic device 110 can obtain the missing stroke data from a point in time at which the stroke using the electronic pen 120 exits the displayable area of the electronic device 110 to a point in time at which at least one of the acceleration and the coordinates of the electronic pen 120 exceeds the threshold value.

[0235] For example, the electronic device 110 can obtain the missing stroke data from a point in time at which the stroke using the electronic pen 120 exits the displayable area of the electronic device 110 to a point in time at which the acceleration of the stroke of the electronic pen 120 exceeds the threshold value compared to the acceleration a1, or a point in time at which the z-axis coordinates of the stroke of the electronic pen 120 exceed the threshold value.

[0236] In an embodiment, the electronic device 110 can receive, from the electronic pen 120, missing stroke data from a point in time at which a stroke using the electronic pen 120 exits a displayable area of the electronic device 110 to a point in time at which at least one of acceleration and coordinates of the electronic pen 120 exceeds a threshold value.

[0237] In an embodiment, the electronic device 110 can transmit, to the electronic device 110, missing stroke data from a point in time at which a stroke using the electronic pen 120 exits a displayable area of the electronic device 110 to a point in time at which at least one of acceleration and coordinates of the electronic pen 120 exceeds a threshold value.

[0238] Figure 7 is a flowchart of a method for obtaining missing stroke data according to an embodiment.

[0239] Referring to Figure 7 , the electronic device 110 can determine whether missing stroke data exists (710). In an embodiment, the electronic device 110 can determine whether missing stroke data obtained based on a detected missing stroke exists.

[0240] In an embodiment, Figure 7 may show operations after the missing stroke data is obtained in Figure 3 .

[0241] In an embodiment, the electronic device 110 can terminate the operations when the electronic device 110 determines that the missing stroke data does not exist. In an embodiment, the non-existence of the missing stroke data can mean that the missing stroke is not detected.

[0242] In an embodiment, when the electronic device 110 determines that the missing stroke data exists, the electronic device 110 can consider that the missing stroke is detected.

[0243] In an embodiment, the electronic device 110 can generate a virtual display area (720), wherein the virtual display area extends beyond the displayable area in a direction in which the missing stroke is detected.

[0244] In an embodiment, the virtual display area can be an arbitrary 2D plane created by extending from an edge of a display of the electronic device 110 in a direction in which the missing stroke is detected. However, the virtual display area is not limited thereto.

[0245] In an embodiment, the virtual display area can be a virtual 2D plane generated for calculating a tip position of the electronic pen 120. In an embodiment, the virtual display area can be a virtual 2D plane generated for obtaining the missing stroke.

[0246] In an embodiment, the electronic device 110 can calculate a tip position of the electronic pen 120 on the virtual display area (730).

[0247] In an embodiment, the electronic device 110 can calculate the pen tip position of the electronic pen 120 on the virtual display area by using the stroke data. In an embodiment, the electronic device 110 can calculate the pen tip position of the electronic pen 120 on the virtual display area by using at least one of the position, the inclination, and the sensor data of the electronic pen 120.

[0248] In an embodiment, the electronic device 110 can calculate the pen tip position of the electronic pen 120 on the virtual display area by receiving the stroke data from the electronic pen 120. In an embodiment, the electronic device 110 can calculate the pen tip position of the electronic pen 120 on the virtual display area by receiving at least one of the position, the inclination, and the sensor data of the electronic pen 120 from the electronic pen 120.

[0249] In an embodiment, the electronic pen 120 can transmit the stroke data to the electronic device 110. In an embodiment, the electronic pen 120 can transmit the stroke data for calculating the pen tip position of the electronic pen 120 to the electronic device 110. In an embodiment, the electronic pen 120 can transmit at least one of the position, the inclination, and the sensor data of the electronic pen 120 to the electronic device 110.

[0250] In an embodiment, the electronic device 110 can obtain the missing stroke data by calculating the pen tip position of the electronic pen 120 on the virtual display area (740).

[0251] In an embodiment, the pen tip position of the electronic pen 120 on the virtual display area can be included in the missing stroke data.

[0252] In an embodiment, the electronic device 110 can obtain the missing stroke by using the missing stroke data. In an embodiment, the missing stroke can be a stroke connected by calculating the pen tip position of the electronic pen 120 on the virtual display area.

[0253] In an embodiment, the electronic device 110 can obtain the missing stroke connected by calculating the pen tip position of the electronic pen 120 on the virtual display area by using the missing stroke data.

[0254] In an embodiment, the electronic device 110 can obtain the missing stroke by receiving the missing stroke data from the electronic pen 120. In an embodiment, the electronic pen 120 can transmit the missing stroke data to the electronic device 110.

[0255] In an embodiment, the electronic device 110 can obtain the missing stroke by calculating the pen tip position of the electronic pen 120 on the virtual display area. In an embodiment, the missing stroke can be a stroke connected by calculating the pen tip position of the electronic pen 120 on the virtual display area.

[0256] In an embodiment, strokes connected by calculating the pen tip position of the electronic pen 120 can be included in the missing stroke data. In an embodiment, the obtained missing stroke can be included in the missing stroke data.

[0257] In an embodiment, the electronic device 110 can adjust the layout of the displayable area based on the missing stroke data. In an embodiment, the electronic device 110 can adjust the layout of the displayable area based on the obtained missing stroke.

[0258] Figure 8 is a diagram illustrating a method for calculating the pen tip position of the electronic pen 120 according to an embodiment.

[0259] Referring to Figure 8 , the electronic device 110 can obtain the missing stroke data by calculating the pen tip position of the electronic pen 120. In an embodiment, the electronic device 110 can obtain the missing stroke by calculating the pen tip position of the electronic pen 120.

[0260] In an embodiment, the electronic device 110 can obtain the missing stroke by using the missing stroke data. In an embodiment, the missing stroke can be strokes connected by calculating the pen tip position of the electronic pen 120.

[0261] In an embodiment, the electronic device 110 can obtain the missing stroke by receiving the missing stroke data from the electronic pen 120. In an embodiment, the electronic device 110 can obtain the missing stroke by receiving the pen tip position information of the electronic pen 120 from the electronic pen 120. In an embodiment, the electronic pen 120 can transmit the missing stroke data to the electronic device 110.

[0262] In an embodiment, the missing stroke data can include at least one of the position of the electronic pen 120, the inclination of the electronic pen 120, the gyro sensor of the electronic pen 120, the accelerometer sensor of the electronic pen 120, and the position data of the user's hand.

[0263] In an embodiment, the user can generate strokes by using the electronic pen 120. In an embodiment, it can be assumed that the user using the electronic pen 120 generates strokes with the movement of the fingers and the wrist rather than the movement of the entire hand.

[0264] In an embodiment, the pen tip position of the electronic pen 120 can be denoted by W. In an embodiment, the fixed imaginary center point can be denoted by C. In an embodiment, it can be assumed that the user generates strokes by rotating the electronic pen 120 based on the fixed imaginary center point C. In an embodiment, the position of C can vary depending on how the user uses the electronic pen 120.

[0265] In an embodiment, it can be assumed that the pen tip position W of the electronic pen 120 is continuously in contact with the surface of the input area, and the electronic pen 120 moves along the line C-W.

[0266] In an embodiment, it can be assumed that the pen tip position W of the electronic pen 120 moves in two dimensions. In an embodiment, W can move from W0to W t while maintaining contact with the surface of the input area. In an embodiment, the position of C changes as W moves, but because there is no significant error in the movement, it can be assumed that the position of C is fixed.

[0267] In an embodiment, g can denote the direction of gravity. In an embodiment, B can be a point that contacts the surface of the input area while C is on a straight line in the direction g. In an embodiment, the distance between B and C can be assumed to be a distance of about 5 cm. In an embodiment, the distance between B and C can vary according to the user, and can not affect the determination of the position of W.

[0268] In an embodiment, the electronic device 110 can receive data of an accelerometer included in the electronic pen 120 from the electronic pen 120. In an embodiment, the accelerometer can refer to a sensor capable of measuring acceleration of the electronic pen 120 along 3D coordinate axes. In an embodiment, the data of the accelerometer included in the electronic pen 120 can be data obtained by measuring acceleration of the electronic pen 120 along 3D coordinate axes.

[0269] In an embodiment, the data of the accelerometer can have a value a = (a x , a y , a z ). In an embodiment, when the user holds the electronic pen 120 and does not move, the accelerometer can measure a gravitational acceleration. In an embodiment, the gravitational acceleration can have a value g = (g x , g y , g z ).

[0270] According to an embodiment, the electronic pen 120 can rotate according to gravity. In an embodiment, the accelerometer can adjust the measured value a of acceleration to a' = (a' x , a' y , a' z ) according to gravity. In an embodiment, a' z may be in a direction opposite to gravity. In an embodiment, a' x and a' y may have a direction parallel to the surface of the input area. In an embodiment, the accelerometer can remove the effect of g by removing the z component after rotation.

[0271] In an embodiment, the imaginary starting point on the surface of the input area can be (x0, y0). In an embodiment, the point after substituting N sensor data measurements can be (x N , y N). In an embodiment, (x N , y N ) can be expressed via the following equation.

[0272] [Equation 1]

[0273] In an embodiment, (v nx , v ny ) can be expressed via the following equation.

[0274] [Equation 2]

[0275] In an embodiment, t n may represent a time interval between n-1 and n-th measurements.

[0276] Figure 9 is a diagram illustrating a method for calculating a pen tip position of an electronic pen 120 on a virtual display area 920 according to an embodiment.

[0277] Referring to Figure 9 , the electronic device 110 can receive stroke data related to a stroke using the electronic pen 120. In an embodiment, by using the received stroke data, the electronic device 110 can display the stroke using the electronic pen 120 in the displayable area 910 of the electronic device 110.

[0278] In an embodiment, the electronic device 110 can detect a missing stroke, wherein the missing stroke is a stroke using the electronic pen 120 outside the displayable area 910 of the electronic device 110.

[0279] In an embodiment, the electronic device 110 can generate a virtual display area 920, wherein the virtual display area 920 extends beyond the displayable area 910 in a direction in which the missing stroke is detected.

[0280] In an embodiment, the virtual display area 920 can be an arbitrary 2D plane created by extending from an edge of the display of the electronic device 110 in a direction in which the missing stroke is detected. However, the virtual display area 920 is not limited thereto.

[0281] In an embodiment, the virtual display area 920 can be a virtual 2D plane generated to calculate a pen tip position of the electronic pen 120. In an embodiment, the virtual display area 920 can be a virtual 2D plane generated to obtain a missing stroke.

[0282] In an embodiment, the electronic device 110 can calculate a pen tip position of the electronic pen 120 on the virtual display area 920.

[0283] In an embodiment, the electronic device 110 can calculate the pen tip position of the electronic pen 120 on the virtual display area 920 by using the stroke data. In an embodiment, the electronic device 110 can calculate the pen tip position of the electronic pen 120 on the virtual display area 920 by using at least one of the position, the inclination, and the sensor data of the electronic pen 120.

[0284] In an embodiment, the electronic device 110 can calculate the pen tip position of the electronic pen 120 on the virtual display area 920 by receiving the stroke data from the electronic pen 120. In an embodiment, the electronic device 110 can calculate the pen tip position of the electronic pen 120 on the virtual display area 920 by receiving at least one of the position, the inclination, and the sensor data of the electronic pen 120 from the electronic pen 120.

[0285] In an embodiment, the electronic pen 120 can transmit the stroke data to the electronic device 110. In an embodiment, the electronic pen 120 can transmit the stroke data for calculating the pen tip position of the electronic pen 120 to the electronic device 110. In an embodiment, the electronic pen 120 can transmit at least one of the position, the inclination, and the sensor data of the electronic pen 120 to the electronic device 110.

[0286] In an embodiment, the pen tip positions of the electronic pen 120 can be represented by P1, P2, P3,..., and Pn. In an embodiment, P1, P2, P3,..., and Pn can be the pen tip positions of the electronic pen 120 calculated at regular time intervals. In an embodiment, the use (or writing) direction of the electronic pen 120 can be the direction from P1 to Pn.

[0287] In an embodiment, the pen tip positions of the electronic pen 120 on the displayable area 910 of the electronic device 110 can be P1 and P2. In an embodiment, the pen tip positions of the electronic pen 120 on the virtual display area 920 can be P3, P4, P5, and P6.

[0288] In an embodiment, the pen tip positions of the electronic pen 120 on the virtual display area 920 can have different heights. In an embodiment, the pen tip positions of the electronic pen 120 on the virtual display area 920 can have different z-axis coordinates.

[0289] In an embodiment, P1, P2, and P6 can all have the same height. In an embodiment, P1, P2, and P6 can all have the same z-axis coordinate. In an embodiment, P1, P2, and P6 can have the same z-axis coordinate as the surface of the displayable area 910 of the electronic device 110.

[0290] In an embodiment, P3, P4, and P5 can have different heights. In an embodiment, P3, P4, and P5 can have different z-axis coordinates. In an embodiment, P3, P4, and P5 can have different z-axis coordinates from a surface of the displayable area 910 of the electronic device 110.

[0291] In an embodiment, when the z-axis coordinate of the tip position of the electronic pen 120 on the virtual display area 920 is different from the z-axis coordinate of the surface of the displayable area 910 of the electronic device 110, the electronic device 110 can adjust the z-axis coordinate of the tip position of the electronic pen 120 on the virtual display area 920 to be the same as the z-axis coordinate of the surface of the displayable area 910 of the electronic device 110.

[0292] In an embodiment, when the height of the tip position of the electronic pen 120 on the virtual display area 920 is different from the height of the surface of the displayable area 910 of the electronic device 110, the electronic device 110 can adjust the height of the tip position of the electronic pen 120 on the virtual display area 920 to be equal to the height of the surface of the displayable area 910 of the electronic device 110.

[0293] In an embodiment, the electronic device 110 can adjust the z-axis coordinates of P3, P4, and P5 to be the same as the z-axis coordinates of P0, P1, and P6. In an embodiment, the electronic device 110 can adjust the heights of P3, P4, and P5 to be equal to the heights of P0, P1, and P6.

[0294] In an embodiment, P3, P4, and P5 with the adjusted z-axis coordinates can be adjusted to P3', P4', and P5'. In an embodiment, P3, P4, and P5 with the adjusted heights can be adjusted to P3', P4', and P5'.

[0295] In an embodiment, the electronic device 110 can obtain the missing stroke by connecting the tip position of the electronic pen 120. In an embodiment, the electronic device 110 can obtain the missing stroke by connecting P1, P2, P3', P4', P5', and P6.

[0296] In an embodiment, the electronic device 110 can obtain the missing stroke data by calculating the tip position of the electronic pen 120 on the virtual display area 920.

[0297] In an embodiment, the tip position of the electronic pen 120 on the virtual display area 920 can be included in the missing stroke data.

[0298] In an embodiment, the electronic device 110 can obtain the missing stroke by using the missing stroke data. In an embodiment, the missing stroke can be a stroke connected by calculating the tip position of the electronic pen 120 on the virtual display area 920.

[0299] In an embodiment, the electronic device 110 can obtain the missing stroke by calculating the tip position of the electronic pen 120 on the virtual display area 920, by using the missing stroke data.

[0300] In an embodiment, the electronic device 110 can obtain the missing stroke by receiving the missing stroke data from the electronic pen 120. In an embodiment, the electronic pen 120 can transmit the missing stroke data to the electronic device 110.

[0301] In an embodiment, the electronic device 110 can obtain the missing stroke by calculating the tip position of the electronic pen 120 on the virtual display area 920.

[0302] In an embodiment, the stroke connected by calculating the tip position of the electronic pen 120 on the virtual display area 920 can be included in the missing stroke data. In an embodiment, the obtained missing stroke can be included in the missing stroke data.

[0303] In an embodiment, the electronic device 110 can adjust the layout of the displayable area 910 based on the missing stroke data. In an embodiment, the electronic device 110 can adjust the layout of the displayable area 910 based on the obtained missing stroke.

[0304] Figure 10 is a diagram illustrating a method for calculating the tip position of the electronic pen 120 in the virtual display area 1020 according to an embodiment.

[0305] Referring to Figure 10 , the electronic device 110 can receive stroke data related to a stroke using the electronic pen 120. In an embodiment, by using the received stroke data, the electronic device 110 can display the stroke using the electronic pen 120 in the displayable area 1010 of the electronic device 110.

[0306] In an embodiment, the electronic device 110 can detect a missing stroke, wherein the missing stroke is a stroke using the electronic pen 120 outside the displayable area 1010 of the electronic device 110.

[0307] In an embodiment, the electronic device 110 can generate a virtual display area 1020, wherein the virtual display area 1020 extends beyond the displayable area 1010 in a direction in which the missing stroke is detected.

[0308] In an embodiment, the virtual display area 1020 can be an arbitrary 2D plane created by extending from the edge of the display of the electronic device 110 in the direction in which the missing stroke is detected. However, the virtual display area 1020 is not limited thereto.

[0309] In an embodiment, the virtual display area 1020 can be a virtual 2D plane generated for calculating the tip position of the electronic pen 120. In an embodiment, the virtual display area 1020 can be a virtual 2D plane generated for obtaining the missing stroke.

[0310] In an embodiment, the electronic device 110 can calculate the tip position of the electronic pen 120 on the virtual display area 1020.

[0311] In an embodiment, the tip position of the electronic pen 120 can be denoted by P0, P1, P2, …, and Pn. In an embodiment, P0, P1, P2, …, Pn can be the tip position of the electronic pen 120 calculated at regular time intervals. In an embodiment, the direction of use of the electronic pen 120 is the direction from P0 to Pn.

[0312] In an embodiment, the tip position of the electronic pen 120 on the displayable area 1010 of the electronic device 110 can be P0. In an embodiment, P0 can be the tip position of the electronic pen 120 on the displayable area 1010 just before the missing stroke occurs.

[0313] In an embodiment, the tip position of the electronic pen 120 on the virtual display area 1020 can be P1, P2, and P3. In an embodiment, P1, P2, and P3 can be points adjusted to have a height equal to the height of the surface of the displayable area 1010 of the electronic device 110. In an embodiment, P1, P2, and P3 can be points adjusted to have the same z-axis coordinates as the z-axis coordinates of the surface of the displayable area 1010 of the electronic device 110.

[0314] In an embodiment, the electronic device 110 can obtain the missing stroke by connecting the tip positions of the electronic pen 120. In an embodiment, the electronic device 110 can obtain the missing stroke by connecting P0, P1, P2, and P3.

[0315] In an embodiment, the electronic device 110 can adjust the layout of the displayable area 1010 based on the obtained missing stroke.

[0316] Figure 11 is a flowchart of a method for adjusting the layout of the displayable area of the electronic device 110 according to an embodiment.

[0317] Referring to Figure 11 , the electronic device 110 can obtain missing stroke data regarding the detected missing stroke (1110). Because the method for obtaining the missing stroke data has been described with reference to Figure 3 and Figure 7 , a description of the method for obtaining the missing stroke data is omitted.

[0318] In an embodiment,Figure 11 Operations that can be shown after the operations of Figure 7

[0319] In an embodiment, the electronic device 110 can adjust a layout of a displayable region based on the missing stroke data.

[0320] In an embodiment, the electronic device 110 can adjust a layout of a displayable region so that a missing stroke obtained using the missing stroke data can be displayed in the displayable region of the electronic device 110.

[0321] In an embodiment, the electronic device 110 can obtain information about a use direction of the electronic pen 120, a virtual display region, and a displayable region of the electronic device 110 (1120).

[0322] In an embodiment, the electronic device 110 can obtain information about a use direction of the electronic pen 120, a virtual display region, and a displayable region by using the missing stroke data.

[0323] In an embodiment, the use direction of the electronic pen 120 (or the direction of writing with the electronic pen 120) can indicate a direction in which a user generates a stroke using the electronic pen 120. For example, if the user is right-handed, the use direction of the electronic pen 120 can be from left to right.

[0324] In an embodiment, the information about the virtual display region can include information about a size of the virtual display region including the missing stroke. In an embodiment, the information about the virtual display region can indicate a minimum size of the virtual display region capable of including the missing stroke.

[0325] In an embodiment, the information about the displayable region can include information about a size of the displayable region. In an embodiment, the information about the displayable region can include information about a size of a region in which a stroke using the electronic pen 120 is displayed. In an embodiment, the information about the displayable region can include a minimum size of a region containing a stroke using the electronic pen 120. For example, the size of the displayable region can indicate a size of an input region of S-Note installed in an application on a Samsung smart phone.

[0326] In an embodiment, the electronic device 110 can receive information about a use direction of the electronic pen 120, a virtual display region, and a displayable region from the electronic pen 120. In an embodiment, the electronic pen 120 can transmit information about a use direction of the electronic pen 120, a virtual display region, and a displayable region to the electronic device 110.

[0327] In an embodiment, the electronic device 110 can determine whether there is a blank space in the displayable region based on at least one of the use direction of the electronic pen 120, the virtual display region, and the displayable region (1130).​

[0328] In an embodiment, the electronic device 110 can determine whether a blank space exists in the displayable area using the missing stroke data.

[0329] In an embodiment, the blank space can refer to a blank space (or a blank area) in the displayable area in a direction opposite to a direction of use of the electronic pen 120. In an embodiment, the blank space can refer to a space obtained by excluding a size of an area including a stroke made using the electronic pen 120 from a size of the displayable area.

[0330] In an embodiment, the electronic device 110 can determine whether a blank space exists by comparing a size of a virtual display area including the missing stroke with a size of the blank space.

[0331] In an embodiment, the electronic device 110 can determine that a blank space exists only when the size of the virtual display area including the missing stroke is smaller than the size of the blank space.

[0332] In an embodiment, the electronic device 110 can determine that a blank space exists only when a size of the missing stroke is smaller than the size of the blank space such that the missing stroke can be included in the blank space.

[0333] In an embodiment, the electronic device 110 can determine that a blank space does not exist when the size of the virtual display area including the missing stroke is greater than the size of the blank space.

[0334] In an embodiment, the electronic device 110 can determine that a blank space does not exist when the size of the missing stroke is greater than the size of the blank space.

[0335] In an embodiment, when a blank space exists in the displayable area based on at least one of a direction of use of the electronic pen 120, a virtual display area, and a displayable area, the electronic device 110 can move (1150) the entire set of strokes toward the blank space.

[0336] In an embodiment, the entire set of strokes can refer to strokes made using the electronic pen 120 that are displayed in the displayable area of the electronic device 110. In an embodiment, the entire set of strokes can not include the missing stroke.

[0337] In an embodiment, the electronic device 110 can move the entire set of strokes toward the blank space by a size of a virtual display area including the missing stroke. In an embodiment, the electronic device 110 can move the entire set of strokes toward the blank space by an amount corresponding to a size of the missing stroke.

[0338] In an embodiment, the electronic device 110 can move the entire set of strokes toward an edge of the displayable area in a direction of the blank space.

[0339] In an embodiment, the electronic device 110 can move the entire set of strokes by a distance corresponding to one of a size of the missing stroke and a size of the empty space.

[0340] In an embodiment, the electronic device 110 can adjust the layout of the displayable area by moving the entire set of strokes toward the empty space.

[0341] In an embodiment, the electronic device 110 can display the missing stroke in the displayable area according to the adjusted layout.

[0342] In an embodiment, the electronic device 110 can display the missing stroke by connecting the missing stroke to the entire set of strokes according to the layout in which the entire set of strokes is moved toward the empty space.

[0343] In an embodiment, the missing stroke can be displayed such that it is connected to the entire set of strokes to complete a single letter (or text) or a drawing. In an embodiment, the missing stroke can be added to a missing portion in the entire set of strokes and connected to the missing portion in the entire set of strokes.

[0344] In an embodiment, when there is no empty space in the displayable area, the electronic device 110 can adjust the size of the entire set of strokes according to a ratio between the virtual display area and the displayable area (1140).

[0345] In an embodiment, the ratio between the virtual display area and the displayable area can refer to a zoom-out ratio that allows the missing stroke to be displayed in the displayable area.

[0346] In an embodiment, the ratio between the virtual display area and the displayable area can refer to a value of the size of the displayable area divided by a value of the size of the displayable area plus a value of the size of the virtual display area including the missing stroke.

[0347] In an embodiment, the electronic device 110 can zoom out the size of the entire set of strokes according to the ratio between the virtual display area and the displayable area.

[0348] In an embodiment, the electronic device 110 can adjust the layout of the displayable area by zooming out the size of the entire set of strokes according to the ratio between the virtual display area and the displayable area.

[0349] In an embodiment, the electronic device 110 can display the missing stroke in the displayable area according to the adjusted layout.

[0350] In an embodiment, the electronic device 110 can display the missing stroke by connecting the missing stroke to the entire set of strokes according to the layout in which the size of the entire set of strokes is zoomed out according to the ratio between the virtual display area and the displayable area.

[0351] In an embodiment, the electronic device 110 can reduce the size of the missing stroke according to a ratio between the virtual display area and the displayable area. In an embodiment, the electronic device 110 can display the reduced missing stroke by connecting the reduced missing stroke to the reduced complete set of strokes.

[0352] In an embodiment, the missing stroke can be displayed such that the missing stroke is connected to the complete set of strokes to complete a single letter (or text) or drawing. In an embodiment, the missing stroke can be added to a missing portion in the complete set of strokes and connected to the missing portion in the complete set of strokes.

[0353] Figure 12 is a diagram illustrating a method for moving the complete set of strokes to the blank space 1220 according to an embodiment.

[0354] Referring to Figure 12 The electronic device 110 can receive stroke data related to strokes using the electronic pen 120. In an embodiment, by using the received stroke data, the electronic device 110 can display the strokes using the electronic pen 120 in the displayable area 1240 of the electronic device 110.

[0355] In an embodiment, the strokes using the electronic pen 120 can be "HELLO! Sam". In an embodiment, "HELLO! Sam", which is a set of strokes using the electronic pen 120, can be displayed in the displayable area 1240 of the electronic device 110.

[0356] In an embodiment, the electronic device 110 can detect a missing stroke 1210, which is a stroke made outside the displayable area 1240 of the electronic device 110 using the electronic pen 120. In an embodiment, the missing stroke 1210 can be an end portion of the last letter "m" in the set of strokes "HELLO! Sam" using the electronic pen 120.

[0357] In an embodiment, the electronic device 110 can obtain missing stroke data about the detected missing stroke 1210.

[0358] In an embodiment, the missing stroke data can include at least one of stylus tip position data, accelerometer data, gyroscope data, magnetometer data, tilt data, time data, sensor data, and direction data of the electronic pen 120. However, the missing stroke data is not limited thereto.

[0359] In an embodiment, the electronic device 110 can adjust the layout of the displayable area 1240 based on the missing stroke data.

[0360] In an embodiment, a horizontal width of a stroke using the electronic pen 120 can be denoted by W. In an embodiment, W can denote a distance from a point where a stroke is made using the electronic pen 120 to an end of an opposite edge of the displayable area 1240. In an embodiment, W can denote a distance between A and B, or a distance between C and D.

[0361] In an embodiment, a horizontal length of the displayable area 1240 can be denoted by sW. In an embodiment, sW can denote a distance from an end of one edge of the displayable area 1240 to an end of an opposite edge thereof. In an embodiment, sW can denote a distance from P to B or a distance from Q to C.

[0362] In an embodiment, a vertical height of a stroke using the electronic pen 120 can be denoted by H. In an embodiment, H can denote a distance from P to Q, a distance from A to D, a distance from B to C, or a distance from E to F.

[0363] In an embodiment, A, B, C, and D can denote vertices of a rectangle including a stroke displayed in the displayable area 1240.

[0364] In an embodiment, P can denote a point where a straight line connecting A and B intersects an end of an edge of the displayable area 1240. In an embodiment, Q can denote a point where a straight line connecting C and D intersects an end of an edge of the displayable area 1240.

[0365] In an embodiment, E can denote an upper right vertex of a rectangle containing the missing stroke 1210. In an embodiment, F can denote a lower right vertex of a rectangle containing the missing stroke 1210.

[0366] In an embodiment, the electronic device 110 can determine whether there is a blank space 1220 in the displayable area 1240 based on at least one of a use direction of the electronic pen 120, the virtual display area 1230, and the displayable area 1240.

[0367] In an embodiment, the blank space 1220 can refer to a blank space in the displayable area 1240 in a direction opposite to a use direction of the electronic pen 120. In an embodiment, the blank space can refer to a space obtained by excluding a size of an area including a stroke using the electronic pen 120 from a size of the displayable area 1240. In an embodiment, the blank space 1220 can be a rectangular PADQ area.

[0368] In an embodiment, the electronic device 110 can determine whether there is a blank space 1220 by comparing a size of the virtual display area 1230 including the missing stroke 1210 with a size of the blank space 1220.

[0369] In an embodiment, the virtual display area 1230 including the missing stroke 1210 can be a rectangular BEFC area. In an embodiment, the size of the virtual display area 1230 including the missing stroke 1210 can be denoted by x. In an embodiment, x can denote a distance from B to E, or a distance from C to F. In an embodiment, x can denote a size of the missing stroke 1210.

[0370] In an embodiment, the size of the blank space 1220 can denote a distance from P to A or a distance from Q to D. In an embodiment, the size of the blank space 1220 can refer to a value obtained by subtracting W from sW.

[0371] In an embodiment, the electronic device 110 can determine whether the blank space 1220 exists by comparing x with the distance from P to A. In an embodiment, the electronic device 110 can determine whether the blank space 1220 exists by comparing x with the distance from Q to D.

[0372] In an embodiment, when x is less than the distance from P to A, it can be determined that the blank space 1220 exists. In an embodiment, when x is less than the distance from Q to D, it can be determined that the blank space 1220 exists.

[0373] In an embodiment, when x is greater than the distance from P to A, it can be determined that the blank space 1220 does not exist. In an embodiment, when x is greater than the distance from Q to D, it can be determined that the blank space 1220 does not exist.

[0374] In an embodiment, when there is the blank space 1220 in the displayable area 1240 based on at least one of the usage direction of the electronic pen 120, the virtual display area 1230, and the displayable area 1240, the electronic device 110 can move the entire set of strokes toward the blank space 1220.

[0375] In an embodiment, the entire set of strokes can refer to a portion excluding the missing stroke 1210 from "HELLO! Sam".

[0376] In an embodiment, the electronic device 110 can move the entire set of strokes by x. In an embodiment, the electronic device 110 can move the entire set of strokes by the distance from P to A. In an embodiment, the electronic device 110 can move the entire set of strokes by the distance from Q to D. In an embodiment, the electronic device 110 can move the entire set of strokes by a distance equal to sW minus W.

[0377] In an embodiment, the electronic device 110 can move the entire set of strokes by one of x and the distance from P to A.

[0378] In an embodiment, the electronic device 110 can move the entire set of strokes so that the missing stroke 1210 can be included in the displayable area 1240 of the electronic device 110.

[0379] In an embodiment, the electronic device 110 can adjust the layout of the displayable area 1240 by moving the entire set of strokes toward the blank space 1220.

[0380] In an embodiment, the electronic device 110 can display the missing stroke 1210 in the displayable area 1240 according to the adjusted layout.

[0381] In an embodiment, the electronic device 110 can display the missing stroke 1210 by connecting the missing stroke 1210 to the entire set of strokes according to the layout in which the entire set of strokes has been moved toward the blank space.

[0382] In an embodiment, the end portion of the last letter "m" in "HELLO! Sam" can be displayed by connecting the end portion of the last letter "m" in "HELLO! Sam" to "HELLO! Sam" that has been moved toward the blank space 1220.

[0383] In an embodiment, the missing stroke 1210 can be displayed so that it is connected to the entire set of strokes to complete a single letter (or text) or drawing. In an embodiment, the missing stroke 1210 can be added to and connected to the missing portion in the entire set of strokes.

[0384] In an embodiment, the electronic device 110 can connect the missing stroke 1210 to the entire set of strokes to complete the entire letter (or text) or drawing before adjusting the layout of the displayable area 1240.

[0385] In an embodiment, the electronic device 110 can move the completed entire letter or drawing toward the blank space 1220 according to the adjusted layout.

[0386] Figure 13 is a diagram illustrating a method for adjusting the size of an entire set of strokes according to a ratio between a virtual display area 1320 and a displayable area 1330 according to an embodiment.

[0387] Referring to Figure 13 , the electronic device 110 can receive stroke data related to strokes using the electronic pen 120. In an embodiment, by using the received stroke data, the electronic device 110 can display the strokes using the electronic pen 120 in the displayable area 1330 of the electronic device 110.

[0388] In an embodiment, the strokes using the electronic pen 120 can be "HELLO! Sam". In an embodiment, "HELLO! Sam" that is a set of strokes using the electronic pen 120 can be displayed in the displayable area 1330 of the electronic device 110.

[0389] In an embodiment, the electronic device 110 can detect a missing stroke 1310, where the missing stroke 1310 is a stroke made outside of the displayable area 1330 of the electronic device 110 using the electronic pen 120. In an embodiment, the missing stroke 1310 can be a last letter "m" of a set of strokes "HELLO! Sam" using the electronic pen 120.

[0390] In an embodiment, the electronic device 110 can obtain missing stroke data regarding the detected missing stroke 1310.

[0391] In an embodiment, the missing stroke data can include at least one of a stylus tip position data, an accelerometer data, a gyroscope data, a magnetometer data, a tilt data, a time data, a sensor data, and a direction data of the electronic pen 120. However, the missing stroke data is not limited thereto.

[0392] In an embodiment, the electronic device 110 can adjust a layout of the displayable area 1330 based on the missing stroke data.

[0393] In an embodiment, a horizontal width of a stroke using the electronic pen 120 can be denoted by W. In an embodiment, W can denote a distance from a point where the stroke using the electronic pen 120 starts to an end of an opposite edge of the displayable area 1330. In an embodiment, W can denote a distance from A to B, or a distance from C to D.

[0394] In an embodiment, a horizontal length of the displayable area 1330 can be denoted by sW. In an embodiment, sW can denote a distance from an end of one edge of the displayable area 1330 to an end of an opposite edge thereof.

[0395] In an embodiment, a vertical height of a stroke using the electronic pen 120 can be denoted by K. In an embodiment, K can denote a distance from A to D, a distance from B to C, or a distance from E to F.

[0396] In an embodiment, A, B, C, and D can denote vertices of a rectangle including a stroke displayed in the displayable area 1330.

[0397] In an embodiment, E can denote a top right vertex of a rectangle containing the missing stroke 1310. In an embodiment, F can denote a bottom right vertex of the rectangle containing the missing stroke 1310.

[0398] In an embodiment, a virtual display area 1320 including the missing stroke 1310 can be a rectangle BEFC area. In an embodiment, a size of the virtual display area 1320 including the missing stroke 1310 can be denoted by x. In an embodiment, x can denote a distance from B to E, or a distance from C to F. In an embodiment, x can denote a size of the missing stroke 1310.

[0399] In an embodiment, the electronic device 110 can determine whether there is a blank space in the displayable area 1330 based on at least one of the use direction of the electronic pen 120, the virtual display area 1320, and the displayable area 1330.

[0400] In an embodiment, when there is no blank space in the displayable area 1330, the electronic device 110 can adjust the size of the entire set of strokes according to a ratio between the virtual display area 1320 and the displayable area 1330.

[0401] In an embodiment, the ratio between the virtual display area 1320 and the displayable area 1330 can refer to a reduction ratio that allows the missing stroke 1310 to be displayed in the displayable area 1330.

[0402] In an embodiment, the ratio between the virtual display area 1320 and the displayable area 1330 can represent a value of the size of the displayable area 1330 divided by a value of the size of the displayable area 1330 plus a value of the size of the virtual display area 1320 including the missing stroke 1310.

[0403] In an embodiment, the ratio between the virtual display area 1320 and the displayable area 1330 can represent a distance from A to B divided by a distance from A to E. In an embodiment, the distance from A to B can be W. In an embodiment, the distance from A to E can be W plus x.

[0404] In an embodiment, the ratio between the virtual display area 1320 and the displayable area 1330 can be represented as .

[0405] In an embodiment, the electronic device 110 can reduce the size of the entire set of strokes according to the ratio between the virtual display area 1320 and the displayable area 1330.

[0406] In an embodiment, the size of the entire set of strokes can be represented by y. In an embodiment, the size of the entire set of strokes reduced according to the ratio between the virtual display area 1320 and the displayable area 1330 can be represented as .

[0407] In an embodiment, the lower right vertex of the rectangle containing the entire set of strokes of reduced size can be represented by H. In an embodiment, when a line is connected from H to be perpendicular to the line segment EF, the point at which the line intersects the line segment EF at a right angle can be represented by I.

[0408] In an embodiment, the length of the line segment HB can be a value obtained by multiplying K by the ratio between the virtual display area 1320 and the displayable area 1330. In an embodiment, the length of the line segment HB can be represented as .

[0409] In an embodiment, the size of the angle HFC can be expressed as In an embodiment, the size of the angle HFC can be expressed as The size of the entire set of strokes can be adjusted by moving F to H.

[0410] In an embodiment, the electronic device 110 can adjust the layout of the displayable area 1330 by reducing the size of the entire set of strokes according to the ratio between the virtual display area 1320 and the displayable area 1330.

[0411] In an embodiment, the electronic device 110 can display the missing stroke 1310 in the displayable area 1330 according to the adjusted layout.

[0412] In an embodiment, the electronic device 110 can display the missing stroke 1310 by connecting the missing stroke 1310 to the entire set of strokes according to the layout in which the size of the entire set of strokes is reduced according to the ratio between the virtual display area 1320 and the displayable area 1330.

[0413] In an embodiment, the electronic device 110 can reduce the size of the missing stroke 1310 according to the ratio between the virtual display area 1320 and the displayable area 1330. In an embodiment, the electronic device 110 can display the reduced missing stroke by connecting the reduced missing stroke to the reduced entire set of strokes.

[0414] In an embodiment, the end portion of the last letter "m" of "HELLO! Sam" can be reduced according to the ratio between the virtual display area 1320 and the displayable area 1330. In an embodiment, the reduced end portion of the last letter "m" of the reduced "HELLO! Sam" can be displayed by connecting the reduced end portion of the last letter "m" of the reduced "HELLO! Sam" to the reduced entire set of strokes.

[0415] In an embodiment, the missing stroke 1310 can be displayed such that the missing stroke 1310 is connected to the entire set of strokes to complete a single letter or drawing. In an embodiment, the missing stroke 1310 can be added to and connected to a missing portion in the entire set of strokes.

[0416] In an embodiment, the electronic device 110 can connect the missing stroke 1310 to the entire set of strokes to complete an entire letter or drawing before adjusting the layout of the displayable area 1330.

[0417] In an embodiment, the electronic device 110 can reduce the completed entire letter or drawing according to the ratio between the virtual display area 1320 and the displayable area 1330.

[0418] Figure 14is a diagram illustrating a method for calculating a pen tip position of an electronic pen 120 by using positions of beacons 1410 and 1420 according to an embodiment.

[0419] Referring to Figure 14 , the electronic device 110 can detect a missing stroke, wherein the missing stroke is a stroke of the electronic pen 120 outside of a displayable area of the electronic device 110.

[0420] In an embodiment, the electronic device 110 can generate a virtual display area, wherein the virtual display area extends beyond the displayable area in a direction in which the missing stroke is detected.

[0421] In an embodiment, the electronic device 110 can calculate a pen tip position of the electronic pen 120 on the virtual display area. In an embodiment, the electronic device 110 can calculate the pen tip position of the electronic pen 120 on the virtual display area by using stroke data.

[0422] In an embodiment, the electronic device 110 can obtain missing stroke data by calculating the pen tip position of the electronic pen 120 on the virtual display area.

[0423] In an embodiment, the missing stroke data can include at least one of pen tip position data of the electronic pen 120, accelerometer data, gyroscope data, magnetometer data, tilt data, time data, sensor data, and direction data. However, the missing stroke data is not limited thereto.

[0424] In an embodiment, the missing stroke data can include position data of a beacon 1410 included in the electronic device 110, or position data of a beacon 1420 included in the electronic pen 120.

[0425] In an embodiment, the beacons 1410 and 1420 are short-range wireless communication devices based on a Bluetooth Low Energy (BLE) protocol, and can be devices for transmitting information about a specific position. In an embodiment, the beacons 1410 and 1420 can be included in the electronic device 110 and the electronic pen 120, respectively.

[0426] In an embodiment, the electronic device 110 can obtain pen tip position information of the electronic pen 120 by using a position of the beacon 1410 included in the electronic device 110 and a position of the beacon 1420 included in the electronic pen 120.

[0427] In an embodiment, the electronic device 110 can receive position information of the beacon 1420 included in the electronic pen 120 from the electronic pen 120. In an embodiment, the electronic pen 120 can transmit the position information of the beacon 1420 included in the electronic pen 120 to the electronic device 110.

[0428] In an embodiment, the vertices of the displayable area of the electronic device 110 can be A, B, C, and D. In an embodiment, the location of the beacon 1410 included in the electronic device 110 can be E. In an embodiment, the location of the beacon 1420 included in the electronic device 110 can be S.

[0429] In an embodiment, the distance from the location of the beacon 1420 included in the electronic pen 120 to the pen tip of the electronic pen 120 can be a. In an embodiment, the distance from the location of the beacon 1420 included in the electronic pen 120 to the location of the beacon 1410 included in the electronic device 110 can be b.

[0430] In an embodiment, the signal strength of the beacon 1410 or 1420 measured by the receiver can be represented by a received signal strength indicator (RSSI). In an embodiment, the RSSI can be affected by the distance and the transmission power. In an embodiment, the RSSI can be used to estimate the distance between the receiver and the beacon 1410 or 1420.

[0431] In an embodiment, the power measured by the receiver can be represented by Measured Power. In an embodiment, the Measured Power can be used in combination with the RSSI to estimate the distance between the receiver and the beacon 1410 or 1420.

[0432] In an embodiment, a or b can be represented by Distance. In an embodiment, Distance can be represented via the following equation.

[0433] [Equation 3]

[0434] In an embodiment, N can be a constant determined by environmental factors. In an embodiment, depending on the environmental factors, N can have a value between 2 and 4.

[0435] In an embodiment, the inclination angle between the electronic pen 120 and the plane of the displayable area of the electronic device 110 can be α.

[0436] In an embodiment, the electronic device 110 can calculate α by using the data of the gyroscope included in the electronic pen 120.

[0437] In an embodiment, the data of the gyroscope included in the electronic pen 120 can be data obtained by measuring the direction of rotation, the angle of rotation, and the angular velocity of the electronic pen 120 in three dimensions.

[0438] In an embodiment, the data of the gyroscope can have an angular velocity r = (r x , r y , r z). In an embodiment, the initial posture of the electronic pen 120 can be denoted by o1= (o 1x , o 1y , o 1z ). In an embodiment, o1may be a value considering gravity in a stationary state measured by using an accelerometer included in the electronic pen 120.

[0439] In an embodiment, as the electronic pen 120 rotates, data of a gyroscope included in the electronic pen 120 can be used to update the initial posture. In an embodiment, when o1rotates for a time period t with an angular velocity r, a rotation angle can be denoted as Q( t r). In an embodiment, an updated posture o2may be denoted via the following equation.

[0440] [Equation 4]

[0441] In an embodiment, *may denote quaternion multiplication. In an embodiment, a can be calculated using o2.

[0442] In an embodiment, the electronic device 110 can calculate the pen tip position of the electronic pen 120 by using at least one of the position S, the position E, the distance a, the distance b, and the inclination angle a.

[0443] In an embodiment, the electronic device 110 can obtain the pen tip position information of the electronic pen 120 via the position of the beacon 1410 included in the electronic device 110 and the position of the beacon 1420 included in the electronic pen 120.

[0444] In an embodiment, the electronic device 110 can obtain a missing stroke by using the missing stroke data. In an embodiment, the missing stroke can be a stroke connected by calculating the pen tip position of the electronic pen 120. In an embodiment, the electronic device 110 can obtain the missing stroke by calculating the pen tip position of the electronic pen 120 on the virtual display area.

[0445] In an embodiment, the electronic device 110 can adjust the layout of the displayable area based on the missing stroke data. In an embodiment, the electronic device 110 can adjust the layout of the displayable area based on the obtained missing stroke.

[0446] Figure 15 is a diagram illustrating a method for calculating the pen tip position of the electronic pen 120 by using the positions of beacons according to an embodiment.

[0447] Referring to Figure 15In an embodiment, the vertices of the displayable area of the electronic device 110 can be A, B, C, and D. In an embodiment, the vertices of the virtual display area extending beyond the displayable area of the electronic device 110 can be A', B', C', and D'.

[0448] In an embodiment, the position of the beacon included in the electronic device 110 can be E. In an embodiment, the position of the beacon included in the electronic pen 120 can be S.

[0449] In an embodiment, the position of the nib of the electronic pen 120 can be P. In an embodiment, a point at which a line drawn from S perpendicular to the plane ABCD intersects the plane ABCD can be M.

[0450] In an embodiment, M, E, and P can be points located on the plane A'B'C'D', and M, E, and P can all have the same z-axis coordinate.

[0451] In an embodiment, the distance from the position of the beacon included in the electronic pen 120 to the nib of the electronic pen 120 can be a. In an embodiment, the distance between the position of the beacon included in the electronic pen 120 and the position of the beacon included in the electronic device 110 can be b.

[0452] In an embodiment, the angle of inclination between the line segment SP and the line segment PM can be α.

[0453] In an embodiment, the coordinates of S can be represented by (x S , y S , z S ). In an embodiment, the coordinates of E can be represented by (x E , y E , z E ).

[0454] In an embodiment, the values of a and b can be calculated as described with reference to Figure 14 . In an embodiment, the value of α can be calculated as described with reference to Figure 14 .

[0455] In an embodiment, the lengths of the edges SM and MP among the three edges of the triangle SMP can be represented by the following equation.

[0456] [Equation 5]

[0457]

[0458] In an embodiment, the length of the edge ME among the three edges of the triangle SEM can be represented via the following equation.

[0459] [Equation 6]

[0460] In an embodiment, the square of the length of the edge ME of the three edges of the triangle SEM can be expressed via the following equation using the coordinates of M and the coordinates of E.

[0461] [Equation 7]

[0462] In an embodiment, E and M are points located on the plane ABCD, and z E and z M may have the same value. In an embodiment, (z E -z M ) 2 may be 0.

[0463] In an embodiment, the square of the length of the edge ME of the three edges of the triangle SEM can be expressed via the following equation.

[0464] [Equation 8]

[0465] In an embodiment, the square of the length of the edge SM of the three edges of the triangle SEM can be expressed via the following equation using the coordinates of S and the coordinates of M.

[0466] [Equation 9]

[0467] In an embodiment, the square of the length of the edge SM of the three edges of the triangle SEM can be expressed via the following equation.

[0468] [Equation 10]

[0469] In an embodiment, the coordinates of M can be calculated using Equation 8 and Equation 10.

[0470] In an embodiment, the coordinates of P can be calculated using at least one of the coordinates of M, the coordinates of S, the length of the edge MP, the length of the edge SM, and the length of a.

[0471] In an embodiment, the electronic device 110 can obtain the missing stroke data by calculating the position P of the nib of the electronic pen 120 on the virtual display area.

[0472] In an embodiment, the electronic device 110 can obtain the missing stroke by calculating the position P of the nib of the electronic pen 120 on the virtual display area. In an embodiment, the missing stroke can be a stroke connected by calculating the nib position of the electronic pen 120.

[0473] Figure 16 is a diagram illustrating a method for adjusting a layout of a displayable area based on a blank space between each stroke according to an embodiment.

[0474] Referring to Figure 16 , the electronic device 110 can receive stroke data related to a stroke using the electronic pen 120. In an embodiment, by using the received stroke data, the electronic device 110 can display the stroke using the electronic pen 120 in the displayable area of the electronic device 110.

[0475] In an embodiment, the stroke using the electronic pen 120 can be "Samsung". In an embodiment, the stroke "Samsung" using the electronic pen 120 can be displayed in the displayable area of the electronic device 110.

[0476] In an embodiment, the electronic device 110 can detect a missing stroke, wherein the missing stroke is a stroke made outside the displayable area of the electronic device 110 using the electronic pen 120. In an embodiment, the missing stroke can be an end portion of the last letter "g" in the stroke "Samsung" using the electronic pen 120.

[0477] In an embodiment, the electronic device 110 can obtain missing stroke data about the detected missing stroke.

[0478] In an embodiment, the missing stroke data can include at least one of a stylus tip position data, an accelerometer data, a gyroscope data, a magnetometer data, a tilt data, a time data, a sensor data, and a direction data of the electronic pen 120. However, the missing stroke data is not limited thereto.

[0479] In an embodiment, the electronic device 110 can adjust a layout of a displayable area based on the missing stroke data.

[0480] In an embodiment, the electronic device 110 can adjust a layout of a displayable area by comparing a size of a blank space between each stroke with a size of a missing stroke.

[0481] In an embodiment, the strokes themselves can be respectively denoted by o1, o2, o3, o4, o5, o6, and o7. In an embodiment, o1 can denote "S", o2 can denote "a", o3 can denote "m", o4 can denote "s", o5 can denote "u", o6 can denote "n", and o7 can denote "g".

[0482] In an embodiment, sizes of the strokes in the displayable area of the electronic device 110 can be respectively denoted by w1, w2, w3, w4, w5, w6, w7. In an embodiment, a size of the missing stroke can be denoted by w8. In an embodiment, each w can denote a minimum horizontal width of a stroke.

[0483] In an embodiment, the blank space between each stroke can be denoted by S1, S2, S3, S4, S5, and S6. In an embodiment, each S can denote a minimum distance between each stroke.

[0484] In an embodiment, the space between the end of the first stroke and the edge of the displayable area of the electronic device 110 can be denoted by S0. In an embodiment, S0 can denote a minimum distance between the end of the first stroke and the edge of the displayable area of the electronic device 110.

[0485] In an embodiment, the electronic device 110 can determine whether there is a blank space between the strokes that is greater than or equal to the size of the missing stroke. In an embodiment, the electronic device 110 can determine whether there is an S that is greater than or equal to w8.

[0486] In an embodiment, the electronic device 110 can start from the blank space close to the missing stroke when determining whether there is a blank space between the strokes that is greater than or equal to the size of the missing stroke. For example, the electronic device 110 can perform the determination in the order of S6, S5, S4, …, and S0.

[0487] In an embodiment, when the electronic device 110 determines that there is a blank space between the strokes that is greater than or equal to the size of the missing stroke, the electronic device 110 can move the strokes by the size of the missing stroke toward the corresponding blank space between the strokes.

[0488] In an embodiment, in the case where the electronic device 110 determines that there is a blank space between the strokes that is greater than or equal to the size of the missing stroke, the electronic device 110 can move the strokes on the left or right of the corresponding blank space by the amount of the size of the missing stroke.

[0489] In an embodiment, when the electronic device 110 determines that S6 is greater than or equal to w8, the electronic device 110 can move the stroke corresponding to o7 by w8.

[0490] In an embodiment, the electronic device 110 can display the missing stroke in the displayable area of the electronic device 110 by moving the strokes.

[0491] In an embodiment, in the case where the electronic device 110 determines that there is no blank space between the strokes that is greater than or equal to the size of the missing stroke, the electronic device 110 can move each stroke so that the blank space between each stroke is the same.

[0492] In an embodiment, by comparing the blank space between each stroke with the size of the missing stroke, the electronic device 110 can determine whether the missing stroke can be corrected (or compensated) by moving each stroke.

[0493] In an embodiment, the electronic device 110 can determine whether the following equation is satisfied.

[0494] [Equation 11]

[0495] In an embodiment, may denote the minimum distance by which two strokes can be separated. In an embodiment, n can denote the number of blank spaces between each stroke. For example, n can be 6, which is the number of blank spaces between each stroke in the stroke "Samsung."

[0496] In an embodiment, when Equation 11 is satisfied, the electronic device 110 can move each stroke so that the blank spaces between each stroke are the same.

[0497] In an embodiment, the total size of the blank spaces between each stroke after the movement can be denoted by Ss. In an embodiment, Ss can be denoted via the following equation.

[0498] [Equation 12]

[0499] In an embodiment, the size of the blank spaces between each stroke of the movement can be denoted by In an embodiment, may be denoted via the following equation.

[0500] [Equation 13]

[0501] In an embodiment, in a case where the electronic device 110 determines that there is no blank space between the strokes that is greater than or equal to the size of the missing stroke, the electronic device 110 can move each stroke so that the blank spaces between each stroke are .

[0502] In an embodiment, the electronic device 110 can display the missing stroke in the displayable area of the electronic device 110 by moving each stroke.

[0503] Figure 17 is a diagram illustrating a method for obtaining missing stroke data by using at least one of the smart glasses 1710, the smart ring 1730, and the smart watch 1720 according to an embodiment.

[0504] Referring to Figure 17 , the electronic device 110 can receive stroke data related to a stroke using the electronic pen 120. In an embodiment, by using the received stroke data, the electronic device 110 can display the stroke generated using the electronic pen 120 in the displayable area of the electronic device 110.

[0505] In an embodiment, the electronic device 110 can detect a missing stroke, wherein the missing stroke is a stroke made outside the displayable area of the electronic device 110 using the electronic pen 120.

[0506] In an embodiment, the electronic device 110 can generate a virtual display area, wherein the virtual display area extends beyond the displayable area in a direction in which the missing stroke is detected.

[0507] In an embodiment, the electronic device 110 can obtain missing stroke data by calculating a stylus position of the electronic pen 120 on the virtual display area.

[0508] In an embodiment, the missing stroke data can include at least one of stylus position data, accelerometer data, gyroscope data, magnetometer data, tilt data, time data, sensor data, direction data, and beacon position data of the electronic pen 120. However, the missing stroke data is not limited thereto.

[0509] In an embodiment, the electronic device 110 can obtain a missing stroke by using the missing stroke data. In an embodiment, the missing stroke can be a stroke connected by calculating a stylus position of the electronic pen 120 on the virtual display area.

[0510] In an embodiment, the electronic device 110 can obtain a missing stroke connected by calculating a stylus position of the electronic pen 120 on the virtual display area by using the missing stroke data.

[0511] In an embodiment, the electronic device 110 can obtain a missing stroke by calculating a stylus position of the electronic pen 120 on the virtual display area.

[0512] In an embodiment, the electronic device 110 can obtain missing stroke data by using at least one of the smart glasses 1710, the smart ring 1730, and the smart watch 1720.

[0513] In an embodiment, the smart glasses 1710 can refer to a smart device in the form of glasses installed with a computer, and implement a see-through function and a recording function. In an embodiment, the smart glasses 1710 can include at least one of a camera, an interface device, and a device for transmitting an image. However, the smart glasses 1710 are not limited thereto.

[0514] In an embodiment, the smart watch 1720 can refer to a smart device connected to the electronic device 110 to perform at least one of functions of a watch, a telephone call, a text message, an email, music, and a game. However, the smart watch 1720 is not limited thereto.

[0515] In an embodiment, the smart ring 1730 is a wearable computer in the form of a ring, and can refer to a smart device that performs at least one of a function of controlling the electronic device 110, analyzing a health status of a user, and making a payment. However, the smart ring 1730 is not limited thereto.

[0516] In an embodiment, the smart glasses 1710 can display a virtual display area extending beyond a displayable area of the electronic device 110 in real time.

[0517] In an embodiment, the smart glasses 1710 can display the virtual display area in real time by receiving the missing stroke data from the electronic device 110 and the electronic pen 120.

[0518] In an embodiment, the electronic device 110 and the electronic pen 120 can transmit the missing stroke data to the smart glasses 1710.

[0519] In an embodiment, a user wearing the smart glasses 1710 can view the virtual display area extending beyond the displayable area of the electronic device 110 in real time.

[0520] In an embodiment, the smart glasses 1710 can display the missing stroke on the virtual display area in real time by using the missing stroke data. In an embodiment, a user wearing the smart glasses 1710 can view the missing stroke on the virtual display area in real time.

[0521] In an embodiment, data regarding the missing stroke on the virtual display area obtained using the smart glasses 1710 can be transmitted to the electronic device 110.

[0522] In an embodiment, data obtained using the smart glasses 1710 can be included in the missing stroke data.

[0523] In an embodiment, the smart watch 1720 and the smart ring 1730 can be used to obtain the missing stroke data.

[0524] In an embodiment, the smart watch 1720 and the smart ring 1730 can be used to obtain data regarding at least one of an acceleration of the electronic pen 120, a tilt of the electronic pen 120, a distance from the electronic device 110, and a position of a hand of a user. However, the smart watch 1720 and the smart ring 1730 are not limited thereto.

[0525] In an embodiment, the missing stroke data obtained using the smart watch 1720 and the smart ring 1730 can be used to improve accuracy of calculation of a pen tip position of the electronic pen 120.

[0526] In an embodiment, the missing stroke data obtained using the smart watch 1720 and the smart ring 1730 can be used to improve accuracy of the missing stroke.

[0527] In an embodiment, the electronic device 110 can adjust a layout of the displayable area based on the missing stroke data. In an embodiment, the missing stroke can be displayed in the displayable area according to the adjusted layout.

[0528] Figure 18 is a diagram illustrating a process for correcting the missing stroke 1810 according to an embodiment.

[0529] Referring to Figure 18 , the electronic device 110 can receive stroke data related to a stroke using the electronic pen 120. In an embodiment, by using the received stroke data, the electronic device 110 can display the stroke using the electronic pen 120 in the displayable area of the electronic device 110.

[0530] In an embodiment, the stroke using the electronic pen 120 can be "Hello Team". In an embodiment, the stroke "Hello Team" using the electronic pen 120 can be displayed in the displayable area of the electronic device 110.

[0531] In an embodiment, the electronic device 110 can detect a missing stroke 1810, wherein the missing stroke 1810 is a stroke using the electronic pen 120 outside the displayable area of the electronic device 110. In an embodiment, the missing stroke 1810 can be an end portion of the last letter "m" in the stroke "Hello Team" using the electronic pen 120.

[0532] In an embodiment, the electronic device 110 can obtain missing stroke data about the detected missing stroke 1810.

[0533] In an embodiment, the electronic device 110 can obtain the missing stroke 1810 by using the missing stroke data. In an embodiment, the missing stroke 1810 can be a stroke connected by calculating the tip position of the electronic pen 120 on the virtual display area.

[0534] In an embodiment, the calculated tip position of the electronic pen 120 can be a set of non-continuous points. In an embodiment, the missing stroke 1810 can be represented as a non-continuous stroke.

[0535] In an embodiment, the electronic device 110 can correct (or compensate, make up, reconstruct) the missing stroke 1810, thereby converting it to a continuous stroke.

[0536] In an embodiment, the electronic device 110 can correct the missing stroke 1810 using a filter or an algorithm. For example, the filter or the algorithm for correcting the missing stroke 1810 can be an epsilon filter, a mean shift algorithm, or a mean estimation algorithm.

[0537] In an embodiment, the electronic device 110 can display the corrected missing stroke 1810 in the displayable area.

[0538] Figure 19 is a block diagram of a configuration of the electronic device 110 according to an embodiment.

[0539] Referring to Figure 19 The electronic device 110 can include a processor 1910, a display 1920, and a memory 1930.

[0540] In an embodiment, the processor 1910 controls all operations of the electronic device 110 and signal flow between internal components of the electronic device 110, and performs a function of processing data.

[0541] In an embodiment, the processor 1910 can include a single core, a dual core, a triple core, a quad core, and a multiple core equal to a multiple thereof. Also, the processor 1910 can include a plurality of processors. For example, the processor 1910 can be implemented as a main processor (not shown) and a sub-processor (not shown) operating in a sleep mode.

[0542] In an embodiment, the processor 1910 can include at least one of a central processing unit (CPU), a graphics processing unit (GPU), and a video processing unit (VPU). Alternatively, according to an embodiment, the processor 1910 can be implemented as a system on chip (SoC) that integrates at least one of a CPU, a GPU, and a VPU. Alternatively, the processor 1910 can further include a neural processing unit (NPU).

[0543] In an embodiment, the processor 1910 can receive stroke data related to a stroke using the electronic pen 120.

[0544] In an embodiment, the processor 1910 can detect a missing stroke, wherein the missing stroke is a stroke made outside a displayable area of the electronic device 110 using the electronic pen 120.

[0545] In an embodiment, the processor 1910 can obtain missing stroke data about the detected missing stroke.

[0546] In an embodiment, the processor 1910 can adjust a layout of the displayable area based on the missing stroke data.

[0547] In an embodiment, the processor 1910 can display the missing stroke in the displayable area according to the adjusted layout.

[0548] In an embodiment, when the processor 1910 detects a stroke using the electronic pen 120 at an edge of the displayable area of the electronic device 110, the processor 1910 can activate a missing stroke detection mode.

[0549] In an embodiment, the processor 1910 can generate a virtual display area, wherein the virtual display area extends beyond the displayable area in a direction in which the missing stroke is detected.

[0550] In an embodiment, the processor 1910 can obtain the missing stroke data by calculating a pen tip position of the electronic pen 120 on the virtual displayable area.

[0551] In an embodiment, when the processor 1910 detects that the missing stroke returns to the displayable area from outside the displayable area, the processor 1910 can obtain the missing stroke data regarding the missing stroke outside the displayable area.

[0552] In an embodiment, when the processor 1910 detects that the missing stroke has occurred entirely outside the displayable area, the processor 1910 can obtain the missing stroke data by using data from at least one of an accelerometer and a gyroscope included in the electronic pen 120 until at least one of acceleration and coordinates of the electronic pen 120 does not exceed a corresponding threshold value.

[0553] In an embodiment, the processor 1910 can obtain the missing stroke data via pen tip position information of the electronic pen 120 obtained using a position of a beacon included in the electronic device 110 and a position of a beacon included in the electronic pen 120.

[0554] In an embodiment, when there is a blank space in the displayable area based on at least one of a use direction of the electronic pen 120, the virtual display area, and the displayable area, the processor 1910 can move the entire set of strokes to the blank space.

[0555] In an embodiment, when there is no blank space in the displayable area, the processor 1910 can adjust a size of the entire set of strokes according to a ratio between the virtual display area and the displayable area.

[0556] In an embodiment, the processor 1910 can adjust a layout of the displayable area by comparing a size of a blank space between each stroke to a size of the missing stroke.

[0557] In an embodiment, the processor 1910 can obtain the missing stroke data by using at least one of a smart glass, a smart ring, and a smart watch.

[0558] According to an embodiment, the display 1920 generates a driving signal by converting an image signal, a data signal, an on screen display (OSD) signal, a control signal, etc. processed by the processor 1910. The display 1920 can be implemented as a plasma display panel (PDP), a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a flexible display, etc., and can also be implemented as a 3D display. Furthermore, the display 1920 can be configured as a touch screen and be used as an input device as well as an output device.

[0559] In an embodiment, the memory 1930 can store various pieces of data, programs, or applications for driving and controlling the electronic device 110.

[0560] In an embodiment, the program stored in the memory 1930 can include one or more instructions. The program (one or more instructions) or application stored in the memory 1930 can be executed by the processor 1910.

[0561] Figure 20 is a diagram illustrating a configuration of the electronic pen 120 according to an embodiment.

[0562] Referring to Figure 20 , the electronic pen 120 can include a processor 2010, a memory 2020, a battery 2030, an antenna 2040, an accelerometer 2050, a gyroscope 2060, a magnetometer 2070, and a communication unit 2080.

[0563] In an embodiment, the processor 2010 controls all operations of the electronic pen 120 and a signal flow between internal components of the electronic pen 120, and performs a function of processing data.

[0564] In an embodiment, the processor 2010 can include a single core, a dual core, a triple core, a quad core, and a plurality of cores equal to a multiple thereof. Furthermore, the processor 2010 can include a plurality of processors. For example, the processor 2010 can be implemented as a main processor (not shown) and a sub-processor (not shown) operating in a sleep mode.

[0565] In an embodiment, the processor 2010 can include at least one of a CPU, a GPU, and a VPU. Alternatively, according to an embodiment, the processor 140 can be implemented as a system on chip (SoC) that integrates at least one of a CPU, a GPU, and a VPU. Alternatively, the processor 2010 can further include an NPU.

[0566] In an embodiment, the memory 2020 can store various pieces of data, programs, or applications for driving and controlling the electronic pen 120.

[0567] In an embodiment, a program stored in the memory 2020 can include one or more instructions. The program (one or more instructions) stored in the memory 2020 or an application can be executed by the processor 2010.

[0568] In an embodiment, the battery 2030 can store power required for the operation of the electronic pen 120. For example, the battery 2030 can be a lithium ion battery, a primary cell, a secondary cell, or a fuel cell. In an embodiment, the battery 2030 can be rechargeable or replaceable.

[0569] In an embodiment, the antenna 2040 can be used to transmit a signal or power to the outside or receive a signal or power from the outside. In an embodiment, the electronic pen 120 can exchange a signal or power with the electronic device 110 via the antenna 2040.

[0570] In an embodiment, the accelerometer 2050 can be a sensor capable of measuring acceleration of the electronic pen 120 along 3D coordinate axes. In an embodiment, the electronic pen 120 can obtain missing stroke data by using the accelerometer 2050.

[0571] In an embodiment, the gyroscope 2060 can be a sensor capable of measuring a direction of rotation, a rotation angle, and an angular velocity of the electronic pen 120 in three dimensions. In an embodiment, the electronic pen 120 can obtain missing stroke data by using the gyroscope 2060.

[0572] In an embodiment, the magnetometer 2070 can be a sensor that measures a magnetic field or a magnetic moment of the electronic pen 120. In an embodiment, the electronic pen 120 can obtain information about a direction of the electronic pen 120 by using the magnetometer 2070.

[0573] In an embodiment, the communication unit 2080 can transmit and receive data or a signal to or from an external device (e.g., the electronic device 110) or a server. For example, the communication unit 2080 can include a WiFi module, a Bluetooth module, an infrared communication module, a wireless communication module, a local area network (LAN) module, an Ethernet module, a wired communication module, etc. In this case, each communication module can be implemented in the form of at least one hardware chip.

[0574] The method for displaying a stroke using an electronic pen on an electronic device according to an embodiment can include activating a missing stroke detection mode when a stroke using an electronic pen is detected at an edge of a displayable area of the electronic device.

[0575] According to an embodiment, the method for displaying a stroke using an electronic pen on an electronic device can include generating a virtual display area, wherein the virtual display area extends beyond the displayable area in a direction in which a missing stroke is detected.

[0576] According to an embodiment, the method for displaying strokes using an electronic pen on an electronic device can include obtaining missing stroke data by calculating a pen tip position of the electronic pen on a virtual display area.

[0577] According to an embodiment, the method for displaying strokes using an electronic pen on an electronic device can include obtaining missing stroke data of a missing stroke outside the displayable area in case that the missing stroke is detected to return from outside the displayable area to the displayable area.

[0578] According to an embodiment, the method for displaying strokes using an electronic pen on an electronic device can include obtaining missing stroke data by using data from at least one of an accelerometer and a gyroscope included in the electronic pen until at least one of acceleration and coordinates of the electronic pen does not exceed a corresponding threshold value in case that the missing stroke is detected to have occurred completely outside the displayable area.

[0579] According to an embodiment, the method for displaying strokes using an electronic pen on an electronic device can include obtaining missing stroke data via pen tip position information of the electronic pen, wherein the pen tip position information of the electronic pen is obtained using a position of a beacon included in the electronic device and a position of a beacon included in the electronic pen.

[0580] According to an embodiment, the method for displaying strokes using an electronic pen on an electronic device can include moving the entire set of strokes to a blank space in case that there is a blank space in the displayable area based on at least one of a use direction of the electronic pen, a virtual display area, and a displayable area.

[0581] According to an embodiment, the method for displaying strokes using an electronic pen on an electronic device can include adjusting a size of the entire set of strokes according to a ratio between the virtual display area and the displayable area in case that there is no blank space.

[0582] According to an embodiment, the method for displaying strokes using an electronic pen on an electronic device can include adjusting a layout of the displayable area by comparing a size of a blank space between each stroke with a size of a missing stroke.

[0583] According to an embodiment, the method for displaying strokes using an electronic pen on an electronic device can include obtaining missing stroke data by using at least one of a smart glass, a smart ring, and a smart watch.

[0584] The at least one processor can be configured to execute the at least one instruction to activate a missing stroke detection mode when a stroke using the electronic pen is detected at an edge of a displayable area of a display.

[0585] The at least one processor can be configured to execute the at least one instruction to generate a virtual display area, wherein the virtual display area extends beyond the displayable area in a direction in which the missing stroke is detected.

[0586] The at least one processor can be configured to execute the at least one instruction to obtain the missing stroke data by calculating a pen tip position of the electronic pen on the virtual display area.

[0587] The at least one processor can be configured to execute the at least one instruction to obtain missing stroke data of the missing stroke outside the displayable area in a case where it is detected that the missing stroke returns to the displayable area from outside the displayable area.

[0588] The at least one processor can be configured to execute the at least one instruction to obtain the missing stroke data by using data from at least one of an accelerometer and a gyroscope included in the electronic pen until at least one of acceleration and coordinates of the electronic pen does not exceed a corresponding threshold value in a case where it is detected that the missing stroke has occurred entirely outside the displayable area.

[0589] The at least one processor can be configured to execute the at least one instruction to obtain the missing stroke data via pen tip position information of the electronic pen, wherein the pen tip position information of the electronic pen is obtained using a position of a beacon included in the electronic device and a position of a beacon included in the electronic pen.

[0590] The at least one processor can be configured to execute the at least one instruction to move the entire set of strokes to a blank space in the displayable area based on at least one of a use direction of the electronic pen, the virtual display area, and the displayable area in a case where there is a blank space in the displayable area.

[0591] The at least one processor can be configured to execute the at least one instruction to adjust a size of the entire set of strokes according to a ratio between the virtual display area and the displayable area in a case where there is no blank space.

[0592] The at least one processor can be configured to execute the at least one instruction to adjust a layout of the displayable area by comparing a size of a blank space between each stroke to a size of the missing stroke.

[0593] The method for displaying strokes using an electronic pen on an electronic device according to the embodiments can be implemented in the form of program commands executable by various types of computers and recorded on a computer-readable recording medium. The computer-readable recording medium can include program commands, data files, data structures, etc., individually or in combination. The program commands recorded on the computer-readable recording medium can be designed and configured specifically for the present disclosure, or can be known to and used by those of ordinary skill in the computer software field. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as compact disc read only memories (CD-ROMs) and digital versatile discs (DVDs), magneto-optical media such as floptical disks, and hardware devices specifically configured to store and execute program commands, such as ROMs, random access memories (RAMs), flash memories, etc. Examples of the program commands include not only machine codes created by compilers, but also high-level language codes that can be executed by computers using an interpreter, etc.

[0594] In addition, the method for displaying strokes using an electronic pen on an electronic device according to the disclosed embodiments can be included in a computer program product when provided. The computer program product can be traded between a seller and a buyer as a product.

[0595] The computer program product can include a software program and a computer-readable storage medium storing the software program thereon. For example, the computer program product can include a product (e.g., a downloadable application) in the form of a software program that is electronically distributed by a manufacturer of an electronic device or through an electronic market (e.g., Google Play Store™ and App Store™). For such electronic distribution, at least a portion of the software program can be stored on a storage medium or can be temporarily generated. In this case, the storage medium can be a storage medium of a server of the manufacturer, a server of the electronic market, or a storage medium of a relay server for temporarily storing the software program.

[0596] In a system composed of a server and a client device, the computer program product can include a storage medium of the server or a storage medium of the client device. Alternatively, in the case where a third device (e.g., a smart phone) that is communicably connected to the server or the client device is present, the computer program product can include a storage medium of the third device. Alternatively, the computer program product can include the software program itself transmitted from the server to the client device or the third device, or from the third device to the client device.

[0597] In this case, one of the server, the client device, and the third device can execute a computer program product to perform the method according to the disclosed embodiments. Alternatively, at least two of the server, the client device, and the third device can execute a computer program product to perform the method according to the disclosed embodiments in a distributed manner.

[0598] For example, a server (e.g., a cloud server, an artificial intelligence (AI) server, etc.) can execute a computer program product stored therein to control a client device communicably connected to the server to perform the method according to the disclosed embodiments.

[0599] Although the embodiments have been specifically described above, the embodiments should not be construed as limiting the scope of the present disclosure, and various modifications and improvements made by those of ordinary skill in the art based on the basic idea of the present disclosure also fall within the scope of the present disclosure defined by the appended claims.

Claims

1. A method for displaying strokes made with an electronic pen (120) on an electronic device (110), the method comprising: receiving stroke data (210) related to strokes made with the electronic pen (120); detecting a missing stroke (220), wherein the missing stroke (220) is a stroke made with the electronic pen (120) outside of a displayable area of the electronic device (110); obtaining missing stroke data (230) about the detected missing stroke; adjusting a layout of the displayable area based on the missing stroke data (240); and displaying the missing stroke in the displayable area according to the adjusted layout (250). 2.The method of claim 1, further comprising: activating a missing stroke detection mode in case strokes made with the electronic pen (120) are detected at an edge of the displayable area of the electronic device (110). 3.The method of claim 1 or 2, further comprising: generating a virtual display area, wherein the virtual display area extends beyond the displayable area in a direction in which the missing stroke is detected; and obtaining the missing stroke data by calculating a pen tip position of the electronic pen (120) on the virtual display area.

4. The method of any one of claims 1 to 3, wherein, Obtaining missing stroke data about the detected missing stroke comprises: in case the missing stroke is detected to return to the displayable area from outside of the displayable area, obtaining the missing stroke data of the missing stroke outside of the displayable area.

5. The method of any one of claims 1 to 4, wherein, Obtaining missing stroke data about the detected missing stroke comprises: in case the missing stroke is detected to have occurred completely outside of the displayable area, obtaining the missing stroke data by using data from at least one of an accelerometer (2050) and a gyroscope (2060) included in the electronic pen (120) until at least one of an acceleration and a coordinate of the electronic pen (120) does not exceed a corresponding threshold.

6. The method of any one of claims 1 to 5, wherein, Obtaining missing stroke data about the detected missing stroke comprises: obtaining the missing stroke data via pen tip position information of the electronic pen (120), wherein the pen tip position information of the electronic pen (120) is obtained using a position of a beacon (1410) included in the electronic device (110) and a position of a beacon (1420) included in the electronic pen (120).

7. The method of any one of claims 1 to 6, wherein, Adjusting a layout of the displayable area based on the missing stroke data comprises: in case there is a blank space in the displayable area based on at least one of a use direction of the electronic pen (120), a virtual display area, and the displayable area, moving a whole set of strokes to the blank space.

8. The method of any one of claims 1 to 7, wherein, Adjusting a layout of the displayable area based on the missing stroke data comprises: in case a blank space does not exist, adjusting a size of the whole set of strokes according to a ratio between a virtual display area and the displayable area.

9. The method of any one of claims 1 to 8, wherein, Adjusting a layout of the displayable area based on the missing stroke data comprises: The layout of the displayable area is adjusted by comparing the size of the blank space between each stroke with the size of the missing stroke.

10. The method of any one of claims 1 to 9, wherein, Obtaining missing stroke data about the detected missing stroke includes: The missing stroke data is obtained by using at least one of a smart glasses (1710), a smart ring (1730), and a smart watch (1720). 11.An electronic device (110) for displaying strokes made with an electronic pen (120), the electronic device (110) comprising: a display (1920); a memory (1930) storing at least one instruction; and at least one processor (1910), wherein the at least one processor (1910) is configured to execute the at least one instruction to: receive stroke data related to strokes made with the electronic pen (120), detect a missing stroke, wherein the missing stroke is a stroke made with the electronic pen (120) outside a displayable area of the display (1920), obtain missing stroke data about the detected missing stroke, adjust a layout of the displayable area based on the missing stroke data, and display the missing stroke in the displayable area according to the adjusted layout.

12. The electronic device (110) according to claim 11, wherein The at least one processor (1910) is further configured to execute the at least one instruction to activate a missing stroke detection mode in case a stroke made with the electronic pen (120) is detected at an edge of the displayable area of the electronic device (110).

13. The electronic device (110) according to claim 11 or 12, wherein The at least one processor (1910) is further configured to execute the at least one instruction to: generate a virtual display area, wherein the virtual display area extends beyond the displayable area in a direction in which the missing stroke is detected, and obtain the missing stroke data by calculating a stylus position of the electronic pen (120) on the virtual display area.

14. The electronic device (110) according to any one of claims 11 to 13, wherein The at least one processor (1910) is further configured to execute the at least one instruction to obtain the missing stroke data of the missing stroke outside the displayable area in case the missing stroke is detected to return to the displayable area from outside the displayable area.

15. The electronic device (110) according to any one of claims 11 to 14, wherein The at least one processor (1910) is further configured to execute the at least one instruction to obtain the missing stroke data by using data from at least one of an accelerometer (2050) and a gyroscope (2060) included in the electronic pen (120) in case the missing stroke is detected to have occurred completely outside the displayable area until at least one of an acceleration and a coordinate of the electronic pen (120) does not exceed a corresponding threshold.

16. The electronic device (110) according to any one of claims 11 to 15, wherein The at least one processor (1910) is further configured to execute the at least one instruction to obtain the missing stroke data via a pen tip position information of the electronic pen (120), wherein the pen tip position information of the electronic pen (120) is obtained using a position of a beacon (1410) included in the electronic device (110) and a position of a beacon (1420) included in the electronic pen (120).

17. The electronic device (110) according to any one of claims 11 to 16, wherein The at least one processor (1910) is further configured to execute the at least one instruction to move the entire set of strokes to a blank space in the displayable area based on at least one of a use direction of the electronic pen (120), a virtual display area, and the displayable area, in a case where the blank space exists in the displayable area.

18. The electronic device (110) according to any one of claims 11 to 17, wherein The at least one processor (1910) is further configured to execute the at least one instruction to adjust a size of the entire set of strokes according to a ratio between the virtual display area and the displayable area, in a case where the blank space does not exist.

19. The electronic device (110) according to any one of claims 11 to 18, wherein The at least one processor (1910) is further configured to execute the at least one instruction to adjust a layout of the displayable area by comparing a size of a blank space between each stroke with a size of the missing stroke. 20.A computer readable recording medium having stored thereon a program for executing the method of any one of claims 1 to 10.

Images