Electronic device for adjusting ratio of handwriting input, operating method thereof, and recording medium
The electronic device addresses the challenge of adjusting handwriting input ratios by distinguishing between input types and applying specific adjustments, ensuring accurate and aesthetically pleasing display across mode changes.
Patent Information
- Application Number
- PCT/KR2024/003274
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-13
- Filing Date
- 2024-03-15
- Publication Date
- 2024-11-21
AI Technical Summary
Existing electronic devices face challenges in accurately and aesthetically adjusting the ratio of handwriting inputs when switching between portrait and landscape modes, often resulting in reduced readability and aesthetics due to uniform adjustment of all handwriting inputs.
The electronic device employs a processor to differentiate between first and second types of handwriting inputs, maintaining the ratio of the first type while adjusting the second type based on pre-defined rules, ensuring accurate display and readability even when the screen ratio changes.
This approach ensures that handwriting inputs are displayed with maintained accuracy, readability, and aesthetics, even when the screen ratio changes, by appropriately adjusting the position, arrangement, and size of different handwriting input types.
Smart Images

Figure KR2024003274_21112024_PF_FP_ABST
Abstract
Description
Electronic device for adjusting the rate of handwriting input, method of operation thereof and recording medium
[0001] Embodiments of the present disclosure relate to an electronic device for adjusting the rate of handwriting input, an operating method thereof, and a recording medium.
[0002] User equipment such as smartphones, tablets, and wearable devices may provide various functions such as music playback, navigation, short-range wireless communication (e.g., Bluetooth, Wi-Fi, or near field communication (NFC)), fingerprint recognition, still image capturing or video recording, or electronic payment functions.
[0003] Some user devices can recognize handwriting input using a part of the user's body or an electronic pen. For example, an electronic device may have an input device that detects approach and contact with a part of the user's body or an electronic pen, thereby recognizing handwriting input received through the input device using a part of the user's body or an electronic pen.
[0004] An electronic device can display a screen containing handwriting input through a display. When the electronic device changes from landscape mode to portrait mode, the display can display a screen with a changed aspect ratio.
[0005] An electronic device according to one embodiment may include a display, a processor, and a memory storing instructions.
[0006] In an electronic device according to one embodiment, the instructions, when executed by the processor, may cause the electronic device to display a first screen on the display, the first screen having a width-to-height ratio corresponding to a first ratio.
[0007] In an electronic device according to one embodiment, the first screen may include at least one handwriting input of a first type and at least one handwriting input of a second type.
[0008] In an electronic device according to one embodiment, the instructions, when executed by the processor, may cause the electronic device to confirm a command for changing the width-to-height ratio of the first screen from the first ratio to the second ratio.
[0009] In an electronic device according to one embodiment, the instructions, when executed by the processor, may cause the electronic device to display a second screen in which the horizontal-to-vertical ratio of the first screen is changed to the second ratio, based on the instructions.
[0010] In an electronic device according to one embodiment, a width-to-height ratio of the at least one handwriting input of the first type included in the second screen may be maintained identical to a width-to-height ratio of the at least one handwriting input of the first type included in the first screen.
[0011] In an electronic device according to one embodiment, a horizontal-to-vertical ratio of the at least one handwriting input of the second type included in the second screen can be changed based on the second ratio.
[0012] In a method of operating an electronic device according to one embodiment, the method may include an operation of displaying a first screen having a length-to-width ratio corresponding to a first ratio on a display included in the electronic device.
[0013] In a method of operating an electronic device according to one embodiment, the first screen may include at least one handwriting input of a first type and at least one handwriting input of a second type.
[0014] In a method of operating an electronic device according to one embodiment, the method may include an operation of confirming a command to change the horizontal-to-vertical ratio of the first screen from the first ratio to the second ratio.
[0015] In an operating method of an electronic device according to one embodiment, the method may include an operation of displaying a second screen in which the horizontal-to-vertical ratio of the first screen is changed to the second ratio based on the command.
[0016] In a method of operating an electronic device according to one embodiment, a horizontal-to-vertical ratio of the at least one handwriting input of the first type included in the second screen may be maintained identical to a horizontal-to-vertical ratio of the at least one handwriting input of the first type included in the first screen.
[0017] In a method of operating an electronic device according to one embodiment, a horizontal-to-vertical ratio of the at least one handwriting input of the second type included in the second screen can be changed based on the second ratio.
[0018] In a non-transitory recording medium according to one embodiment, at least one instruction can be stored that can execute an operation of displaying a first screen having a width-to-height ratio corresponding to a first ratio on a display included in the electronic device.
[0019] In a non-transitory recording medium according to one embodiment, the first screen may include at least one handwriting input of a first type and at least one handwriting input of a second type.
[0020] In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of confirming a command to change the horizontal-to-vertical ratio of the first screen from the first ratio to the second ratio can be stored.
[0021] In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of displaying a second screen in which the width-to-height ratio of the first screen is changed to the second ratio can be stored based on the command.
[0022] In a non-transitory recording medium according to one embodiment, a width-to-height ratio of the at least one handwriting input of the first type included in the second screen may be maintained identical to a width-to-height ratio of the at least one handwriting input of the first type included in the first screen.
[0023] In a non-transitory recording medium according to one embodiment, the horizontal-to-vertical ratio of the at least one handwriting input of the second type included in the second screen can be changed based on the second ratio.
[0024] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.
[0025] FIG. 2A is a diagram showing an electronic device according to one embodiment displaying a first screen having a first aspect ratio of width to height that includes a plurality of handwriting inputs.
[0026] FIG. 2b is a drawing showing a conventional electronic device according to a comparative example displaying a second screen including a plurality of handwriting inputs when the horizontal-to-vertical ratio is changed to a second ratio.
[0027] FIG. 2C is a diagram illustrating an electronic device according to one embodiment of the present invention displaying a second screen including a plurality of handwriting inputs when the aspect ratio of the electronic device is changed to a second aspect ratio.
[0028] FIG. 3 is a schematic block diagram of an electronic device according to one embodiment.
[0029] FIG. 4 is a flowchart illustrating an operation of an electronic device according to one embodiment to adjust the ratio of handwriting input displayed on a display.
[0030] FIG. 5 is a flowchart illustrating an operation of an electronic device according to one embodiment to determine whether to group handwriting input.
[0031] FIG. 6 is a flowchart illustrating an operation of an electronic device according to one embodiment of the present invention to determine whether to group at least one handwriting input of a first type and to place the handwriting input.
[0032] FIG. 7A is a flowchart illustrating an operation of an electronic device according to one embodiment to determine whether to group based on whether a first handwriting input of a first type and a second handwriting input are located in the same area among a plurality of divided areas.
[0033] FIG. 7B is a flowchart illustrating an operation of an electronic device according to one embodiment to determine whether to group based on whether a first handwriting input of a first type and a second handwriting input are located on the same line.
[0034] FIG. 8 is a flowchart illustrating an operation of an electronic device according to one embodiment to determine whether to group at least one handwriting input of a first type.
[0035] FIG. 9 is a flowchart illustrating an operation of an electronic device according to one embodiment of the present invention to adjust a horizontal-to-vertical ratio of a first handwriting input and a second handwriting input when at least a portion of a first handwriting input of a first type overlaps with at least a portion of a second handwriting input.
[0036] FIG. 10A is a diagram illustrating an operation of an electronic device according to one embodiment to check a distance between a plurality of strokes included in at least one handwriting input of a first type.
[0037] FIG. 10B is a diagram illustrating an operation of an electronic device according to one embodiment of the present invention to determine a distance between strokes of at least one handwriting input representing a word.
[0038] FIG. 10c is a diagram illustrating an operation of an electronic device according to one embodiment of the present invention to determine whether to group at least one handwriting input based on a distance between multiple strokes.
[0039] FIG. 11A is a diagram showing a first screen displayed on a display when an electronic device according to one embodiment is in portrait mode.
[0040] FIG. 11b is a drawing showing a second screen displayed on a display when a conventional electronic device according to a comparative example is switched from portrait mode to landscape mode.
[0041] FIG. 12A is a diagram for explaining a grouping operation of a plurality of handwriting inputs included in a first screen when an electronic device according to one embodiment is in portrait mode.
[0042] FIG. 12B is a diagram for explaining an operation of adjusting the horizontal-to-vertical ratio of a plurality of handwriting inputs included in a first screen when an electronic device according to one embodiment switches from a vertical mode to a horizontal mode.
[0043] FIGS. 13A and 13B are diagrams for explaining an operation of adjusting the ratio of at least one handwriting input of a second type included in a first screen when an electronic device according to one embodiment is switched from a portrait mode to a landscape mode.
[0044] FIG. 14A is a drawing for explaining an operation of an electronic device according to one embodiment to display a screen related to a calendar through a display.
[0045] FIG. 14b is a drawing for explaining an operation of an electronic device according to one embodiment to display a screen related to a calendar through a display.
[0046] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0047] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0048] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0049] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0050] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0051] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0052] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0053] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0054] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0055] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0056] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0057] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0058] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0059] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0060] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0061] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0062] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0063] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0064] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0065] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0066] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0067] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0068] FIG. 2A is a diagram showing an electronic device according to one embodiment displaying a first screen having a first aspect ratio of width to height that includes a plurality of handwriting inputs.
[0069] Referring to FIG. 2A, according to one embodiment, an electronic device (301) (e.g., the electronic device (301) of FIG. 3) may display a first screen having a first aspect ratio (e.g., a ratio of 18:22) including a plurality of handwriting inputs on a display (360) (e.g., the display (360) of FIG. 3). According to one embodiment, the electronic device (301) may be implemented as a foldable device or a slidable device. However, this is merely an example, and the electronic device (301) may be implemented as various devices. For example, the first aspect ratio may be determined based on the aspect ratio of the display (360). Alternatively, the first aspect ratio may be determined based on a user's setting among aspect ratios supported by the display (360). The first screen may refer to a screen including a handwriting input (e.g., a handwriting input by a user's finger or a stylus pen (302). For example, the first screen may be a screen related to a calendar divided into a plurality of areas. For example, the first screen may refer to a screen in portrait mode of the electronic device (301). The plurality of handwriting inputs may include a plurality of texts (e.g., meeting, heart heart, Seoul meeting, change presentation date, driver's license renewal, attend event), special characters (e.g., heart, star, exclamation mark), objects (e.g., 251) displayed over at least a portion of one area and other areas adjacent to the one area (e.g., arrows), and objects (e.g., 211, 221) surrounding the plurality of texts (e.g., objects surrounding texts of card renewal, event attendance, driver's license renewal).
[0070] According to one embodiment, the electronic device (301) may identify a command to change the width-to-height ratio of the first screen from the first ratio to the second ratio (e.g., 22:18 ratio). For example, the electronic device (301) may identify a command to change from a portrait mode to a landscape mode according to the rotation of the electronic device (301). For example, when the electronic device (301) is implemented as a foldable device, the electronic device (301) may identify a command to fold the display (360). For example, when the electronic device (301) is implemented as a slideable device, the electronic device (301) may identify a command to expand the display (360) according to the slide degree. For example, the electronic device (301) may identify a command to display in a multi-window.
[0071] According to one embodiment, the electronic device (301) may display a second screen with a width-to-height ratio changed to a second ratio (e.g., a 22:18 ratio) based on the command. For example, the second ratio may be determined based on the width-to-height ratio of the display (360) changed according to the rotation of the electronic device (301). Alternatively, the second ratio may be determined based on a user setting among width-to-height ratios supported by the display (360). Hereinafter, a method for displaying a plurality of handwriting inputs included in a first screen on a second screen will be compared between an embodiment of the present invention and a comparative embodiment.
[0072] FIG. 2b is a drawing showing a conventional electronic device according to a comparative example displaying a second screen including a plurality of handwriting inputs when the horizontal-to-vertical ratio is changed to a second ratio.
[0073] Referring to FIG. 2B, the electronic device according to the comparative embodiment can determine the aspect ratio (e.g., the second aspect ratio) of the second screen to be displayed on the display based on a command to change from a portrait mode to a landscape mode according to the rotation of the electronic device. For example, the second aspect ratio can be determined based on the aspect ratio of the display changed according to the rotation of the electronic device. Alternatively, the second aspect ratio can be determined based on a user setting among aspect ratios supported by the display. For example, the electronic device according to the comparative embodiment can display the second screen by adjusting the aspect ratio of elements (e.g., handwriting input, objects, and split areas) included in the first screen. For example, the aspect ratio of the elements included in the second screen can be increased by a specified aspect ratio.
[0074] An electronic device according to a comparative example can check the coordinates of a plurality of handwriting inputs included in a first screen.
[0075] An electronic device according to a comparative example can determine coordinates of a plurality of handwriting inputs to be displayed on a second screen based on coordinates of a plurality of handwriting inputs included in a first screen and a second ratio.
[0076] An electronic device according to a comparative example can display a second screen including a plurality of handwriting inputs on a display. In this case, the plurality of handwriting inputs can be displayed at locations based on determined coordinates, with the width-to-height ratio changed to a second ratio.
[0077] A plurality of handwriting inputs included in the second screen according to the comparative example may be displayed in a shape that is stretched in the horizontal direction.
[0078] For example, an arrow object displayed between an area with the date 11th and an area with the date 13th in portrait mode may be displayed as being located between an area with the date 11th and an area with the date 13th in landscape mode. For example, texts displayed in portrait mode (e.g., Seoul meeting, change of presentation date, etc.) may be displayed in a horizontally stretched shape in landscape mode. According to a comparative embodiment, a plurality of handwriting inputs displayed on a second screen may have their proportions and sizes automatically adjusted without considering the accuracy or readability of the text. Accordingly, a plurality of handwriting inputs included in the second screen may be displayed in a state where accuracy, readability, and aesthetics are degraded.
[0079] FIG. 2C is a diagram illustrating an electronic device according to one embodiment, which displays a second screen including a plurality of handwriting inputs when the horizontal-to-vertical ratio of the electronic device is changed to a second ratio.
[0080] Referring to FIG. 2C, according to an embodiment, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may display a second screen by adjusting the ratio of elements (e.g., handwriting input, objects, and split regions) included in the first screen. For example, the electronic device (301) may display the second screen by adjusting the ratio of elements (e.g., handwriting input, objects, and split regions) included in the first screen. At this time, the electronic device (301) may maintain the ratio of specific elements (e.g., specific types of handwriting inputs among handwriting inputs) among the elements included in the first screen. Alternatively, the electronic device (301) may adjust the horizontal length (and vertical length) of specific elements (e.g., specific types of handwriting inputs among handwriting inputs) among the elements included in the first screen based on a separately specified ratio.
[0081] According to one embodiment, the first screen may include a plurality of handwriting inputs. For example, the plurality of handwriting inputs may include a first type of handwriting input and a second type of handwriting input. For example, the first type of handwriting input may include texts and special characters (e.g., hearts, stars, exclamation marks), and the second type of handwriting input may include objects (e.g., 211, 221) surrounding the plurality of texts and objects (e.g., 251) (e.g., arrows) displayed over at least a portion of one area and another area adjacent to the one area. Depending on the implementation, the electronic device (301) may determine the plurality of texts (e.g., 231, 241) as the second type of handwriting input when the plurality of texts (e.g., 231, 241) are inseparable from the objects (e.g., 211, 221) surrounding the plurality of texts (e.g., 231, 241). For example, if a handwriting input corresponding to objects surrounding a plurality of texts overlaps with a handwriting input corresponding to the plurality of texts surrounded by the objects, the electronic device (301) may determine that the plurality of texts are inseparable from the objects surrounding the plurality of texts. For example, the electronic device (301) may determine that the plurality of texts (e.g., 231, 241) are separable from the objects (e.g., 211, 221) surrounding the plurality of texts (e.g., 231, 241) when it is determined that the handwriting input corresponding to the plurality of texts (e.g., 231, 241) does not overlap with the objects (e.g., 211, 221) surrounding the plurality of texts (e.g., 231, 241). The electronic device (301) may determine the plurality of texts (e.g., 231, 241) as a first type of handwriting input. However, this is an example, and the first type of handwriting input and the second type of handwriting input of the embodiments of the present invention are not limited to the above example.
[0082] According to one embodiment, the electronic device (301) can determine whether a plurality of handwriting inputs included in the first screen are a first type of handwriting input or a second type of handwriting input. For example, the electronic device (301) can determine whether a plurality of handwriting inputs included in the first screen are a first type of handwriting input or a second type of handwriting input using a pre-learned artificial intelligence (AI) model.
[0083] According to one embodiment, the electronic device (301) may determine whether to group the plurality of handwriting inputs of the first type by considering the distance between the plurality of strokes included in the plurality of handwriting inputs of the first type, whether the plurality of handwriting inputs of the first type are located in the same area among the plurality of divided areas, and / or whether the plurality of handwriting inputs of the first type are located on the same line. For example, the electronic device (301) may classify (or designate) the plurality of handwriting inputs of the first type into groups. The electronic device (301) may determine the arrangement (or position) of the handwriting inputs or adjust the size (or ratio) of the handwriting inputs according to the classified groups.
[0084] According to one embodiment, the electronic device (301) may determine the position, arrangement, or size of a plurality of handwriting inputs of the first type to be displayed on the second screen for each determined group. According to one embodiment, the electronic device (301) may identify an area corresponding to the determined group. The area corresponding to the determined group may refer to an area formed by a plurality of handwriting inputs included in the group. For example, the area corresponding to the determined group may refer to an area formed by a plurality of strokes included in the group. For example, when the electronic device (301) is rotated from portrait mode to landscape mode, the electronic device (301) may adjust the position, arrangement, or size of the area corresponding to each of the determined groups. Based on the adjustment of the position, arrangement, or size of the area corresponding to each of the determined groups, the position, arrangement, or size of the plurality of handwriting inputs included in the area may be adjusted to be identical to each other. In this case, the electronic device (301) may display the second screen by maintaining the width-to-height ratio of each of the plurality of handwriting inputs to be identical to the ratio of each of the plurality of handwriting inputs displayed on the first screen. For example, the electronic device (301) can maintain the width-to-height ratio of each of the first type of texts (232, 242, 263) included in the second screen to be the same as the width-to-height ratio of each of the first type of texts (231, 241, 260) included in the first screen.
[0085] According to one embodiment, the second screen may include objects (e.g., 252) (e.g., arrows) displayed over at least a portion of other areas adjacent to the one area and any one area of the second type having a changed width-to-height ratio based on the second ratio.
[0086] According to one embodiment, the electronic device (301) can check the coordinates of the center points of the areas (271, 281, 261) corresponding to each of the groups of the plurality of handwriting inputs (231, 241, 260) of the first type on the first screen. According to one embodiment, the electronic device (301) can determine, based on the coordinates, the coordinates of the center points of the areas (272, 282, 262) corresponding to each of the groups of the plurality of handwriting inputs (232, 242, 263) of the first type on the second screen. According to one embodiment, the electronic device (301) can adjust the positions or arrangements of the plurality of handwriting inputs of the first type to be displayed on the second screen based on the determined coordinates. For example, the electronic device (301) can determine that the coordinates in the x-axis direction (e.g., horizontal direction) of the center point of the area (261) corresponding to the first type of handwriting input (e.g., heart heart) (260) included in the first screen are 100, and the coordinates in the y-axis direction (e.g., vertical direction) are 250. For example, the electronic device (301) can determine that the coordinates in the x-axis direction (e.g., horizontal direction) of the center point of the area (262) corresponding to the first type of handwriting input (e.g., heart heart) (263) to be displayed on the second screen are 122, and the coordinates in the y-axis direction (e.g., vertical direction) are 204, and can adjust the position or arrangement of the area (262) corresponding to the first type of handwriting input based on the determined coordinates.
[0087] According to one embodiment, the electronic device (301) may determine the positions of the plurality of second type handwriting inputs on the second screen based on the positions of the plurality of second type handwriting inputs included in the first screen and the second ratio. According to one embodiment, the electronic device (301) may display the second screen in which the plurality of second type handwriting inputs, whose width-to-height ratio is changed based on the second ratio, are arranged at the determined positions.
[0088] Through this, the electronic device (301) may not uniformly adjust the size or ratio of the first type of handwriting input (e.g., text) among the plurality of handwriting inputs displayed on the second screen. Accordingly, the plurality of handwriting inputs included in the second screen may be displayed while maintaining accuracy, readability, and aesthetics even when the screen ratio is changed. In addition, the plurality of handwriting inputs displayed on the second screen may be displayed according to the user's intention even when the screen ratio is changed.
[0089] FIG. 3 is a schematic block diagram of an electronic device according to one embodiment.
[0090] Referring to FIG. 3, according to one embodiment, an electronic device (301) may include a processor (320), a memory (330), a display (360), and a communication module (390). The electronic device (301) may be implemented in the same or similar manner as the electronic device (101) of FIG. 1.
[0091] According to one embodiment, the processor (320) may display a first screen having a width-to-height ratio corresponding to a first ratio on the display (360) (e.g., the display module (160) of FIG. 1). For example, the display (360) may be implemented as a touchscreen. The first screen may refer to a screen including a handwriting input (e.g., a handwriting input by a user's finger or a stylus pen). For example, the first screen may include a screen divided into a plurality of regions. For example, the first screen may include a screen related to a calendar including a date. In this case, the processor (320) may identify regions on the screen related to the calendar where a plurality of dates are displayed as a plurality of regions.
[0092] According to one embodiment, the first screen may include at least one handwritten input of a first type and at least one handwritten input of a second type. According to one embodiment, the at least one handwritten input of the first type may include text. The text may include Korean, English, and numbers. Depending on the implementation, the at least one handwritten input of the first type may also include non-text handwritten inputs. For example, the at least one handwritten input of the first type may further include a handwritten input indicating an object displayed over a date on a calendar. For example, the object displayed over a date on the calendar may include various shapes such as a circle, a triangle, a square, or a check mark. For example, depending on the implementation, the at least one handwritten input of the first type may further include a handwritten input indicating a special character. For example, the handwritten input indicating a special character may include various shapes such as a heart, a star, a diamond, an exclamation point, or a question mark.
[0093] According to one embodiment, at least one handwriting input of the second type may include a handwriting input representing objects other than text that are not included in the first type (e.g., shapes, line segments). Furthermore, at least one handwriting input of the second type may include a handwriting input representing an object displayed on at least a portion of a first region included in the plurality of regions and at least a portion of a second region adjacent to the first region. For example, the object displayed on at least a portion of the first region and at least a portion of the second region adjacent to the first region may include a handwriting input representing an arrow shape. Depending on the implementation, the processor (320) may determine whether the text is separable from the non-text object when the non-text object surrounds the text. The processor (320) may determine that the text is separable from the non-text object when the text and the non-text object do not overlap. When an object other than text surrounds a text, if it is determined that the text surrounded by the object is inseparable from the object, the processor (320) may determine the text surrounded by the object and the object as a second type of handwriting input. If it is determined that the text surrounded by the object is inseparable from the object, the processor (320) may determine the text surrounded by the object as a first type of handwriting input, and the object as a second type of handwriting input.
[0094] According to one embodiment, the processor (320) may check a command to change the width-to-height ratio of the first screen from the first ratio to the second ratio. According to one embodiment, the processor (320) may display the second screen, in which the width-to-height ratio has been changed to the second ratio, on the display (360) based on the command. For example, the processor (320) may check the command when the electronic device (301) is rotated such that the screen is changed from landscape mode to portrait mode or from portrait mode to landscape mode. Alternatively, the processor (320) may check the command when displaying the corresponding screen when receiving information about a screen including a handwriting input from an external electronic device through the communication module (390). For example, when the width-to-height ratio of the display of the external electronic device is different from that of the display (360) of the electronic device (301), the processor (320) may check a command to change the width-to-height ratio of the corresponding screen to match the display (360).
[0095] According to one embodiment, the processor (320) may determine, based on the command, whether a plurality of handwriting inputs included in the first screen are first type handwriting inputs or second type handwriting inputs. For example, the processor (320) may determine, using a pre-learned artificial intelligence (AI) model, whether at least one handwriting input included in the first screen corresponds to the first type or the second type. For example, the pre-learned AI model may be stored in the memory (330). Alternatively, the processor (320) may access a server through the communication module (390) and determine, using the AI model stored in the server, whether at least one handwriting input included in the first screen corresponds to the first type or the second type.
[0096] According to one embodiment, when the processor (320) determines that the at least one handwriting input of the first type is present, the processor (320) may check the distance between a plurality of strokes (or a plurality of strokes) included in the at least one handwriting input of the first type. A stroke may mean a continuous stroke from a point at which an input (e.g., a touch input) is started to a point at which the input (e.g., a touch input) is released. According to one embodiment, each of the strokes may include information about the time, order, and / or coordinates of the input. According to one embodiment, the processor (320) may check the distance between the starting points of the plurality of strokes. According to one embodiment, the processor (320) may check the distance between a first stroke input to the display (360) at the nth time and a second stroke input to the display (360) at the n+1th time. Here, n may mean a natural number. However, this is an example, and various embodiments of the present invention may check the distance in various ways.
[0097] According to one embodiment, the at least one handwriting input of the first type may include a first handwriting input and a second handwriting input. For example, the first handwriting input and the second handwriting input may refer to handwriting inputs distinguished by word units (or syllable units). For example, the first handwriting input may refer to a handwriting input inputted on the display (360) at the nth time, and the second handwriting input may refer to a handwriting input inputted on the display (360) at the n+1th time (where n is a natural number). For example, the processor (320) may use an AI model to distinguish or identify handwriting inputs by word units (or syllable units). For example, the processor (320) may distinguish or identify handwriting inputs by word units based on spacing (or spacing spaces).
[0098] According to one embodiment, the processor (320) may determine a first distance between the last stroke of the first handwriting input and the first stroke of the second handwriting input. In addition, the processor (320) may determine whether the first handwriting input and the second handwriting input are included in the same line or the same area based on the first distance between the last stroke of the first handwriting input and the first stroke of the second handwriting input. For example, the processor (320) may determine a first distance between a starting point of the last stroke of the first handwriting input and a starting point of the first stroke of the second handwriting input. For example, the processor (320) may determine a first distance between an ending point of the last stroke of the first handwriting input and a starting point of the first stroke of the second handwriting input. However, this is an example, and embodiments of the present invention may determine the first distance in various ways.
[0099] According to one embodiment, the processor (320) may compare a first distance between the first handwriting input and the second handwriting input with a specified distance. For example, the specified distance may refer to a distance for determining whether to group the handwriting inputs. The specified distance may be set by the processor (320) or may be set by the user. Depending on the implementation, according to one embodiment, the processor (320) may use an AI model to distinguish or identify handwriting inputs on a word-by-word (or syllable-by-syllable) basis. For example, the processor (320) may use a spacing (or spacing space) to distinguish or identify handwriting inputs on a word-by-word basis. For example, the processor (320) may use an AI model to identify handwriting inputs within the same sentence. The processor (320) may use an AI model to identify handwriting inputs at the sentence-by-sentence level. According to one embodiment, if the first handwriting input and the second handwriting input are identified as handwriting inputs within the same word, the processor (320) may determine the first handwriting input and the second handwriting input to be in the same group. According to one embodiment, the processor (320) may determine the first handwriting input and the second handwriting input to be in the same group if the first handwriting input and the second handwriting input are confirmed to be handwriting inputs within the same sentence.
[0100] According to one embodiment, the processor (320) may determine whether to group at least one handwriting input based on the comparison result. For example, if the first distance is determined to be greater than a specified distance, the processor (320) may determine the first handwriting input to be a first group and the second handwriting input to be a second group different from the first group. If the first distance is determined to be not greater than the specified distance, the processor (320) may determine the first and second handwriting inputs to be the same group.
[0101] According to one embodiment, if the first handwriting input and the second handwriting input are determined to belong to the same group, the processor (320) may adjust the arrangement, position, size, and / or ratio of the first handwriting input and the second handwriting input to be the same. Alternatively, if the first handwriting input and the second handwriting input are determined to belong to different groups, the processor (320) may adjust the arrangement, position, size, and / or ratio of the first handwriting input and the second handwriting input to be different.
[0102] According to one embodiment, the processor (320) may adjust the first distance by considering whether the first handwriting input and the second handwriting input are located within the same area among the plurality of areas included in the first screen or on the same line. According to one embodiment, the processor (320) may compare the adjusted distance with a specified distance to determine whether the first handwriting input and the second handwriting input are grouped. Furthermore, according to one embodiment, the processor (320) may adjust the first distance by considering whether the first handwriting input and the second handwriting input are located within the same area among the plurality of areas included in the first screen or on the same line only when the first distance exceeds the specified distance.
[0103] According to one embodiment, the processor (320) may determine whether the first handwriting input and the second handwriting input are located within the same region among a plurality of regions included in the first screen. According to one embodiment, if the processor (320) determines that the first handwriting input and the second handwriting input are located within the same region, the processor (320) may adjust the first distance to be shorter according to a specified first rule. For example, the specified first rule may mean dividing the first distance by a specified value greater than 1. For example, the specified first rule may mean subtracting a specified value from the first distance. However, this is an example, and embodiments of the present invention may adjust the first distance to be shorter according to various rules.
[0104] According to one embodiment, if the processor (320) determines that the first handwriting input and the second handwriting input are not located within the same area, the processor (320) may adjust the first distance to be longer according to a specified second rule. For example, the specified second rule may mean multiplying the first distance by a specified value greater than 1. For example, the specified second rule may mean adding a specified value to the first distance. However, this is merely an example, and embodiments of the present invention may adjust the first distance to be longer according to various rules.
[0105] According to one embodiment, the processor (320) can determine whether the first handwriting input and the second handwriting input are located on the same line. According to one embodiment, if the processor (320) determines that the first handwriting input and the second handwriting input are located on the same line, the processor (320) can adjust the first distance to be shorter according to a designated third rule. For example, the designated third rule may mean dividing the first distance by a designated value greater than 1. For example, the designated third rule may mean subtracting a designated value from the first distance. However, this is merely an example, and embodiments of the present invention can adjust the first distance to be shorter according to various rules.
[0106] According to one embodiment, if it is determined that the first handwriting input and the second handwriting input are not located on the same line, the processor (320) may adjust the first distance to be longer according to a specified fourth rule. For example, the specified fourth rule may mean multiplying the first distance by a specified value greater than 1. For example, the specified fourth rule may mean adding a specified value to the first distance. However, this is an example, and embodiments of the present invention may adjust the first distance to be longer according to various rules. Alternatively, according to one embodiment, if it is determined that the first handwriting input and the second handwriting input are not located on the same line, the processor (320) may also check whether the first handwriting input and the second handwriting input are located within the same area among a plurality of areas included in the first screen.
[0107] According to one embodiment, the processor (320) may compare the distance adjusted by the above rules with the specified distance to determine the groups of the first handwriting input and the second handwriting input. According to one embodiment, if the adjusted distance is determined to be greater than the specified distance, the processor (320) may determine the groups of the first handwriting input and the second handwriting input to be different groups. According to one embodiment, if the adjusted distance is determined to be not greater than the specified distance, the processor (320) may determine the groups of the first handwriting input and the second handwriting input to be the same group.
[0108] According to one embodiment, the specified values of the first rule, the second rule, the third rule and the fourth rule may be the same, all different, or some may be set to be the same.
[0109] According to one embodiment, the processor (320) may determine the arrangement, position, and size of at least one handwriting input to be displayed on the second screen for each determined group. For example, when the electronic device (301) switches from portrait mode to landscape mode or from landscape mode to portrait mode, the processor (320) may adjust the position, arrangement, and size, etc., of each area corresponding to each determined group. The area corresponding to the determined group may refer to an area formed by at least one handwriting input included in the group. For example, the area corresponding to the determined group may refer to an area formed by a plurality of strokes included in the determined group. Based on the adjustment of the position, arrangement, or size of the area corresponding to each determined group, the position, arrangement, or size of at least one handwriting input included in the area corresponding to each determined group may be adjusted to be identical to each other. For example, the processor (320) may check the coordinates of the center point of the area corresponding to the first type of handwriting input on the first screen. The processor (320) may determine the coordinates of the center point of the area corresponding to the first type of handwriting input on the second screen based on the coordinates of the center point of the area corresponding to the first type of handwriting input on the first screen. The processor (320) may display the first type of handwriting input on the second screen based on the coordinates of the center point of the first type of handwriting input on the second screen.
[0110] According to one embodiment, the processor (320) can determine whether at least a portion of the first handwriting input overlaps at least a portion of the second handwriting input when the width-to-height ratio of the first handwriting input of the first group to be displayed on the second screen and the width-to-height ratio of the second handwriting input of the second group are maintained to be the same as the width-to-height ratio of the first handwriting input of the first screen and the width-to-height ratio of the second handwriting input of the first screen.
[0111] According to one embodiment, the processor (320) may determine that at least a portion of the first handwriting input overlaps with at least a portion of the second handwriting input when the area corresponding to the first group and the area corresponding to the second group overlap at least partially. For example, the area corresponding to the first group may refer to an area formed by handwriting inputs included in the first group, and the area corresponding to the second group may refer to an area formed by handwriting inputs included in the second group.
[0112] According to one embodiment, if it is determined that at least a portion of the first handwriting input overlaps with at least a portion of the second handwriting input, the processor (320) may change the horizontal-to-vertical ratio of the first handwriting input and the second handwriting input to be displayed on the second screen based on the second ratio. According to one embodiment, if it is determined that at least a portion of the first handwriting input and at least a portion of the second handwriting input do not overlap, the processor (320) may maintain the horizontal-to-vertical ratio of the first handwriting input and the second handwriting input to be displayed on the second screen to be the same as the horizontal-to-vertical ratio of the first handwriting input and the second handwriting input displayed on the first screen.
[0113] The operations of the electronic device (301) described in the drawings below may be performed by the processor (320). However, for convenience of explanation, the operations performed by the processor (320) will be described as being performed by the electronic device (301).
[0114] FIG. 4 is a flowchart illustrating an operation of an electronic device according to one embodiment to adjust the ratio of handwriting input displayed on a display.
[0115] Referring to FIG. 4, according to one embodiment, in operation 411, an electronic device (301) (e.g., the electronic device (301) of FIG. 3) may display a first screen including at least one handwriting input of a first type and at least one handwriting input of a second type on a display (360) (e.g., the display (360) of FIG. 3). The first screen may refer to a screen including a handwriting input (e.g., a handwriting input by a user's finger or a stylus pen). For example, the first screen may include a screen divided into a plurality of regions. The first screen may include a screen related to a calendar including a date.
[0116] According to one embodiment, in operation 413, the electronic device (301) may confirm a command to change the horizontal-to-vertical ratio of the first screen from the first ratio to the second ratio. For example, the electronic device (301) may confirm the command when the electronic device (301) changes from a horizontal mode to a vertical mode or from a vertical mode to a horizontal mode depending on the rotation of the electronic device (301). Alternatively, the electronic device (301) may confirm the command when displaying the corresponding screen when receiving information about a screen including a handwriting input from an external electronic device through the communication module (390) (e.g., the communication module (390) of FIG. 3 ). For example, when the horizontal-to-vertical ratio of the display of the external electronic device is different from that of the display (360) of the electronic device (301), the electronic device (301) may confirm a command to change the horizontal-to-vertical ratio of the corresponding screen to match the display (360).
[0117] According to one embodiment, in operation 415, the electronic device (301) may display a second screen including at least one handwriting input of a first type in which the horizontal-to-vertical ratio is maintained and at least one handwriting input of a second type in which the horizontal-to-vertical ratio is changed to a second ratio, based on the command.
[0118] According to one embodiment, at least one handwritten input of the first type may include text. Depending on the implementation, the at least one handwritten input of the first type may also include non-text handwritten inputs. For example, the at least one handwritten input of the first type may further include a handwritten input representing an object displayed over a date on a calendar. For example, the object displayed over a date on the calendar may include a heart shape, a star shape, a circle shape, a triangle shape, a square shape, or a check shape. Depending on the implementation, the at least one handwritten input of the first type may also include a special character. For example, the special character may include a heart shape, a star shape, or an exclamation mark written around text. However, this is only an example, and various shapes and handwritten inputs may be included.
[0119] According to one embodiment, at least one handwriting input of the second type may include a handwriting input representing objects other than text (e.g., shapes, line segments) that are not included in the first type. Furthermore, at least one handwriting input of the second type may include a handwriting input surrounding text (e.g., shapes). Furthermore, at least one handwriting input of the second type may include a handwriting input representing an object displayed on at least a portion of a first region included in the plurality of regions and at least a portion of a second region adjacent to the first region. For example, the object displayed on at least a portion of the first region and at least a portion of the second region adjacent to the first region may include a handwriting input representing an arrow shape. According to an implementation, when an object other than text surrounds a text, and the text surrounded by the object is determined to be inseparable from the object, the electronic device (301) may determine the text surrounded by the object and the object as the second type of handwriting input. If the electronic device (301) determines that the text surrounding the object is separable from the object, the electronic device may determine the text surrounding the object as a first type of handwriting input and the object as a second type of handwriting input.
[0120] FIG. 5 is a flowchart illustrating an operation of an electronic device according to one embodiment to determine whether to group at least one handwriting input.
[0121] According to one embodiment, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may display a first screen including at least one handwriting input of a first type and at least one handwriting input of a second type on a display (360) (e.g., the display (360) of FIG. 3) at a first ratio. According to one embodiment, the electronic device (301) may confirm a command to change the horizontal-to-vertical ratio of the first screen to a second ratio.
[0122] According to one embodiment, the electronic device (301) can use a learned artificial intelligence (AI) model to determine whether at least one handwriting input corresponds to the first type or the second type.
[0123] Referring to FIG. 5, according to one embodiment, in operation 511, the electronic device (301) may, based on the command, check the distance between a plurality of strokes (or, a plurality of strokes) included in the at least one handwriting input of the first type. A stroke may mean a continuous stroke from a point at which an input (e.g., a touch input) is started to a point at which the input (e.g., a touch input) is released. For example, the electronic device (301) may check the distance between a stroke input to the display (360) at the nth time and a stroke input to the display (360) at the n+1th time. n represents a natural number. For example, the electronic device (301) may check the first distance between a starting point of a first stroke (e.g., a stroke input to the display (360) at the first time) and a starting point of a second stroke (e.g., a stroke input to the display (360) at the second time). For example, the electronic device (301) may also check the first distance between an ending point of the first stroke and a starting point of the second stroke. However, this is an example, and various embodiments of the present invention can determine the distance in various ways.
[0124] According to one embodiment, in operation 513, the electronic device (301) may compare the distance between multiple strokes included in at least one handwriting input with a specified distance. For example, the specified distance may refer to a distance for determining whether at least one handwriting input is grouped. The specified distance may be set by the processor (320) or by the user.
[0125] According to one embodiment, in operation 515, the electronic device (301) may determine whether to group at least one handwriting input based on the comparison result. According to one embodiment, if the distance is greater than a specified distance, the electronic device (301) may determine them as different groups. According to one embodiment, if the distance is less than the specified distance, the electronic device (301) may determine them as the same group. According to one embodiment, the electronic device (301) may determine the arrangement or position of at least one handwriting input for each group.
[0126] According to one embodiment, the electronic device (301) may display a second screen including at least one handwriting input of the first type based on the determined arrangement or position. At this time, the horizontal-to-vertical ratio of the at least one handwriting input of the first type included in the second screen may be maintained identical to the horizontal-to-vertical ratio of the first handwriting input included in the first screen.
[0127] For example, the electronic device (301) can identify an area corresponding to a first group and an area corresponding to a second group. The area corresponding to the first group may refer to an area formed by at least one handwriting input included in the first group, and the area corresponding to the second group may refer to an area formed by at least one handwriting input included in the second group. For example, when the electronic device (301) switches from portrait mode to landscape mode or landscape mode to portrait mode depending on the rotation of the electronic device (301), the electronic device (301) may adjust the position, arrangement, or size of the area corresponding to the first group, and may adjust the position, arrangement, or size of the area corresponding to the second group. Based on the adjustment of the position, arrangement, or size of the area corresponding to the first group, the position, arrangement, or size of at least one handwriting input included in the area corresponding to the first group may be adjusted to be identical to each other. Based on the adjustment of the position, arrangement, or size of the area corresponding to the second group, the position, arrangement, or size of at least one handwriting input included in the area corresponding to the second group may be adjusted to be identical to each other.
[0128] Through this, the electronic device (301) according to one embodiment can improve the readability of the first type of handwriting input by maintaining the same horizontal-to-vertical ratio of the first type of handwriting input even when the screen displayed on the display (360) is switched from landscape mode to portrait mode or from portrait mode to landscape mode.
[0129] An electronic device (301) according to one embodiment can accurately display a first type of handwriting input by adjusting the position or arrangement of the first type of handwriting input by group.
[0130] FIG. 6 is a flowchart illustrating an operation of an electronic device according to one embodiment of the present invention to determine whether to group at least one handwriting input of a first type and to place the handwriting input.
[0131] Referring to FIG. 6, according to one embodiment, in operation 611, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may check a first distance between the last stroke of the first word indicated by the first handwriting input included in the first screen and the first stroke of the second word indicated by the second handwriting input. According to one embodiment, the electronic device (301) may check the first distance between the starting point of the last stroke of the first word and the starting point of the first stroke of the second word. The first handwriting input may refer to a handwriting input inputted to the display (360) (e.g., the display (360) of FIG. 3) at the nth time, and the second handwriting input may refer to a handwriting input inputted to the display (360) at the n+1th time. n may refer to a natural number. For example, the electronic device (301) may distinguish or identify handwriting inputs in units of words based on an AI model. For example, the electronic device (301) can distinguish or identify handwriting inputs in word units based on spacing (or spacing spaces). However, this is merely an example, and various embodiments of the present invention can determine the first distance in various ways.
[0132] According to one embodiment, in operation 613, the electronic device (301) may compare the first distance and the specified distance.
[0133] According to one embodiment, if the electronic device (301) determines that the first distance is greater than the specified distance (operation 613 - Yes), in operation 615, the electronic device may determine the first handwriting input as a first group and the second handwriting input as a second group different from the first group.
[0134] According to one embodiment, in operation 617, the electronic device (301) may arrange the first handwriting input according to the first group and arrange the second handwriting input according to the second group while maintaining the width-to-height ratio of the handwriting input. For example, the electronic device (301) may determine the arrangement or position to be displayed on the second screen. For example, the electronic device (301) may check the area corresponding to the first group and the area corresponding to the second group. The area corresponding to the first group may refer to the area formed by the first handwriting input, and the area corresponding to the second group may refer to the area formed by the second handwriting input. For example, when the electronic device (301) is rotated to switch from portrait mode to landscape mode or from landscape mode to portrait mode, the electronic device (301) may adjust the position, arrangement, or size of the area corresponding to the first group and adjust the position, arrangement, or size of the area corresponding to the second group.
[0135] According to one embodiment, if the electronic device (301) determines that the first distance is not greater than the specified distance (operation 613-No), then in operation 619, the electronic device may determine the first handwriting input and the second handwriting input as a third group.
[0136] According to one embodiment, in operation 621, the electronic device (301) may arrange the first handwriting input and the second handwriting input according to the third group. For example, the electronic device (301) may identify an area corresponding to the third group. The area may refer to an area formed by the first handwriting input and the second handwriting input. For example, when the electronic device (301) is rotated to switch from portrait mode to landscape mode or from landscape mode to portrait mode, the electronic device (301) may adjust the position, arrangement, or size of each area corresponding to the third group.
[0137] According to one embodiment, the electronic device (301) may display a second screen including a first handwriting input and a second handwriting input on the display (360) based on the determined arrangement or position. At this time, the width-to-height ratio of the first handwriting input included in the second screen may be maintained the same as the width-to-height ratio of the first handwriting input included in the first screen, and the width-to-height ratio of the second handwriting input included in the second screen may be maintained the same as the width-to-height ratio of the second handwriting input included in the first screen.
[0138] FIG. 7A is a flowchart illustrating an operation of an electronic device according to one embodiment to determine whether to group based on whether a first handwriting input of a first type and a second handwriting input are located in the same area among a plurality of divided areas.
[0139] Referring to FIG. 7A, according to one embodiment, in operation 711, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may determine a first distance between the last stroke of the first type of first handwriting input included in the first screen and the first stroke of the second type of first handwriting input.
[0140] According to one embodiment, in operation 713, the electronic device (301) may determine whether the first handwriting input and the second handwriting input are located within the same region among a plurality of regions included in the first screen. According to one embodiment, the first screen may include a screen divided into a plurality of regions. Alternatively, according to one embodiment, the electronic device (301) may determine whether the first handwriting input and the second handwriting input are located within the same region among a plurality of regions included in the first screen only when the first distance is greater than a specified distance. At this time, according to one embodiment, the electronic device (301) may determine the first handwriting input and the second handwriting input to be the same group when the first distance is less than the specified distance.
[0141] According to one embodiment, if the electronic device (301) determines that the first handwriting input and the second handwriting input are located within the same area (operation 713 - Yes), in operation 715, the first distance may be shortened according to a specified first rule. For example, the specified first rule may mean dividing the first distance by a specified value. For example, the specified first rule may mean subtracting a specified value from the first distance. However, this is an example, and embodiments of the present invention may shorten the first distance according to various rules.
[0142] According to one embodiment, in operation 717, the electronic device (301) may determine a group of the first handwriting input and the second handwriting input based on a second distance that is adjusted to be shorter than the first distance. According to one embodiment, the electronic device (301) may determine a group of the first handwriting input and the second handwriting input based on comparing the second distance with a specified distance. If the second distance is greater than the specified distance, the electronic device (301) may determine the first handwriting input and the second handwriting input to be different groups. If the second distance is not greater than the specified distance, the electronic device (301) may determine the first handwriting input and the second handwriting input to be the same group.
[0143] According to one embodiment, if the electronic device (301) determines that the first handwriting input and the second handwriting input are not located within the same area (operation 713-No), in operation 719, the electronic device may adjust the first distance to be longer according to a specified second rule. For example, the specified second rule may mean multiplying the first distance by a specified value greater than 1. For example, the specified second rule may mean adding a specified value to the first distance. However, this is an example, and embodiments of the present invention may adjust the first distance to be longer according to various rules.
[0144] According to one embodiment, the electronic device (301) may determine a group of the first handwriting input and the second handwriting input based on a third distance in which the first distance is adjusted to be longer in operation 721. According to one embodiment, the electronic device (301) may determine a group of the first handwriting input and the second handwriting input based on comparing the third distance with a specified distance. If the third distance is greater than the specified distance, the electronic device (301) may determine the first handwriting input and the second handwriting input to be different groups. If the third distance is not greater than the specified distance, the electronic device (301) may determine the first handwriting input and the second handwriting input to be the same group.
[0145] According to one embodiment, the specified values of the first rule and the second rule may be set to different values or may be set to the same value.
[0146] Through this, the electronic device (301) according to one embodiment can group multiple handwriting inputs located in the same area into the same group, thereby increasing the readability of the multiple handwriting inputs.
[0147] FIG. 7B is a flowchart illustrating an operation of an electronic device according to one embodiment to determine whether to group based on whether a first handwriting input of a first type and a second handwriting input are located on the same line.
[0148] Referring to FIG. 7B, according to one embodiment, in operation 731, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may determine a first distance between the last stroke of the first type of first handwriting input included in the first screen and the first stroke of the second type of first handwriting input.
[0149] According to one embodiment, in operation 733, the electronic device (301) may determine whether the first handwriting input and the second handwriting input are located on the same line. Alternatively, according to one embodiment, the electronic device (301) may determine whether the first handwriting input and the second handwriting input are located on the same line only when the first distance is greater than a specified distance. At this time, according to one embodiment, the electronic device (301) may determine the first handwriting input and the second handwriting input to be the same group when the first distance is less than the specified distance.
[0150] According to one embodiment, if the electronic device (301) determines that the first handwriting input and the second handwriting input are located on the same line (operation 733 - Yes), in operation 735, the first distance may be shortened according to a designated third rule. For example, the designated third rule may mean dividing the first distance by a designated value greater than 1. For example, the designated third rule may mean subtracting a designated value from the first distance. However, this is an example, and embodiments of the present invention may shorten the first distance according to various rules.
[0151] According to one embodiment, in operation 737, the electronic device (301) may determine a group of the first handwriting input and the second handwriting input based on the shortened fourth distance. According to one embodiment, the electronic device (301) may determine a group of the first handwriting input and the second handwriting input based on comparing the fourth distance with a specified distance. If the fourth distance is greater than the specified distance, the electronic device (301) may determine the first handwriting input and the second handwriting input to be different groups. If the fourth distance is not greater than the specified distance, the electronic device (301) may determine the first handwriting input and the second handwriting input to be the same group.
[0152] According to one embodiment, if the electronic device (301) determines that the first handwriting input and the second handwriting input are not located on the same line (operation 733-No), then in operation 739, the electronic device may adjust the first distance to be longer according to the specified fourth rule.
[0153] According to one embodiment, in operation 741, the electronic device (301) may determine a group of the first handwriting input and the second handwriting input based on the adjusted fifth distance. According to one embodiment, the electronic device (301) may determine a group of the first handwriting input and the second handwriting input based on comparing the fifth distance with a specified distance. If the fifth distance is greater than the specified distance, the electronic device (301) may determine the first handwriting input and the second handwriting input to be different groups. If the fifth distance is not greater than the specified distance, the electronic device (301) may determine the first handwriting input and the second handwriting input to be the same group.
[0154] According to one embodiment, the specified values of the third and fourth rules may be set to different values or may be set to the same value.
[0155] FIG. 8 is a flowchart illustrating an operation of an electronic device according to one embodiment to determine whether to group at least one handwriting input of a first type.
[0156] According to one embodiment, an electronic device (301) (e.g., the electronic device (301) of FIG. 3) may display a first screen including a first type of first handwriting input and a second handwriting input on a display (360) (e.g., the display (360) of FIG. 3). The first screen may include a screen divided into a plurality of regions.
[0157] Referring to FIG. 8, according to one embodiment, in operation 811, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may determine a first distance between the last stroke of the first type of first handwriting input and the first stroke of the second type of first handwriting input.
[0158] According to one embodiment, in operation 813, the electronic device (301) may determine whether the first distance is greater than a specified distance.
[0159] According to one embodiment, if the electronic device (301) determines that the first distance is not greater than the specified distance (operation 813-No), then in operation 815, the electronic device may determine the first handwriting input and the second handwriting input as the same input.
[0160] According to one embodiment, if the electronic device (301) determines that the first distance is greater than the specified distance (operation 813 - Yes), in operation 817, the electronic device may determine whether the first handwriting input and the second handwriting input are located on the same line.
[0161] According to one embodiment, if the electronic device (301) determines that the first handwriting input and the second handwriting input are not located on the same line (operation 817-No), in operation 819, the electronic device may determine whether the first handwriting input and the second handwriting input are located within the same area among a plurality of areas included in the first screen.
[0162] According to one embodiment, if the electronic device (301) determines that the first handwriting input and the second handwriting input are located within the same area among the plurality of areas included in the first screen (operation 819 - Yes), in operation 821, the electronic device may adjust the first distance to be shorter according to a specified first rule. For example, the specified first rule may mean dividing the first distance by a specified value greater than 1. For example, the specified first rule may mean subtracting a specified value from the first distance. However, this is an example, and embodiments of the present invention may adjust the first distance to be shorter according to various rules.
[0163] According to one embodiment, in operation 823, the electronic device (301) may determine a group of first handwriting inputs and second handwriting inputs based on a second distance adjusted to be shorter than the first distance.
[0164] According to one embodiment, if the electronic device (301) determines that the first handwriting input and the second handwriting input are not located within the same area (operation 819 - No), in operation 825, the electronic device may adjust the first distance to be longer according to a specified second rule. For example, the specified second rule may mean multiplying the first distance by a specified value greater than 1. For example, the specified second rule may mean adding a specified value to the first distance. However, this is an example, and embodiments of the present invention may adjust the first distance to be longer according to various rules.
[0165] According to one embodiment, in operation 827, the electronic device (301) may determine a group of first handwriting inputs and second handwriting inputs based on a third distance in which the first distance is adjusted to be longer.
[0166] According to one embodiment, if the electronic device (301) determines that the first handwriting input and the second handwriting input are located on the same line (operation 817 - Yes), in operation 829, the first distance may be shortened according to a designated third rule. For example, the designated third rule may mean dividing the first distance by a designated value greater than 1. For example, the designated third rule may mean subtracting a designated value from the first distance. However, this is an example, and embodiments of the present invention may shorten the first distance according to various rules.
[0167] According to one embodiment, in operation 831, the electronic device (301) may determine a group of first handwriting inputs and second handwriting inputs based on the shortened fourth distance.
[0168] According to one embodiment, the specified values of operations 821, 825 and 829 may be the same or different from each other.
[0169] Through this, the electronic device (301) according to one embodiment can increase the readability of the plurality of handwriting inputs by subdividing the grouping of the plurality of handwriting inputs by considering the distance between the plurality of handwriting inputs and whether the plurality of handwriting inputs are located on the same line and in the same area.
[0170] FIG. 9 is a flowchart illustrating an operation of an electronic device according to one embodiment of the present invention to adjust a horizontal-to-vertical ratio of a first handwriting input and a second handwriting input when at least a portion of a first handwriting input of a first type overlaps at least a portion of a second handwriting input.
[0171] According to one embodiment, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may display a first screen including at least one handwriting input of a first type and at least one handwriting input of a second type on the display (360) (e.g., the display (360) of FIG. 3) at a first ratio. According to one embodiment, the electronic device (301) may confirm a command to change the horizontal-to-vertical ratio of the first screen to a second ratio. For example, the electronic device (301) may confirm the command when the electronic device (301) changes from a portrait mode to a landscape mode according to rotation of the electronic device (301). For example, the command may mean a command to display a second screen on the display (360) in which the first ratio of the first screen is changed to the second ratio.
[0172] According to one embodiment, at least one handwritten input of the first type may include text. The text may include Korean, English, numbers, and the like. Depending on the implementation, the at least one handwritten input of the first type may also include non-text handwritten inputs. For example, the at least one handwritten input of the first type may further include a handwritten input indicating an object displayed over a date on a calendar. For example, the object displayed over a date on the calendar may include various shapes, such as a circle, a triangle, a square, or a check mark.
[0173] According to one embodiment, at least one handwriting input of the second type may include a handwriting input representing objects other than text that are not included in the first type (e.g., shapes, line segments). Furthermore, at least one handwriting input of the second type may include a handwriting input representing an object displayed on at least a portion of a first region included in the plurality of regions and at least a portion of a second region adjacent to the first region. For example, the object displayed on at least a portion of the first region and at least a portion of the second region adjacent to the first region may include a handwriting input representing an arrow shape. According to an implementation, when an object other than text surrounds a text, and the text surrounded by the object is determined to be inseparable from the object, the electronic device (301) may determine the text surrounded by the object and the object as a handwriting input of the second type. When the text surrounded by the object is determined to be separable from the object, the electronic device (301) may determine the text surrounded by the object as a handwriting input of the first type and the object as a handwriting input of the second type.
[0174] Referring to FIG. 9, according to one embodiment, in operation 911, the electronic device (301) may determine a first handwriting input of a first type as a first group, and determine a second handwriting input of the first type as a second group different from the first group.
[0175] According to one embodiment, in operation 913, the electronic device (301) may check (or determine) whether at least a portion of the first handwriting input overlaps with at least a portion of the second handwriting input. According to one embodiment, the electronic device (301) may check (or determine) whether at least a portion of the first handwriting input overlaps with at least a portion of the second handwriting input when the width-to-height ratio of the first handwriting input to be displayed on the second screen and the width-to-height ratio of the second handwriting input on the first screen are maintained to be the same as the width-to-height ratio of the first handwriting input on the first screen and the width-to-height ratio of the second handwriting input on the first screen. According to one embodiment, the electronic device (301) may determine that at least a portion of the first handwriting input overlaps with at least a portion of the second handwriting input when at least a portion of the first area corresponding to the first group overlaps with a portion of the second area corresponding to the second group. The first area may refer to an area formed by a plurality of strokes of the first handwriting input, and the second area may refer to an area formed by a plurality of strokes of the second handwriting input.
[0176] According to one embodiment, in operation 915, if the electronic device (301) determines (or determines) that at least a portion of the first handwriting input overlaps at least a portion of the second handwriting input, the electronic device (301) may change the horizontal-to-vertical ratio of the first handwriting input and the second handwriting input to be displayed on the second screen based on the second ratio.
[0177] According to one embodiment, if the electronic device (301) determines (or determines) that at least a portion of the first handwriting input and at least a portion of the second handwriting input do not overlap, the electronic device (301) can maintain the horizontal-to-vertical ratio of the first handwriting input and the second handwriting input to be displayed on the second screen to be the same as the horizontal-to-vertical ratio of the first handwriting input and the second handwriting input displayed on the first screen.
[0178] FIG. 10A is a diagram illustrating an operation of an electronic device according to one embodiment to check a distance between a plurality of strokes included in at least one handwriting input of a first type.
[0179] According to one embodiment, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may check the distance between a plurality of strokes (or, a plurality of strokes) included in at least one handwriting input of the first type. For example, the at least one handwriting input may mean a handwriting input in syllable units. A stroke may mean a continuous stroke from a point at which an input (e.g., a touch input) starts to a point at which the input (e.g., a touch input) is released. According to one embodiment, the electronic device (301) may check the distance between the starting points of the plurality of strokes. According to one embodiment, the electronic device (301) may check the distance between a first stroke input to the display (360) (e.g., the display (360) of FIG. 3) at the nth time and a second stroke input to the display (360) at the n+1th time. Here, n may mean a natural number. For example, the electronic device (301) may check the distance between a starting point of the first stroke and a starting point of the second stroke. For example, the electronic device (301) can determine the distance between the end point of the first stroke and the start point of the second stroke. However, this is merely an example, and embodiments of the present invention are not limited thereto, and the distance can be determined in various ways. Below, the operation of the electronic device (301) determining the distance between the start points of multiple strokes will be described in detail.
[0180] Referring to FIG. 10A, according to one embodiment, the electronic device (301) can check a distance (1006) between a starting point (1001) of a first stroke (stroke in the ① direction) of a first handwriting input (H) included in at least one handwriting input and a starting point (1002) of a second stroke (stroke in the ② direction) of the first handwriting input (H). According to one embodiment, the electronic device (301) can check a distance (1007) between a starting point (1002) of the second stroke and a starting point (1003) of a third stroke (stroke in the ③ direction) of the first handwriting input (H).
[0181] According to one embodiment, the electronic device (301) can determine the distance (1008) between the starting point (1003) of the third stroke and the starting point (1004) of the fourth stroke (stroke in the direction of ④) of the second handwriting input (w) included in at least one handwriting input.
[0182] According to one embodiment, the electronic device (301) can determine the distance (1009) between the starting point (1004) of the fourth stroke and the starting point (1005) of the fourth stroke (stroke in the ⑤ direction) of the third handwriting input (R) included in at least one handwriting input.
[0183] According to one embodiment, the electronic device (301) may compare each distance between strokes (1006, 1007, 1008, 1009) with a designated distance, and determine whether to group at least one handwriting input based on the comparison result.
[0184] FIG. 10B is a diagram illustrating an operation of an electronic device according to one embodiment to determine the distance between strokes of at least one handwriting input representing a word. FIG. 10C is a diagram illustrating an operation of an electronic device according to one embodiment to determine whether to group at least one handwriting input based on the distance between multiple strokes.
[0185] Referring to FIG. 10B, according to one embodiment, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may check the distance between a plurality of strokes (or, a plurality of strokes) included in at least one handwriting input of the first type. For example, the at least one handwriting input may refer to a handwriting input in units of words. For example, the electronic device (301) may check the handwriting input in units of words based on an AI model. For example, the electronic device (301) may check the handwriting input in units of words based on spacing. A stroke may refer to a continuous stroke from a point where an input is started to a point where the input is released.
[0186] According to one embodiment, the electronic device (301) can check the distance (1030) between the starting point (1011) of the last stroke of the first handwriting input (e.g., HwR) representing the first word and the starting point (1012) of the first stroke of the second handwriting input (e.g., meeting) representing the second word. According to one embodiment, the electronic device (301) can check the distance (1040) between the starting point (1013) of the last stroke of the second handwriting input (e.g., meeting) representing the second word and the starting point (1014) of the first stroke of the third handwriting input (e.g., 2 o'clock) representing the third word. According to one embodiment, the electronic device (301) can check the distance (1050) between the starting point (1015) of the last stroke of the third handwriting input (e.g., 2 o'clock) representing the third word and the starting point (1016) of the first stroke of the fourth handwriting input (e.g., HwR) representing the fourth word. According to one embodiment, the electronic device (301) can determine a distance (1060) between a starting point (1017) of the last stroke of a fourth handwriting input (e.g., HwR) representing a fourth word and a starting point (1018) of a first stroke of a fifth handwriting input (e.g., meeting) representing a fifth word. According to one embodiment, the electronic device (301) can determine a distance (1070) between a starting point (1019) of the last stroke of a fifth handwriting input (e.g., meeting) representing a fifth word and a starting point (1020) of a first stroke of a sixth handwriting input (e.g., 2 o'clock) representing a sixth word.
[0187] According to one embodiment, the electronic device (301) can check whether the distance (1030) is greater than a specified distance. According to one embodiment, if it is determined that the distance (1030) is greater than the specified distance, the electronic device (301) can check whether the first handwriting input (e.g., HwR) and the second handwriting input (e.g., meeting) are located on the same line. According to one embodiment, if it is determined that the first handwriting input (e.g., HwR) and the second handwriting input (e.g., meeting) are not located on the same line, the electronic device (301) can check whether the first handwriting input (e.g., HwR) and the second handwriting input (e.g., meeting) are located in the same area (e.g., an area where 2 is displayed). According to one embodiment, the electronic device (301) may adjust the distance (1030) shorter according to a specified first rule based on determining that the first handwriting input (e.g., HwR) and the second handwriting input (e.g., meeting) are located in the same area (e.g., the area where 2 is displayed).
[0188] In one embodiment, the electronic device (301) can determine whether the distance (1040) is greater than a specified distance. In one embodiment, if the electronic device (301) determines that the distance (1040) is less than the specified distance, the electronic device (301) can determine the second handwriting input (e.g., meeting) and the third handwriting input (e.g., 2 o'clock) to be in the same group.
[0189] According to one embodiment, the electronic device (301) can check whether the distance (1050) is greater than a specified distance. According to one embodiment, if it is determined that the distance (1050) is greater than the specified distance, the electronic device (301) can check whether the third handwriting input (e.g., 2 o'clock) and the fourth handwriting input (e.g., HwR) are located on the same line. According to one embodiment, if it is determined that the third handwriting input (e.g., 2 o'clock) and the fourth handwriting input (e.g., HwR) are not located on the same line, the electronic device (301) can check whether the third handwriting input (e.g., 2 o'clock) and the fourth handwriting input (e.g., HwR) are located in the same area (e.g., an area where 2 is displayed). According to one embodiment, the electronic device (301) may adjust the distance (1050) based on a second rule specified based on determining that the third handwriting input (e.g., 2 o'clock) and the fourth handwriting input (e.g., HwR) are not located in the same area.
[0190] In one embodiment, the electronic device (301) can determine whether the distance (1060) is greater than a specified distance. In one embodiment, if the distance (1060) is determined to be greater than the specified distance, the electronic device (301) can determine whether the fourth handwriting input (e.g., HwR) and the fifth handwriting input (e.g., meeting) are located on the same line. In one embodiment, the electronic device (301) can adjust the distance (1060) to be shorter according to a specified third rule based on the determination that the fourth handwriting input (e.g., HwR) and the fifth handwriting input (e.g., meeting) are located on the same line.
[0191] According to one embodiment, the electronic device (301) may determine whether the distance (1070) is greater than a specified distance. According to one embodiment, if it is determined that the distance (1070) is greater than the specified distance, the electronic device (301) may determine whether the fifth handwriting input (e.g., meeting) and the sixth handwriting input (e.g., 2 o'clock) are located on the same line. According to one embodiment, if it is determined that the fifth handwriting input (e.g., meeting) and the sixth handwriting input (e.g., 2 o'clock) are not located on the same line, the electronic device (301) may determine whether the fifth handwriting input (e.g., meeting) and the sixth handwriting input (e.g., 2 o'clock) are located in the same area (e.g., an area where 9 is displayed). According to one embodiment, based on the determination that the fifth handwriting input (e.g., meeting) and the sixth handwriting input (e.g., 2 o'clock) are located in the same area, the electronic device (301) may adjust the distance (1070) to be shorter according to a specified first rule.
[0192] Referring to FIG. 10c, according to one embodiment, the electronic device (301) may compare the adjusted distance with the specified distance to determine whether to group multiple handwriting inputs.
[0193] According to one embodiment, the electronic device (301) may determine the second handwriting input (e.g., meeting) and the third handwriting input (e.g., 2 o'clock) as the same group based on the determination that the distance (1040) is smaller than the specified distance. According to one embodiment, the electronic device (301) may determine whether the adjusted distance is smaller than the specified distance based on the distance (1030) being adjusted short. According to one embodiment, the electronic device (301) may determine the first handwriting input (e.g., HwR), the second handwriting input (e.g., meeting), and the third handwriting input (e.g., 2 o'clock) as the same first group based on the determination that the adjusted distance is smaller than the specified distance. The electronic device (301) may determine the first area (1080) corresponding to the first group.
[0194] In one embodiment, the electronic device (301) can determine whether the adjusted distance is less than a specified distance based on the distances (1060, 1070) being adjusted shorter. In one embodiment, the electronic device (301) can determine the fourth handwriting input (e.g., HwR), the fifth handwriting input (e.g., meeting), and the sixth handwriting input (e.g., 2 o'clock) as the same second group based on the determination that the adjusted distance is less than the specified distance. The electronic device (301) can determine the second area (1090) corresponding to the second group.
[0195] In one embodiment, the electronic device (301) may determine whether the adjusted distance (1050) is less than a specified distance based on the length adjustment. In one embodiment, the electronic device (301) may determine the fourth handwriting input (e.g., HwR) to be a second group different from the first group based on the determination that the adjusted distance is greater than the specified distance.
[0196] For example, the electronic device (301) can adjust the size, arrangement, and position of the first area (1080), and adjust the size, arrangement, and position of the second area (1090). Based on the adjustment of the size, arrangement, and position of the first area (1080), the sizes, arrangements, and positions of the first handwriting input, the second handwriting input, and the third handwriting input included in the first area (1080) can be adjusted. Based on the adjustment of the size, arrangement, and position of the second area (1090), the sizes, arrangements, and positions of the fourth handwriting input, the fifth handwriting input, and the sixth handwriting input included in the second area (1090) can be adjusted.
[0197] FIG. 11A is a diagram showing a first screen displayed on a display when an electronic device according to one embodiment is in portrait mode.
[0198] Referring to FIG. 11A, an electronic device (301) according to one embodiment (e.g., the electronic device (301) of FIG. 3 ) may, when in portrait mode, display a first screen including a plurality of handwriting inputs on a display (360) (e.g., the display (360) of FIG. 3 ). The first screen may include a screen divided into a plurality of areas. The first screen may also include a screen related to a calendar.
[0199] For example, the first screen may include a plurality of handwriting inputs (1120, 1130, 1140) and a handwriting input (1110) representing an object displayed over at least a portion of a first area (e.g., an area displaying 25) and at least a portion of a second area adjacent to the first area (e.g., an area displaying 26).
[0200] FIG. 11b is a drawing showing a second screen displayed on a display when a conventional electronic device according to a comparative example is switched from portrait mode to landscape mode.
[0201] Referring to FIG. 11B, a conventional electronic device according to a comparative example can identify coordinates of a plurality of handwriting inputs (1120, 1130, 1140) displayed on a first screen and a handwriting input (1110) representing an object based on a command to switch from a portrait mode to a landscape mode. The conventional electronic device according to the comparative example can determine to change the horizontal-to-vertical ratio of the first screen from a first ratio to a second ratio based on a command to switch from a portrait mode to a landscape mode.
[0202] A conventional electronic device according to a comparative example can check the coordinates of a plurality of handwriting inputs (1120, 1130, 1140) on a first screen and a handwriting input (1110) representing an object.
[0203] A conventional electronic device according to a comparative example can determine coordinates of a plurality of handwriting inputs (1120, 1130, 1140) to be displayed on a second screen and a handwriting input (1110) representing an object based on a second ratio. A conventional electronic device according to a comparative example can display a second screen including a plurality of handwriting inputs (1121, 1131, 1141) and a handwriting input (1111) representing an object based on the determined coordinates.
[0204] According to a comparative example, a conventional electronic device may display handwriting inputs (1121, 1131, 1141) overlapping each other. According to a comparative example, a conventional electronic device may display handwriting inputs (1121, 1131, 1141) tilted in a horizontal direction. According to a comparative example, a conventional electronic device may display a handwriting input (1111) representing an object in a lengthened form.
[0205] According to a comparative example, the readability and aesthetics of multiple handwriting inputs displayed on the second screen may be degraded.
[0206] FIG. 12A is a diagram for explaining a grouping operation of a plurality of handwriting inputs included in a first screen when an electronic device according to one embodiment is in portrait mode.
[0207] Referring to FIG. 12A, according to one embodiment, an electronic device (301) (e.g., the electronic device (301) of FIG. 3) may distinguish between a plurality of handwriting inputs (1120, 1130, 1140) and an object (1110) using a learned AI model based on a command to switch from a portrait mode to a landscape mode. According to one embodiment, the command may mean a command to adjust the horizontal-to-vertical ratio of a screen displayed on a display (360) from a first ratio to a second ratio.
[0208] According to one embodiment, the electronic device (301) can compare distances between multiple strokes included in multiple handwriting inputs (1120, 1130, 1140) with a specified distance. According to one embodiment, the electronic device (301) can determine whether the multiple handwriting inputs (1120, 1130, 1140) are located in the same area or on the same line.
[0209] According to one embodiment, the electronic device (301) may determine whether to group the plurality of handwriting inputs (1120, 1130, 1140) based on distances between the plurality of strokes included in the plurality of handwriting inputs (1120, 1130, 1140) and whether the plurality of handwriting inputs (1120, 1130, 1140) are located in the same area or on the same line.
[0210] According to one embodiment, the electronic device (301) may determine each of the plurality of handwriting inputs (1120, 1130, 1140) as a first group, a second group, and a third group. According to one embodiment, the electronic device (301) may determine the first plurality of handwriting inputs (e.g., Good note meeting) as a first group, the second plurality of handwriting inputs (e.g., 2 o'clock meeting) as a second group, and the third plurality of handwriting inputs (e.g., after-school counseling) as a third group. According to one embodiment, the electronic device (301) may identify an area (1122) corresponding to the first group, an area (1133) corresponding to the second group, and an area (1144) corresponding to the third group.
[0211] FIG. 12B is a diagram for explaining an operation of adjusting the horizontal-to-vertical ratio of a plurality of handwriting inputs included in a first screen when an electronic device according to one embodiment switches from a vertical mode to a horizontal mode.
[0212] Referring to FIG. 12B, according to one embodiment, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) can determine whether at least some of the plurality of handwriting inputs (1120, 1130, 1140) overlap when the horizontal-to-vertical ratio of the plurality of handwriting inputs to be displayed on the second screen is maintained to be the same as the horizontal-to-vertical ratio of the plurality of handwriting inputs (1120, 1130, 1140) of the first screen.
[0213] According to one embodiment, the electronic device (301) can determine that at least a portion of an area (1122) corresponding to a first group overlaps with at least a portion of an area (1133) corresponding to a second group, and that at least a portion of an area (1133) corresponding to the second group overlaps with at least a portion of an area (1144) corresponding to a third group. According to one embodiment, the electronic device (301) can determine that at least a portion of a first plurality of handwriting inputs (1120) of a first group overlaps with a second plurality of handwriting inputs (1130) of a second group, and that at least a portion of a second plurality of handwriting inputs (1130) of a second group overlaps with a third plurality of handwriting inputs (1140) of a third group.
[0214] According to one embodiment, if it is determined that at least some of the plurality of handwriting inputs (1120, 1130, 1140) overlap, the electronic device (301) may change the horizontal-to-vertical ratio of the plurality of handwriting inputs (1170, 1180, 1190) to be displayed on the second screen based on the second ratio.
[0215] According to one embodiment, the electronic device (301) can change the horizontal-to-vertical ratio of a handwriting input (1160) representing an object to be displayed on a second screen based on a second ratio.
[0216] According to one embodiment, the electronic device (301) can display a plurality of handwriting inputs (1170, 1180, 1190) without overlapping each other. According to one embodiment, the electronic device (301) can relatively improve the readability and aesthetics of the plurality of handwriting inputs displayed on the second screen compared to the electronic device according to the comparative embodiment.
[0217] FIGS. 13A and 13B are diagrams for explaining an operation of adjusting the ratio of at least one handwriting input of a second type included in a first screen when an electronic device according to one embodiment is switched from a portrait mode to a landscape mode.
[0218] Referring to FIG. 13A, an electronic device (301) (e.g., the electronic device (301) of FIG. 3 ) may display a first screen on a display (360) (e.g., the display (360) of FIG. 3 ) in portrait mode. The first screen may include a screen related to a calendar including a date. For example, the screen related to the calendar may include a screen in which a date is displayed in each of a plurality of areas.
[0219] According to one embodiment, the electronic device (301) may identify a first type of handwriting input (1310) included in the first screen. The first type of handwriting input may further include a handwriting input (1310) indicating an object displayed over a date (e.g., 17) of a calendar. The first type of handwriting input may further include a handwriting input (1341, 1351, 1361) indicating a special character (e.g., a diamond shape).
[0220] In one embodiment, the electronic device (301) can determine whether the text (1330) can be separated from the object (1320) when a non-text object (1320) surrounds the text (1330) (e.g., driver's license renewal). For example, the non-text object (1320) may refer to an object whose interior is colored. For example, the text (1330) may refer to text displayed on the non-text object (1320).
[0221] According to one embodiment, the electronic device (301) may determine whether a handwriting input corresponding to an object other than text (1320) overlaps with a handwriting input corresponding to text (1330). According to one embodiment, the electronic device (301) may determine that the text (1330) cannot be separated from the object (1320) based on the determination that the handwriting input corresponding to the object other than text (1320) overlaps with the handwriting input corresponding to text (1330). According to one embodiment, the electronic device (301) may determine the text (1330) as a second type of handwriting input.
[0222] Referring to FIG. 13b, the electronic device (301) can display a second screen in which the horizontal-to-vertical ratio of the first screen is changed from the first ratio to the second ratio based on a command to switch from the vertical mode to the horizontal mode.
[0223] According to one embodiment, the second screen may include handwriting input (1321) representing text (1331) and objects whose width-to-height ratio has been changed based on the second ratio.
[0224] According to one embodiment, the electronic device (301) can maintain the horizontal-to-vertical ratio of the first type of handwriting input (1311, 1341, 1351, 1361) displayed on the second screen to be the same as the horizontal-to-vertical ratio of the first type of handwriting input (1310) displayed on the first screen.
[0225] FIG. 14A is a drawing for explaining an operation of an electronic device according to one embodiment to display a screen related to a calendar through a display.
[0226] According to one embodiment, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may be implemented as a foldable device.
[0227] Referring to FIG. 14A, according to one embodiment, a display (360) (e.g., the display (360) of FIG. 3) may include a first region (1410) positioned on one side relative to a folding region and a second region (1420) positioned on the other side relative to the folding region.
[0228] According to one embodiment, the electronic device (301) may display a part (1430) of a third screen, in which a second ratio representing the width-to-height ratio of a second screen (e.g., the second screen of FIG. 2C) is changed to a third ratio, in the first area (1410) based on the folding of the electronic device (301). However, this is an example, and the electronic device (301) may also display the entire third screen in the first area (1410). For example, the third ratio may mean a different ratio from the second ratio. Depending on the implementation, according to one embodiment, the third ratio may be the same ratio as the second ratio, and the part (1430) of the third screen may mean a part of the second screen. The electronic device (301) may also display a part of the second screen with the second ratio in the first area (1410) based on the folding of the electronic device (301).
[0229] According to one embodiment, the electronic device (301) can maintain the horizontal-to-vertical ratio of the first type of handwriting input displayed on a portion (1430) of the third screen to be the same as the horizontal-to-vertical ratio of the first type of handwriting input displayed on the second screen.
[0230] According to one embodiment, the electronic device (301) can change the horizontal-to-vertical ratio of the second type of handwriting input to be displayed on a portion (1430) of the third screen based on the third ratio.
[0231] According to one embodiment, the electronic device (301) may display a scroll bar in the first area (1410) that may display at least a portion of a third screen (1430) and a portion of the third screen other than the portion of the third screen (1430). For example, when an input for up / down or left / right movement of the scroll bar is confirmed, the electronic device (301) may display a screen of another portion of the third screen.
[0232] In one embodiment, depending on the implementation, the second area (1420) may display a fourth screen (1440) in which at least one handwriting input included in the third screen has been deleted. In one embodiment, the fourth screen (1440) may include a screen that is a scaled-down version of the third screen.
[0233] According to one embodiment, the electronic device (301) can confirm an input (e.g., a touch input or a tap input) for a specific date (e.g., September 5) displayed on the fourth screen (1440). According to one embodiment, the electronic device (301) can display an object (1455) that can add a schedule (e.g., time, schedule content) for the date based on the input for the specific date (e.g., September 5) on the fifth screen (1450). According to one embodiment, if a schedule (e.g., 9 o'clock, heart heart) for the date is added based on the input for the object (1455), the electronic device (301) can display the schedule on the fifth screen (1450).
[0234] Depending on the implementation, according to one embodiment, the electronic device (301) may display, on a fifth screen (1450), at least one handwritten input (e.g., heart heart) displayed in an area corresponding to a specific date (e.g., September 5) included in a portion (1430) of the third screen based on an input (e.g., touch input) for a specific date (e.g., September 5) displayed on the fourth screen (1440). For example, the at least one handwritten input (e.g., heart heart) displayed on the fifth screen (1450) may be at least one handwritten input (e.g., heart heart) displayed in an area corresponding to a specific date (e.g., September 5) included in a portion (1430) of the third screen. For example, at least one handwritten input (e.g., heart heart) displayed on the fifth screen (1450) may mean a handwritten input (or text, character) recognized or identified by the electronic device (301) from at least one handwritten input (e.g., heart heart) displayed on the fifth screen (1450) through character recognition technology.
[0235] According to one embodiment, the electronic device (301) may enlarge and display at least one handwritten input (e.g., heart heart) displayed in an area corresponding to a specific date (e.g., September 5) in a part of the third screen (1430) based on an input (e.g., touch input) for a specific date (e.g., September 5) displayed on the fourth screen (1440) in the first area (1410). For example, the electronic device (301) may enlarge and display the at least one handwritten input (e.g., heart heart) in a location where an area corresponding to a specific date (e.g., September 5) included in a part of the third screen (1430) is located in the first area (1410).
[0236] FIG. 14b is a drawing for explaining an operation of an electronic device according to one embodiment to display a screen related to a calendar through a display.
[0237] Referring to FIG. 14b, according to one embodiment, when the electronic device (301) is folded, the electronic device (301) can display a fourth screen (1440) and a fifth screen (1450) on a first area (1410) positioned on one side based on the folding area.
[0238] According to one embodiment, the electronic device (301) may display a sixth screen (1460) capable of acquiring handwriting input by a user's body (e.g., hand or finger) or a stylus pen (302) on a second area (1420) positioned on the other side based on the folding area. The sixth screen (1460) may be an execution screen of an application. However, this is only an example, and the sixth screen (1460) may include various screens.
[0239] In one embodiment, an electronic device (301) may include a display (360), a processor (320), and a memory (330) for storing instructions.
[0240] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to display a first screen on the display, the horizontal-to-vertical ratio of which corresponds to a first ratio.
[0241] In an electronic device (301) according to one embodiment, the first screen may include at least one handwriting input of a first type and at least one handwriting input of a second type.
[0242] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to confirm a command to change the horizontal-to-vertical ratio of the first screen from the first ratio to the second ratio.
[0243] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to display a second screen in which the horizontal-to-vertical ratio of the first screen is changed to the second ratio, based on the instructions.
[0244] In an electronic device (301) according to one embodiment, the horizontal-to-vertical ratio of the at least one handwriting input of the first type included in the second screen may be maintained to be the same as the horizontal-to-vertical ratio of the at least one handwriting input of the first type included in the first screen.
[0245] In an electronic device (301) according to one embodiment, the horizontal-to-vertical ratio of the at least one handwriting input of the second type included in the second screen can be changed based on the second ratio.
[0246] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to determine a distance between a plurality of strokes included in the at least one handwriting input of the first type.
[0247] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to determine whether to group the at least one handwriting input based on a comparison of the distance and a specified distance.
[0248] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to determine a first distance between a last stroke of a first handwriting input representing a first word and a first stroke of a second handwriting input representing a second word among a plurality of strokes included in the at least one handwriting input of the first type.
[0249] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to determine whether to group the first handwriting input and the second handwriting input based on a comparison of the first distance and a specified distance.
[0250] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to determine the first handwriting input as a first group and determine the second handwriting input as a second group different from the first group, if the first distance is determined to be greater than the specified distance.
[0251] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to determine the arrangement or position of the at least one handwriting input based on whether the grouping is performed.
[0252] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to change a horizontal-to-vertical ratio of the first handwriting input and the second handwriting input based on the second ratio when it is determined that at least a portion of the first handwriting input and at least a portion of the second handwriting input overlap.
[0253] In an electronic device (301) according to one embodiment, the first screen may include a screen divided into a plurality of areas.
[0254] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to adjust the first distance to be shorter according to a specified rule when the first handwriting input and the second handwriting input are located within the same area among the plurality of areas.
[0255] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), may cause the electronic device (301) to determine the first handwriting input and the second handwriting input as the same group when the first handwriting input and the second handwriting input are located on the same line.
[0256] In an electronic device (301) according to one embodiment, at least one handwriting input of the second type may include a handwriting input indicating an object displayed on at least a portion of a first area included in the plurality of areas and at least a portion of a second area adjacent to the first area.
[0257] In an electronic device (301) according to one embodiment, when the first screen is a screen related to a calendar including a date, at least one handwriting input of the first type may include a handwriting input indicating an object displayed on the date.
[0258] In an electronic device (301) according to one embodiment, the instructions, when executed by the processor (320), can cause the electronic device (301) to check the command when the electronic device changes from a landscape mode to a portrait mode or from the portrait mode to the landscape mode according to the rotation of the electronic device.
[0259] In a method of operating an electronic device (301) according to one embodiment, the first screen may include at least one handwriting input of a first type and at least one handwriting input of a second type.
[0260] In a method of operating an electronic device (301) according to one embodiment, the method may include an operation of confirming a command to change the horizontal-to-vertical ratio of the first screen from the first ratio to the second ratio.
[0261] In an operating method of an electronic device (301) according to one embodiment, an operation may be included of displaying a second screen in which the horizontal-to-vertical ratio of the first screen is changed to the second ratio based on the command.
[0262] In a method of operating an electronic device (301) according to one embodiment, a horizontal-to-vertical ratio of the at least one handwriting input of the first type included in the second screen may be maintained to be the same as a horizontal-to-vertical ratio of the at least one handwriting input of the first type included in the first screen.
[0263] In a method of operating an electronic device (301) according to one embodiment, a horizontal-to-vertical ratio of the at least one handwriting input of the second type included in the second screen can be changed based on the second ratio.
[0264] In a method of operating an electronic device (301) according to one embodiment, an operation of checking a distance between a plurality of strokes included in at least one handwriting input of the first type may be included.
[0265] In an operating method of an electronic device (301) according to one embodiment, an operation of determining whether to group at least one handwriting input may be included based on a comparison of the distance and a specified distance.
[0266] In a method of operating an electronic device (301) according to one embodiment, the method may include an operation of checking a first distance between a last stroke of a first handwriting input representing a first word and a first stroke of a second handwriting input representing a second word among a plurality of strokes included in at least one handwriting input of the first type.
[0267] In an operating method of an electronic device (301) according to one embodiment, an operation of determining whether to group the first handwriting input and the second handwriting input based on a comparison of the first distance and a specified distance may be included.
[0268] In an operating method of an electronic device (301) according to one embodiment, if it is determined that the first distance is greater than the specified distance, an operation of determining the first handwriting input as a first group and determining the second handwriting input as a second group different from the first group may be included.
[0269] In an operating method of an electronic device (301) according to one embodiment, an operation of determining the arrangement or position of the first handwriting input and the second handwriting input based on whether or not the grouping is performed may be included.
[0270] In an operating method of an electronic device (301) according to one embodiment, if it is determined that at least a part of the first handwriting input and at least a part of the second handwriting input overlap, an operation of changing a horizontal-to-vertical ratio of the first handwriting input and the second handwriting input based on the second ratio may be included.
[0271] In a method of operating an electronic device (301) according to one embodiment, the first screen may include a screen divided into a plurality of areas.
[0272] In an operating method of an electronic device (301) according to one embodiment, when the first handwriting input and the second handwriting input are located within the same area among the plurality of areas, an operation of adjusting the first distance to be shorter according to a specified rule may be included.
[0273] In an operating method of an electronic device (301) according to one embodiment, when the first handwriting input and the second handwriting input are located on the same line, an operation of determining the first handwriting input and the second handwriting input as the same group may be included.
[0274] In a method of operating an electronic device (301) according to one embodiment, at least one handwriting input of the second type may include a handwriting input indicating an object displayed on at least a portion of a first area included in the plurality of areas and at least a portion of a second area adjacent to the first area.
[0275] In a method of operating an electronic device (301) according to one embodiment, when the first screen is a screen related to a calendar including a date, at least one handwriting input of the first type may include a handwriting input indicating an object displayed on the date.
[0276] In an operating method of an electronic device (301) according to one embodiment, an operation of confirming the command may be included when the electronic device is changed from a landscape mode to a portrait mode or from the portrait mode to the landscape mode according to rotation of the electronic device.
[0277] In a non-transitory recording medium according to one embodiment, at least one instruction that can execute an operation of displaying a first screen having a length-to-width ratio corresponding to a first ratio can be stored on a display (360) included in the electronic device (301).
[0278] In a non-transitory recording medium according to one embodiment, the first screen may include at least one handwriting input of a first type and at least one handwriting input of a second type.
[0279] In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of confirming a command to change the width-to-height ratio of the first screen from the first ratio to the second ratio can be stored.
[0280] In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of displaying a second screen in which the width-to-height ratio of the first screen is changed to the second ratio can be stored based on the command.
[0281] In a non-transitory recording medium according to one embodiment, a width-to-height ratio of the at least one handwriting input of the first type included in the second screen may be maintained identical to a width-to-height ratio of the at least one handwriting input of the first type included in the first screen.
[0282] In a non-transitory recording medium according to one embodiment, the horizontal-to-vertical ratio of the at least one handwriting input of the second type included in the second screen can be changed based on the second ratio.
[0283] In one embodiment, a non-transitory recording medium may store at least one instruction capable of executing an operation of checking a distance between a plurality of strokes included in at least one handwriting input of the first type.
[0284] In a non-transitory recording medium according to one embodiment, at least one instruction can be stored that can execute an operation of determining whether to group at least one handwriting input based on a comparison of the distance and a specified distance.
[0285] In one embodiment, a non-transitory recording medium may store at least one instruction capable of executing an operation of checking a first distance between a last stroke of a first handwriting input representing a first word and a first stroke of a second handwriting input representing a second word among a plurality of strokes included in at least one handwriting input of the first type.
[0286] In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of determining whether to group the first handwriting input and the second handwriting input based on a comparison of the first distance and a specified distance may be stored.
[0287] In a non-transitory recording medium according to one embodiment, if it is determined that the first distance is greater than the specified distance, at least one instruction can be stored that can execute an operation of determining the first handwriting input as a first group and determining the second handwriting input as a second group different from the first group.
[0288] In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of determining the arrangement or position of at least one handwriting input based on whether the grouping is performed can be stored.
[0289] In a non-transitory recording medium according to one embodiment, when it is confirmed that at least a part of the first handwriting input and at least a part of the second handwriting input overlap, at least one instruction that can execute an operation of changing the horizontal-to-vertical ratio of the first handwriting input and the second handwriting input based on the second ratio can be stored.
[0290] In a non-transitory recording medium according to one embodiment, the first screen may include a screen divided into a plurality of areas.
[0291] In a non-transitory recording medium according to one embodiment, when the first handwriting input and the second handwriting input are located within the same area among the plurality of areas, at least one instruction capable of executing an operation of adjusting the first distance to be shorter according to a specified rule may be stored.
[0292] In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of determining the first handwriting input and the second handwriting input as the same group when the first handwriting input and the second handwriting input are located on the same line may be stored.
[0293] In a non-transitory recording medium according to one embodiment, at least one handwriting input of the second type may include a handwriting input indicating an object displayed on at least a portion of a first area included in the plurality of areas and at least a portion of a second area adjacent to the first area.
[0294] In a non-transitory recording medium according to one embodiment, when the first screen is a screen related to a calendar including a date, at least one handwriting input of the first type may include a handwriting input indicating an object displayed on the date.
[0295] In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of confirming the command when the electronic device (301) is changed from a landscape mode to a portrait mode or from the portrait mode to the landscape mode according to rotation may be stored.
[0296] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0297] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0298] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0299] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101) or an electronic device (301)). For example, a processor (e.g., a processor (120) or a processor (320)) of the machine (e.g., an electronic device (101) or an electronic device (301)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0300] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0301] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (101 of FIG. 1; 301 of FIG. 3), Display (160 in Fig. 1; 360 in Fig. 3); Processor (120 in Fig. 1; 320 in Fig. 3); and Contains a memory (130 in FIG. 1; 330 in FIG. 3) for storing instructions, The above instructions, when executed by the processor, cause the electronic device to: On the above display, a first screen is displayed having a width-to-height ratio corresponding to a first ratio, wherein the first screen includes at least one handwriting input of a first type and at least one handwriting input of a second type, Confirm a command to change the horizontal-vertical ratio of the first screen from the first ratio to the second ratio, An electronic device, wherein, based on the command, a second screen is set to be displayed in which the width-to-height ratio of the first screen is changed to the second ratio, wherein the width-to-height ratio of the at least one handwriting input of the first type included in the second screen is maintained the same as the width-to-height ratio of the at least one handwriting input of the first type included in the first screen, and the width-to-height ratio of the at least one handwriting input of the second type included in the second screen is changed based on the second ratio.
2. In paragraph 1, The above instructions, when executed by the processor, cause the electronic device to: Checking the distance between a plurality of strokes included in at least one handwriting input of the first type, An electronic device configured to determine whether to group at least one handwriting input based on a comparison of the distance and the specified distance.
3. In any one of paragraphs 1 and 2, The above instructions, when executed by the processor, cause the electronic device to: Checking a first distance between the last stroke of the first handwriting input representing a first word and the first stroke of the second handwriting input representing a second word among the plurality of strokes included in at least one handwriting input of the first type, An electronic device configured to determine whether to group the first handwriting input and the second handwriting input based on a comparison of the first distance and the specified distance.
4. In any one of paragraphs 1 to 3, The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to determine the first handwriting input as a first group and determine the second handwriting input as a second group different from the first group if the first distance is determined to be greater than the specified distance.
5. In any one of paragraphs 1 to 4, The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to determine the placement or location of at least one handwriting input based on whether said grouping is performed.
6. In any one of paragraphs 1 to 5, The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to change a horizontal-to-vertical ratio of the first handwriting input and the second handwriting input based on the second ratio when it is determined that at least a portion of the first handwriting input and at least a portion of the second handwriting input overlap.
7. In any one of paragraphs 1 to 6, The above first screen includes a screen divided into multiple areas, The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to adjust the first distance to be shorter according to a specified rule when the first handwriting input and the second handwriting input are located within the same area among the plurality of areas.
8. In any one of paragraphs 1 to 7, The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to determine the first handwriting input and the second handwriting input as the same group when the first handwriting input and the second handwriting input are located on the same line.
9. In any one of paragraphs 1 to 8, The above first screen includes a screen divided into multiple areas, An electronic device wherein at least one handwriting input of the second type comprises a handwriting input indicating an object displayed on at least a portion of a first area included in the plurality of areas and at least a portion of a second area adjacent to the first area.
10. In any one of paragraphs 1 to 9, The above instructions, when executed by the processor, cause the electronic device to: An electronic device in which at least one handwriting input of the first type includes a handwriting input representing an object displayed on the date, wherein the first screen is a screen related to a calendar including a date.
11. In any one of paragraphs 1 to 10, The above instructions, when executed by the processor, cause the electronic device to: An electronic device set to confirm the command when the electronic device changes from a landscape mode to a portrait mode or from a portrait mode to a landscape mode depending on the rotation of the electronic device.
12. In the method of operating an electronic device, An operation of displaying a first screen having a width-to-height ratio corresponding to a first ratio on a display (160 of FIG. 1; 360 of FIG. 3) included in the electronic device (101 of FIG. 1; 301 of FIG. 3); wherein the first screen includes at least one handwriting input of a first type and at least one handwriting input of a second type, An operation for confirming a command to change the horizontal-vertical ratio of the first screen from the first ratio to the second ratio; and An operating method of an electronic device, comprising: an operation of displaying a second screen in which the width-to-height ratio of the first screen is changed to the second ratio based on the command, wherein the width-to-height ratio of the at least one handwriting input of the first type included in the second screen is maintained the same as the width-to-height ratio of the at least one handwriting input of the first type included in the first screen, and the width-to-height ratio of the at least one handwriting input of the second type is changed based on the second ratio.
13. In paragraph 12, An operation of determining a distance between a plurality of strokes included in at least one handwriting input of the first type; and A method of operating an electronic device further comprising: determining whether to group at least one handwriting input based on a comparison of said distance with a specified distance.
14. In any one of paragraphs 12 to 13, An operation of determining a first distance between a last stroke of a first handwriting input representing a first word and a first stroke of a second handwriting input representing a second word among a plurality of strokes included in at least one handwriting input of the first type; and A method of operating an electronic device further comprising: determining whether to group the first handwriting input and the second handwriting input based on a comparison of the first distance and the specified distance.
15. In non-transitory recording media, An operation of displaying a first screen having a width-to-height ratio corresponding to a first ratio on a display (160 of FIG. 1; 360 of FIG. 3) included in an electronic device (101 of FIG. 1; 301 of FIG. 3); wherein the first screen includes at least one handwriting input of a first type and at least one handwriting input of a second type, An operation for confirming a command to change the horizontal-vertical ratio of the first screen from the first ratio to the second ratio; and A recording medium storing at least one instruction, comprising: an operation of displaying a second screen in which the width-to-height ratio of the first screen is changed to the second ratio based on the command, wherein the width-to-height ratio of the at least one handwriting input of the first type included in the second screen is maintained the same as the width-to-height ratio of the at least one handwriting input of the first type included in the first screen, and the width-to-height ratio of the at least one handwriting input of the second type included in the second screen can be changed based on the second ratio.
Citation Information
Patent Citations
Handwriting input device and program
JP2015056017A
User terminal and method for displaying screen
KR101397685B1
Method and device for providing content
KR1020160016569A
Manufacturing system of polarity and manufacturing apparatus thereof
KR102259843B1
KR20210073196A
