Electronic device and operation method thereof
The electronic device with an expandable display and processor ensures seamless content adjustment and identification during form factor changes, addressing challenges in flexible displays.
Patent Information
- Application Number
- KR1020210003845
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-01-12
- Publication Date
- 2026-11-03
- Estimated Expiration
- 2041-01-12
AI Technical Summary
Electronic devices with flexible, slideable, foldable, or rollable displays face challenges in adjusting content input properties and easy identification before and after changes in form factor.
An electronic device with an expandable and contractible display, memory, and processor that recognizes handwriting inputs in different states, adjusting display configurations to maintain content continuity during form factor changes.
The device effectively adjusts content input properties and ensures easy identification before and after form factor changes, enhancing user interaction and display flexibility.
Smart Images

Figure 112021003809412-PAT00005_ABST
Abstract
Description
Technology Field
[0001] The various embodiments disclosed in this document relate to electronic devices and methods of operating electronic devices. Background Technology
[0002] Recently, electronic devices can have various form factors. Depending on the form factor of the electronic device, the structure of the display can also vary. In particular, electronic devices with form factors in which the size of the display changes, such as flexible devices, slideable devices, foldable devices, rollable devices, or multi-foldable devices, are being developed. The problem to be solved
[0003] The various embodiments disclosed in this document aim to provide an electronic device that adjusts the properties of content input to a display after a change in form factor when the form factor of the electronic device changes.
[0004] The various embodiments disclosed in this document aim to provide an electronic device capable of easily identifying content before a change in form factor and content after a change in form factor when the form factor of the electronic device changes. means of solving the problem
[0005] An electronic device according to an embodiment disclosed in this document may include an expandable and contractible display, a memory, and a processor operatively connected to the display and the memory. According to one embodiment, the memory may include instructions such that, when executed, the processor recognizes a first handwriting input received from a user through the display in a contracted state, displays at least one first stroke corresponding to the received first handwriting input on the display in the contracted state, changes the display to an expanded state based on a specified input, displays a first user interface indicating the last stroke of the at least one first stroke when the display is in an expanded state, and when the display is in an expanded state, if a second handwriting input is received from the user within a specified distance from the point where the first user interface is displayed, recognizes a second stroke corresponding to the second handwriting input as being related to the last stroke of the at least one first stroke, and connects the second stroke to the last stroke and displays it on the expanded display.
[0006] Additionally, a method of operation of an electronic device including a retractable or expandable display according to an embodiment disclosed in this document may include: recognizing a first handwriting input received from a user through the display in a retracted state; displaying at least one first stroke corresponding to the received first handwriting input on the display in the retracted state; expanding the display based on a designated input; displaying a first user interface indicating the last stroke among the at least one first stroke when the display is expanded; recognizing a second stroke corresponding to the second handwriting input as being related to the last stroke among the at least one first stroke when the display is expanded and receiving a second handwriting input within a designated distance from the point where the first user interface is displayed; and connecting the second stroke to the last stroke and displaying it on the expanded display. Effects of the invention
[0007] According to the embodiments disclosed in this document, an electronic device can be provided that adjusts the properties of content input to a display after a change in form factor when the form factor of the electronic device changes.
[0008] According to the embodiments disclosed in this document, when the form factor of an electronic device changes, an electronic device can be provided that allows easy identification of content before the change in form factor and content after the change in form factor.
[0009] In addition, various effects that can be identified directly or indirectly through this document may be provided. Brief explanation of the drawing
[0010] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 2 is a drawing showing an example of the external shape of an electronic device according to one embodiment. FIG. 3 is an exploded perspective view showing the configurations of the electronic device of FIG. 2. FIG. 4 illustrates an exemplary form factor of an electronic device according to various embodiments. FIG. 5 is a block diagram of an electronic device according to various embodiments. FIG. 6 is a diagram illustrating the operation of an electronic device according to various embodiments. FIG. 7 is a diagram illustrating the operation of an electronic device according to various embodiments. FIG. 8 illustrates an example in which an electronic device recognizes two or more strokes as related, according to various embodiments. FIG. 9 is a diagram illustrating the operation of an electronic device according to various embodiments. FIGS. 10a and FIGS. 10b are drawings illustrating the operation of an electronic device according to various embodiments. FIG. 11 is a drawing illustrating the operation of an electronic device according to various embodiments. FIG. 12 is a flowchart of a method of operation of an electronic device including a display in which the display area can be expanded and contracted according to various embodiments. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Specific details for implementing the invention
[0011] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0012] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0013] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0014] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0015] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0016] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0017] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0018] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0019] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0020] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0021] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0022] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0023] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0024] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0025] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0026] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0027] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0028] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.
[0029] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0030] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0031] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0032] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0033] FIG. 2 is a drawing showing an example of the external shape of an electronic device according to one embodiment.
[0034] Referring to FIG. 2, an electronic device (101) according to one embodiment may include a display (160) (e.g., a flexible display having at least a portion available), a first housing (181), and a second housing (182). For example, the first housing (181) may serve as a fixed cover that accommodates the second housing and a portion of the display. The second housing (182) may serve as a sliding cover to which one side of the display (160) is fixed. The second housing (182) may be moved in a first direction (e.g., X-axis direction) or a second direction (e.g., -X-axis direction opposite to the first direction) relative to the first housing (181). As in state 103, when the first housing (181) and the second housing (182) overlap by a first width, a first display area (160a) of a first size may be positioned to face upward (e.g., Z-axis direction). Alternatively, in state 103, the display (160) may include a first display area (160a) of a first size that is visually exposed to the outside.
[0035] According to one embodiment, in state 103, the first housing (181) may be positioned to enclose at least a portion of the second direction (e.g., -X-axis direction), at least a portion of the third direction (e.g., Y-axis direction), at least a portion of the fourth direction (e.g., -Y-axis direction), and at least a portion of the fifth direction (e.g., -Z-axis direction, or a direction opposite to the Z-axis direction) of the first display area (160a). The second housing (182) may be positioned to enclose at least a portion of the first direction (e.g., X-axis direction), at least a portion of the third direction (e.g., Y-axis direction), at least a portion of the fourth direction (e.g., -Y-axis direction), and at least a portion of the fifth direction (e.g., -Z-axis direction) of the first display area (160a).
[0036] According to one embodiment, in state 103, at least a portion of the second display area (160b) extending from the first display area (160a) may be arranged in a rolled or unfolded manner inside at least one of the first housing (181) and the second housing (182). In this state, the surface on which the pixels of the first display area (160a) irradiate light may face the front direction (e.g., Z-axis direction), and at least a portion of the upper surface of the second display area (160b) on which the pixels are arranged may face the rear direction (e.g., -Z-axis direction). A portion of the second display area (160b) may be arranged in a curved manner.
[0037] According to one embodiment, when the second housing (182) is moved in the first direction (e.g., X-axis direction) relative to the first housing (181), the visual exposure area of the display (160) may be expanded. For example, when the first housing (181) and the second housing (182) overlap by a second width (e.g., a size smaller than the first width), as in state 107 (e.g., a state in which the second housing (182) performs a sliding motion to expand the area of the display (160)), the display (160) may include a first display area (160a) of a first size and a second display area (160b) of a second size that are visually exposed to the outside (or facing the upward direction (e.g., Z-axis direction). In state 107, the first size of the first display area (160a) and the second size of the second display area (160b) may be the same. Alternatively, the first size may be larger than the second size. According to various embodiments, the second size may vary depending on the sliding movement distance or travel distance of the second housing (182).
[0038] According to one embodiment, the display (160) may maintain a partially rolled state in state 103, and in state 107, at least a portion of the rolled state may be unfolded. For example, in state 107, the first housing (181) may be positioned to wrap at least a portion of the second direction (e.g., -X-axis direction), at least a portion of the third direction (e.g., Y-axis direction), at least a portion of the fourth direction (e.g., -Y-axis direction), and at least a portion of the fifth direction (e.g., -Z-axis direction, or a direction opposite to the Z-axis direction) of the second display area (160b).
[0039] According to various embodiments, the second housing (182) is connected to at least a portion of the inner side of the first housing (181) and can be slid along the inner surface of the first housing (181) in either the first direction (e.g., X-axis direction) or the second direction (e.g., -X-axis direction). While the first housing (181) and the second housing (182) are sliding, the first housing (181) and the second housing (182) can be positioned to surround the edges of the display (160). Various electronic elements related to driving the display (160), electronic elements related to various user functions supported by the electronic device (101), and / or a battery may be positioned inside the first housing (181) and the second housing (182).
[0040] FIG. 3 is an exploded perspective view showing the configurations of the electronic device of FIG. 2.
[0041] Referring to FIG. 3, an electronic device (101) according to one embodiment may include a display (160), a panel support member (117), a display support member (113), a support structure (114), a sliding support member (111), an actuator (112), an elastic module (210), a printed circuit board (119), a first housing (181), and a second housing (182).
[0042] According to one embodiment, the display (160) may have a plurality of pixels arranged in a matrix form, and at least a portion thereof may be provided in a flexible form. For example, the display (160) may include a panel layer in which a plurality of pixels are arranged and a screen is displayed, and an external protective layer disposed on top of the panel layer. The external protective layer may be formed of a polymer structure (e.g., polyimide) or glass. Additionally, the display (160) may further include a touch panel layer. As described in FIG. 1, the display (160) may include a first display area (160a) and a second display area (160b). At least a portion of the second display area (160b) may be wrapped and disposed inside the first housing (181) in state 103 of FIG. 1, and may be visually exposed to the outside of the first housing (181) in state 107. While at least a portion of the second display area (160b) is wound and bent and positioned relative to the rotation axis (115) (or rolling gear portion, or rotation axis member), the remaining portion of the second display area (160b) may be positioned on the rear side of the first display area (160a).
[0043] According to one embodiment, one side of the display (160) (e.g., at least a portion of the second display area (160b)) may be mounted inside at least one of the first housing (181) and the second housing (182). In this state, one end of the display (160) placed inside the electronic device (101) may be fastened to an elastic member. For example, while the second display area (160b) of the display (160) is exposed to the outside, the elastic force by the elastic member acts as tension on the display (160), thereby counteracting the repulsive force in the curved section of the display (160). As a result, the portion of the display (160) that is wound may be maintained uniformly.
[0044] According to one embodiment, the display support member (113) has a specified rigidity and can support the display (160). For example, the display support member (113) may be provided with at least a portion of aluminum or an aluminum alloy, and the surface facing the display (160) may be formed flat. As an example, at least a portion of the display support member (113) may be provided with an injection molded product (e.g., a structure including plastic or magnesium). In the 103 state, the first surface of the display support member (113) (e.g., the surface observed in the Z-axis direction) may be positioned to face the rear surface of the first display area (160a) (e.g., the surface observed in the -Z-axis direction), and the second surface of the display support member (113) (e.g., the surface observed in the -Z-axis direction) may be positioned to face the upper surface of the support structure (114) (e.g., the surface observed in the Z-axis direction).
[0045] According to one embodiment, at least a portion of the display support member (113) (or display (160)) is coupled with the second housing (182) and can be slid according to the sliding motion of the second housing (182). Alternatively, the second housing (182) can be moved by an actuator (112). In this regard, a separate physical button capable of directing the actuator drive may be placed in the electronic device (101), or a menu related to the actuator drive may be displayed on the display screen of the display (160). While the second housing (182) is moved in the first direction (e.g., X-axis direction), at least a portion of the panel support member (117) is moved in the first direction (e.g., X-axis direction), and the arrangement direction of the second display area (160b) of the display (160) fixed to the panel support member (117) may be changed from the sixth direction (e.g., -Z-axis direction) to the fifth direction (Z-axis direction). While the second housing (182) is moved in the first direction (e.g., X-axis direction), at least a portion of the panel support member (117) may be moved to the side of the second housing (182) while positioned on the lower surface of the second housing (182).
[0046] According to one embodiment, the panel support member (117) may have a shape in which a plurality of column portions (or protrusions, long bars, slates) having a certain length in the third direction (e.g., Y-axis direction) are arranged at regular intervals. At least a portion of the panel support member (117) may form a track and move (or slide) a portion of the display (e.g., second display area (160b)) placed on the track. One side length of the protrusions may correspond to one side length of the display (160). The panel support member (117) may be arranged to wrap around at least a portion of the support structure (114). The plurality of protrusions constituting the panel support member (117) may have a flat surface facing the rear of the display (160), and a portion facing the support structure (114) (e.g., a portion facing the rotation axis (115)) may be formed to protrude. For example, the lower surface of the panel support member (117) (e.g., one surface of the protrusions facing the rotation axis (115)) may have the teeth and grooves of a gear repeatedly formed. Depending on the sliding motion, among the plurality of protrusions constituting the panel support member (117), the protrusions positioned on the upper or lower surface of the support structure (114) may be arranged continuously with other adjacent protrusions to form a flat surface. Among the plurality of protrusions constituting the panel support member (117), the protrusions positioned at the location facing the rotation axis (115) may be arranged spaced apart from adjacent protrusions at a certain distance. The panel support member (117) may include a connecting chain or a connecting axis connecting the plurality of protrusions. At least one of the plurality of protrusions may be made of a material that responds to magnetic force (e.g., a magnetic body (an object that responds to magnetic force to form an attractive force) or a magnet).
[0047] According to one embodiment, the rotation axis (115) (or rolling gear part, or rotation axis member) has a length similar to one side length of the panel support member (117) and may be positioned at one side edge of the support structure (114). For example, the rotation axis (115) may be provided in the shape of a cylindrical rod. The centers of both sides of the rotation axis (115) may be formed to protrude above the periphery. The centers of both sides of the protruding rotation axis (115) may be mounted on one side of the support structure (114). Accordingly, the rotation axis (115) may rotate while the second housing (182) moves in the first direction (e.g., X-axis direction). At least a portion of the rotation axis (115) may be gear-coupled with the panel support member (117). Alternatively, the rotation axis (115) may be in contact with at least a portion of the panel support member (117). While the rotation axis (115) rotates, the arrangement of the panel support member (117) can be changed.
[0048] According to one embodiment, the actuator (112) can generate power by receiving power from a battery included in the electronic device (101). A pinion gear is disposed on one side of the actuator (112), and the pinion gear can perform gear operation on a rack formed on one side of the panel support member (117). Depending on the operation of the actuator (112), the second housing (182) and the display (160) can move in the first direction (e.g., X-axis direction) or the second direction (e.g., -X-axis direction). The actuator (112) is disposed along the length direction (e.g., Y-axis or -Y-axis direction) of the support structure (114), and at least one may be disposed.
[0049] According to one embodiment, at least one piece of hardware (e.g., a printed circuit board (119), a processor, a battery) related to driving the electronic device (101) may be disposed on the inside of the support structure (114). For example, the printed circuit board (119) may be disposed between the support structure (114) and the first housing (181). Electronic components (e.g., a processor, a communication circuit, a memory, a sensor module) for driving the electronic device (101) may be disposed on the printed circuit board (119).
[0050] According to one embodiment, the sliding support member (111) may be fastened to one side of the support structure (114). The sliding support member (111) may be fastened to the second housing (182) so that the second housing (182) and the display (160) can move.
[0051] According to one embodiment, the elastic module (210) can assist the movement of the second housing (182). For example, the elastic module (210) may include a first spring and a second spring that are complementarily combined. A portion of the elastic module (210) may be coupled to a support structure (114). Another portion of the elastic module (210) may be coupled to the second housing (182). Accordingly, when the second housing (182) moves in the first direction (e.g., X-axis direction) up to a designated point, the elastic module (210) can apply an elastic force in the second direction (e.g., -X-axis direction). When the second housing (182) passes the designated point while moving in the first direction (e.g., X-axis direction), the elastic module (210) can apply an elastic force in the first direction (e.g., X-axis direction).
[0052] According to one embodiment, the first housing (181) may include a cover base (181a) comprising a bottom surface on which at least a portion of the support structure (114) is seated and side walls arranged to surround the edges of the support structure (114) (e.g., sides arranged at the ends in the X-axis and -X-axis directions), and a guard member (110) that secures the edges of the support structure (114) (e.g., sides arranged at the ends in the Y-axis and -Y-axis directions). A fastening portion is arranged on the third direction (e.g., Y-axis direction) or the fourth direction (e.g., -Y-axis direction) of the first housing (181), and the guard member (110) may close at least a portion of the third direction (e.g., Y-axis direction) or the fourth direction (e.g., -Y-axis direction) of the first housing (181) by being fastened to the fastening portion. The first direction (e.g., X-axis direction) of the first housing (181) is open, and the second housing (182) can be connected through the first direction (e.g., X-axis direction).
[0053] According to one embodiment, the second housing (182) may be connected to the first housing (181) in the first direction (e.g., X-axis direction). The second housing (182) may include side walls (e.g., side walls positioned in the X-axis direction, Y-axis direction, and -Y-axis direction) that surround some sides of the support structure (114). The second housing (182) may be moved in the first direction (e.g., X-axis direction) or the second direction (e.g., -X-axis direction) while seated on the support structure (114). At this time, the position and arrangement of the second housing (182) may be changed according to the operation of an actuator. Alternatively, the position and arrangement of the second housing (182) may be changed through an external force applied by a user.
[0054] Meanwhile, although the above description describes a structure in which various configurations of the electronic device (101) are arranged, the present invention is not limited thereto. For example, the electronic device (101) according to an embodiment of the present invention includes a display, a first housing surrounding one side of the display, a panel support member disposed on one side of the display, a rotating shaft in contact with the panel support member, and a second housing connected to the first housing, and other configurations may be added or excluded as needed.
[0055] The electronic device (101) described above includes an actuator and can operate to automatically expand or contract the second display area (160b) according to the control of the actuator. Alternatively, the electronic device (101) can manually expand or contract the second display area (160b) by causing the second housing (182) to move in the first direction (e.g., X-axis direction) due to external pressure applied to the second housing (182), and the panel support member (117) and the rotation axis (115) engaged with the second housing (182) to rotate. Alternatively, the rotation axis (115) may be positioned in the second housing (182) and the display (160) may be fixed to the first housing (181), so that the electronic device (101) can expand or contract a portion of the display (160) housed in the second housing (182) according to the movement of the second housing (182).
[0056] FIG. 4 illustrates an exemplary form factor of an electronic device according to various embodiments.
[0057] Referring to FIG. 4, the electronic device (400) (e.g., the electronic device (101) of FIG. 1 to 3) can be modified to have various shapes.
[0058] Referring to FIG. 4(a), an electronic device (400) according to one embodiment may be folded or unfolded with respect to a first axis (401) (e.g., y-axis). For example, the amount of content displayed on the display (430) when the electronic device (400) is in a folded state (411) may be relatively less than the amount of content displayed on the display (430) when the electronic device (400) is in an unfolded state (412).
[0059] Referring to FIG. 4(b), an electronic device (400) according to one embodiment may be folded or unfolded with respect to a second axis (402) (e.g., x-axis). For example, the amount of content displayed on the display (430) when the electronic device (400) is in a folded state (421) may be relatively less than the amount of content displayed on the display (430) when the electronic device (400) is in an unfolded state (422).
[0060] According to one embodiment, when the form factor of the display (430) changes (e.g., fold or unfold) while a user of the electronic device (400) is looking at the content displayed on the display (430), the electronic device (400) may apply visual effects to at least a portion of the content displayed on the display (430) before the form factor changes, or add a user interface (UI) (or indicator) to display on the display (430).
[0061] The embodiments described below with reference to the drawings may be applied in the same or similarly to various form factors of the electronic device described with reference to FIGS. 2 to 4. Furthermore, since the form factors of the electronic device shown in FIGS. 2 to 4 are examples for convenience of explanation, the form factor of the electronic device according to one embodiment is not interpreted as being limited to the forms shown in FIGS. 2 to 4. The embodiments described below may be applied in the same or similarly to various form factors in which the size of the electronic device's display varies, other than the forms shown in FIGS. 2 to 4.
[0062] FIG. 5 is a block diagram of an electronic device according to various embodiments.
[0063] Referring to FIG. 5, an electronic device (500) (e.g., the electronic device (101) of FIG. 1 to 3 or the electronic device (400) of FIG. 4) may include a display (510) in which the display area can be expanded and contracted (e.g., the display module (160) of FIG. 1 to 3 or the display (430) of FIG. 4), a memory (520) (e.g., the memory (130) of FIG. 1), and a processor (530) (e.g., the processor (120) of FIG. 1).
[0064] According to one embodiment, the display (510) may include at least a portion of a flexible area. According to one embodiment, the display (510) may be configured so that the display area can be expanded and contracted. For example, at least a portion of the display (510) may be located inside the electronic device (500) (e.g., rolled and placed within the electronic device), and the display area may be expanded by sliding out by a user, or the display area may be contracted by sliding in. For example, the display (510) may include at least one of a flexible display, a slideable display, a foldable display, or a rollable display.
[0065] According to one embodiment, the display (510) may be reduced so that at least some area is not visually exposed to the outside. For example, the state in which at least some area of the display (510) is reduced may be a first state. For example, the state in which at least some area of the display (510) is reduced may be a folded (or folded) state or a rolled state.
[0066] According to one embodiment, the display (510) may be extended so that at least some of the areas are visually exposed to the outside. For example, the extended state of the display (510) may be a second state. For example, the extended state of the display (510) may be an unfolded (or unrolled) state.
[0067] According to one embodiment, the memory (520) may store at least one program, application, data, or instructions executed by the processor (530). According to one embodiment, the memory (520) may include at least a portion of the memory (130) illustrated in FIG. 1. According to one embodiment, the memory (520) may include information or instructions that enable at least a portion of the operation of the electronic device (500) described below to be performed. According to one embodiment, the memory (520) may include instructions related to a plurality of applications executed by the processor (530).
[0068] According to one embodiment, the processor (530) may display a user interface on the display (510) or scroll an execution screen (e.g., an execution screen of an application) displayed on the display (510) based on a change in the form factor of the electronic device (500). According to one embodiment, the processor (530) may display a user interface on the display (510) or scroll an execution screen displayed on the display (510) based on a change in the size of the display (510).
[0069] According to one embodiment, the processor (530) detects that the size of the display (510) has changed and may display a user interface (e.g., a line, a blinking object) on the display (510) that indicates at least some of the content displayed on the display (510) before the size of the display (510) changed. For example, the content displayed on the display (510) may include at least one of text, an image, or a drawing entered by the user.
[0070] According to one embodiment, based on the extension of the display (510) of the electronic device (500), the processor (530) may display a user interface on the display (510) to distinguish between content displayed on the display (510) before extension and content newly displayed on the display (510) after extension.
[0071] According to one embodiment, based on whether the display (510) of the electronic device (500) is reduced or expanded, the processor (530) may display a user interface on the display (510) that indicates the content the user was looking at among the content displayed on the display (510) before the display (510) was reduced or expanded.
[0072] According to one embodiment, when the display (510) of the electronic device (500) is reduced or expanded, some of the content displayed on the display (510) before the display (510) is reduced or expanded may be hidden from the display area or moved to the upper part of the display area. According to one embodiment, the processor (530) may automatically (or without user input) scroll up or scroll down the execution screen of the display (430) to move some of the content displayed on the display (430) before the reduction or expansion to the lower part of the display (510).
[0073] According to one embodiment, based on the display (510) of the electronic device (500) being reduced or expanded, the processor (530) may display a user interface on the display (510) that points to the last content among the content being input by the user through the display (510). According to one embodiment, after the display (510) is reduced or expanded, the processor (530) may receive user input within a specified distance from the point where the user interface is displayed on the display (510). Based on the received user input, the processor (530) may recognize that the content newly input by the user and the content previously input by the user are related to each other. For example, the processor (530) may connect the content being input by the user before the display (510) is reduced or expanded with the content newly input by the user after the display (510) is reduced or expanded and display it on the display (510). In the following, the operations described as being performed by the electronic device (500) may be referred to as being performed by the processor (530).
[0074] According to one embodiment, the electronic device (500) may display a user interface on the display (510) that represents a portion of the content displayed on the display (510) before the form factor changed, based on a change in the form factor (or a change in the size of the display (510). When the form factor of the electronic device (500) changes while the user of the electronic device (500) is looking at the display (510), the user can easily recognize the content being looked at based on the displayed user interface.
[0075] According to one embodiment, the electronic device (500) may display a user interface on the display (510) that represents the last content among the content entered by the user on the display (510) before the form factor changed, based on a change in the form factor (or the size of the display (510)). According to one embodiment, if the user provides user input to the user interface displayed on the display (510) after the form factor of the electronic device (500) has changed, the electronic device (500) may recognize that the new content to be received from the user is related to the content previously entered by the user on the display (510). According to one embodiment, the electronic device (500) may provide a continuous user experience to the user when the form factor changes. For example, the electronic device (500) may prevent a interruption in the user experience that may occur when the form factor changes.
[0076] FIG. 6 is a diagram illustrating the operation of an electronic device according to various embodiments.
[0077] Referring to FIGS. 6 (a) through (c), an electronic device (600) (e.g., the electronic device (101) of FIGS. 1 through 3 or the electronic device (400) of FIG. 4 or the electronic device (500) of FIG. 5) may include a display (610) (e.g., the display module (160) of FIGS. 1 through 3 or the display (430) of FIG. 4 or the display (510) of FIG. 5).
[0078] FIG. 6(a) illustrates a reduced state of the display (610) of the electronic device (600). In one embodiment, the electronic device (600) can receive a first handwriting input from a user using an external input device (601) (e.g., a digital pen or a stylus pen) while the display (610) is reduced, and can recognize the received first handwriting input. In various embodiments, the electronic device (600) can receive the first handwriting input from the user through a finger touch. For example, the electronic device (600) can receive the first handwriting input from the user through a first touch input. According to one embodiment, the electronic device (600) can display a drawing (630) on the display (610) that includes at least one first stroke corresponding to the recognized first handwriting input. According to one embodiment, the electronic device (600) can recognize a first handwriting input entered by a user using an external input device (601) in stroke units and display it on a display (610). For example, at least one first stroke corresponding to the first handwriting input entered by the user can form a picture (630). For example, the electronic device (600) can display a picture (630) formed based on at least one recognized stroke on the display (610). According to one embodiment, the electronic device (600) can recognize a stroke based on detecting a motion in which the external input device (601) comes off (or is released) from the display (610) after contacting the display (610). In various embodiments, the electronic device (600) can recognize a stroke by dividing the picture (630) corresponding to the first handwriting input entered by the user using the external input device (601) into predetermined pixel units.
[0079] Referring to FIG. 6(a), the electronic device (600) can receive a designated input to expand the display (610) after recognizing the last stroke (631) among at least one first stroke corresponding to the first handwriting input received from the user while the display (610) is in a reduced state.
[0080] FIGS. 6(b) and (c) illustrate an expanded state of the display (610) of the electronic device (600). Referring to FIGS. 6(b), the electronic device (600) according to one embodiment may display a user interface (640) on the display (610) that displays the last stroke (631) recognized in the state before the display was expanded (e.g., a reduced state) after the display (610) is expanded. In various embodiments, the electronic device (600) may apply visual effects to the last stroke (631). For example, the electronic device (600) may change the color of the last stroke (631) so that the last stroke (631) has a different color from the previous stroke. For example, the electronic device (600) may apply a blinking effect to the last stroke (631) so that the last stroke (631) blinks on the display (610).
[0081] Referring to FIG. 6(c), the electronic device (600) can recognize a second handwriting input received within a specified distance from the last stroke (631) after the display (610) is extended. In various embodiments, the electronic device (600) can recognize a second handwriting input received within a specified distance from a point where the user interface (640) is displayed while the display (610) is extended. For example, the electronic device (600) can receive the second handwriting input from the user through a second touch input.
[0082] Referring to FIG. 6(c), the electronic device (600) can recognize a second stroke (632) corresponding to a second handwriting input received from a user when the display (610) is expanded. According to one embodiment, the electronic device (600) can recognize the second stroke (632) corresponding to the second handwriting input received within a specified distance from a point on the display (610) where the last stroke (631) (or user interface (640)) is displayed as being related to the last stroke (631) last recognized when the display (610) is reduced. According to one embodiment, the electronic device (600) can recognize the second stroke (632) corresponding to the second handwriting input received within a specified distance from a point on the display (610) where the last stroke (631) (or user interface (640)) is displayed as being continuous with the last stroke (631) last recognized when the display (610) is reduced.
[0083] An electronic device (600) according to one embodiment may display a second stroke (632) connected to a last stroke (631) on a display (610). For example, the electronic device (600) may move the second stroke (632) so that the starting point of the second stroke (632) is located at the end point of the last stroke (631) (or, the point where the first handwriting input corresponding to the last stroke (631) is released from the display (610). For example, the electronic device (600) may move the second stroke (632) so that at least a part of the second stroke (632) (e.g., the starting point of the second stroke (632)) is displayed at the point where the display of the last stroke (631) on the display (610) ends. For example, the electronic device (600) may generate a third stroke (not shown) so that the third stroke is positioned between the last stroke (631) and the second stroke (632). For example, the third stroke positioned between the last stroke (631) and the second stroke (632) may connect the last stroke (631) and the second stroke (632). The electronic device (600) according to one embodiment may set the attributes of the second stroke (632) to be the same as the attributes of the last stroke (631). The electronic device (600) according to one embodiment may recognize the last stroke (631) and the second stroke (632) as a single stroke. For example, the electronic device (600) may display the last stroke (631) and the second stroke (632) on a display (610) so that they are visually recognized as a single stroke. An example of displaying on a display (610) that the electronic device (600) recognizes the last stroke (631) and the second stroke (632) as one stroke according to one embodiment is described with reference to FIG. 8, which will be described later.
[0084] FIGS. 6 (a) to (c) illustrate, by way of example, a case where the electronic device (600) expands a reduced display (610). The foregoing description may be applied in the same or similar way to a case where the electronic device (600) reduces the expanded display (610).
[0085] FIG. 7 is a diagram illustrating the operation of an electronic device according to various embodiments.
[0086] Referring to FIGS. 7(a) through (c), an electronic device (700) (e.g., the electronic device (101) of FIGS. 1 through 3, the electronic device (400) of FIG. 4, the electronic device (500) of FIG. 5, or the electronic device (600) of FIG. 6) may include a display (710) (e.g., the display module (160) of FIGS. 1 through 3, the display (430) of FIG. 4, the display (510) of FIG. 5, or the display (610) of FIG. 6). FIGS. 7(a) through (c) illustrates either a reduced state or an enlarged state of the display (710) of the electronic device (700).
[0087] Referring to FIG. 7(a), an electronic device (700) according to one embodiment can receive a first handwriting input from a user through a display (710) using an external input device (701) (e.g., a digital pen or a stylus pen) and recognize the received first handwriting input. In various embodiments, the electronic device (700) can receive the first handwriting input from the user through a finger touch. For example, the electronic device (700) can receive the first handwriting input from the user through a first touch input. According to one embodiment, the electronic device (700) can display a drawing (730) on the display (710) that includes at least one first stroke corresponding to the recognized first handwriting input. According to one embodiment, the electronic device (700) can recognize the first handwriting input entered by the user using the external input device (701) in stroke units and display it on the display (710). For example, at least one first stroke corresponding to a first handwriting input entered by a user can form a picture (730). For example, an electronic device (700) can display a picture (730) formed based on at least one recognized stroke on a display (710). As the description of a stroke according to one embodiment has been described above with reference to FIG. 6, redundant descriptions are omitted.
[0088] Referring to FIG. 7(a), the electronic device (700) can receive a designated input (e.g., user's pinch zoom input or user's input using a physical key) that enlarges (e.g., zoom in) the execution screen of an application displayed on the display (710) after recognizing the last stroke (731) among at least one first stroke corresponding to the first handwriting input received from the user.
[0089] FIGS. 7(b) and (c) illustrate, by way of example, a case where the electronic device (700) enlarges the execution screen of an application displayed on the display (710) based on a specified input. According to one embodiment, the electronic device (700) can enlarge (e.g., zoom in) the execution screen of an application displayed on the display (710) based on a specified input. The embodiment described with reference to FIG. 7 may be applied in the same or similar way when the electronic device (700) reduces (e.g., zoom out) the content displayed on the display (710) based on a specified input.
[0090] FIG. 7(b) and (c) illustrate an enlarged state of the content (e.g., picture (730)) included in the execution screen when the execution screen of the application is enlarged based on a specified input. According to one embodiment, the electronic device (700) can enlarge the picture (730) displayed on the display (710) based on a specified input according to a first handwriting input received from a user.
[0091] Referring to FIG. 7(b), an electronic device (700) according to one embodiment may display a user interface (740) on a display (710) that displays the last stroke (731) recognized before the figure (730) was enlarged after the figure (730) has been enlarged. In various embodiments, the electronic device (700) may apply a visual effect to the last stroke (731). For example, the electronic device (700) may change the color of the last stroke (731) so that the last stroke (731) has a different color from the previous stroke. For example, the electronic device (700) may apply a blinking effect to the last stroke (731) so that the last stroke (731) blinks on the display (710).
[0092] Referring to FIG. 7(c), the electronic device (700) can recognize a second handwriting input received within a specified distance from the last stroke (731). According to one embodiment, the electronic device (700) can recognize a second handwriting input received within a specified distance from a point where the user interface (740) is displayed while the figure (730) is magnified. For example, the electronic device (700) can receive the second handwriting input from the user through a second touch input.
[0093] Referring to FIG. 7(c), the electronic device (700) can recognize a second stroke (732) corresponding to a second handwriting input received from a user while the picture (730) is enlarged. According to one embodiment, the electronic device (700) can recognize the second stroke (732) corresponding to the second handwriting input received within a specified distance from a point on the display (710) where the last stroke (731) (or user interface (740)) is displayed as being related to the last stroke (731) last recognized before the picture (730) is enlarged. According to one embodiment, the electronic device (700) can recognize the second stroke (732) corresponding to the second handwriting input received within a specified distance from a point on the display (710) where the last stroke (731) (or user interface (740)) is displayed as being continuous with the last stroke (731) last recognized before the picture (730) is enlarged.
[0094] An electronic device (700) according to one embodiment may display a second stroke (732) connected to a last stroke (731) on a display (710). For example, the electronic device (700) may move the second stroke (732) so that the starting point of the second stroke (732) is located at the end point of the last stroke (731) (or, the point where the first handwriting input corresponding to the last stroke (731) is released from the display (710). For example, the electronic device (700) may move the second stroke (732) so that at least a part of the second stroke (732) (e.g., the starting point of the second stroke (732)) is displayed at the point where the display of the last stroke (731) on the display (710) ends. For example, the electronic device (700) may generate a third stroke (not shown) so that the third stroke is positioned between the last stroke (731) and the second stroke (732). For example, the third stroke positioned between the last stroke (731) and the second stroke (732) may connect the last stroke (731) and the second stroke (732). The electronic device (700) according to one embodiment may set the attributes of the second stroke (732) to be the same as the attributes of the last stroke (731). The electronic device (700) according to one embodiment may recognize the last stroke (731) and the second stroke (732) as a single stroke. For example, the electronic device (700) may display the last stroke (731) and the second stroke (732) on a display (710) so that they are visually recognized as a single stroke. An example in which an electronic device (700) according to one embodiment displays on a display (610) the last stroke (731) and the second stroke (732) as one stroke is described with reference to FIG. 8, which will be described later.
[0095] FIG. 8 illustrates an example in which an electronic device recognizes two or more strokes as related, according to various embodiments.
[0096] FIGS. 8 (a) through (e) illustrate, by way of example, a stroke displayed on a display (e.g., the display module (160) of FIGS. 1 through 3, the display (430) of FIG. 4, the display (510) of FIG. 5, the display (610) of FIG. 6, or the display (710) of FIG. 7) by an electronic device (e.g., the electronic device (101) of FIGS. 1 through 3, the electronic device (400) of FIG. 4, the display (610) of FIG. 6, or the display (710) of FIG. 7) in response to handwriting input received from a user.
[0097] According to one embodiment, FIGS. 8(a) through (e) illustrate, exemplarily, strokes displayed by an electronic device according to different types of pens. For example, FIGS. 8(a) illustrates a fountain pen type stroke. For example, FIGS. 8(b) illustrates a standard pen type stroke. For example, FIGS. 8(c) illustrates a pencil type stroke. For example, FIGS. 8(d) illustrates a brush type stroke. For example, FIGS. 8(e) illustrates a pen with opaque properties (e.g., a highlighter) type stroke. The strokes illustrated in FIGS. 8(a) through (e) are exemplarily illustrated to show differences in pen types. Various embodiments will be described below based on the strokes of FIGS. 8(a) and FIGS. 8(e).
[0098] An electronic device according to one embodiment may recognize a first stroke (811, 821) (e.g., the last stroke (631) of FIG. 6 or the last stroke (631) of FIG. 7) and a second stroke (812, 822) (e.g., the second stroke (632) of FIG. 6 or the second stroke (732) of FIG. 7) as being related to each other based on at least one of a change in the form factor of the electronic device, a change in the size of the display, and / or an enlargement or reduction of the execution screen displayed on the display. For example, the electronic device may recognize the first stroke (811, 821) and the second stroke (812, 822) as being connected to each other as a single stroke based on at least one of a change in the form factor of the electronic device, a change in the size of the display, and / or an enlargement or reduction of the execution screen displayed on the display. For example, the electronic device may display the first stroke and the second stroke on the display so that they are visually recognized as a single stroke.
[0099] Referring to FIG. 8(a), an electronic device according to one embodiment may recognize a first stroke (811) and a second stroke (812) as related. An electronic device according to one embodiment may set the attributes of the first stroke (811) and the attributes of the second stroke (812) to be the same. For example, the attributes of the stroke may include at least one of a pen type, a pen thickness value, and / or a pen color. For example, if the type of the first stroke (811) is the aforementioned fountain pen type, the electronic device may set the type of the second stroke to a fountain pen type and display it on the display. For example, if the thickness value of the first stroke (811) is 10 points, the electronic device may set the thickness value of the second stroke (812) to 10 points, which is the same as the thickness value of the first stroke (811), and display it on the display. For example, if the color of the first stroke (811) is blue, the electronic device can set the color of the second stroke (812) to blue and display it on the display.
[0100] According to the comparative example, the electronic device may perceive the first stroke (811) and the second stroke (812) as unrelated. In this case, the electronic device according to the comparative example may display on the display that the point (815) between the first stroke (811) and the second stroke (812) does not appear visually smooth, thereby allowing the first stroke (811) and the second stroke (812) to be distinguished from each other.
[0101] An electronic device according to one embodiment may recognize a first stroke (811) and a second stroke (812) as related. In this case, the electronic device according to one embodiment may connect the first stroke (811) and the second stroke (812) to appear smooth. For example, the electronic device may connect the first stroke (811) and the second stroke (812) to display a single smooth stroke (817) on the display. According to one embodiment, there may be a point between the first stroke (811) and the second stroke (812) where the user's handwriting input is not recognized. For example, the electronic device may recognize first coordinate information (e.g., x-axis coordinate value and y-axis coordinate value) indicating the end point of the first stroke (811) (or, the point where the first handwriting input corresponding to the first stroke (811) is removed from (or released) from the display). The electronic device may recognize second coordinate information indicating the start point where the second stroke (812) is input to the display (or, the point where the second handwriting input corresponding to the second stroke (812) begins to be input to the display). An electronic device according to one embodiment may compare the recognized first coordinate information and the second coordinate information. If the first coordinate information and the second coordinate information are not the same, the electronic device according to one embodiment may move the second stroke (812) to make the first coordinate information and the second coordinate information the same and display them on the display. If the first coordinate information and the second coordinate information are not the same, the electronic device according to one embodiment may move the first point where the first stroke (811) is removed from (or released) from the display and the second stroke (812) A third stroke (not shown) connecting the second point that has started to be input to the display can be generated.An electronic device according to one embodiment may generate a third stroke (not shown) connecting between a first stroke (811) and a second stroke (812) and add it between the first stroke (811) and the second stroke (812). An electronic device according to one embodiment may visually connect the first stroke (811), the second stroke (812), and the added third stroke smoothly so that they are recognized as a single stroke.
[0102] Referring to FIG. 8(e), the electronic device according to the comparative example can change the opacity of the overlapping point between the strokes so that the first stroke (821) and the second stroke (822) are not related when the stroke type is a pen having the aforementioned opaque properties (e.g., a highlighter type). For example, the electronic device according to the comparative example can change the opacity of at least some overlapping point (825) between the first stroke (821) and the second stroke (822) so that the first stroke (821) and the second stroke (822) are visually recognized as separate strokes rather than a single stroke and display them on the display.
[0103] An electronic device according to one embodiment may recognize a first stroke (821) and a second stroke (822) as related. For example, the electronic device may smoothly connect the first stroke (821) and the second stroke (822) so that they are recognized as a single stroke (827). For example, the electronic device may connect the first stroke (821) and the second stroke (822) to display a single smooth stroke (827) on a display. According to one embodiment, the electronic device may set the opacity of the second stroke (822) to be the same as the opacity of the first stroke (821), and maintain the opacity of at least some overlapping point (825) between the first stroke (821) and the second stroke (822) without changing it (e.g., the opacity of the first stroke (822) or the second stroke).
[0104] According to one embodiment, in the case of a change in form factor, a change in the size of a display, and / or enlargement or reduction of an execution screen displayed on a display, an electronic device recognizes a first stroke and a second stroke, which are input before and after the change respectively, as a single stroke, and displays the recognized single stroke on a display to provide a continuous user experience to the user.
[0105] FIG. 9 is a diagram illustrating the operation of an electronic device according to various embodiments.
[0106] Referring to FIGS. 9 (a) through (c), an electronic device (900) (e.g., electronic device (101) of FIGS. 1 through 3 or electronic device (400) of FIG. 4 or electronic device (500) of FIG. 5 or electronic device (600) of FIG. 6 or electronic device (700) of FIG. 7) may include a display (910) (e.g., display module (160) of FIGS. 1 through 3 or display (430) of FIG. 4 or display (510) of FIG. 5 or display (610) of FIG. 6 or display (710) of FIG. 7).
[0107] FIG. 9(a) illustrates a reduced state of the display (910) of an electronic device (900). An electronic device (900) according to one embodiment may display an application execution screen on the display (910) when the display (910) is in a reduced state. For example, the application execution screen may include a plurality of text data (930). For example, the plurality of text data (930) may include a first text data (931) and a second text data (932). According to one embodiment, the first text data (931) may be text data displayed at the bottom of the plurality of text data (930) displayed on the display (910) when the display (910) is in a reduced state. For example, the first text data (931) may be text data that the user visually perceives last on the reduced state display. For example, the first text data (931) may be text data displayed at the bottom of the reduced display (910). According to one embodiment, the second text data (932) may be text data that is not displayed on the display (910) when the display (910) is in a reduced state. For example, the second text data (932) may be text data that is to be displayed on the display (910) next after the first text data (931) is displayed on the display (910). According to one embodiment, the electronic device (900) may receive a specified input (e.g., user input) that causes the display (910) to expand.
[0108] FIGS. 9(b) and (c) illustrate an expanded state of the display (910) of the electronic device (900). Referring to FIGS. 9(b), the electronic device (900) according to one embodiment may recognize that when the display (910) is expanded, at least some of the plurality of text data (930) that were displayed on the reduced display (910) are not displayed on the display (910). For example, the electronic device (900) may recognize that the first text data (931) that was displayed on the reduced display (910) is not displayed on the expanded display (910). For example, the electronic device (900) may recognize that the first text data (931) that was displayed on the reduced display (910) is hidden so as not to be visually exposed on the expanded display (910). For example, the electronic device (900) can recognize that the first text data (931) is not visually exposed outside the display area of the display (910) based on the display (910) being extended.
[0109] Referring to FIG. 9(c), the electronic device (900) can scroll the execution screen displayed on the display (910) so that the first text data (931) is displayed on the display (910) and visually exposed. According to one embodiment, the electronic device (900) can automatically scroll the execution screen of the application displayed on the display (910) so that the hidden first text data (931) is displayed on the display (910). Referring to FIG. 9(c), the electronic device (900) can further display the second text data (932) on the display (910). According to one embodiment, the electronic device (900) can generate a user interface (950) (or an indicator) (e.g., a separator line) that distinguishes between the first text data (931) that was already displayed on the reduced display (910) and the newly displayed second text data (932). The electronic device (900) can display the generated user interface (950) on the display (910) so as to be positioned between the first text data (931) and the second text data (932).
[0110] According to one embodiment, the electronic device (900) can scroll the execution screen so that the first text data (931) displayed on the display (910) before the form factor (or size of the display (910)) of the electronic device (900) changes is displayed on the display (910) after the form factor of the electronic device (900) changes. The electronic device (900) according to one embodiment can provide a continuous user experience to the user because the user can continuously (or consecutively) visually recognize the first text data (931) before and after the change in the form factor of the electronic device (900).
[0111] According to one embodiment, the electronic device (900) may display a user interface (950) on the display (910) that distinguishes between data already displayed before a change in the form factor of the electronic device (900) (e.g., first text data (931)) and data newly appearing after a change in the form factor (e.g., second text data (932)). Through the displayed user interface (950), the user can determine which data (e.g., first text data (931)) has been visually recognized or which data (e.g., second text data (932)) must be visually recognized, thereby having a continuous user experience.
[0112] FIGS. 10a and FIGS. 10b are drawings illustrating the operation of an electronic device according to various embodiments.
[0113] Referring to FIGS. 10a and 10b, an electronic device (e.g., electronic device (101) of FIGS. 1 to 3 or electronic device (400) of FIG. 4 or electronic device (500) of FIG. 5 or electronic device (600) of FIG. 6 or electronic device (700) of FIG. 7 or electronic device (900) of FIG. 9) can display an application execution screen (e.g., news application) on a display (e.g., display module (160) of FIGS. 1 to 3 or display (430) of FIG. 4 or display (510) of FIG. 5 or display (610) of FIG. 6 or display (710) of FIG. 7 or display (910) of FIG. 9).
[0114] FIG. 10a illustrates a case where an electronic device according to one embodiment expands a reduced display. FIG. 10a(a) illustrates an execution screen of an application displayed on the reduced display of an electronic device according to one embodiment. According to one embodiment, the reduced display may display a plurality of contents (1010, 1020, 1030). For example, the reduced display may display a first content (1010), a second content (1020), and a third content (1030). According to one embodiment, the electronic device may receive a designated input (e.g., user input) that causes the display to expand.
[0115] FIG. 10a(b) illustrates an application execution screen displayed on an expanded display of an electronic device according to one embodiment. According to one embodiment, the electronic device may expand the display based on a specified input. The expanded display may display a greater amount of content than the content displayed on the reduced display. According to one embodiment, the electronic device may scroll the application execution screen so that some of the content (e.g., third content (1030)) among the plurality of contents (1010, 1020, 1030) displayed before the display is expanded is located at the bottom part of the screen area of the display. According to one embodiment, the electronic device may scroll the application execution screen so that the third content (1030) among the plurality of contents (1010, 1020, 1030) displayed on the display before the size of the display is changed is located at the end of the screen area after the size of the display is changed. For example, the third content (1030) may be the content displayed at the bottom of the display area of the display among the multiple contents (1010, 1020, 1030) displayed before the size of the display changes. For example, the third content (1030) may be the content that the user perceiving the display last visually perceives.
[0116] According to one embodiment, when the electronic device expands the display after the user has visually recognized all content displayed on the reduced display, the electronic device may position the content last recognized by the user among the previously displayed content (e.g., third content (1030)) at the bottom of the display area of the expanded display. For example, the electronic device may position the content last recognized by the user (e.g., third content (1030)) at the very bottom of the display area of the expanded display. A user of the electronic device according to one embodiment can determine which content (e.g., third content (1030)) has been visually recognized, even after the size of the display has changed, because the content last recognized before the size of the display (e.g., third content (1030)) is located at the bottom of the display. The electronic device according to one embodiment may provide a continuous user experience to the user when the display changes from a reduced state to an expanded state.
[0117] FIG. 10b illustrates a case where an electronic device according to one embodiment shrinks an expanded display. FIG. 10b(a) illustrates an execution screen of an application displayed on an expanded display of an electronic device according to one embodiment. According to one embodiment, the expanded display may display a plurality of contents (1010, 1020, 1030). For example, the shrinking display may display a first content (1010), a second content (1020), and a third content (1030). According to one embodiment, the electronic device may receive a specified input (e.g., user input) that causes the display to shrink.
[0118] FIG. 10b(b) illustrates an execution screen of an application displayed on a reduced display of an electronic device according to one embodiment. According to one embodiment, the electronic device may reduce the display based on a specified input. The reduced display may display a smaller amount of content than the content displayed on the expanded display before reduction. The electronic device according to one embodiment may scroll the execution screen of the application so that some of the content (e.g., third content (1030)) among the plurality of contents (1010, 1020, 1030) displayed before the display is reduced is located at the bottom part of the screen area of the display. For example, the third content (1030) may be the content displayed at the bottom part of the display area among the plurality of contents (1010, 1020, 1030) displayed before the size of the display is changed. For example, the third content (1030) may be the content that is last visually perceived by the user perceiving the display.
[0119] According to one embodiment, when the electronic device reduces the display after the user has visually recognized all content displayed on the expanded display, the electronic device may position the content that the user last recognized among the previously displayed content (e.g., third content (1030)) at the bottom of the display area of the reduced display. For example, the electronic device may position the content that the user last recognized (e.g., third content (1030)) at the very bottom of the display area of the reduced display. The user of the electronic device according to one embodiment can determine which content (e.g., third content (1030)) has been visually recognized, since the content that the user last recognized before the display size change (e.g., third content (1030)) is located at the bottom of the display even after the display size has changed. The electronic device according to one embodiment may provide a continuous user experience to the user when the display changes from an expanded state to a reduced state.
[0120] FIG. 11 is a drawing illustrating the operation of an electronic device according to various embodiments.
[0121] Referring to FIG. 11, an electronic device (e.g., the electronic device (101) of FIG. 1 to 3 or the electronic device (400) of FIG. 4 or the electronic device (500) of FIG. 5 or the electronic device (600) of FIG. 6 or the electronic device (700) of FIG. 7 or the electronic device (900) of FIG. 9) can display an application execution screen (e.g., a gallery application) on a display (e.g., the display module (160) of FIG. 1 to 3 or the display (430) of FIG. 4 or the display (510) of FIG. 5 or the display (610) of FIG. 6 or the display (710) of FIG. 7 or the display (910) of FIG. 9).
[0122] FIG. 11(a) illustrates an execution screen of an application configured as a first layout on a display of an electronic device according to one embodiment. For example, the electronic device may display a plurality of thumbnail images (1110) as the first layout on the display. For example, the plurality of thumbnail images (1110) may include a first thumbnail image (1111). For example, the first thumbnail image (1111) may be a thumbnail image located last among the plurality of thumbnail images displayed as the first layout. For example, the first thumbnail image (1111) may be the thumbnail image that the user perceiving the display visually perceives last. According to one embodiment, the electronic device may receive user input to change the execution screen of the application to a layout different from the first layout.
[0123] FIG. 11(b) illustrates an execution screen of an application configured with a second layout on a display of an electronic device according to one embodiment. For example, the electronic device may display an execution screen of an application that was displayed in a first layout on the display in a second layout based on user input that changes the layout. According to one embodiment, the electronic device may display a plurality of thumbnail images (1110) that were displayed on the first layout and a plurality of thumbnail images (1120) that are newly displayed on the second layout on the display. According to one embodiment, the electronic device may recognize a plurality of thumbnail images (1120) that are newly displayed on the second layout based on a first thumbnail image (1111). According to one embodiment, the electronic device may apply a visual effect to a plurality of thumbnail images (1110) that have already been displayed for a specified time (e.g., N seconds). For example, the electronic device can dim a plurality of thumbnail images (1110) for a specified time to distinguish them from a newly displayed plurality of thumbnail images (1120).
[0124] FIG. 11(c) illustrates an execution screen of an application configured as a second layout on a display of an electronic device according to one embodiment. For example, the electronic device may display an execution screen of an application that was displayed in a first layout on the display as a second layout based on user input that changes the layout. According to one embodiment, the electronic device may recognize a plurality of thumbnail images (1120) newly displayed on the second layout based on a first thumbnail image (1111). According to one embodiment, the electronic device may generate a user interface (1130) (e.g., a separator line) that distinguishes between a plurality of thumbnail images (1110) displayed on the first layout and a plurality of thumbnail images (1120) newly displayed on the second layout. An electronic device according to one embodiment may display a generated user interface (1130) on a display such that it is positioned between a plurality of thumbnail images (1110) that were displayed on a first layout and a plurality of thumbnail images (1120) newly displayed on a second layout.
[0125] FIG. 11(d) illustrates an execution screen of an application configured as a second layout on a display of an electronic device according to one embodiment. For example, the electronic device may display an execution screen of an application that was previously displayed in a first layout on the display as a second layout based on user input that changes the layout. According to one embodiment, the electronic device may recognize a second thumbnail image (1121) that is displayed first among a plurality of thumbnail images (1120) newly displayed on the second layout based on a first thumbnail image (1111). According to one embodiment, the electronic device may apply a visual effect to the second thumbnail image (1121) for a specified time (e.g., N seconds, where N is a positive number). For example, the electronic device may apply a blinking effect to the second thumbnail image (1121) to make it blink for a specified time, thereby allowing the user to easily recognize the plurality of thumbnail images (1120) newly displayed.
[0126] According to one embodiment, when content (e.g., thumbnails) displayed on a display changes based on a change in layout, the electronic device may display various visual effects or user interfaces on the display to distinguish between newly displayed content (e.g., a plurality of newly displayed thumbnail images (1120)) and previously displayed content (e.g., a plurality of thumbnail images (1110)). A user of the electronic device according to one embodiment can use the various visual effects or user interfaces to determine which content (e.g., a plurality of thumbnail images (1110)) has been visually recognized or which content (e.g., a plurality of newly displayed thumbnail images (1120)) should be visually recognized first, thereby having a continuous user experience.
[0127] An electronic device according to one embodiment of the present disclosure (e.g., electronic device (101) of FIGS. 1 to 3 or electronic device (400) of FIG. 4 or electronic device (500) of FIG. 5 or electronic device (600) of FIG. 6 or electronic device (700) of FIG. 7 or electronic device (900) of FIG. 9 or electronic device described with reference to FIG. 10a to 10b or electronic device described with reference to FIG. 11) comprises an expandable and contractible display (e.g., display module (160) of FIG. 1 to 3 or display (430) of FIG. 4 or display (510) of FIG. 5 or display (610) of FIG. 6 or display (710) of FIG. 7 or display (910) of FIG. 9), a memory (e.g., memory (130) of FIG. 1 or memory (520)) and said display, and a processor operatively connected to said memory (e.g., of FIG. 1 It may include a processor (120) or a processor (530) of FIG. 5. According to one embodiment, the memory may include instructions such that, when executed, the processor recognizes a first handwriting input received from a user through the display in a reduced state, displays at least one first stroke corresponding to the received first handwriting input on the display in the reduced state, changes the display to an expanded state based on a specified input, displays a first user interface indicating the last stroke of the at least one first stroke when the display is in an expanded state, and when the display is in an expanded state, if a second handwriting input is received from the user within a specified distance from the point where the first user interface is displayed, recognizes a second stroke corresponding to the second handwriting input as being related to the last stroke of the at least one first stroke, and connects the second stroke to the last stroke and displays it on the expanded display.
[0128] According to one embodiment, the instructions may cause the processor to set the attributes of the second stroke to be the same as the attributes of the last stroke among the at least one first stroke.
[0129] According to one embodiment, the attribute may include at least one of the type of pen, the thickness value of the pen, or the color of the pen.
[0130] According to one embodiment, the instructions may cause the processor to move the second stroke such that at least a portion of the second stroke is displayed at the point where the input of the last stroke ends.
[0131] According to one embodiment, the instructions may cause the processor to recognize the second stroke and the last stroke as one stroke, and to display the recognized one stroke on the extended display.
[0132] According to one embodiment, the instructions may cause the processor to add a third stroke having the same properties as the last stroke between the last stroke and the second stroke and display it on the extended display.
[0133] According to one embodiment, the instructions may display a second user interface configured to distinguish between the first text data and the second text data additionally displayed on the expanded state display when the processor displays the first text data on the reduced state display and changes the display to the expanded state based on the specified input.
[0134] According to one embodiment, the instructions may cause the processor to display an execution screen containing at least one piece of content on the display in a reduced state, and to scroll the execution screen of the display so that if at least some of the content displayed on the display in the reduced state is not displayed on the display in an expanded state, the at least some of the content is displayed on the display in an expanded state.
[0135] According to one embodiment, the instructions may cause the processor to scroll the execution screen so that at least some content is located at the bottom part of the display area of the extended state of the display.
[0136] According to one embodiment, the instructions may cause the processor to change the color of the last stroke or apply a visual effect including a blinking effect to the last stroke.
[0137] FIG. 12 is a flowchart of a method of operation of an electronic device including a display in which the display area can be expanded and contracted according to various embodiments.
[0138] According to one embodiment, in operation 1210, an electronic device (e.g., electronic device (101) of FIGS. 1 to 3 or electronic device (400) of FIG. 4 or electronic device (500) of FIG. 5 or electronic device (600) of FIG. 6 or electronic device (700) of FIG. 7 or electronic device (900) of FIG. 9) can recognize a first handwriting input received from a user through a reduced display (e.g., display module (160) of FIGS. 1 to 3 or display (430) of FIG. 4 or display (510) of FIG. 5 or display (610) of FIG. 6 or display (710) of FIG. 7 or display (910) of FIG. 9). For example, the electronic device may receive a first handwriting input for a user to input a picture or text on a display using at least one of an external input device (e.g., the external input device (601) of FIG. 6 or the external input device (701) of FIG. 7) or a finger touch, and may recognize the received first handwriting input.
[0139] According to one embodiment, in operation 1220, the electronic device may display at least one first stroke corresponding to the recognized first handwriting input on a reduced display. According to one embodiment, the electronic device may recognize the recognized first handwriting input in stroke units. For example, the electronic device may display at least one first stroke corresponding to the recognized first handwriting input on a reduced display. According to one embodiment, the electronic device may display a picture or text composed of at least one first stroke on the display. For example, the picture or text displayed on the display may include at least one first stroke recognized by the electronic device.
[0140] According to one embodiment, in operation 1230, the electronic device may extend the display based on a specified input (e.g., user input). For example, the specified input may include a press input using a physical key or a button input. For example, the specified input may include physical force provided by the user.
[0141] According to one embodiment, in operation 1240, the electronic device may display a first user interface indicating the last stroke of at least one first stroke when the display is in an expanded state. According to one embodiment, the electronic device may display a first user interface indicating the last stroke of at least one first stroke (e.g., the last stroke (631) of FIG. 6 or the last stroke (731) of FIG. 7) when the display is in a reduced state.
[0142] According to one embodiment, in operation 1250, when the electronic device receives a second handwriting input within a specified distance from a point where the first user interface is displayed while the display is extended, it may recognize a second stroke corresponding to the second handwriting input as being associated with the last stroke of at least one first stroke. According to one embodiment, the electronic device may set the attributes of the last stroke of at least one first stroke and the attributes of the second stroke to be the same. For example, the attributes of the stroke may include at least one of a pen type, a pen thickness value, and / or a pen color. According to one embodiment, the electronic device may recognize the last stroke of at least one first stroke and the second stroke as a single stroke.
[0143] According to one embodiment, in operation 1260, the electronic device may display a second stroke connected to the last stroke on an extended display. According to one embodiment, the electronic device may connect the last stroke of at least one first stroke and the second stroke so as to appear smooth. According to one embodiment, the electronic device may display a recognized single stroke on a display so that it is visually recognized as one. According to one embodiment, when the form factor of the electronic device or the size of the display changes, the electronic device may display the strokes input before and after the change, respectively, on a display so that they are recognized as one stroke, thereby providing a continuous user experience to the user.
[0144] A method of operation of an electronic device (e.g., electronic device (101) of FIGS. 1 to 3, electronic device (400) of FIGS. 4, electronic device (500) of FIGS. 5, electronic device (700) of FIGS. 7, electronic device (900) of FIGS. 9, or electronic device described with reference to FIGS. 10a to 10b or electronic device described with reference to FIGS. 11 to 12) comprising a retractable or expandable display (e.g., display module (160) of FIGS. 1 to 3 or display (430) of FIGS. 4 or display (510) of FIGS. 5 or display (510) of FIGS. 6 or display (710) of FIGS. 7 or display (710) of FIGS. 9 or electronic device described with reference to FIGS. 10a to 10b or electronic device described with reference to FIGS. 11 to 12) according to one embodiment of the present disclosure comprises the operation of recognizing a first handwriting input received from a user through the display in a retracted state, and on the display in the retracted state, the received first handwriting input The method may include an operation of displaying at least one corresponding first stroke, an operation of expanding the display based on a specified input, an operation of displaying a first user interface indicating the last stroke among the at least one first stroke while the display is expanded, an operation of recognizing a second stroke corresponding to the second handwriting input as being related to the last stroke among the at least one first stroke when a second handwriting input is received within a specified distance from the point where the first user interface is displayed while the display is expanded, and an operation of connecting the second stroke to the last stroke and displaying it on the expanded display.
[0145] According to one embodiment, the operation recognized as related may include an operation of setting the attribute of the second stroke to be the same as the attribute of the last stroke among the at least one first stroke.
[0146] According to one embodiment, the attribute may include at least one of the type of pen, the thickness value of the pen, or the color of the pen.
[0147] According to one embodiment, the operation of connecting the second stroke to the last stroke and displaying it on the extended display may include the operation of moving the second stroke so that at least a portion of the second stroke is displayed at the point where the input of the last stroke ends.
[0148] According to one embodiment, the operation of recognizing as related includes the operation of recognizing the last stroke and the second stroke as one stroke, and the operation of connecting the second stroke with the last stroke and displaying it on the extended display may include the operation of displaying the recognized single stroke on the extended display.
[0149] According to one embodiment, the operation of connecting the second stroke to the last stroke and displaying it on the extended display may include the operation of adding a third stroke having the same properties as the last stroke between the last stroke and the second stroke and displaying it on the extended display.
[0150] According to one embodiment, the operation method may further include an operation of displaying first text data on the display in the reduced state and, when the display is changed to the expanded state based on the specified input, an operation of displaying a second user interface configured to distinguish between the first text data and second text data additionally displayed on the display in the expanded state.
[0151] According to one embodiment, the operation method may further include an operation of displaying an execution screen containing at least one content on the display in the reduced state, and an operation of scrolling the execution screen so that, if at least some of the content displayed on the display in the reduced state is not displayed when the display is expanded, the at least some content is displayed on the display in the expanded state.
[0152] According to one embodiment, the scrolling operation may include the operation of scrolling the execution screen so that at least some content is located at the bottom part of the display area of the extended state of the display.
[0153] According to one embodiment, the operation method may further include at least one of an operation to change the color of the last stroke or an operation to apply a visual effect including a blinking effect to the last stroke.
[0154] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0155] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0156] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0157] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0158] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0159] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
Claim 1 In an electronic device, a display supporting a first state and a second state, wherein the first state includes one of an expanded state and a contracted state, and the second state includes the other of the expanded state and the contracted state; memory;and includes at least one processor operatively connected to the display and the memory, wherein the memory, when executed by the at least one processor, the electronic device comprises instructions such that while the display is in the first state: display at least one first stroke corresponding to a first handwriting input received through the display, and based on an input detected while the at least one first stroke is displayed, change the display to the second state while maintaining the display of the at least one first stroke, and while the state of the display is in the second state: display a first user interface on a portion corresponding to the last stroke of the at least one first stroke, and while the at least one first stroke and the first user interface are displayed, display at least one second stroke corresponding to a second handwriting input received through the display, wherein if the second handwriting input is received within a specified distance from the point where the first user interface is displayed, the portion of the second stroke is connected to the last stroke and displayed, and the instructions comprise the at least one An electronic device that, when executed by a processor, connects a portion of the second stroke to the last stroke, wherein if the attribute of at least one first stroke has a first attribute value and the attribute of at least one second stroke has a second attribute value different from the first attribute value, the attribute for the portion of the second stroke is set to the first attribute value to connect it to the last stroke. Claim 2 delete Claim 3 An electronic device according to claim 1, wherein the attribute comprises at least one of a type of pen, a pen thickness value, or a pen color. Claim 4 An electronic device according to claim 1, wherein, when the instructions are executed by the at least one processor, the electronic device moves the second stroke such that a part of the second stroke is displayed at the point where the input of the last stroke ends, when the second handwriting input is received within a specified distance from the point where the first user interface is displayed. Claim 5 An electronic device according to claim 1, wherein, when the instructions are executed by the at least one processor, the electronic device indicates the second stroke and the at least one first stroke as one stroke. Claim 6 An electronic device according to claim 1, wherein, when the instructions are executed by the at least one processor, the electronic device adds a third stroke having the first attribute value between the last stroke and the part of the second stroke in connecting the part of the second stroke to the last stroke. Claim 7 An electronic device according to claim 1, wherein, when the instructions are executed by the at least one processor, the electronic device displays a first text data while the state of the display is the first state, and displays a second user interface configured to distinguish between the first text data and the second text data additionally displayed on the display while the state of the display is the second state. Claim 8 An electronic device according to claim 1, wherein, when the instructions are executed by the at least one processor, the electronic device displays an execution screen containing at least one content while the state of the display is the first state, and scrolls the execution screen so that at least some content is displayed on the display when the display changes to the second state. Claim 9 In claim 8, the electronic device, when the instructions are executed by the at least one processor, causes the electronic device to scroll the execution screen such that at least some content is located at the bottom part of the display area of the display in the second state. Claim 10 An electronic device according to claim 1, wherein, when the instructions are executed by the at least one processor, the electronic device changes the color of the last stroke or applies a visual effect including a blinking effect to the last stroke when displaying the first user interface. Claim 11 A method of operation of an electronic device comprising a display that supports a first state which is one of an expanded state and a contracted state, and a second state which is the other of the expanded state and the contracted state, wherein while the display is in the first state: an operation of displaying at least one first stroke corresponding to a first handwriting input received through the display; and based on an input detected while the at least one first stroke is displayed, an operation of expanding the display to the second state while maintaining the display of the at least one first stroke, wherein while the state of the display is in the second state: an operation of displaying a first user interface on a portion corresponding to the last stroke of the at least one first stroke; and while the at least one first stroke and the first user interface are displayed, an operation of displaying at least one second stroke corresponding to a second handwriting input received through the display, wherein if the second handwriting input is received within a specified distance from the point where the first user interface is displayed, an operation of connecting and displaying a portion of the second stroke with the last stroke, wherein the operation of connecting and displaying a portion of the second stroke with the last stroke is such that the attribute of the at least one first stroke A method of operation of an electronic device comprising, if the attribute of at least one second stroke has a first attribute value and the attribute of the second stroke has a second attribute value different from the first attribute value, setting the attribute for a part of the second stroke to the first attribute value and connecting it to the last stroke. Claim 12 delete Claim 13 In claim 11, the above attribute comprises at least one of a type of pen, a pen thickness value, or a pen color, a method of operation of an electronic device. Claim 14 A method of operation of an electronic device according to claim 11, wherein when the second handwriting input is received within a specified distance from a point where the first user interface is displayed, the second stroke is moved such that a part of the second stroke is displayed at the point where the input of the last stroke ends. Claim 15 A method of operation of an electronic device according to claim 11, comprising an operation of representing at least one first stroke and the second stroke as one stroke. Claim 16 A method of operation of an electronic device according to claim 11, comprising the operation of adding a third stroke having the first attribute value between the last stroke and the second stroke. Claim 17 A method of operation of an electronic device according to claim 11, further comprising: an operation of displaying first text data while the state of the display is the first state; and an operation of displaying a second user interface configured to distinguish between second text data additionally displayed on the display and the first text data while the state of the display is the second state. Claim 18 A method of operation of an electronic device according to claim 11, further comprising: an operation of displaying an execution screen containing at least one content while the state of the display is the first state; and an operation of scrolling the execution screen so that at least some content is displayed on the display when at least some content is not displayed as the display changes to the second state. Claim 19 A method of operation of an electronic device according to claim 18, comprising the operation of scrolling the execution screen so that at least some of the content is located at the bottom part of the display area of the display in the second state. Claim 20 A method of operation of an electronic device according to claim 11, wherein the operation of displaying the first user interface further includes at least one of the operation of changing the color of the last stroke or the operation of applying a visual effect including a blinking effect to the last stroke.
Citation Information
Patent Citations
Mobile device and flexible display device
KR1020170090295A
Electronic device and method for handwriting
US20160154769A1
Information processing device, information processing method and program
WO2014147712A1
