Method for correcting user input according to sliding operation of display and electronic device supporting same
The electronic device addresses input accuracy issues by detecting sliding events and correcting user input coordinates in real-time, ensuring consistent input recognition across varying display sizes, thus enhancing usability on flexible display devices.
Patent Information
- Application Number
- PCT/KR2024/006982
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-16
- Filing Date
- 2024-05-23
- Publication Date
- 2024-12-05
AI Technical Summary
Electronic devices with flexible displays, such as rollable or slideable devices, face challenges in maintaining input accuracy and usability due to changes in display size during sliding operations, leading to inconsistencies in user input recognition.
An electronic device with a flexible display that includes a method to detect sliding events and correct user input coordinates in real-time, ensuring consistent input recognition across varying display sizes by adjusting the input area accordingly.
This solution enhances user usability and convenience by accurately processing user inputs even during sliding operations, maintaining consistency and improving the overall user experience on devices with changing display sizes.
Smart Images

Figure KR2024006982_05122024_PF_FP_ABST
Abstract
Description
Method for compensating user input based on slide motion of display and electronic device supporting same
[0001] Embodiments of the present disclosure provide an electronic device having a flexible display (e.g., a rollable display or a slidable display) and a method of operating the same.
[0002] With the advancement of digital technology, various types of electronic devices, such as mobile terminals, personal digital assistants (PDAs), electronic notebooks, smart phones, tablet PCs (personal computers), wearable devices, laptop PCs, and / or display devices (e.g., TVs and / or monitors), are becoming widely used. The hardware and / or software components of these electronic devices are continuously being developed to support and enhance their functionality.
[0003] Electronic devices can have limited sizes for portability, which in turn limits the size of their displays. Consequently, various forms of electronic devices offering expanded screens are being developed. For example, electronic devices are gradually increasing in size from limited displays, and are being designed to provide users with a variety of services (or functions) through larger displays.
[0004] Recent electronic devices may have new form factors, such as rollable devices (or slidable devices) and / or foldable and slideable hybrid devices. For example, the electronic device may include a flexible display (e.g., a rollable display or a slidable display), and at least a portion of the display may be rolled up or unfolded for use. For example, the electronic device may be implemented so that the screen can be expanded or contracted in a sliding manner. For example, a portion of the flexible display may be slidably pulled out from or into the interior space of the electronic device, thereby causing the screen to expand or contract.
[0005] As electronic devices evolve into new form factors, the need for development of corresponding user interfaces (UIs) and their operation is increasing.
[0006] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.
[0007] In one embodiment of the present disclosure, a method for correcting a user input (e.g., touch) in an electronic device (e.g., a rollable device or a slideable device) including a flexible display (e.g., a rollable display or a slideable display) and an electronic device supporting the same are provided.
[0008] In one embodiment of the present disclosure, a method for compensating a user input (e.g., a touch) according to a state change (e.g., a slide action) such as an increase (or expansion) of a display area size of a display (e.g., slide out or roll out) or a decrease (or reduction) of an area size of a display (e.g., slide in or roll in) in an electronic device including a flexible display, and an electronic device supporting the same are provided.
[0009] In one embodiment of the present disclosure, in a situation where a user input and a slide motion (e.g., a slide in / out motion of a display) occur simultaneously in an electronic device (e.g., a touch occurs during a slide in / out motion, or a slide in / out occurs during a touch motion), a method for correcting a user input to match a slide motion and an electronic device supporting the same are provided.
[0010] In one embodiment of the present disclosure, in an electronic device in which a user's input area can change according to a sliding motion of a display, a method for correcting the position of a user input and the position of a screen in real time to resolve a consistency problem that may occur when the input area changes due to a sliding event is provided, and an electronic device supporting the same.
[0011] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.
[0012] An electronic device according to one embodiment of the present disclosure may include a first housing, a second housing arranged to slide in a designated direction from the first housing, a display having a first display area and a second display area extending from the first display area according to a change in state according to the sliding movement of the second housing, processing circuitry, at least one processor operatively connected to the display, and a memory storing instructions and operatively connected to the at least one processor.
[0013] According to one embodiment, the memory may include instructions that, when executed by the at least one processor, cause the electronic device to display an execution screen of an application in a specified state of the display. According to one embodiment, the memory may include instructions that, when executed by the at least one processor, cause the electronic device to display an input area through the execution screen. According to one embodiment, the memory may include instructions that, when executed by the at least one processor, cause the electronic device to detect a sliding event in which a size of a display area of the display is changed by a sliding motion of the display while displaying the input area through the execution screen. According to one embodiment, the memory may include instructions that, when executed by the at least one processor, cause the electronic device to correct input coordinates related to a user input of the input area based on a size of the display area that changes according to a slide state, based on detection of the sliding event. According to one embodiment, the memory may include instructions that, when executed by the at least one processor, cause the electronic device to process the user input based on the calibrated input coordinates.
[0014] An electronic device according to one embodiment of the present disclosure may include a display having a first display area and a second display area extending from the first display area. A method of operating the electronic device according to one embodiment of the present disclosure may include an operation of displaying an execution screen of an application in a specified state of the display. According to one embodiment, the method may include an operation of displaying an input area through the execution screen. According to one embodiment, the method may include an operation of detecting a sliding event in which a size of a display area of the display is changed by a sliding operation of the display while the input area is displayed through the execution screen. According to one embodiment, the method may include an operation of correcting an input coordinate related to a user input of the input area based on a size of the display area that changes according to a slide state based on detection of the sliding event. According to one embodiment, the method may include an operation of processing the user input based on the corrected input coordinate.
[0015] In order to solve the above-described problem, various embodiments of the present disclosure may include a computer-readable recording medium having recorded thereon a program for executing the method on a processor.
[0016] According to one embodiment, a non-transitory computer-readable recording medium (or storage medium or computer program product) storing one or more programs is described. According to one embodiment, the one or more programs may include instructions that, when executed by a processor of an electronic device, perform an operation of displaying an execution screen of an application in a specified state of the display, an operation of displaying an input area through the execution screen, an operation of detecting a sliding event in which a size of a display area of the display is changed by a slide operation of the display while the input area is displayed through the execution screen, an operation of correcting an input coordinate related to the user input of the input area based on the size of the display area that changes according to the slide state based on detection of the sliding event, and an operation of processing the user input based on the corrected input coordinate.
[0017] Further scope of the applicability of the present disclosure will become apparent from the detailed description below. However, since various modifications and variations within the spirit and scope of the present disclosure will readily become apparent to those skilled in the art, it should be understood that the detailed description and specific examples, such as preferred embodiments of the present disclosure, are given by way of example only.
[0018] According to an embodiment of the present disclosure, an electronic device, an operating method thereof, and a recording medium thereof, in an electronic device (e.g., a rollable device or a slideable device) including a flexible display (e.g., a rollable display or a slideable display), a user input (e.g., a touch) can be adaptively corrected in response to a change in the state of the electronic device (e.g., a change in the size of a display area due to a slide operation). According to an embodiment of the present disclosure, in a situation where a user input (e.g., a touch input) and a slide operation (e.g., a slide in / out operation of a display) by a user occur simultaneously in the electronic device (e.g., a touch occurs during a slide in / out operation, or a slide in / out occurs during a touch operation), input coordinates (e.g., touch coordinates) can be corrected so that the user input (e.g., a touch) is recognized and related information is displayed as the user intends.
[0019] According to one embodiment of the present disclosure, in an electronic device in which a user input area can change according to a sliding motion of a display, the position of the user input and the position of the screen can be corrected in real time to resolve consistency issues that may arise when the input area changes due to a sliding event, thereby enhancing user usability. According to one embodiment of the present disclosure, the usability and convenience of the electronic device can be improved by supporting correction for user input that is adaptive to changes in the state of the electronic device.
[0020] In addition, various effects may be directly or indirectly realized through this document. The effects obtained through this disclosure are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains, based on the description below.
[0021] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0022] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.
[0023] FIGS. 2A and 2B are drawings illustrating the front and back of an electronic device in a closed state having a form factor according to one embodiment.
[0024] FIGS. 2C and 2D are drawings illustrating the front and back of an electronic device in an open state having a form factor according to one embodiment.
[0025] FIGS. 3A and 3B are drawings illustrating the front and back of an electronic device in a closed state having a form factor according to one embodiment.
[0026] FIGS. 3C and 3D are drawings illustrating the front and back of an electronic device in an open state having a form factor according to one embodiment.
[0027] FIG. 4 is an exploded perspective view of an electronic device having a form factor according to one embodiment.
[0028] FIGS. 5A, 5B, 5C, 5D, 5E, 5F, and 5G are drawings illustrating various examples of the structure of an expandable display of an electronic device according to one embodiment.
[0029] FIG. 6 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0030] FIG. 7 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.
[0031] FIG. 8 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.
[0032] FIG. 9 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.
[0033] FIGS. 10A and 10B are diagrams illustrating an example of an operation for processing user input in an electronic device according to one embodiment of the present disclosure.
[0034] FIGS. 11A and 11B are diagrams illustrating an example of an operation for processing user input in an electronic device according to one embodiment of the present disclosure.
[0035] FIGS. 12A, 12B, 12C, and 12D are diagrams illustrating operational examples of user input processing in an electronic device according to one embodiment of the present disclosure.
[0036] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.
[0037] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.
[0038] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0039] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor (123) (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0040] The auxiliary processor (123) may control at least a part of functions or states related to at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0041] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0042] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (OS) (142), middleware (144), or an application (146).
[0043] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0044] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0045] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0046] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0047] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0048] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0049] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0050] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0051] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0052] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).
[0053] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0054] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0055] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB, enhanced mobile broadband), minimizing terminal power and connecting multiple terminals (mMTC, massive machine type communications), or high reliability and low latency communications (URLLC, ultra-reliable and low-latency communications). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0056] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0057] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
[0058] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0059] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0060] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0061] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0062] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0063] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0064] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0065] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0066] FIGS. 2A and 2B are drawings illustrating the front and back of an electronic device in a closed state having a form factor according to one embodiment. FIGS. 2C and 2D are drawings illustrating the front and back of an electronic device in an open state having a form factor according to one embodiment.
[0067] The electronic device (200) of FIGS. 2A to 2D may be at least partially similar to the electronic device (101) of FIG. 1, may include the electronic device (101) of FIG. 1, or may further include other embodiments of the electronic device (101) of FIG. 1.
[0068] Referring to FIGS. 2A to 2D , the electronic device (200) may include a first housing (210) (e.g., a first housing structure or a base housing), a second housing (220) (e.g., a second housing structure or a slide housing), and a flexible display (230) (e.g., an expandable display) arranged to be supported by at least a portion of the first housing (210) and the second housing (220). According to one embodiment, the first housing (210) may be coupled to the second housing (220) so as to be movable (e.g., slidable) in a specified direction (e.g., in the x-axis direction) and a specified reciprocating distance.
[0069] According to one embodiment, the electronic device (200) may include a bendable member (or bendable support member) (e.g., a multi-joint hinge module or a multi-bar assembly) that forms at least partially the same plane as at least a portion of the first housing (210) when in an open state (or an extended state or a slide-out state) and is at least partially accommodated into an interior space of the second housing (220) when in a closed state (or a collapsed state or a slide-in state). According to one embodiment, at least a portion of the flexible display (230) may be arranged so as to be invisible from the outside by being accommodated into the interior space of the second housing (220) while being supported by the bendable member when in a closed state. According to one embodiment, at least a portion of the flexible display (230) may be arranged so as to be visible from the outside by being supported by the bendable member that forms at least partially the same plane as the first housing (210) when in an open state.
[0070] According to various embodiments, the electronic device (200) may include a front surface (200a) (e.g., a first surface), a rear surface (200b) (e.g., a second surface) facing in an opposite direction from the front surface (200a), and a side surface (not shown) surrounding a space between the front surface (200a) and the rear surface (200b). According to one embodiment, the electronic device (200) may include a first housing (210) including a first side surface member (211) and a second housing (220) including a second side surface member (221). According to one embodiment, the first side member (211) may include a first side member (2111) having a first length along a first direction (direction ①), a second side member (2112) extending from the first side member (2111) to have a second length longer than the first length along a direction substantially perpendicular thereto, and a third side member (2113) extending from the second side member (2112) substantially parallel to the first side member (2111) and having the first length. According to one embodiment, the first side member (211) may be formed at least partially of a conductive material (e.g., metal). According to one embodiment, at least a portion of the first side member (211) may include a first support member (212) extending to at least a portion of an interior space of the first housing (210).
[0071] According to various embodiments, the second side member (221) can include a fourth side member (2211) that corresponds at least partially with the first side member (2111) and has a third length, a fifth side member (2212) that extends from the fourth side member (2211) in a direction substantially parallel to the second side member (2112) and has a fourth length that is longer than the third length, and a sixth side member (2213) that extends from the fifth side member (2212) to correspond with the third side member (2113) and has a third length. In one embodiment, the second side member (221) can be formed at least partially of a conductive material (e.g., metal). In one embodiment, at least a portion of the second side member (221) can include a second support member (222) that extends to at least a portion of the interior space of the second housing (220). In one embodiment, the first side (2111) and the fourth side (2211) and the third side (2113) and the sixth side (2213) can be slidably coupled to each other. In one embodiment, in a closed state, the first side (2111) can be arranged to overlap at least a portion of the fourth side (2211) so as to be invisible from the outside. In one embodiment, in a closed state, the third side (2113) can be arranged to overlap at least a portion of the sixth side (2213) so as to be visible from the outside. In one embodiment, in a closed state, at least a portion of the first support member (212) can overlap the second support member (222), and the remaining portion of the first support member (212) can be arranged to be visible from the outside. Accordingly, the first support member (212) may include, in a closed state, a non-overlapping portion (212a) that does not overlap with the second support member (222) and an overlapping portion (212b) that overlaps with the second support member (222). In some embodiments, the non-overlapping portion (212a) and the overlapping portion (212b) may be formed integrally.In some embodiments, the non-overlapping portion (212a) and the overlapping portion (212b) may be provided separately and structurally coupled.
[0072] According to various embodiments, the first housing (210) may include a first sub-space (A) corresponding to the non-overlapping portion (212a) and a second sub-space (B) corresponding to the overlapping portion (212b) in the first space. According to one embodiment, the first sub-space (A) and the second sub-space (B) may be arranged in a manner that is at least partially connected to or separated from each other. According to one embodiment, the first sub-space (A) may be formed to have a larger spatial volume than the second sub-space (B). This may be due to an overlapping structure in which the second support member (222) and the first support member (212) overlap in an area corresponding to the second sub-space (B). According to one embodiment, the electronic device (200) may include a plurality of electronic components (e.g., a camera module (216), a sensor module (217), a flash (218), a main board (or PCB)) or a battery arranged in the first space of the first housing (210). According to one embodiment, the first sub-space (A) may be utilized as an area where, for example, electronic components that require a relatively large mounting space (a relatively large mounting thickness is required) or that must be operated while avoiding an overlapping structure (e.g., a camera module (216), a sensor module (217), or a flash (218)) are placed. According to one embodiment, the second sub-space (B) may be utilized as an area where, for example, electronic components that require a relatively small mounting space (a relatively small mounting thickness is required) or that can be operated regardless of an overlapping structure (e.g., a main board (or PCB)) or a battery are placed.
[0073] According to various embodiments, the front (200a) and the back (200b) of the electronic device (200) may have variable areas depending on the closed and open states. In some embodiments, the electronic device (200) may include, in the back (200b), a first back cover (213) disposed on at least a portion of the first housing (210) and a second back cover (223) disposed on at least a portion of the second housing (220). According to one embodiment, the first back cover (213) and / or the second back cover (223) may be disposed in a manner that they are coupled with at least a portion of the first support member (212) and the second support member (213). In some embodiments, the first back cover (213) and / or the second back cover (223) may be formed integrally with each of the side members (211, 221). In one embodiment, the first back cover (213) and / or the second back cover (223) may be formed of a polymer, a coated or colored glass, a ceramic, a metal (e.g., aluminum (Al), stainless steel (STS), or magnesium), or a combination of at least two of the foregoing materials. In some embodiments, the first back cover (213) and / or the second back cover (223) may extend to at least a portion of each of the side members (211, 221). In some embodiments, at least an extended portion of each of the side members (211, 221) of the first back cover (213) and the second back cover (223) may be formed into a curved surface. In some embodiments, at least a portion of the first support member (212) may be replaced by the first back cover (213), and at least a portion of the second support member (222) may be replaced by the second back cover (223).
[0074] According to various embodiments, the electronic device (200) may include a flexible display (230) arranged to be supported by at least a portion of a first housing (210) and a second housing (220). In one embodiment, the flexible display (230) may include a first portion (230a) (e.g., a flat portion) that is always visible from the outside, and a second portion (230b) (e.g., a bendable portion) that extends from the first portion (230a) and is at least partially retracted into an interior space of the second housing (220) so as not to be visible from the outside when in a closed state. In one embodiment, the first portion (230a) may be arranged to be supported by the first housing (210), and the second portion (230b) may be arranged to be at least partially supported by a bendable member. According to one embodiment, the flexible display (230) may be arranged to extend from the first portion (230a) while receiving support from the bendable member, form substantially the same plane as the first portion (230a), and be visible from the outside, when the first housing (210) is pulled out along a designated first direction (direction ①). According to one embodiment, the second portion (230b) of the flexible display (230) may be arranged to be inserted into the internal space of the second housing (220) when the first housing (210) is inserted along a designated second direction (direction ②), and not be visible from the outside. Accordingly, the display area of the flexible display (230) may be variable as the first housing (210) slides along the designated direction from the second housing (220).
[0075] According to various embodiments, the first housing (210) and the second housing (220) may be operated in a sliding manner so that the overall width thereof is variable with respect to each other. In one embodiment, the electronic device (200) may be configured to have a first width (W1) from the second side (2112) to the fourth side (2212) in a closed state. In one embodiment, the electronic device (200) may be configured to have a third width (W3) greater than the first width (W1) by moving a portion of the bendable member introduced into the internal space of the second housing (220) to have an additional second width (W2) in an open state. For example, the flexible display (230) may have a display area substantially corresponding to the first width (W1) in a closed state, and may have an expanded display area substantially corresponding to the third width (W3) in an open state.
[0076] According to various embodiments, the withdrawal operation of the electronic device (200) may be performed through a user's manipulation. For example, the electronic device (200) may be switched from a closed state to an open state through an operation of the flexible display (230) being pushed in a first direction (direction ①) specified through the user's manipulation. According to one embodiment, the electronic device (200) may be switched from an open state to a closed state through an operation of the flexible display (230) being pushed in a second direction (direction ②) specified through the user's manipulation. According to one embodiment, the electronic device (200) may maintain an open state and / or a closed state by being pressed in a direction in which the first housing (210) is to be pulled in or out from the second housing (220) based on a specified inflection point through a slide hinge module (not shown) disposed between the first housing (210) and the second housing (220). In some embodiments, the electronic device (200) may be configured such that the first housing (210) is pulled out in a designated first direction (e.g., direction ①) by operating a locker exposed through the rear surface (200b) of the electronic device (200). In some embodiments, the electronic device (200) may be automatically operated by a drive mechanism (e.g., a drive motor, a reduction module, and / or a gear assembly) disposed in the internal space of the first housing (210) and / or the internal space of the second housing (220). According to one embodiment, the electronic device (200) may be configured to control the operation of the second housing (220) through the drive mechanism when detecting an event for switching the closed / open state of the electronic device (200) through a processor (e.g., the processor (120) of FIG. 1).In some embodiments, a processor of the electronic device (200) (e.g., processor (120) of FIG. 1) may control the flexible display (230) to display visual information (e.g., object and / or application execution screens) in various ways in response to a changed display area of the flexible display (230) depending on whether the flexible display (230) is in a closed state, an open state, or an intermediate state (e.g., including a free stop state).
[0077] According to various embodiments, the electronic device (200) may include at least one of an input module (203) (e.g., the input module (150) of FIG. 1), an audio output module (206, 207) (e.g., the audio output module (155) of FIG. 1), a sensor module (204, 217), a camera module (205, 216), a connector port (208), a key input device (219), or an indicator (not shown). In another embodiment, the electronic device (200) may be configured such that at least one of the above-described components is omitted, or other components are additionally included.
[0078] According to various embodiments, the input module (203) may include a microphone. In some embodiments, the input module (203) may include a plurality of microphones arranged to detect the direction of sound. The audio output module (206, 207) may include a speaker. The audio output module (206, 207) may include a call receiver (206) and an external speaker (207). According to one embodiment, the external speaker (207) may be arranged in the second housing (220) and configured to transmit sound to the outside through the first speaker hole (207a). According to one embodiment, the external speaker (207) may be arranged in the internal space of the second housing (220), thereby providing a user with high quality sound regardless of the sliding motion of the first housing (210). According to one embodiment, the connector port (208) may be arranged in the internal space of the second housing (220) together with the external speaker (207). In some embodiments, the connector port (208) may be arranged in the interior space of the first housing (210) and, in a closed state, may be exposed to the outside through a connector port hole (not shown) formed in the second housing (220). In this case, the connector port (208) may be configured to be hidden from the outside through the second housing (220) in a closed state. According to one embodiment, the receiver (206) may be configured to respond to the external environment in the interior space of the first housing (210). In some embodiments, the audio output module (206, 207) may include a speaker (e.g., a piezo speaker) that operates without a separate speaker hole.
[0079] According to various embodiments, the sensor module (204, 217) may generate an electrical signal or data value corresponding to an internal operating state of the electronic device (200) or an external environmental state. The sensor module (204, 217) may include, for example, a first sensor module (204) (e.g., a proximity sensor or a light sensor) disposed on the front (200a) of the electronic device (200) and / or a second sensor module (217) disposed on the rear (200b). According to one embodiment, the first sensor module (204) may be disposed on the front (200a) of the electronic device (200) below the flexible display (230). According to one embodiment, the first sensor module (204) and / or the second sensor module (217) may include at least one of a proximity sensor, an illuminance sensor, a time of flight (TOF) sensor, an ultrasonic sensor, a fingerprint recognition sensor, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, and / or a humidity sensor.
[0080] According to various embodiments, the camera modules (205, 216) may include a first camera module (205) disposed on the front (200a) of the electronic device (200) and a second camera module (216) disposed on the rear (200b). According to one embodiment, the electronic device (200) may include a flash (218) positioned near the second camera module (216). According to one embodiment, the camera modules (205, 216) may include one or more lenses, an image sensor, and / or an image signal processor. According to one embodiment, the first camera module (205) may be disposed under the flexible display (230) and configured to capture an object through a portion of an active area of the flexible display (230). According to one embodiment, the flash (218) may include, for example, a light emitting diode or a xenon lamp.
[0081] According to various embodiments, among the camera modules (205, 216), a first camera module (205) and / or among the sensor modules (204, 217), some sensor modules (204) may be arranged to be in contact with the external environment through an opening or a transparent area perforated in the flexible display (230) in the internal space of the electronic device (200). In one embodiment, an area of the flexible display (230) facing the first camera module (205) may be formed as a transparent area having a specified transmittance as part of an area for displaying content. In one embodiment, the transparent area may be formed to have a transmittance in a range of about 5% to about 20%. This transparent area may include an area overlapping with an effective area (e.g., a field of view area) of the first camera module (205) through which light passes to be imaged by an image sensor to generate an image. For example, the transparent area of the flexible display (230) may include an area with a lower pixel density and / or wiring density than the surrounding area. For example, the transparent area may replace the opening described above. For example, some camera modules (205) may include an under display camera (UDC). In some embodiments, some sensor modules (204) may be arranged to perform their functions without being visually exposed through the flexible display (230) in the internal space of the electronic device (200). According to one embodiment, the second camera module (216) among the camera modules (205, 216) and / or some sensor modules (217) among the sensor modules (204, 217) may be arranged to correspond to the external environment through at least a portion of the first housing (210) (e.g., the first rear cover (213)) in the internal space of the electronic device (200). In this case, the second camera module (216) and / or some sensor modules (217) may be placed at a designated location of the first housing (210) that is always visible from the outside, regardless of whether it is in a closed state and / or an open state.
[0082] According to various embodiments, the electronic device (101, 200) may include a display having a structure as shown in FIGS. 2A to 2D. According to various embodiments, the electronic device (101) may include various expandable form factors of the display in addition to the form factor as described in the description with reference to FIGS. 2A to 2D. For example, the electronic device (101) may be implemented in various form factors based on a sliding (or rolling) method according to the form factor structure of the electronic device (101, 200) of FIGS. 2A to 2D. Examples of this are illustrated in the drawings described below (e.g., FIGS. 5A to 5G).
[0083] FIGS. 3A and 3B are drawings illustrating the front and back of an electronic device in a closed state having a form factor according to one embodiment. FIGS. 3C and 3D are drawings illustrating the front and back of an electronic device in an open state having a form factor according to one embodiment.
[0084] The electronic device (300) of FIGS. 3A to 3D may be at least partially similar to the electronic device (101) of FIG. 1, may include the electronic device (101) of FIG. 1, or may further include other embodiments of the electronic device (101) of FIG. 1.
[0085] Referring to FIGS. 3A to 3D , the electronic device (300) may include a first housing (310) (e.g., a first housing structure, a movable part, or a slide housing), a second housing (320) (e.g., a second housing structure, a fixed part, or a base housing) coupled to the first housing (310) so as to be movable (e.g., slidable) in a specified direction (e.g., direction ① or direction ②) (e.g., in the y-axis direction), and a flexible display (330) (e.g., an expandable display or a stretchable display) arranged to be supported by at least a portion of the first housing (310) and the second housing (320). According to one embodiment, the electronic device (300) may be arranged such that the first housing (310) is pulled out (slide-out) in a first direction (direction ①) or is slid in (slide-in) in a second direction (direction ②) opposite to the first direction (direction ①) based on the second housing (320) held by the user. According to one embodiment, at least a portion of the first housing (310) including the first space (3101) may be accommodated in the second space (3201) of the second housing (320), thereby changing to a closed state (or slid-in state). According to one embodiment, the electronic device (300) may include a bendable member (or bendable support member) (e.g., a multi-joint hinge module or a multi-bar assembly) that, when in an open (or withdrawn) state, forms at least partially the same plane as at least a portion of the first housing (310) and, when in a closed state, is accommodated at least partially into a second space (3201) of the second housing (320). According to one embodiment, at least a portion of the flexible display (330) may be accommodated into the internal space (3201) of the second housing (320) while being supported by the bendable member (e.g., the bendable support member (340) of FIG. 4) when in a closed state, thereby being arranged so as not to be visible from the outside.According to one embodiment, at least a portion of the flexible display (330) may be positioned so as to be visible from the outside while being supported by a bendable member (e.g., the bendable member (340) of FIG. 4) that forms at least partially the same plane as the first housing (310) in an open state.
[0086] According to various embodiments, the electronic device (300) may include a first housing (310) including a first side member (311) and a second housing (320) including a second side member (321). In one embodiment, the first side member (311) may include a first side member (3111) having a first length along a first direction (e.g., a y-axis direction), a second side member (3112) extending from the first side member (3111) to have a second length shorter than the first length along a direction substantially perpendicular to the first side member (3111) (e.g., an x-axis direction), and a third side member (3113) extending from the second side member (3112) substantially parallel to the first side member (3111) and having the first length. In one embodiment, the first side member (311) may be formed at least partially of a conductive material (e.g., a metal). In some embodiments, the first side member (311) may be formed by a combination of a conductive material and a non-conductive material (e.g., a polymer). In one embodiment, the first housing (310) may include a first support member (312) extending from at least a portion of the first side member (311) to at least a portion of the first space (3101). In one embodiment, the first support member (312) may be formed integrally with the first side member (311). In some embodiments, the first support member (312) may be formed separately from the first side member (311) and structurally coupled to the first side member (311).
[0087] According to various embodiments, the second side member (321) can include a fourth side member (3211) that corresponds at least partially with the first side member (3111) and has a third length, a fifth side member (3212) that extends from the fourth side member (3211) in a direction substantially parallel to the second side member (3112) and has a fourth length that is shorter than the third length, and a sixth side member (3213) that extends from the fifth side member (3212) to correspond with the third side member (3113) and has a third length. According to one embodiment, the second side member (321) can be formed at least partially of a conductive material (e.g., a metal). In some embodiments, the second side member (321) can be formed by a combination of a conductive material and a non-conductive material (e.g., a polymer). In one embodiment, at least a portion of the second side member (321) may include a second support member (322) extending to at least a portion of the second space (3201) of the second housing (320). In one embodiment, the second support member (322) may be formed integrally with the second side member (321). In some embodiments, the second support member (322) may be configured separately from the second side member (321) and structurally coupled to the second side member (321).
[0088] According to various embodiments, the first side (3111) and the fourth side (3211) may be slidably coupled to each other. According to one embodiment, the third side (3113) and the sixth side (3213) may be slidably coupled to each other. According to one embodiment, in the closed state, the first side (3111) may overlap with the fourth side (3211) so as to be substantially invisible from the outside. According to one embodiment, in the closed state, the third side (3113) may overlap with the sixth side (3213) so as to be substantially invisible from the outside. In some embodiments, at least a portion of the first side (3111) and the third side (3113) may be arranged so as to be at least partially visible from the outside in the closed state. According to one embodiment, in the closed state, the first support member (312) may overlap with the second support member (322) so as to be substantially invisible from the outside. In some embodiments, a portion of the first support member (312) may be positioned so as to be invisible from the outside by overlapping the second support member (322) in a closed state, and the remaining portion of the first support member (312) may be positioned so as to be visible from the outside.
[0089] According to various embodiments, the electronic device (300) may include a first rear cover (313) coupled to the first housing (310) on the rear side. In one embodiment, the first rear cover (313) may be disposed through at least a portion of the first support member (312). In some embodiments, the first rear cover (313) may be formed integrally with the first side member (311). In one embodiment, the first rear cover (313) may be formed of a polymer, a coated or colored glass, a ceramic, a metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of these materials. In some embodiments, the first rear cover (313) may extend to at least a portion of the first side member (311). In some embodiments, at least a portion of the first support member (312) may be replaced by the first rear cover (313).
[0090] According to various embodiments, the electronic device (300) may include a second rear cover (323) coupled to a second housing (320) on the rear side. In one embodiment, the second rear cover (323) may be disposed through at least a portion of the second support member (322). In some embodiments, the second rear cover (323) may be formed integrally with the second side member (321). In one embodiment, the second rear cover (323) may be formed of a polymer, a coated or colored glass, a ceramic, a metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of these materials. In some embodiments, the second rear cover (323) may extend to at least a portion of the second side member (321). In some embodiments, at least a portion of the second support member (322) may be replaced by the second rear cover (323).
[0091] According to various embodiments, the electronic device (300) may include a flexible display (330) arranged to be supported by at least a portion of a first housing (310) and a second housing (320). In one embodiment, the flexible display (330) may include a first portion (330a) (e.g., a flat portion) that is always visible from the outside, and a second portion (330b) (e.g., a bendable portion) that extends from the first portion (330a) and is at least partially accommodated in a second space (3201) of the second housing (320) such that at least a portion thereof is not visible from the outside when in a closed state. In one embodiment, the first portion (330a) may be arranged to be supported by the first housing (310), and the second portion (330b) may be arranged to be at least partially supported by a bendable member (e.g., a bendable member (340) of FIG. 4). According to one embodiment, the second part (330b) of the flexible display (330) may be arranged to extend from the first part (330a) and form substantially the same plane as the first part (330a) while receiving support from a bendable member (e.g., a bendable member (340) of FIG. 4) when the first housing (310) is pulled out along the first direction (direction ①), and may be arranged to be visible from the outside. According to one embodiment, the second part (330b) of the flexible display (330) may be accommodated in the second space (3201) of the second housing (320) when the second housing (320) is pulled in along the second direction (direction ②), and may be arranged to be invisible from the outside. Accordingly, the electronic device (300) can induce the display area of the flexible display (330) to vary as the first housing (310) slides along a specified direction (e.g., y-axis direction) from the second housing (320).
[0092] According to various embodiments, the flexible display (330) may have a variable length in the first direction (direction ①) according to the sliding movement of the first housing (310) relative to the second housing (320). For example, the flexible display (330) may have a first display area (e.g., an area corresponding to the first portion (330a)) corresponding to a first length (L1) in a closed state. According to one embodiment, the flexible display (330) may be expanded to have a third display area (e.g., an area including the first portion (330a) and the second portion (330b)) corresponding to a third length (L3) longer than the first length (L1) and larger than the first display area, according to the sliding movement of the first housing (310) that is additionally moved by a second length (L2) relative to the second housing (320) in an open state.
[0093] According to various embodiments, the electronic device (300) may include at least one of an input device (e.g., a microphone (303-1)), an audio output device (e.g., a call receiver (306) or a speaker (307)), a sensor module (304, 317), a camera module (e.g., a first camera module (305) or a second camera module (316)), a connector port (308), a key input device (319), or an indicator (not shown) disposed in a first space (3101) of a first housing (310). According to one embodiment, the electronic device (300) may include another input device (e.g., a microphone (303)) disposed in a second housing (320). In another embodiment, the electronic device (300) may be configured such that at least one of the above-described components is omitted, or other components are additionally included. In another embodiment, at least one of the above-described components may be disposed in the second space (3201) of the second housing (320).
[0094] According to various embodiments, the input device may include a microphone (303-1). In some embodiments, the input device (e.g., microphone (303-1)) may include multiple microphones arranged to detect the direction of sound. The audio output device may include, for example, a call receiver (306) and a speaker (307). In one embodiment, the speaker (307) may be in contact with the outside through at least one speaker hole formed in the first housing (310) at a location that is always exposed to the outside (e.g., second side (3112)), regardless of the closed / open (or inlet / outlet) state. In one embodiment, the connector port (308) may be in contact with the outside through a connector port hole formed in the first housing (310) in an open state. In some embodiments, the connector port (308) may be in contact with the outside through an opening formed in the second housing (320) and formed to correspond with the connector port hole in a closed state. In some embodiments, the call receiver (306) may include an operative speaker (e.g., a piezo speaker) without a separate speaker hole.
[0095] According to various embodiments, the sensor modules (304, 317) may generate electrical signals or data values corresponding to the internal operating state of the electronic device (300) or the external environmental state. The sensor modules (304, 317) may include, for example, a first sensor module (304) (e.g., a proximity sensor or a light sensor) disposed on the front of the electronic device (300) and / or a second sensor module (317) (e.g., a heart rate monitoring (HRM) sensor) disposed on the rear of the electronic device (300). According to one embodiment, the first sensor module (304) may be disposed on the front of the electronic device (300), below the flexible display (330). According to one embodiment, the first sensor module (304) and / or the second sensor module (317) may include at least one of a proximity sensor, an illuminance sensor, a time of flight (TOF) sensor, an ultrasonic sensor, a fingerprint recognition sensor, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, or a humidity sensor.
[0096] According to various embodiments, the camera module may include a first camera module (305) disposed on the front of the electronic device (300) and a second camera module (316) disposed on the rear of the electronic device (300). According to one embodiment, the electronic device (300) may also include a flash (not shown) positioned near the second camera module (316). According to one embodiment, the camera modules (305, 316) may include one or more lenses, an image sensor, and / or an image signal processor. According to one embodiment, the first camera module (305) may be disposed under the flexible display (330) and configured to capture a subject through a portion of an active area (e.g., a display area) of the flexible display (330).
[0097] According to various embodiments, among the camera modules, the first camera module (305) and among the sensor modules (304, 317), some of the sensor modules (304) may be arranged to detect the external environment through the flexible display (330). For example, the first camera module (305) or some of the sensor modules (304) may be arranged in the first space (3201) of the first housing (310) so as to be in contact with the external environment through a transparent area or a perforated opening formed in the flexible display (330). According to one embodiment, an area of the flexible display (330) facing the first camera module (305) may be formed as a transparent area having a designated transmittance as part of a display area that displays content. According to one embodiment, the transparent area may be formed to have a transmittance in a range of about 5% to about 20%. This transparent area may include an area overlapping with the effective area (e.g., field of view area) of the first camera module (305) through which light passes to be imaged by the image sensor to create an image. For example, the transparent area of the flexible display (330) may include an area with a lower pixel arrangement density and / or wiring density than the surrounding area. For example, the transparent area may replace the opening described above. For example, some camera modules (305) may include an under-display camera (UDC). In some embodiments, some sensor modules (304) may be arranged to perform their functions without being visually exposed through the flexible display (330) in the internal space of the electronic device (300).
[0098] According to various embodiments, the electronic device (300) may include at least one antenna (e.g., the antenna module (197) of FIG. 1) electrically connected to a wireless communication circuit (e.g., the wireless communication module (192) of FIG. 1) disposed in a second housing (310). According to one embodiment, the electronic device (300) may also include a bezel antenna (A) disposed through a conductive second side member (321) of the second housing (310). For example, the bezel antenna (A) may include a conductive portion (327) disposed on at least a portion of a fifth side (3212) and a sixth side (3213) of the second side member (321) and electrically segmented through at least one segment (3271, 3272) formed of a non-conductive material (e.g., a polymer). According to one embodiment, the wireless communication circuit (e.g., the wireless communication module (192) of FIG. 1) may be configured to transmit or receive a wireless signal in at least one frequency band (e.g., about 800 MHz to 6000 MHz) (e.g., a legacy band) designated through the conductive portion (327). According to one embodiment, the electronic device (300) may include a side cover (3212a) disposed on the fifth side (3212) to cover at least a portion of at least one segment (3271). In some embodiments, the bezel antenna (A) may be disposed on at least one of the second side (3112), the fourth side (3211), the fifth side (3212), and the sixth side (3213). In some embodiments, the electronic device (300) may further include at least one antenna module (e.g., a 5G antenna module or antenna structure) disposed in an internal space (e.g., the first space (3101) or the second space (3201)) and arranged to transmit or receive a wireless signal in a frequency band ranging from about 3 GHz to 100 GHz via another wireless communication circuit (e.g., the wireless communication module (192) of FIG. 1).
[0099] According to various embodiments, the insertion / withdrawal operation of the electronic device (300) may be performed automatically. For example, the insertion / withdrawal operation of the electronic device (300) may be performed through a gearing operation of a drive motor (e.g., drive motor (360) of FIG. 4) including a pinion gear (361) disposed in a first space (3101) of a first housing (310) and a rack gear (e.g., rack gear (3251) of FIG. 4) disposed in a second space (3201) of a second housing (320) and meshed with the pinion gear (361). For example, the processor of the electronic device (300) (e.g., processor (120) of FIG. 1) may operate the drive motor (e.g., drive motor (360) of FIG. 4) disposed inside the electronic device (300) when detecting a triggering operation to change from a closed state to an open state or from an open state to a closed state. In one embodiment, the triggering action may include selecting (e.g., touching) an object displayed on the flexible display (330) or operating a physical button (e.g., a key button) included in the electronic device (300).
[0100] FIG. 4 is an exploded perspective view of an electronic device having a form factor according to one embodiment.
[0101] In describing the electronic device (300) of FIG. 4, the same symbols are given to components that are substantially the same as those of the electronic devices (300) of FIGS. 3a to 3d, and a detailed description thereof may be omitted.
[0102] Referring to FIG. 4, the electronic device (300) may include a first housing (310) including a first space (3101), a second housing (320) movably (e.g., slidingly) coupled to the first housing (310) and including a second space (e.g., the second space (3201) of FIG. 3C), a bendable member (340) at least partially rotatably arranged in the second space (3201), a flexible display (330) arranged to be supported by at least a portion of the bendable member (340) and the first housing (310), and a driving module that drives the first housing (310) in a direction in which it is to be drawn in (e.g., in the -y-axis direction) and / or in a direction in which it is to be drawn out (e.g., in the y-axis direction) from the second housing (320). In one embodiment, the drive module may include a drive motor (360) disposed in a first space (3101) and including a pinion gear (361), and a rack gear (3251) disposed in a second space (3201) to mesh with the pinion gear (361). In one embodiment, the drive module may further include a reduction module disposed to reduce the rotational speed and increase the driving force by being coupled with the drive motor (360). In one embodiment, the drive motor (360) may be disposed in the first space (3101) of the first housing (310) to be supported by at least a portion of the first support member (312). In one embodiment, the drive motor (360) may be fixed to an end (e.g., an edge) of the first support member (312) in the incoming direction (e.g., the -y-axis direction) in the first space (3101).
[0103] According to various embodiments, the electronic device (300) may include a plurality of electronic components arranged in a first space (3101). According to one embodiment, the plurality of electronic components may include a first substrate (351) (e.g., a main substrate), a camera module (316), a socket module (318) (e.g., a SIM tray), a speaker (307), a connector port (308), and a battery (B) arranged around the first substrate (351). According to one embodiment, the plurality of electronic components may be arranged around the first substrate (351) in the first space (3101) of the first housing (310) together with a driving motor (360), so that efficient electrical connection may be possible.
[0104] According to various embodiments, the electronic device (300) may include a rear bracket (314) arranged between the first support member (312) and the first rear cover (313) of the first housing (310) to cover at least some of the plurality of electronic components. In one embodiment, the bracket (314) may be structurally coupled to at least some of the first support member (312). In some embodiments, the rear bracket (314) may be omitted. In one embodiment, the rear bracket (314) may be arranged to cover the plurality of electronic components and support the first rear cover (313). In one embodiment, the rear bracket (314) may include a notch area (314a) or an opening (314a) (e.g., a through hole) formed in an area corresponding to a camera module (316) and / or a sensor module (e.g., a sensor module (317) of FIG. 3D ). According to one embodiment, the camera module (316) and / or the sensor module (317) may be positioned to detect the external environment through the notch area (314a) or the opening (314a). According to one embodiment, the first rear cover (313) may be processed to be transparent in at least an area corresponding to the camera module (316) and / or the sensor module (317). In some embodiments, the camera module (316) and / or the sensor module (317) may be configured to operate only when the electronic device (300) is in an open state.
[0105] According to various embodiments, the electronic device (300) may include a plate-type support bracket (325) (e.g., DSB, display support bar) disposed in a second space (3201) of a second housing (320) and slidably coupled to at least a portion of a first support member (312). In one embodiment, the support bracket (325) may include an opening (325a) of a specified size. In one embodiment, the support bracket (325) may include a support portion (3252) disposed at one end and having a curved outer surface to support a back surface of a bendable member (340) that bends during a sliding operation. In one embodiment, the support bracket (325) may include a support plate (3253) formed to support a back surface of the bendable member (340) when in an open state by extending from at least a portion of the support portion (3252) to at least a portion of the opening (325a). In one embodiment, the support bracket (325) may include a rack gear (3251) fixed to have a length along a direction parallel to the sliding direction and crossing the opening (325a). In some embodiments, the rack gear (3251) may be formed integrally with the support bracket (325). In one embodiment, the electronic device (300) may include a pair of guide rails (326) arranged on both sides of the support bracket (325) to guide both ends of the bendable member (340) in the sliding direction.
[0106] According to various embodiments, the second housing (320) may include an opening (322a) (e.g., a through hole) disposed in an area corresponding to a camera module (316) and / or a sensor module (317) disposed in the first housing (310) when the electronic device (300) is in a closed state in the second support member (322). According to one embodiment, the camera module (316) and / or the sensor module (317) may detect an external environment through the opening (322a) formed in the second housing (320) when the electronic device (300) is in a closed state. In this case, at least an area corresponding to the camera module (316) and / or the sensor module (317) of the second rear cover (323) may be processed to be transparent.
[0107] According to various embodiments, the electronic device (300) may include a second substrate (352) and an antenna member (353) disposed in a space between a second support member (322) and a second rear cover (323) of a second housing (320). According to one embodiment, the second substrate (352) and the antenna member (353) may be electrically connected to the first substrate (351) through at least one electrical connection member (e.g., FPCB, flexible printed circuit board or FRC, flexible RF cable). In some embodiments, the antenna member (353) may be electrically connected to the second substrate (352), thereby being electrically connected to the first substrate (351) through the second substrate (352).
[0108] According to various embodiments, the electronic device (101, 300) may include a display having a structure as shown in FIGS. 3A to 3D. According to various embodiments, the electronic device (101) may include various expandable form factors of the display in addition to the form factor described in the description referring to FIGS. 3A to 3D. For example, the electronic device (101) may be implemented in various form factors based on a sliding (or rolling) method according to the form factor structure of the electronic device (101, 300) of FIGS. 3A to 3D. Examples of this are illustrated in the drawings described below (e.g., FIGS. 5A to 5G).
[0109] FIGS. 5A, 5B, 5C, 5D, 5E, 5F, and 5G are drawings illustrating various examples of the structure of an expandable display of an electronic device according to one embodiment.
[0110] Referring to FIGS. 5A to 5G, an electronic device (e.g., the electronic device (101) of FIG. 1) according to various embodiments may include a housing structure in which a display may be expanded in at least one direction, including up, down, left, and right. For example, FIGS. 5A to 5G may illustrate examples of various form factors of an electronic device including a display with a variable display area according to one embodiment.
[0111] As illustrated in FIG. 5A, the electronic device may be implemented to enable a unidirectional sliding motion. For example, the electronic device may include a display (510) that is expandable in a first direction (e.g., to the right). For example, the display (510) may display a screen through a first display area (511) in a first non-expanded state (e.g., a closed state or a collapsed state), and the second display area (512) may be accommodated within the housing and in an inactive state.
[0112] According to one embodiment, the electronic device can be switched from a first state to a second state (e.g., an open state or an expanded state) by a user operation or a preset input.
[0113] According to one embodiment, when the electronic device transitions from a first state to a second state, the second display area (512) may be pulled out in a first direction and exposed to the outside. In the second state in which the display (510) is expanded, the electronic device may switch the second display area (512) to an active state and display a screen through the first display area (511) and the second display area (512). According to another embodiment, when the electronic device transitions from the first state to the second state, when the second housing is slid in one direction (e.g., in the first direction) with respect to the first housing, at least a portion of the display (510) accommodated in the first housing (e.g., corresponding to a left portion of the first display area (511) in the illustrated drawing) may be pulled out, so that the display area of the display (510) may be expanded. When the electronic device transitions from the second state to the first state, when the second housing slides in the second direction with respect to the first housing, a part of the display (510) (e.g., corresponding to a left part of the first display area (511) in the illustrated drawing) is drawn into the first housing, so that the display area of the display (510) may be reduced. According to one embodiment, in the case of the electronic device, the display area of the display (510) (e.g., the first display area (511)) in the first state (e.g., the closed state) may have, for example, a 4:3 ratio, and the display areas of the display (510) (e.g., the first display area (511) and the second display area (512)) in the second state (e.g., the open state) may be expanded to, for example, a 21:9 ratio.
[0114] According to another embodiment, the electronic device may include a first display area (516) that displays a screen in a first state (e.g., a closed state) in which the display (515) is not expanded, and a second display area (517) that is expandable in a second direction (e.g., a leftward direction) and displays a screen in a second state (e.g., an open state) in which the display (515) is expanded.
[0115] As illustrated in FIG. 5b, the electronic device may include a display expandable in a third direction (e.g., upward direction) or a fifth direction (e.g., downward direction).
[0116] According to one embodiment, the electronic device may include a first display area (521) for displaying a screen in a first state in which the display (520) is not expanded, and a second display area (522) that is expandable in a third direction and displays a screen in a second state in which the display (525) is expanded. According to another embodiment, the electronic device may include a first display area (526) for displaying a screen in a first state in which the display (525) is not expanded, and a second display area (527) for displaying a screen in a second state in which the display (525) is expanded, and displays a screen in a fourth direction.
[0117] As illustrated in FIG. 5c, the electronic device may include a display that is expandable in both left and right directions or in both up and down directions.
[0118] According to one embodiment, the electronic device may include a first display area (531) that displays a screen in a first state in which the display (530) is not expanded, a second display area (532) that is expandable in a first direction and displays a screen in a second state in which the display (530) is expanded, and a third display area (533) that is expandable in a second direction and displays a screen in the second state in which the display (530) is expanded. In this case, at least one of the second display area (532) and the third display area (533) may be expanded depending on a user operation, a preset input, or a type of content being output (e.g., a video, an image, text, or a game).
[0119] According to one embodiment, the electronic device having the housing structure illustrated in FIG. 5C may be implemented to enable a bidirectional sliding motion. For example, in a first state (e.g., a closed state), the display area (e.g., a first display area (531)) of the display (530) may have, for example, a 21:9 ratio, and in a second state (e.g., an open state), the display areas (e.g., a first display area (531), a second display area (532), and a third display area (533)) of the display (530) may be expanded to, for example, a 4:3 ratio. When the electronic device transitions from the first state to the second state, when the second housing and the third housing are slid in both directions, for example, in a first direction (e.g., leftward) and a second direction (e.g., rightward), with respect to the first housing, a part of the display (532) accommodated in the first housing (e.g., the second display area (532)) is pulled out in the first direction, and another part (e.g., the third display area (533)) is pulled out in the second direction, so that the display area of the display (530) can be expanded. Although not shown in the drawing, the electronic device may expand only a part of the display (530) in the first direction (e.g., the first display area (531) and the second display area (532)), or only another part of the display (530) in the second direction (e.g., the first display area (531) and the third display area (533)).
[0120] According to another embodiment, the electronic device may include a first display area (536) that displays a screen in a first state in which the display (535) is not expanded, a second display area (537) that is expandable in a third direction and displays a screen in a second state in which the display (535) is expanded, and a third display area (538) that is expandable in a fourth direction and displays a screen in the second state in which the display (535) is expanded.
[0121] According to various embodiments, the electronic device may include a display that is expandable in both an upward (or downward) direction and a rightward (or leftward) direction.
[0122] As illustrated in FIG. 5d, the electronic device may include a display capable of stepwise expansion, and the display may be expanded only partially.
[0123] According to one embodiment, the electronic device may include a first display area (551) that displays a screen in a first state in which the display (550) is not expanded, a second display area (552) that is expandable in a first direction (e.g., toward the right) and displays a screen in a second state in which the display (550) is expanded, and a third display area (553) that is further expandable in the first direction (e.g., toward the right) and displays a screen in a third state in which the display (550) is further expanded.
[0124] In one embodiment, the electronic device can display a screen by activating only the second display area (552) of the display (550). In one embodiment, the electronic device can display a screen by activating both the second display area (552) and the third display area (553) of the display (550). For example, the display (550) can be fixed via a support structure when extended to the second display area (552), and can be extended from the second display area (552) to the third display area (553) with additional force.
[0125] As illustrated in FIG. 5E, the electronic device may include a display expandable in a third direction (e.g., upward direction) or a fourth direction (e.g., downward direction). In one embodiment, the electronic device illustrated in FIG. 5E may include a bar-type form factor when closed.
[0126] According to one embodiment, the electronic device may include a first display area (561) for displaying a screen in a first state in which the display (560) is not expanded, and a second display area (562) for displaying a screen in a second state in which the display is expanded and expandable in a third direction. According to another embodiment, the electronic device may include a first display area (566) for displaying a screen in a first state in which the display (565) is not expanded, and a second display area (567) for displaying a screen in a second state in which the display is expanded and expandable in a fourth direction.
[0127] As illustrated in FIG. 5F, the electronic device may include a display that is expandable in both vertical and horizontal directions. In one embodiment, the electronic device illustrated in FIG. 5F may include a bar-type form factor when closed.
[0128] According to one embodiment, the electronic device may include a first display area (571) that displays a screen in a first state in which the display (570) is not expanded, a second display area (572) that is expandable in a third direction and displays a screen in a second state in which the display (570) is expanded, and a third display area (573) that is expandable in a fourth direction and displays a screen in the second state in which the display (570) is expanded. In this case, at least one of the second display area (532) and the third display area (533) may be expanded depending on a user operation, a preset input, or a type of content being output (e.g., a video, an image, text, or a game).
[0129] The electronic device (101) in various embodiments described below may include a display having at least one structure among FIGS. 2A to 5F. According to various embodiments, in addition to the form factors described in FIGS. 2A to 5F, various expandable form factors of the display may be included.
[0130] According to various embodiments, the electronic device (101) may be implemented in various form factors according to various sliding movements of the display, in addition to the form factors of the electronic devices of FIGS. 5A to 5F. An example of this is illustrated in FIG. 5G.
[0131] For example, as illustrated in FIG. 5G, the electronic device may include various form factors, such as a rollable (or slideable) device (580, 585, 590) that can expand the area of the display in a rolling manner and / or a sliding manner. According to one embodiment, as illustrated in FIG. 5G, the electronic device may be implemented in various forms, and the display may be provided in various ways depending on the implementation form of the electronic device.
[0132] According to one embodiment, an electronic device (e.g., 580, 585, 590) may include a roll-up display (e.g., a rollable display) within a housing. According to one embodiment, the electronic device may refer to an electronic device in which the display is capable of bending deformation, such that at least a portion thereof is wound or rolled, or can be stored within a housing (not shown). Depending on the needs of a user, the electronic device may be used by expanding the screen display area by unfolding the display or exposing a wider area of the display to the outside. For example, the electronic device (101) may have a display area exposed to the outside that may vary depending on the degree to which the user unfolds the display.
[0133] According to one embodiment, the electronic device (101) includes a housing structure for protecting a display that is rolled into a circular shape, and can operate in a structure in which the display is opened (e.g., expanded) within the housing. For example, at least a portion of the display may be housed within a cylindrical housing or a flat housing, as illustrated in FIG. 5g.
[0134] According to various embodiments, the electronic device (101) may be manually switched by a user or automatically switched through a driving mechanism (e.g., a driving motor, a reduction gear module, and / or a gear assembly) disposed inside the housing when changing the state of the display (e.g., an open state, an intermediated state, a closed state). According to one embodiment, the driving mechanism may be triggered to operate based on a user input. According to one embodiment, the user input for triggering the operation of the driving mechanism may include a touch input, a force touch input, and / or a gesture input through the display module (160). For example, when a signal is generated from various sensors such as a pressure sensor, the electronic device (101) may be switched from a closed state to an open state, or from an open state to a closed state. For example, when carrying or holding an electronic device (101) by hand, a squeeze gesture in which a part of the hand (e.g., a palm or a finger) presses within a designated area of the electronic device (101) may be detected by a sensor, and in response, the electronic device (101) may be switched from a closed state to an open state, or from an open state to a closed state. In another embodiment, a user input for triggering an operation of the drive mechanism may include a voice input (or a voice input), or an input of a physical button visually exposed to the outside of the housing.
[0135] As exemplified above, the electronic device (101) according to one embodiment of the present disclosure can be implemented as a device capable of changing the display area of the display in various rolling (or sliding) manners.
[0136] FIG. 6 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0137] Referring to FIG. 6, in one embodiment, an electronic device (101) (e.g., electronic device (200, 300)) may include a processor (120) (e.g., processor (120) of FIG. 1), a memory (130) (e.g., memory (130) of FIG. 1), a display module (160) (e.g., display module (160) of FIG. 1), a sensor IC (integrated circuit) (640), a tension control module (650), a sensor module (660) (e.g., sensor module (176) of FIG. 1), and / or an input module (670) (e.g., input module (150) of FIG. 1). According to one embodiment, the electronic device (101) may be the electronic device of FIG. 1, may include at least some of the components of the electronic device of FIG. 1, or may be implemented by additionally including other components.
[0138] According to one embodiment, the electronic device (101) may include a first housing (210, 410), a second housing (220, 420) coupled with the first housing (210, 410) in a first state (e.g., a closed state) of the electronic device (101), and configured to slide in a designated direction from the first housing (220, 420) in the first state to support a second state that at least partially expands a display of the electronic device (101).
[0139] According to one embodiment, the display module (160) may include a flexible display (610) (e.g., a flexible display (230, 430)) whose display area is partially variable in conjunction with the sliding movement (e.g., a slide in operation or a slide out operation) of the second housing (220, 420) and a display driving circuit (630) for driving the display module (160).
[0140] According to one embodiment, the flexible display (610) may include a first display area (e.g., a fixed area) that is fixedly disposed in the first housing (210, 410) and a second display area (e.g., an extended area) that is rollably mounted in the second housing (220, 420). In one embodiment, the first display area may be visually exposed in a first state (e.g., a closed state or an inward state) and / or a second state (e.g., an open state or an outward state) of the electronic device (101). In one embodiment, the second display area may be visually exposed in the second state of the electronic device (101) and may partially expand the area of the display (610) according to sliding movement of the second housing (220, 420).
[0141] According to one embodiment, the flexible display (610) (e.g., a rollable display or a sliderable display) may be implemented such that a portion thereof (e.g., a bendable section) is withdrawable from the internal space of the second housing (220, 420) of the electronic device (101). For example, when the electronic device (101) is switched from a closed state (or a retracted state or a slide-in state) to an open state (e.g., a retracted state or a slide-out state) or a partially open state, the bendable section of the flexible display (610) is slidably pulled out from the internal space of the electronic device (101), thereby allowing the screen to expand in whole or in part. When the electronic device (101) is switched from an open state or a partially open state to a closed state, the bendable section is slidably pulled into the internal space of the electronic device (101), thereby allowing the screen to contract in whole or in part.
[0142] According to one embodiment, the display driving circuit (630) is a circuit for controlling the flexible display (610) and may include, for example, a display driver IC (DDI, display drive integrated circuit) or a DDI chip. According to one embodiment, the display driving circuit (630) may include a TDDI (touch DDI) arranged in a COP (chip on panel) or COF (chip on film) manner. The display driving circuit (630) may receive a signal commanded by the processor (120) and control at least one display of the flexible display (610) so that a corresponding screen is displayed. The display driving circuit (630) may act as a signal path between the flexible display (610) and the processor (120) and control pixels through TFTs (thin film transistors) in the flexible display (610). For example, the display driving circuit (630) has a function of turning on or off pixels included in the flexible display (610) and can be electrically connected to the gate electrode of the TFT.
[0143] The display driving circuit (630) has a function of creating a color difference by adjusting the amount of RGB (red, green, blue) signals of a pixel, and can be electrically connected to a source electrode of a TFT. The TFT can include a gate line (or scan line) electrically connecting the display driving circuit (630) and the gate electrode of the TFT, and a data line (or source line) electrically connecting the display driving circuit (632) and the source electrode of the TFT. According to various embodiments, the display driving circuit (630) may also operate in response to an RGBW (red, green, blue, white) method in which a white pixel is added to an RGB pixel.
[0144] According to one embodiment, the display driver circuit (630) may be a DDI package. The DDI package may include a DDI (or DDI chip), a timing controller (T-CON), a graphic RAM (GRAM), or power generating circuits. According to one embodiment, the graphic RAM may be omitted, or a memory provided separately from the display driver circuit (630) may be utilized. The timing controller may convert a data signal input from the processor (120) into a signal required by the DDI. The timing controller may adjust the input data information into signals suitable for the gate driver (or gate IC) and the source driver (or source IC) of the DDI. The graphic RAM may function as a memory that temporarily stores data to be input to the driver (or IC) of the DDI. The graphic RAM may store the input signal and output it back to the driver of the DDI, and at this time, may interact with the timing controller to process the signal. The power driving unit can generate a voltage for driving the flexible display (610) and supply the voltage required for the gate driver and source driver of the DDI.
[0145] According to one embodiment, the DDI may be implemented to include one or more. According to one embodiment, the electronic device (101) may include one DDI operatively or electrically connected to the processor (120) and the flexible display (610) (e.g., a first display area and a second display area). For example, the first display area and the second display area may be connected to one DDI. According to one embodiment, the electronic device (101) may include two DDIs (e.g., a first DDI and a second DDI) operatively or electrically connected to the processor (120) and the flexible display (610). For example, the first display area may be connected to the first DDI, and the second display area may be connected to the second DDI. According to one embodiment, the first DDI and the second DDI may be operatively or electrically connected to each other.
[0146] According to one embodiment, the flexible display (610) may include a touch detection circuit (620) (or a touch sensor). The touch detection circuit (620) may include, for example, a transmitter (Tx) including a plurality of first electrode lines (or a plurality of drive electrodes), and a receiver (Rx) including a plurality of second electrode lines (or a plurality of receive electrodes).
[0147] According to one embodiment, a sensor IC (integrated circuit) (640) can supply current (e.g., alternating current) to a touch detection circuit (620), and an electric field can be formed between a transmitter and a receiver of the touch detection circuit (620). The sensor IC (640) can convert an analog signal acquired through the touch detection circuit (620) into a digital signal. For example, when a finger touches the screen or reaches a threshold distance from the screen, a change in the electric field occurs, and a change in electrostatic capacity (or voltage drop) related to this may occur. When the change in electrostatic capacity is greater than a threshold value, the sensor IC (640) can generate an electrical signal regarding a coordinate on the screen as a valid touch input or hovering input and output it to the processor (120). The processor (120) can recognize the coordinate on the screen based on the electrical signal received from the sensor IC (640).
[0148] In one embodiment, the sensor IC (640) may include a touch controller integrated circuit (IC). The touch controller IC may perform various functions, such as noise filtering, noise removal, or sensing data extraction, in relation to the touch sensing circuit (620). In one embodiment, the touch controller IC may include various circuits, such as an analog-digital converter (ADC), a digital signal processor (DSP), and / or a micro control unit (MCU).
[0149] According to one embodiment, the tension control module (650) may be included in, or connected to, a tension structure that provides tension to the flexible display (610), for example. The tension control module (650) may control the tension to be applied to the flexible display (610) according to a control signal from the processor (120).
[0150] According to one embodiment, the sensor module (660) (e.g., the sensor module (176) of FIG. 1) may, for example, measure a physical quantity or detect an operating state of the electronic device (101) and generate an electrical signal or data value corresponding thereto. According to one embodiment, the sensor module (660) may include, for example, a gesture sensor, a gyro sensor, a pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor. According to one embodiment, the sensor module (660) may further include at least one control circuit for controlling at least one sensor included therein.
[0151] According to one embodiment, the sensor module (660) may be a device that detects an inclination angle of the electronic device (101) with respect to the ground surface and / or a direction in which the electronic device (101) is facing in a three-dimensional coordinate system by using sensing data acquired from at least one sensor among a plurality of sensors. However, the present invention is not limited thereto, and various sensors that can obtain information about the inclination angle of the electronic device (101) (e.g., azimuth) may be used. For example, an acceleration sensor may sense information about linear movement of the electronic device (101) and / or acceleration of the electronic device (101) with respect to three axes. A gyro sensor may sense information related to rotation of the electronic device (101), and a geomagnetic sensor may sense information about a direction in which the electronic device (101) is facing within an absolute coordinate system. According to one embodiment, the processor (120) may use 9-axis motion data acquired by using a gyro sensor and a geomagnetic sensor. For example, the processor (120) may form a virtual coordinate space based on azimuth (e.g., yaw, pitch, and / or roll values) measured from 9-axis motion data, and may divide one area of the virtual coordinate space into a landscape range and another area into a portrait range.
[0152] According to one embodiment, an input module (670) (e.g., input module (150) of FIG. 1) may receive, for example, user input. The input module (670) may include, for example, a key input device. According to one embodiment, the key input device may include various types of keys, such as physical keys, capacitive keys, or optical keys. The input module (670) may also include various other types of user interfaces (e.g., a keypad or a keyboard).
[0153] According to one embodiment, the memory (130) may store various configuration information and / or instructions related to operating the display module (160) according to the slide in state (or closed state or retracted state), partially open state (e.g., intermediate state), and slide out state (or open state or retracted state) of the electronic device (101). For example, the memory (130) may include at least one configuration that allows the screen display to operate differently according to the closed state, partially open state, and open state. For example, the memory (130) may include at least one instruction that allows the processor (120) to check the transition between the slide in state (closed state), partially open state, and slide out state (open state), and to process the corresponding screen display in the checked state. For example, the memory (130) may include an instruction that allows the processor (120) to adjust the tension of the flexible display (610) using the tension adjustment module (650).
[0154] According to one embodiment, the memory (130) may store various data used by the electronic device (101). In one embodiment, the data may include input data or output data for an application (e.g., the program (140) of FIG. 1) and commands related to the application. In one embodiment, the data may include various sensor data (e.g., acceleration sensor data, gyro sensor data, and / or Hall sensor data) obtained from the sensor module (660). In one embodiment, the data may include various reference data set in the memory (130) to identify a specified state of the electronic device (101) (e.g., a first state (e.g., a closed state) or a second state (e.g., a partially open state or an open state)). In one embodiment, the data may include various setting information set in the memory (130) for operation control related to correcting a user input (e.g., a touch) based on a slide operation (e.g., a slide out or a slide in operation) of the flexible display (610). In one embodiment, the data may include various learning data obtained based on the user's learning through interaction with the user.
[0155] According to one embodiment, the memory (130) may store instructions that cause the processor (120) to operate when executed. For example, the application may be stored as software (e.g., the program (140) of FIG. 1) on the memory (130) and may be executable by the processor (120). According to one embodiment, the application may be a variety of applications that may provide various functions (e.g., various functions executable on the electronic device (101), such as a call, a game, a browser, an email, a media player, a camera, and / or a messenger) on the electronic device (101). According to one embodiment, the application may be provided on-demand and may include a keyboard (or keypad) (e.g., a screen keyboard) that interacts with the various functions described above.
[0156] According to one embodiment, the processor (120) may perform an application layer processing function requested by a user of the electronic device (101). According to one embodiment, the processor (120) may provide control and commands of functions for various blocks of the electronic device (101). According to one embodiment, the processor (120) may perform operations or data processing related to control and / or communication of each component of the electronic device (101). For example, the processor (120) may include at least some of the configurations and / or functions of the processor (120) of FIG. 1. The processor (120) may be operatively connected to, for example, components of the electronic device (101). The processor (120) may load commands or data received from other components of the electronic device (101) into the memory (130), process the commands or data stored in the memory (130), and store result data.
[0157] According to one embodiment of the present disclosure, the processor (120) may include processing circuitry and / or executable program elements. According to one embodiment, the processor (120) may control (or process) operations related to supporting functions related to an application based on a specified state of the electronic device (101) and / or a state change from a specified state, based on the processing circuitry and / or executable program elements.
[0158] According to one embodiment, the processor (120) may display an execution screen of an application in response to the amount of the display (e.g., the second display area) being pulled out when the flexible display (610) (e.g., a rollable display supporting a first display area and a second display area extending (or expanding) from the first display area) is in an open or partially open state. According to one embodiment, the processor (120) may detect a state change (e.g., a slide motion) of the flexible display (610) and determine an exposure screen area based on the detection of the state change of the flexible display (610). According to one embodiment, the processor (120) may control the display module (160) to configure and display an execution screen based on the exposure screen area.
[0159] According to one embodiment, the processor (120) may control the display module (160) to display a screen through a first display area (e.g., a fixed area or a basic area) of the flexible display (610) in a first state (e.g., a slide-in state (or a closed state)). According to one embodiment, the processor (120) may control the display module (160) to display a screen through the first display area and the second display area (e.g., a variable area or an extended area) of the flexible display (610) in a second state (e.g., a partially open state or a slide-out state (or an open state)).
[0160] According to one embodiment, when the second display area is slid (rolled) in accordance with the sliding movement of the second housing (220, 420) so that the electronic device (101) forms a second state (e.g., a partially open state or a slide-out state), the processor (120) may control the display module (160) to display a screen by linking the first display area and the second display area (e.g., an extended area) in the second state, or to display a screen through the second display area independently of the first display area.
[0161] According to one embodiment, the processor (120) may display a first execution screen based on a first display area of a display (e.g., a flexible display (610)) and, while displaying the first execution screen, detect a change in the state of the display (e.g., detect sliding). According to one embodiment, the processor (120) may control the display module (160) to maintain the first execution screen displayed through the first display area and display the second execution screen through the second display area based on detecting the change in state of the display. According to one embodiment, the processor (120) may control the display module (160) to display the first execution screen by changing (e.g., expanding) it in response to the linkage of the first display area and the second display area based on detecting the change in state of the display.
[0162] According to one embodiment, the processor (120) may control the display module (160) to operate the screen display differently according to the slide-in state, the partially open state, and the slide-out state of the display, at least based on the type of application being executed and / or the user-specified settings of the electronic device (101).
[0163] According to one embodiment, the processor (120) may control (or process) an operation related to adaptively compensating a user input (e.g., a touch) for a slide operation (e.g., a slide out or a slide in operation) of a display (e.g., a flexible display (610)) based on a processing circuit and / or executable program element. According to one embodiment, the processor (120) may control (or process) an operation related to adaptively compensating a user input for a slide operation in a situation where a user input and a slide operation (e.g., a slide in / out operation of the flexible display (610)) occur together in the electronic device (101). In one embodiment, a situation where a user input and a slide operation occur together may include, for example, a case where a touch occurs during a slide in / out operation of the flexible display (610), or a case where a slide in / out of the flexible display (610) occurs during a touch operation.
[0164] According to one embodiment, the processor (120) may perform an operation of displaying an execution screen of an application in a specified state of the display. According to one embodiment, the processor (120) may perform an operation of displaying an input area through the execution screen. According to one embodiment, while displaying the input area through the execution screen (e.g., while receiving a user input based on the input area), the processor (120) may perform an operation of detecting a sliding event in which the size of the display area of the display is changed by a sliding motion of the display. According to one embodiment, based on the detection of the sliding event, the processor (120) may perform an operation of correcting input coordinates related to the user input of the input area based on the size of the display area that changes according to the slide state. According to one embodiment, the processor (120) may perform an operation of processing the user input based on the corrected input coordinates.
[0165] According to one embodiment, the operation of the electronic device (101) and / or the processor (120) of the electronic device (101) is described with reference to the drawings described below.
[0166] According to one embodiment, the processor (120) may operate individually and / or collectively. According to one embodiment, the processor (120) may include an application processor and / or a communication processor. According to one embodiment, the communication processor may be included and operated in a communication circuit.
[0167] According to one embodiment, the processor (120) may be an application processor (AP). According to one embodiment, the processor (120) may be a system semiconductor that is responsible for the operation and multimedia driving functions of the electronic device (101). According to one embodiment, the processor (120) may be configured in the form of a system-on-chip (SoC), and may include a technology-intensive semiconductor chip that integrates multiple semiconductor technologies into one and implements system blocks into a single chip.
[0168] The embodiments described in the present disclosure may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. In a hardware implementation, the operations described in one embodiment may be implemented using at least one of Application Specific Integrated Circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and / or other electrical units for performing functions.
[0169] According to one embodiment, the operations performed by the processor (120) may be implemented by executing instructions stored in a recording medium (or a computer program product or storage medium). For example, the recording medium may include a non-transitory computer-readable recording medium having recorded thereon a program for executing various operations performed by the processor (120) (e.g., operations related to adaptively compensating a user input (e.g., a touch) to a slide operation (e.g., a slide-out or slide-in operation) of a display).
[0170] In one embodiment, a computer-readable recording medium (or computer program product) is provided that records a program that causes an electronic device (101) to perform (or execute) various operations. The operations may include: an operation of displaying an execution screen of an application in a specified state of a display; an operation of displaying an input area through the execution screen; an operation of detecting a sliding event in which a size of a display area of the display is changed by a slide operation of the display while displaying the input area through the execution screen (e.g., while a user input is received based on the input area); an operation of correcting input coordinates related to a user input of the input area based on the size of the display area that changes according to the slide state based on detection of the sliding event; and an operation of processing a user input based on the corrected input coordinates.
[0171] An electronic device (101) according to one embodiment of the present disclosure may include a first housing (e.g., a first housing (310) of FIGS. 3A to 3D), a second housing (e.g., a second housing (320) of FIGS. 3A to 3D) arranged to slide in a designated direction from the first housing, a display (e.g., a flexible display (330) of FIGS. 3A to 3D) having a first display area (e.g., a display area in a closed state (or a reduced state)) and a second display area (e.g., a display area in an open state (or an expanded state)) extending from the first display area according to a state change according to the second slide movement, at least one processor (e.g., a processor (120) of FIG. 1 or 6) operatively connected to the display, and a memory (e.g., a memory (130) of FIG. 1 or 6) operatively connected to the at least one processor, including processing circuitry. According to one embodiment, the memory (130) may store instructions that, when individually and / or collectively executed by the at least one processor (120), cause the electronic device (101) to perform operations.
[0172] According to one embodiment, the memory (130) may include an instruction that, when executed by the at least one processor (120), causes the electronic device (101) to display an execution screen of an application in a specified state of the display. According to one embodiment, the memory (130) may include an instruction that, when executed by the at least one processor (120), causes the electronic device (101) to display an input area through the execution screen. According to one embodiment, the memory (130) may include an instruction that, when executed by the at least one processor (120), causes the electronic device (101) to detect a sliding event in which the size of a display area of the display is changed by a sliding motion of the display while displaying the input area through the execution screen. According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to correct input coordinates related to user input of the input area based on a size of the display area that changes according to a slide state, based on detection of the sliding event. According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to process the user input based on the corrected input coordinates.
[0173] According to one embodiment, the specified state may include a slide-in state of the display or a slide-out state of the display. According to one embodiment, the first display area may include an area that is visually exposed in the slide-in state. According to one embodiment, the second display area may include an area that is visually exposed by extending from the first display area in response to a change in the size of the display area that changes from the slide-in state to the slide-out state.
[0174] According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to compensate for a user input between a touch position where an actual touch of the user is input and a release position where the touch is released after the slide movement in response to a change in the size of the display area due to the slide movement of the second housing.
[0175] According to one embodiment, the input area may include an area into which user input can be entered.
[0176] According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to correct a touch value for a user input based on an input area according to a slide state of the display in a situation where the user input and the sliding event occur together.
[0177] According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to determine a slide action that changes the size of a display area of the display while the user input is received. According to one embodiment, the sliding event may include an event in which the size of the display area of the display is changed by the slide action of the display.
[0178] According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to correct input coordinates according to the user input by applying an offset corresponding to a slide state of the display to the input coordinates.
[0179] According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to correct the input coordinates by changing a TSP (touch screen panel) refresh rate.
[0180] According to one embodiment, the memory (130) may include an instruction that, when executed by the at least one processor (120), causes the electronic device (101) to correct the input coordinates by mapping a cycle for reading the input coordinates according to the user input when the sliding event occurs and a sliding speed.
[0181] According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to control the display to display information corresponding to a user input on the input area based on corrected input coordinates.
[0182] According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to determine whether an input area capable of receiving a user input exists on the execution screen of the running application based on detection of a sliding event. According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to determine whether a user input exists through the input area. According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to correct input coordinates corresponding to the user input based on a slide state.
[0183] According to one embodiment, the memory (130) may include instructions that, when executed by the at least one processor (120), cause the electronic device (101) to stop a correction process for the user input based on the termination of the sliding event.
[0184] Hereinafter, the operating method of the electronic device (101) according to various embodiments will be described in detail. The operations performed in the electronic device (101) according to various embodiments may be executed by the processor (120) including various processing circuitry and / or executable program elements of the electronic device (101). According to one embodiment, the operations performed in the electronic device (101) may be stored as instructions in the memory (130) and individually and / or collectively executed by the processor (120).
[0185] FIG. 7 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.
[0186] According to one embodiment, FIG. 7 may illustrate an example of an operation of adaptively processing (e.g., compensating) a user input (e.g., a touch) in response to a slide motion (e.g., a slide out or slide in motion) of a display (e.g., a flexible display (610)) in an electronic device (101) (e.g., electronic device (200) and / or electronic device (300)) according to one embodiment.
[0187] According to one embodiment, the electronic device (101) may include a first housing (e.g., the first housing (310) of FIGS. 3A to 3D) and a second housing (e.g., the second housing (320) of FIGS. 3A to 3D) arranged to slide relative to the first housing. According to one embodiment, the electronic device (101) may include a display (e.g., the flexible display (330) of FIGS. 3A to 3D) that supports a first display area (e.g., a display area in a slide-in state) and a second display area (e.g., a display area in a slide-out state) that extends (or expands) from the first display area.
[0188] In an electronic device (101) according to one embodiment of the present disclosure, a method for processing a user input according to a slide motion of a display may be performed, for example, according to a flowchart illustrated in FIG. 7. The flowchart illustrated in FIG. 7 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 701 to 709 may be performed in at least one processor (120) of the electronic device (101).
[0189] As illustrated in FIG. 7, an operation method (e.g., an operation method for processing a user input in response to a slide operation) performed by an electronic device (101) according to one embodiment may include an operation (701) of displaying an input area through an execution screen, an operation (703) of receiving a user input based on the input area, an operation (705) of detecting a sliding event while displaying the input area through the execution screen, an operation (707) of correcting an input coordinate corresponding to a user input in the input area based on a slide state, and an operation (709) of processing a user input based on the corrected input coordinate.
[0190] Referring to FIG. 7, in operation 701, the processor (120) of the electronic device (101) may perform an operation of displaying an input area through an execution screen. According to one embodiment, the processor (120) may execute an application (e.g., a browser application, a message application, a messenger application) and display an input area through the execution screen of the application. In one embodiment, the input area may represent an area where a user input (e.g., a touch input, a hovering touch input, or an air gesture input) can be input. For example, the input area may include, but is not limited to, a keyboard (or keypad) (e.g., a screen keyboard), a text input area of a messenger, a function icon, a URL input area of a browser, and / or a user input box of a webpage (e.g., a search box).
[0191] According to one embodiment, the input area can receive a user input (e.g., a touch input, a hovering touch input, or an air gesture input) on the execution screen of the running application, and the application can transmit various information (e.g., touch information, coordinate information, text information) about the user input received through the input area to the processor (120). According to one embodiment, the input area can be provided on demand. For example, the input area can be activated when there is a user request, for example, based on a keyboard (or keypad) call command and / or a user selection (e.g., a touch) of an input area (e.g., a URL input area, a search box) included in the application upon execution of the application, and can wait for reception of a user input.
[0192] In operation 703, the processor (120) may perform an operation for receiving a user input based on an input area. According to one embodiment, the user may perform a designated user input (e.g., input for text input, input for selecting a function icon, or input for copy & paste input) through the input area. According to one embodiment, the processor (120) may detect a user input from the displayed input area.
[0193] In operation 705, the processor (120) may perform an operation of detecting a sliding event while displaying an input area through an execution screen. According to one embodiment, the processor (120) may determine a slide operation (e.g., a slide-in operation or a slide-out operation) in which the size of a display area of a display changes while displaying an input area through an execution screen. According to one embodiment, the processor (120) may determine whether a slide operation of the display has started, and if the start of the slide operation is detected, it may be determined as a trigger related to a sliding event.
[0194] According to one embodiment, a sliding event includes an event in which the size of a display area of a display (e.g., the physical size of the display) is changed by a sliding motion of the display, and may include, for example, both up / down and / or left / right directionality and zoom-in / out changeability depending on the form factor of the electronic device (101). According to one embodiment, the processor (120) may determine the start and end of the sliding event based on sensor data of a designated sensor (e.g., a Hall sensor). According to one embodiment, the processor (120) may determine the start and end times for a touch position update based on the start and end of the sliding event. According to one embodiment, the processor (120) may periodically check the sensor values related to the sliding motion and use them to correct the position value of the current input area even during the sliding motion of the display. According to one embodiment, the start time of the sliding event may be recognized through a designated sensor, and the end time of the sliding event may be inferred and applied based on the slide speed.
[0195] In operation 707, the processor (120) may perform an operation of correcting input coordinates corresponding to a user input of an input area based on a slide state. According to one embodiment, a position where the input area is displayed may change due to a slide operation of the display. According to one embodiment, a situation may occur where an input position (or a position touched by the user) (e.g., a position intended by the user) of the input area and a user screen position (or a position where the touch is released) (e.g., a position where the touch is released after a slide movement) do not match due to a slide operation of the display (e.g., a sliding event). According to one embodiment, when the above situation occurs, the processor (120) may correct (e.g., correct a touch value) the touch coordinates according to the user input based on the slide state. According to one embodiment, the processor (120) may correct the touch coordinates by applying an offset corresponding to the slide state to the touch coordinates according to the user input, and process the user input based on the corrected touch coordinates. According to one embodiment, the processor (120) may operate to compensate for touch values physically input based on the current slide state so that they are in the same situation at the final stage. According to one embodiment, compensation for user input is described with reference to the drawings described below.
[0196] In operation 709, the processor (120) may perform an operation for processing a user input based on the corrected input coordinates. According to one embodiment, the processor (120) may control the display module (160) to display information corresponding to the user input on the input area based on the corrected input coordinates. For example, the processor (120) may correct the position value of the input area and update it on the execution screen to provide it to the user. According to one embodiment, an operation for processing a user input will be described with reference to the drawings described below.
[0197] According to one embodiment, FIG. 7 illustrates a case where a slide motion is initiated sequentially or in parallel with a user input, but the present disclosure is not limited thereto. FIG. 7 illustrates detecting a sliding event while a user input is received, but the present disclosure is not limited thereto. For example, according to the present disclosure, a slide movement may occur first, and the user input may occur while the slide movement is in progress. In one embodiment, a situation where a user input and a slide motion occur together may include, for example, a case where a touch occurs during a slide in / out operation of the flexible display (610), or a case where a slide in / out of the flexible display (610) occurs during a touch operation. For example, the present disclosure may include adaptively processing the user input according to the slide movement in a situation where a user input and a slide motion occur together.
[0198] FIG. 8 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.
[0199] According to one embodiment, FIG. 8 may illustrate an example of an operation of adaptively processing (e.g., compensating) a user input (e.g., a touch input, a hovering touch input, or an air gesture input) in response to a slide motion (e.g., a slide out or slide in motion) of a display (e.g., a flexible display (610)) in an electronic device (101) (e.g., the electronic device (200) and / or the electronic device (300)) according to one embodiment.
[0200] According to one embodiment, the electronic device (101) may include a first housing (e.g., the first housing (310) of FIGS. 3A to 3D) and a second housing (e.g., the second housing (320) of FIGS. 3A to 3D) arranged to slide relative to the first housing. According to one embodiment, the electronic device (101) may include a display (e.g., the flexible display (330) of FIGS. 3A to 3D) that supports a first display area (e.g., a display area in a slide-in state) and a second display area (e.g., a display area in a slide-out state) that extends (or expands) from the first display area.
[0201] In an electronic device (101) according to one embodiment of the present disclosure, a method for processing a user input according to a slide motion of a display may be performed, for example, according to a flowchart illustrated in FIG. 8. The flowchart illustrated in FIG. 8 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed or performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 801 to 815 may be performed in at least one processor (120) of the electronic device (101).
[0202] According to one embodiment, the operations described in FIG. 8 may be performed heuristically, for example, in combination with the operations described in FIG. 7, or may be performed heuristically as detailed operations of at least some of the operations described.
[0203] As illustrated in FIG. 8, an operation method (e.g., an operation method for processing a user input in response to a slide operation) performed by an electronic device (101) according to an embodiment may include an operation (801) for detecting a sliding event, an operation (803) for determining whether an input area exists on an execution screen, an operation (807) for processing a specified operation based on a slide state if the input area does not exist, an operation (805) for determining whether a user input exists through the input area if there is no user input, an operation (807) for processing a specified operation based on the slide state, an operation (809) for correcting input coordinates corresponding to the user input based on the slide state if there is a user input, an operation (811) for processing the user input based on the corrected input coordinates, an operation (813) for determining whether the end of a sliding event is detected, an operation for performing the above processing for the user input if the end of the sliding event is not detected, and an operation for processing a specified operation based on the end of the sliding event if the end of the sliding event is detected.
[0204] Referring to FIG. 8, in operation 801, the processor (120) of the electronic device (101) may perform an operation of detecting a sliding event. According to one embodiment, the sliding event includes an event in which the size of the display area of the display (e.g., the physical size of the display) is changed by a sliding operation of the display, and may include, for example, both the directionality of up and down and / or left and right and the changeability of zoom in / out depending on the form factor of the electronic device (101). According to one embodiment, the processor (120) may determine the start and end of the sliding event based on sensor data of a designated sensor (e.g., a Hall sensor). According to one embodiment, the start time of the sliding event may be recognized through the designated sensor, and the end time of the sliding event may be inferred and applied based on a slide speed.
[0205] In operation 803, the processor (120) may perform an operation of determining whether an input area exists on the execution screen. According to one embodiment, the processor (120) may determine, based on detection of a sliding event, whether an input area capable of receiving a user input exists on the execution screen of the running application. In one embodiment, the input area may indicate an area capable of receiving a user input (e.g., a touch input, a hovering touch input, or an air gesture input). For example, the input area may include, but is not limited to, a keyboard (or keypad) (e.g., an on-screen keyboard), a text input area of a messenger, a function icon, a URL input area of a browser, and / or a user input box of a webpage.
[0206] In operation 803, if the input area does not exist (e.g., 'No' in operation 803), in operation 807, the processor (120) may perform an operation of processing a specified operation based on the slide state. According to one embodiment, the processor (120) may control the display module (160) to display the execution screen of the application through at least one display area in response to a change in the size of the display area that changes according to the slide operation. According to one embodiment, the processor (120) may process an operation of displaying the execution screen of the application by zooming in response to a change in the size of the display area, or of displaying the content within the execution screen by moving it.
[0207] In operation 803, if an input area exists (e.g., 'yes' in operation 803), in operation 805, the processor (120) may perform an operation of determining whether there is a user input through the input area. According to one embodiment, the user may perform a user input (e.g., an input for text input, an input for selecting a function icon, or an input for copy & paste input) through the input area. According to one embodiment, the processor (120) may detect a user input from the displayed input area.
[0208] In operation 805, if there is no user input (e.g., 'No' in operation 805), in operation 807, the processor (120) may perform an operation for processing a specified operation based on the slide state. According to one embodiment, the processor (120) may control the display module (160) to display an execution screen of an application through at least one display area in response to a change in the size of the display area that changes according to the slide operation.
[0209] In operation 805, if there is a user input (e.g., 'Yes' in operation 805), in operation 809, the processor (120) may perform an operation of correcting input coordinates corresponding to the user input based on a slide state. According to one embodiment, a position at which an input area is displayed on a display may change due to a slide operation of the display. According to one embodiment, a situation may occur in which an input position (or a position touched by the user) of the input area (e.g., a position intended by the user) and a user screen position (or a position at which the touch is released) (e.g., a position at which the touch is released after a slide movement) do not match depending on a slide operation of the display (e.g., a sliding event). According to one embodiment, when the above situation occurs, the processor (120) may correct the touch coordinates (e.g., correct the touch value) for the user input based on the slide state. According to one embodiment, the processor (120) may correct the touch coordinates by applying an offset corresponding to the slide state to the touch coordinates according to the user input, and process the user input based on the corrected touch coordinates. According to one embodiment, the processor (120) may operate to correct the input touch values according to the current slide state so that they are suitable for the same situation in the final stage. According to one embodiment, the input touch values may be obtained by a user input, such as a touch input based on an input area, a hovering touch input, or an air gesture input. According to one embodiment, the correction of the user input will be described with reference to the drawings described below.
[0210] In operation 811, the processor (120) may perform an operation of processing a user input based on the corrected input coordinates. According to one embodiment, the processor (120) may control the display module (160) to display information corresponding to the user input on the input area based on the corrected input coordinates. For example, the processor (120) may correct the position value of the input area and update it on the execution screen to provide it to the user. According to one embodiment, an operation of processing a user input will be described with reference to the drawings described below.
[0211] At step 813, the processor (120) may perform an operation to determine whether the end of the sliding event is detected. According to one embodiment, the processor (120) may stop a compensation process for a user input based on the end of the sliding event. According to one embodiment, the processor (120) may determine the start and end of the sliding event based on sensor data of a designated sensor (e.g., a Hall sensor). According to one embodiment, the processor (120) may periodically check a sensor value related to the slide motion to determine whether the sliding event has ended. According to one embodiment, the processor (120) may recognize the start time of the sliding event through the designated sensor, and infer the end time of the sliding event based on the slide speed.
[0212] In operation 813, if the end of the sliding event is not detected (e.g., 'No' in operation 813), the processor (120) may proceed to operation 805 and perform operations below operation 805. For example, the processor (120) may perform an operation for performing the above processing on a user input.
[0213] In operation 813, if the end of the sliding event is detected (e.g., 'yes' in operation 813), in operation 815, the processor (120) may perform an operation for processing a specified operation based on the end of the sliding event. According to one embodiment, the processor (120) may update the execution screen with information about user input based on the input area (e.g., text entered by the user) based on the current slide state and provide it to the user.
[0214] FIG. 9 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.
[0215] According to one embodiment, FIG. 9 may illustrate an example of an operation of adaptively processing (e.g., compensating) a user input (e.g., a touch input, a hovering touch input, or an air gesture input) in response to a slide motion (e.g., a slide out or slide in motion) of a display (e.g., a flexible display (610)) in an electronic device (101) (e.g., the electronic device (200) and / or the electronic device (300)) according to one embodiment.
[0216] According to one embodiment, the electronic device (101) may include a first housing (e.g., the first housing (310) of FIGS. 3A to 3D) and a second housing (e.g., the second housing (320) of FIGS. 3A to 3D) arranged to slide relative to the first housing. According to one embodiment, the electronic device (101) may include a display (e.g., the flexible display (330) of FIGS. 3A to 3D) that supports a first display area (e.g., a display area in a slide-in state) and a second display area (e.g., a display area in a slide-out state) that extends (or expands) from the first display area.
[0217] In an electronic device (101) according to one embodiment of the present disclosure, a method for processing a user input according to a slide motion of a display may be performed, for example, according to a flowchart illustrated in FIG. 9. The flowchart illustrated in FIG. 9 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed or performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 901 to 911 may be performed in at least one processor (120) of the electronic device (101).
[0218] According to one embodiment, the operation described in FIG. 9 may be performed heuristically, for example, in combination with the operations described in FIGS. 7 to 8, or may be performed heuristically as a detailed operation of at least some of the operations described.
[0219] As illustrated in FIG. 9, an operation method (e.g., an operation method for processing a user input in response to a slide action) performed by an electronic device (101) according to one embodiment may include an operation (901) of detecting a situation in which a user input and a slide action occur together, an operation (903) of performing a correction process, an operation (905) of determining whether an interrupt occurs, an operation (907) of adding an interrupt argument if an interrupt occurs, an operation (909) of determining whether the end of a sliding event is detected if an interrupt does not occur, an operation of performing the above processing for the user input by proceeding to operation 903 if the end of the sliding event is not detected, and an operation (911) of processing a specified operation based on the end of the sliding event if the end of the sliding event is detected.
[0220] Referring to FIG. 9, in operation 901, the processor (120) of the electronic device (101) may perform an operation for detecting a situation in which a user input and a slide action occur together. According to one embodiment, the situation in which the user input and the slide action occur together may include a situation in which an input area into which a user's touch is input may be affected by a sliding event. For example, while a user is performing a touch input using a keyboard, the situation may include a situation in which an input location of the keyboard (or: a location touched by the user (e.g., a location intended by the user) changes according to a slide action of the display.
[0221] According to one embodiment, when an input area is displayed on a real screen and a user input (e.g., a touch input, a hovering touch input, or an air gesture input) based on the input area is possible, the processor (120) may operate to correct a touch value for the input area according to a slide state of the display when a sliding event occurs. For example, when a user input occurs during a slide operation in which the size of the display area of the display changes, the processor (120) may operate to process the user input based on a correction value and update the user input on the execution screen to provide it to the user.
[0222] In operation 903, the processor (120) may perform an operation for performing a compensation process. According to one embodiment, the processor (120) may perform the compensation process according to the current slide state of the display. For example, the processor (120) may compensate and provide touch values input during the slide operation of the display to correspond to the current slide state of the display.
[0223] According to one embodiment, the processor (120) can remap an input area (e.g., a keyboard) and an execution screen of an application. According to one embodiment, factors for remapping the input area and the execution screen can include position coordinates of the input area (e.g., a keyboard), a current input position through input coordinates according to a user input (e.g., a touch input, a hovering touch input, or an air gesture input), a size of the input area (e.g., a keyboard) itself, and / or a TSP (touch screen panel) refresh rate.
[0224] In one embodiment, the processor (120) may process a correction process to fix the size and position of the input area and to fix the user's current input position (e.g., the touched position). For example, the absolute position of the display may change, but the relative position from which the user views the display may remain constant. Examples of this are illustrated in FIGS. 10A and 10B .
[0225] In one embodiment, the processor (120) may process a compensation process to fix the size of the input area and change the position of the input area. For example, the size of the input area may be fixed, but the starting point of the user input may change based on a sliding event. For example, the absolute position of the display may move up and down and / or left and right based on a sliding event, but the actual touch coordinates may remain at their original values. Examples of this are illustrated in FIGS. 11A and 11B .
[0226] In one embodiment, the processor (120) may fix the user's current input location (e.g., the touched location) and process a correction process to increase or decrease only the size of the execution screen in real time. For example, the position coordinates of the input area may also be corrected. For example, if the size of the input area changes, the absolute position of the display may also change, but the relative position the user is looking at may be maintained at the position of the input area. Examples of this are illustrated in FIGS. 12A, 12B, 12C, and 12D.
[0227] In one embodiment, the processor (120) may instantaneously increase the TSP refresh rate when compensating for user input, thereby allowing the processor (120) to respond accordingly. For example, the processor (120) may change the TSP refresh rate through register access of the TSP.
[0228] According to one embodiment, the processor (120) can process compensation for user input based on at least one of various compensation combinations. According to one embodiment, it can be assumed that the sliding length according to the slide motion of the display is about 55 mm, the sliding speed according to the slide motion is about 55 mm / s, the minimum size of the screen according to the slide-in state is about 1000*3000, the maximum size of the screen according to the slide-out state is about 1000*3825, and the TSP refresh rate at which the display (e.g., the touch detection circuit (620) or the touch IC) transmits the touch coordinates is about 120 Hz. In one embodiment, when the TSP refresh rate is about 12 Hz, for example, a frame can be updated every about 8 to 9 ms (e.g., about 8.3 ms).
[0229] According to one embodiment, the electronic device (101) may have about N different coordinates depending on the vertical length of the display area for each form factor. For example, if the vertical length of the display area is about 200 mm, it may have about 3000 coordinates. In this case, it may have about 15 coordinates per 1 mm. For example, during about 1 second of a slide motion according to a sliding event, the length of the display area may increase by about 55 mm, and about 825 (e.g., 55 mm * 15) touch coordinates may be generated during about 120 frames. These examples can be summarized as shown in below.
[0230] Frame: Time Coordinates000:008.3msx:1000 y:3000001:016.6msx:1000 y:3007002:024.9msx:1000 y:3014003:033.2msx:1000 y:3021......118:583.4msx:1000 y:3811119:591.7msx:1000 y:3818120:600.0msx:1000 y:3825
[0231] As illustrated in , for example, a frame may be updated approximately every 8.3 ms, and approximately 7 coordinate values may be added to the corresponding coordinate values. Examples of this are illustrated in FIGS. 10a and 10b.
[0232] In operation 905, the processor (120) may perform an operation to determine whether an interrupt has occurred. According to one embodiment, the interrupt may include a situation in which a slide operation according to a sliding event is not completed and the slide operation is stopped or canceled.
[0233] At operation 905, the processor (120) may perform an operation of adding an interrupt argument at operation 907 when an interrupt occurs (e.g., 'yes' of operation 905). According to one embodiment, the processor (120) may perform recalibration for user input including the corresponding interrupt argument when the slide operation of the display is stopped or canceled due to the interrupt. According to one embodiment, when an interrupt is detected (e.g., a sliding stop is detected), the processor (120) may determine the type of interrupt (e.g., a forced stop by the user, a law battery, and / or a call situation occurs) and determine an interrupt argument according to the type of interrupt. The interrupt argument may include, for example, an argument value for a situation in which the slide operation is interrupted and not completed.
[0234] At operation 905, if no interrupt occurs (e.g., 'No' at operation 905), at operation 909, the processor (120) may perform an operation of determining whether the end of the sliding event is detected.
[0235] In operation 909, if the end of the sliding event is not detected (e.g., 'No' in operation 909), the processor (120) may proceed to operation 903 and perform operations below operation 903. For example, the processor (120) may perform the above processing for user input.
[0236] At operation 909, if the end of the sliding event is detected (e.g., 'yes' of operation 909), at operation 911, the processor (120) may perform an operation of processing a specified operation based on the end of the sliding event.
[0237] FIGS. 10A and 10B are diagrams illustrating an example of an operation for processing user input in an electronic device according to one embodiment of the present disclosure.
[0238] According to one embodiment, FIGS. 10A and 10B may illustrate an example of an operation for correcting a user input location (e.g., a touched location) in real time according to a slide motion in an input area.
[0239] According to one embodiment, as illustrated in FIGS. 10A and 10B , an example may be provided in which the size and position of the input area are fixed, and compensation for user input is processed while remaining fixed to the user's current input position. For example, an example may be provided in which compensation is provided so that the absolute position of the display may change, but the relative position viewed by the user remains constant.
[0240] According to one embodiment, FIGS. 10A and 10B may illustrate a comparison example of a touch location (1010) where a user's actual touch is input on an input area (e.g., a keyboard) of an electronic device (101) and a release location (1020, 1030) where the touch is released according to a slide movement. For example, FIG. 10A may illustrate an operation example in which there is no correction of touch coordinates according to a slide movement, and FIG. 10B may illustrate an operation example in which touch coordinates are corrected and provided according to a slide movement.
[0241] According to one embodiment, when a user touch input (1010) is located at coordinates of about 1000, 3000, and a sliding event occurs, the position may be at coordinates of about 1000, 3000 even when the touch is released. However, as in the example of FIG. 10A, depending on the sliding speed according to the sliding event, the position actually shown to the user may be, for example, a position (1020) that has risen by about 5.5 cm per second. For example, the touch input position and the touch release position may be different. On the other hand, according to the present disclosure, by correcting the touch release position to correspond to the touch input position based on the sliding speed, and providing a release point at coordinates of about 1000, 3007 rather than coordinates of about 1000, 3000, the user's touch input position and the touch release position may appear to be the same.
[0242] In one embodiment, an update may be required within a specified interval between a touch input and a touch release, and in one embodiment, compensation may be performed by updating a frame approximately every N ms corresponding to the interval for each form factor of the electronic device (101). For example, if the specified interval between a touch input and a touch release in a particular form factor of the electronic device (101) is approximately 70 ms, compensation may be performed by updating a frame approximately every 8.3 ms. For example, a compensation value of approximately 7 may be applied when a touch is released approximately 8.3 ms after a first frame, a compensation value of approximately 14 may be applied when a touch is released approximately 16.6 ms after a second frame, ..., a compensation value of approximately 70 may be applied when a touch is released approximately 83 ms after an N-th frame.
[0243] For example, as illustrated in FIG. 10a, coordinates (1010) of 1000, 3000 according to touch input may be changed to coordinates (1020) of 1000, 3070 according to touch release after about 83 ms. Accordingly, as illustrated in FIG. 10b, a touch coordinate correction value of about 70 may be applied to coordinates (1020) of 1000, 3070 according to touch release, so that coordinates (1030) according to touch release may be maintained at coordinates (1010) of 1000, 3000 according to touch input.
[0244] According to one embodiment, the processor (120) may further consider the UI response speed for real-time correction. For example, the processor (120) may map the cycle for reading input coordinates according to user input and the sliding speed when a sliding event occurs, and may correct the input coordinates in real time using the values. For example, the update time considering the TSP refresh rate of the touch IC and the firmware UI response speed (e.g., about 180 ms) may be considered together. For example, the final response time required to actually show to the user's eyes after a touch input may need to be processed within, for example, about 180 ms. In this case, the firmware UI update time is about 50 ms, and the touch IC update time and the firmware UI update time can be processed within about 180 ms, thereby supporting real-time correction.
[0245] In one embodiment, the electronic device (101) may experience a situation such as a degradation in performance (e.g., processing speed) depending on the use of the electronic device (101). In an embodiment of the present disclosure, when a degradation in performance of the electronic device (101) occurs, the TSP injection rate (e.g., touch IC transfer time) may be adjusted as described above to support a faster compensation process, thereby supporting faster processing.
[0246] According to one embodiment, the electronic device (101) may stop the correction process for the user input when the slide motion is stopped due to the occurrence of an interrupt. According to one embodiment, when a second slide motion (e.g., a slide-in motion) in the opposite direction to the first slide motion occurs during the first slide motion (e.g., a slide-out motion), the electronic device (101) may reverse the existing processing process to support real-time correction, thereby not reducing the user's usability.
[0247] FIGS. 11A and 11B are diagrams illustrating an example of an operation for processing user input in an electronic device according to one embodiment of the present disclosure.
[0248] According to one embodiment, FIGS. 11A and 11B may illustrate an example of providing a notification regarding processing of a user input according to a slide motion of a display through an input area (e.g., a keyboard) in an electronic device (101).
[0249] According to one embodiment, FIG. 11A may illustrate an example of an input area (1110) (e.g., a keyboard) and a touch input on the input area (1110) in a slide-in state of a display. According to one embodiment, FIG. 11B may illustrate an example of providing a notification for correction according to a touch input by changing the input area (1110) to an input area (1120) according to a slide-out operation of the display.
[0250] As illustrated in FIGS. 11A and 11B , the electronic device (101) can support user notification according to correction processing of user input. According to one embodiment, the electronic device (101) can detect a slide-out action during a user input through the first input area (1110) in a slide-in state of the display.
[0251] According to one embodiment, when the electronic device (101) detects a slide-out motion, the electronic device (101) may change a button (or key) having a first size in the first input area (1110) to a button (or key) having a second size (1130) in the opposite direction to the slide-out direction and provide the button (or key) as the second input area (1120). For example, the electronic device (101) may change the input area in response to a change in the size of the display area according to the slide-out motion to provide the user with a notification regarding correction processing of the user input.
[0252] FIGS. 12A, 12B, 12C, and 12D are diagrams illustrating operational examples of user input processing in an electronic device according to one embodiment of the present disclosure.
[0253] According to one embodiment, FIG. 12A may illustrate an example of providing a first input area (1210) of a first size and an execution screen in a slide-in state of a display. According to one embodiment, FIG. 12B may illustrate an example of providing a second input area (1220) of a second size and an execution screen in a slide-in state of a display. According to one embodiment, FIGS. 12C and 12D may illustrate examples of a second input area (1220) and an execution screen provided according to a change in the size of a display area according to a slide-out operation of the display.
[0254] As illustrated in FIG. 12A, the electronic device (101) can detect a slide-out motion during a user input through the first input area (1210) in a slide-in state of the display. According to one embodiment, when the electronic device (101) detects the slide-out motion, as illustrated in FIG. 12B, the electronic device (101) can change a button (or key) having a first size in the first input area (1210) into a button (or key) having a second size (1130) in a direction opposite to the slide-out direction and provide it as a second input area (1220).
[0255] As illustrated in FIGS. 12C and 12D , the electronic device (101) may maintain (or fix) the second input area (1220) and provide an application execution screen with a changed size (e.g., increased size) in response to a change in the size of the display area according to the slide-out operation. For example, the electronic device (101) may change and provide the execution screen in real time in response to the changed size (1230, 1240) of the display area according to the slide-out operation. For example, the electronic device (101) may change the size of the execution screen that displays content during the slide-out operation in a state where the first input area (1210) is changed to the second input area (1220). According to one embodiment, the electronic device (101) may correct and provide a user input based on the second input area (1210).
[0256] An electronic device (101) according to one embodiment of the present disclosure may include a display having a first display area and a second display area extending from the first display area. An operation method performed by the electronic device (101) according to one embodiment of the present disclosure may include an operation of displaying an execution screen of an application in a specified state of the display. The operation method according to one embodiment may include an operation of displaying an input area through the execution screen. The operation method according to one embodiment may include an operation of detecting a sliding event in which a size of a display area of the display is changed by a slide operation of the display while the input area is displayed through the execution screen. The operation method according to one embodiment may include an operation of correcting an input coordinate related to a user input of the input area based on a size of the display area that changes according to a slide state based on detection of the sliding event. The operation method according to one embodiment may include an operation of processing the user input based on the corrected input coordinate.
[0257] According to one embodiment, the specified state may include a slide-in state of the display or a slide-out state of the display. According to one embodiment, the first display area may include an area that is visually exposed in the slide-in state. According to one embodiment, the second display area may include an area that is visually exposed by extending from the first display area in response to a change in the size of the display area that changes from the slide-in state to the slide-out state.
[0258] According to one embodiment, the correcting action may include an action of correcting a touch value for an input area according to a slide state of the display in a situation where the user input and the sliding event occur together.
[0259] According to one embodiment, the operating method may include an operation of determining a slide action that changes the size of the display area of the display while the user input is received. According to one embodiment, the sliding event may include an event in which the size of the display area of the display is changed by the slide action of the display.
[0260] According to one embodiment, the correcting operation may include an operation of correcting the input coordinates by applying an offset corresponding to a slide state of the display to the input coordinates according to the user input.
[0261] According to one embodiment, the correcting operation may include an operation of correcting the input coordinates by changing a touch screen panel (TSP) refresh rate.
[0262] According to one embodiment, the correcting operation may include an operation of correcting the input coordinates by mapping a cycle for reading the input coordinates according to the user input and a sliding speed when the sliding event occurs.
[0263] According to one embodiment, the operating method may include an operation of determining whether an input area capable of receiving user input exists on the execution screen of a running application based on detection of a sliding event. According to one embodiment, the operating method may include an operation of determining whether a user input has been received through the input area. According to one embodiment, the operating method may include an operation of correcting input coordinates corresponding to the user input based on a slide state.
[0264] The various embodiments of the present disclosure disclosed in this specification and drawings are intended to provide specific examples to facilitate easy explanation of the technical content of the present disclosure and to aid understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be interpreted to include all modifications or variations derived based on the technical concepts of the present disclosure, in addition to the embodiments disclosed herein.
Claims
1. In electronic devices, 1st housing; A second housing arranged to slide in a specified direction from the first housing; A display having a first display area and a second display area extending from the first display area according to a change in state according to a sliding movement of the second housing; At least one processor comprising processing circuitry and operatively connected to the display; and comprising a memory operatively connected to at least one processor; The above memory, when executed by the at least one processor, causes the electronic device to: Display the application's execution screen in the specified state of the above display, Display the input area through the above execution screen, While displaying the input area through the above execution screen, detecting a sliding event in which the size of the display area of the display is changed by a sliding motion of the display, Based on the detection of the above sliding event, the input coordinates related to the user input of the input area are corrected based on the size of the display area that changes according to the slide state, and An electronic device storing instructions for processing the user input based on the corrected input coordinates.
2. In paragraph 1, The above specified state includes a slide-in state of the display or a slide-out state of the display, The above first display area includes an area that is visually exposed in the slide-in state, The second display area includes an area that is visually exposed and extends from the first display area in response to a change in the size of the display area, changing from the slide-in state to the slide-out state. The above input area is an electronic device including an area where user input can be entered.
3. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device that compensates for a user input between a touch position where an actual touch of the user is input and a release position where the touch is released after the slide movement in response to a change in the size of the display area due to the slide movement of the second housing.
4. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device that compensates a touch value for a user input based on an input area according to a slide state of the display in a situation where the user input and the sliding event occur together.
5. In the fourth paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device that determines a slide action that changes the size of a display area of the display while receiving said user input.
6. In the fourth paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device that corrects the input coordinates by applying an offset corresponding to the slide state of the display to the input coordinates according to the user input.
7. In the sixth paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: An electronic device that corrects the input coordinates by changing the TSP (touch screen panel) refresh rate.
8. In the sixth paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: An electronic device that maps the cycle for reading input coordinates according to the user input and the sliding speed when the above sliding event occurs to correct the input coordinates.
9. In the first paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: An electronic device that controls the display to display information corresponding to a user input on the input area based on corrected input coordinates.
10. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, Based on the detection of a sliding event, determine whether there is an input area on the running screen of the running application that can receive user input, Determine whether there is user input through the above input area, An electronic device that corrects input coordinates corresponding to the above user input based on a slide state.
11. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, An electronic device that causes the compensation process for said user input to be stopped based on the termination of said sliding event.
12. A method of operating an electronic device including a display having a first display area and a second display area extending from the first display area, An action to display the execution screen of an application in a specified state of the above display; An action to display an input area through the above execution screen; An action for detecting a sliding event in which the size of the display area of the display is changed by a sliding motion of the display while displaying an input area through the above execution screen; An operation of correcting input coordinates related to user input of the input area based on the size of the display area that changes according to the slide state, based on detection of the above sliding event; and A method comprising an action of processing the user input based on the corrected input coordinates.
13. In the 12th paragraph, the correcting operation is: A method for correcting a touch value for an input area according to a slide state of the display in a situation where the above user input and the above sliding event occur together.
14. In the 13th paragraph, the correcting operation is: A method including an action of correcting the input coordinates by applying an offset corresponding to a slide state of the display to the input coordinates according to the user input.
15. A non-transitory computer-readable medium storing instructions that, when executed by a processor of an electronic device, cause the processor to perform operations, The above instructions, when executed by the processor, cause the electronic device to: The action of displaying the application's execution screen in a specified state on the display. Action to display the input area through the above execution screen, An action for detecting a sliding event in which the size of the display area of the display is changed by a sliding action of the display while displaying the input area through the above execution screen; Based on detection of the above sliding event, an operation of correcting input coordinates related to user input in the input area based on the size of the display area that changes according to the slide state, and A non-transitory computer-readable recording medium that causes an operation to be performed to process the user input based on the above-mentioned corrected input coordinates.
Citation Information
Patent Citations
Method for calibrating touch input and mobile device employing the same
KR1020100081432A
Flexible display device with touch sensitive surface and Method for controlling the same
KR1020150118753A
A device and method for measuring the thermal properties of microfluidic fluids using a microchannel resonance structure
KR1020240121523A
Hose-linkable cleaning brush
KR1020240150556A
Electronic device including flexible display and method for controlling thereof
KR102266152B1
