Electronic device and method for identifying input to flexible display
By using hinge structures and sensors in the electronic devices of flexible displays, the problem of input recognition in the folded state of flexible displays is solved, accurate recognition of touch and drag inputs is achieved, and the user interaction experience is improved.
Patent Information
- Application Number
- CN202380092539.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-02-22
- Filing Date
- 2023-11-29
- Publication Date
- 2025-09-05
AI Technical Summary
It is difficult in the existing technology to accurately recognize input from external objects when the flexible display is in a folded state, especially input in the difficult-to-touch area corresponding to the hinge part.
An electronic device connected by a hinge structure, combined with an acceleration sensor and a Hall sensor, identifies touch and drag inputs of external objects in different areas by determining the folding angle and posture of the flexible display.
Accurate recognition of touch and drag input is achieved when the flexible display is in the folded state, improving the convenience of user interaction and the accuracy of input recognition.
Smart Images

Figure CN120604205A_ABST
Abstract
Description
Technical Field
[0001] The following description relates to an electronic device and method for recognizing input to a flexible display. Background Art
[0002] Recently, the distribution of various types of portable electronic devices, such as smartphones, tablet PCs, wireless headphones, smart watches, and laptop computers, is expanding. Some electronic devices may include deformable flexible displays. An electronic device including a flexible display may provide a folded state (e.g., fully folded), an unfolded state (e.g., fully unfolded), and intermediate states between the folded and unfolded states through the flexible display. The electronic device may provide various UIs to the user in the intermediate states. Summary of the Invention
[0003] Technical Solution
[0004] An electronic device is provided. The electronic device may include a first housing. The electronic device may include a second housing. The electronic device may include a hinge structure rotatably coupling the second housing to the first housing. The electronic device may include a flexible display disposed on a surface of the first housing and a surface of the second housing, spanning the hinge structure. The flexible display may include a first region corresponding to the first housing, a second region corresponding to the second housing, and a third region located between the first and second regions. The electronic device may include at least one sensor. The electronic device may include at least one processor operably coupled to the flexible display and the at least one sensor. The at least one processor may be configured to determine input to the flexible display based on an external object. The at least one processor may be configured to, in response to the input having a first contact point on the first region, recognize the input as a touch input to a first location on the first region, the first location corresponding to the location of the first contact point. The at least one processor may be configured to, in response to the input having a second contact point on the third region, recognize the input as a touch input to a second location on the third region, the second location determined based on a location of the second contact point of the external object and a location of a hover input caused by the external object. The at least one processor may be configured to provide a response to the touch input.
[0005] A method performed by an electronic device is provided. The method may include determining an input to a flexible display of the electronic device based on an external object. The method may include, in response to the input having a first contact point on a first area of the flexible display corresponding to a first housing, recognizing the input as a touch input to a first position on the first area, the first position corresponding to the position of the first contact point. The method may include, in response to the input having a second contact point on a third area of the flexible display located between the first area and the second area, recognizing the input as a touch input to a second position on the third area, the second area corresponding to the second housing, the second position determined based on the position of the second contact point of the external object and the position of a hover input caused by the external object. The method may include providing a response to the touch input. The flexible display may include a hinge structure that rotatably couples the second housing to the first housing (210).
[0006] An electronic device is provided. The electronic device may include a first housing. The electronic device may include a second housing. The electronic device may include a hinge structure rotatably coupling the second housing to the first housing. The electronic device may include a flexible display disposed on a surface of the first housing and a surface of the second housing, spanning the hinge structure. The flexible display may include a first area corresponding to the first housing, a second area corresponding to the second housing, and a third area located between the first and second areas. The electronic device may include at least one sensor. The electronic device may include at least one processor operably coupled to the flexible display and the at least one sensor. The at least one processor may be configured to determine the third area based on an angle between the first and second areas. The at least one processor may be configured to, in response to an external object moving from the first area toward the second area across the third area, determine the movement of the external object on the first area as a first drag input and determine the movement of the external object on the third area as a second drag input. The at least one processor may be configured to identify a touch input having a first length on the first area based on a first set of contact points located on the first area according to the first drag input. The at least one processor may be configured to recognize a touch input having a second length on the third area based on a second set of contact points located on the third area according to the second drag input and a hover input caused by the external object over the third area. The at least one processor may be configured to provide a response to the touch input having the first length and the touch input having the second length. BRIEF DESCRIPTION OF THE DRAWINGS
[0007] Figure 1 An example of a block diagram of an electronic device is shown.
[0008] Figure 2a and Figure 2b An example of the positional relationship between the first casing and the second casing in the unfolded state and the folded state of the electronic device is shown.
[0009] Figure 3a and Figure 3b An example of the positions of multiple acceleration sensors in an electronic device is shown.
[0010] Figure 4 An example of input to a flexible display in a folded state of an electronic device is shown.
[0011] Figure 5 An example of an area of a flexible display of an electronic device is shown.
[0012] Figures 6a to 6c An example of a method of determining input according to an area of a flexible display is shown.
[0013] Figure 7a and Figure 7b An example of a method of determining input according to an area of a flexible display is shown.
[0014] Figure 8a and Figure 8b An example of a flow chart representing the operation of a method of determining input according to an area of a flexible display is shown.
[0015] Figure 9a An example of a method of determining an input according to an area of a flexible display of an electronic device that is folded at an angle other than a right angle is shown.
[0016] Figure 9b An example of a method of determining an area of a flexible display of an electronic device that is folded at an angle other than a right angle is shown.
[0017] Figure 10 is a block diagram of an electronic device in a network environment according to various embodiments. DETAILED DESCRIPTION
[0018] The terms used in this disclosure are only used to describe specific embodiments and may not be intended to limit the scope of another embodiment. Singular expression may include plural expression, unless the context clearly states otherwise. Terms used herein (including technical terms or scientific terms) may have the same meaning as that generally understood by those of ordinary skill in the art described in this disclosure. In the terms used in this disclosure, the terms defined in general dictionaries may be interpreted as the same or similar meaning as the contextual meaning of the relevant technology, and unless clearly defined in this disclosure, are not interpreted as ideal or over-formalized meanings. In some cases, even the terms defined in this disclosure may not be interpreted as excluding embodiments of the present disclosure.
[0019] In the various embodiments of the present disclosure described below, the hardware method will be described as an example. However, since the various embodiments of the present disclosure include technologies using both hardware and software, the various embodiments of the present disclosure do not exclude software-based methods.
[0020] In the following description, for the sake of convenience, terms referring to device configurations (e.g., processor, display, module, etc.), terms for computing states (e.g., operation, process), terms referring to signals (e.g., data, signal, information, etc.), and terms referring to data (e.g., parameter, value, etc.) are exemplified. Therefore, the present disclosure is not limited to the terms described below, and other terms having the same technical meaning may be used.
[0021] In addition, in the present disclosure, the terms "greater than" or "less than" may be used to determine whether a specific condition is satisfied or achieved, but this is merely a description for expressing an example and does not exclude the description of "greater than or equal to" or "less than or equal to". The condition described by "greater than or equal to" may be replaced with "greater than", the condition described by "less than or equal to" may be replaced with "less than", and the condition described by "greater than or equal to and less than" may be replaced with "greater than and less than or equal to". In addition, hereinafter, "A" to "B" refers to at least one of the elements from A (including A) to B (including B).
[0022] The following describes an apparatus and method for determining input to an electronic device in a folded state, including a flexible display. Specifically, a flexible display folded at an angle may include a specific area where it is difficult to determine input from an external object. For example, the specific area may include an area of the flexible display corresponding to the hinge portion of the electronic device. Hereinafter, the specific area may be referred to as a difficult-to-touch area.
[0023] Figure 1 An example of a block diagram of an electronic device is shown.
[0024] refer to Figure 1, the electronic device (101) may include a processor (120), a display (160), a sensor (176), and a memory (130). For example, the processor (120), the flexible display (160), the sensor (176), and the memory (130) of the electronic device (101) may be electrically coupled and / or operatively coupled to each other via an electronic component such as a communication bus. The type and / or number of hardware components included in the electronic device (101) is not limited to Figure 1 For example, the electronic device (101) may only include Figure 1 Some of the hardware components are shown in .
[0025] According to an embodiment, the processor (120) of the electronic device (101) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic logic unit (ALU), a field programmable gate array (FPGA), and / or a central processing unit (CPU). The number of processors (120) may be one or more. For example, the processor (120) may be a multi-core processor such as a dual-core, quad-core, or hexa-core processor. The processor (120) may include at least one processor.
[0026] According to an embodiment, the memory (130) of the electronic device (101) may include a hardware component for storing data and / or instructions input to and / or output from the processor (120). For example, the memory (130) may include a volatile memory such as a random access memory (RAM) and / or a non-volatile memory such as a read-only memory (ROM). For example, the volatile memory may include at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). For example, the non-volatile memory may include at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, an optical disk, and an embedded multimedia card (eMMC).
[0027] According to an embodiment, in the memory (130) of the electronic device (101), one or more instructions indicating operations to be performed on data by the processor (120) may be stored. The set of instructions may be referred to as firmware, operating system, process, routine, subroutine and / or application. For example, the electronic device (101) and / or the processor (120) of the electronic device (101) may execute a set of multiple instructions distributed in the form of an application. Figures 5 to 9b At least one operation.
[0028] According to an embodiment, the flexible display (160) can be controlled by a controller such as a processor (120) to output visual information to a user. The flexible display (160) can include a flat panel display (FPD) and / or electronic paper. The FPD can include a liquid crystal display (LCD), a plasma display panel (PDP) and / or one or more light emitting diodes (LEDs). The LED can include an organic LED (OLED). Figure 2a and Figure 2b In the invention, the positional relationship between the first shell and the second shell of the electronic device (101) including the deformable flexible display (160) is described. For example, the flexible display (160) can be used to display a picture obtained by the processor (120) or a picture obtained by the display drive circuit system. For example, the electronic device (101) can display a picture on a part of the flexible display (160) according to the control of the display drive circuit system. For example, the electronic device (101) can display a picture on the part based on the angle at which the flexible display (160) is bent. However, it is not limited to this. For example, the electronic device (101) can display a picture through the entire display area of the flexible display (160) regardless of the angle at which the flexible display (160) is bent. The angle can be referred to as a folding degree.
[0029] According to an embodiment, the flexible display (160) may include at least one of the following: a cover plate (C plate) for protecting the flexible display (160), a base substrate, a thin film transistor (TFT) layer formed on the base substrate, a pixel layer (or an organic light emitting layer) including pixels that emit light based on a voltage applied from the thin film transistor layer, or a polarizing layer provided on the pixel layer. For example, the substrate may be formed of a plurality of layers. The polarizing layer may improve the clarity of an image displayed by the flexible display (160) by imparting directionality to light emitted from a portion of the flexible display (160) (e.g., the pixel layer). For example, the flexible display (160) may further include a window provided above the polarizing layer. For example, the flexible display (160) may not include a polarizing layer. For example, in the case where the flexible display (160) does not include a polarizing layer, in order to enhance visibility, the flexible display (160) may further include a color filter layer for enhancing color purity and a black matrix (BM) layer for preventing light reflection on the thin film encapsulation layer. For example, the flexible display (160) may further include a color filter layer and a black pixel definition layer (PDL). For example, the electronic device (101) may display a screen in a portion of the flexible display (160). For example, based on the angle between a first housing and a second housing of the electronic device (101), the screen may cause at least one image to be generated on a window provided in a portion different from the first housing. The image may be an example of a reflected image of the screen based on the window.
[0030] According to an embodiment, the flexible display (160) of the electronic device (101) may include a sensor (e.g., a touch sensor panel (TSP)) for detecting an external object (e.g., a user's finger) on the flexible display (160). For example, based on the TSP, the electronic device (101) can detect an external object that is in contact with the flexible display (160) or suspended above the flexible display (160). In response to detecting the external object, the electronic device (101) can perform a function related to a specific visual object (e.g., a picture) among the visual objects displayed in the flexible display (160) that corresponds to the position of the external object on the flexible display (160). For example, the electronic device (101) can recognize an input including a contact point corresponding to a first point of the flexible display (160) as an input corresponding to a second point different from the first point. The relevant details are described below. Figures 6a to 7b described in .
[0031] According to an embodiment, the sensor (176) of the electronic device (101) can generate electronic information that can be processed by the processor (120) and / or the memory (130) from non-electronic information related to the electronic device (101). The electronic information generated by the sensor (176) can be stored in the memory (130), processed by the processor (120), and / or sent to another electronic device different from the electronic device (101). The embodiment of the electronic device (101) is not limited to Figure 1 The type and / or number of the one or more sensors shown in . For example, the sensor ( 176 ) may include a global positioning system (GPS) sensor for detecting the geographic location of the electronic device ( 101 ) and an illuminance sensor for measuring ambient light brightness.
[0032] According to an embodiment, a sensor (176) of an electronic device (101) can detect a state of the electronic device (101) (e.g., a folded state or an unfolded state) or an external environmental state. The electronic device (101) can generate an electrical signal or a data value corresponding to the state detected from the sensor (176). For example, the sensor (176) can include at least one of a Hall sensor, an acceleration sensor, or a gyro sensor.
[0033] For example, the Hall sensor may include one or more magnets and / or one or more magnetic sensors. At least one of the one or more magnets or one or more magnetic sensors included in the Hall sensor may be set at different positions in the electronic device (101). The positional relationship of the one or more magnets and / or one or more magnetic sensors in the electronic device (101) may change according to the shape of the electronic device (101). The electronic device (101) may measure the change in the positional relationship by means of one or more magnetic sensors. The change in the positional relationship may cause a change in the magnetic field formed by the one or more magnets. The electronic device (101) may use the Hall sensor to obtain a power signal indicating the change in the magnetic field. For example, the electronic device (101) may use the power signal obtained from the Hall sensor to distinguish a posture or state (e.g., a folded state or an unfolded state). For example, the electronic device (101) may receive data indicating the state of the electronic device (101) from the Hall sensor. For example, the Hall sensor may output data indicating the shape of the flexible display (160). The shape of the flexible display (160) may change as it passes through a folding axis (e.g., Figure 2a The folding axis (237)) of the flexible display (160) is folded or unfolded. For example, the Hall sensor can output different data indicating the shape of the flexible display (160). For example, the electronic device (101) can determine the angle (e.g., folding angle) between the first shell and the second shell of the electronic device (101) based on different data. The electronic device (101) can display a picture in a part of the flexible display (160) based on the determined angle. The electronic device (101) can determine the difficult-to-touch area of the flexible display (160) based on the determined angle. The relevant details are described below. Figure 9a and Figure 9b Detailed description in .
[0034] According to an embodiment, the sensor (176) of the electronic device (101) may include an acceleration sensor for measuring the physical movement of the electronic device (101). For example, the acceleration sensor may output electronic information indicating the magnitude of the gravitational acceleration measured on each of a plurality of specified axes (e.g., x-axis, y-axis, z-axis) perpendicular to each other. For example, the processor (120) of the electronic device (101) may measure the posture of the electronic device (101) in physical space based on the electronic information output from the acceleration sensor. The posture measured by the electronic device (101) may indicate the orientation of the electronic device (101) measured by the acceleration sensor and / or the shape of the electronic device (101) (e.g., the position of the electronic device to be moved). Figures 2a to 2bThe electronic device (101) may be configured to be deformed by an external force according to the shape of the electronic device (101) as described in the embodiment of the present invention. The electronic device (101) may determine a mode of the electronic device (101) based on the measured posture. The electronic device (101) may adjust the size or position of a screen displayed on the flexible display (160) based on the determined mode. For example, the electronic device (101) may measure electronic information indicating the shape of the electronic device (101) by using another sensor (e.g., a Hall sensor) different from the acceleration sensor. For example, the electronic device (101) may determine a portion of the flexible display (160) displaying at least one screen based on the posture of the electronic device (101) using the acceleration sensor.
[0035] With reference to the above, the electronic device (101) can use the sensor (176) to determine the angle between the first shell and the second shell of the electronic device (101). In the folded state, the electronic device (101) can determine the area of the flexible display (160). For example, the area may include a difficult-to-touch area. The electronic device (101) can determine the input directed to the difficult-to-touch area by an external object. The electronic device (101) can identify the touch input directed to the flexible display (160) based on the position of the contact point of the external object with respect to the flexible display (160) and the position of the hover input caused by the external object. Therefore, the device and method according to the embodiment of the present disclosure can accurately determine (or identify) the input directed to the difficult-to-touch area according to the folded state (e.g., the folded angle) of the electronic device (101). In addition, the device and method according to the embodiment of the present disclosure can seamlessly determine (or identify) the drag input directed to the area including the difficult-to-touch area according to the folded state of the electronic device (101). Hereinafter, in Figure 2a and Figure 2b The folded state or unfolded state of the electronic device (101) is described.
[0036] Figure 2a and Figure 2b An example of the positional relationship between the first casing and the second casing in the unfolded state and the folded state of the electronic device is shown.
[0037] refer to Figure 2a and Figure 2b , the electronic device (101) can be understood as Figure 1 For example, the flexible display (230) may indicate Figure 1An example of a flexible display (160) of the present invention. A first housing (210), a second housing (220), and a folding housing (265) may be included in the electronic device (101). At least a portion of the flexible display (230) may be provided on a surface (e.g., a first surface (211)) of the first housing (210) and a surface (e.g., a second surface (221)) of the second housing. The flexible display (230) may include a first display area (231), a second display area (232), and a third display area (233). The folding housing (265) may be referred to as a hinge structure.
[0038] refer to Figure 2a According to an embodiment, the electronic device (101) can provide an unfolded state in which the first shell (210) and the second shell (220) are fully unfolded by folding the shell (265). For example, the electronic device (101) can be in a state (200) as the unfolded state. For example, the state (200) can refer to a state in which the orientation (291) faced by the first surface (211) of the first shell (210) corresponds to the orientation (292) faced by the second surface (221) of the second shell (220). For example, in the state (200), the orientation (291) of the first shell (210) can be parallel to the orientation (292) of the second shell (220). For example, in the state (200), the orientation (291) of the first shell (210) can be the same as the orientation (292) of the second shell (220).
[0039] According to an embodiment, in state (200), the first surface (211) can substantially form a plane with the second surface (221). For example, in state (200), the angle (205-1) between the first surface (211) and the second surface (221) can be 180 degrees. For example, state (200) can refer to a state in which the entire display area of the flexible display (230) can be substantially set on a plane. For example, state (200) can refer to a state in which the first display area (231), the second display area (232), and the third display area (233) can all be set on a plane. For example, in state (200), the third display area (233) may not include a curved surface. For example, the unfolded state can be referred to as an extended state. As an example, in the unfolded state, the electronic device (101) can display a screen based on at least one application by using the display areas (231, 232, 233) of the flexible display (230). In a state different from the unfolded state, the electronic device (101) can display a different screen related to the screen on one of the first display area (231), the second display area (232), or the third display area (233). Hereinafter, descriptions for different states are described.
[0040] refer to Figure 2b , according to an embodiment, the electronic device (101) can provide a folded state in which the first shell (210) and the second shell (220) are folded inwardly by the folding shell (265). For example, the electronic device (101) can be in a folded state including a state (201), a state (202), and a state (203). For example, the folded state including the state (201), the state (202), and the state (203) can refer to a state in which the orientation (291) faced by the first surface (211) of the first shell (210) is different from the orientation (292) faced by the second surface (221) of the second shell (220). For example, the folded state can refer to a state in which the position of the first shell (210) and the position of the second shell (220) are deformed based on the folding axis (237). The electronic device (101) can use a sensor (for example, Figure 1 The sensor (176) is used to determine the state. For example, in the state (201), the angle between the orientation (291) of the first shell (210) and the orientation (292) of the second shell (220) can be 45 degrees, and the orientation (291) of the first shell (210) and the orientation (292) of the second shell (220) can be distinguished from each other. For example, in the state (202), the angle between the orientation (291) of the first shell (210) and the orientation (292) of the second shell (220) can be 120 degrees, and the orientation (291) of the first shell (210) and the orientation (292) of the second shell (220) can be distinguished from each other. For example, in state (203), the angle between the orientation (291) of the first shell (210) and the orientation (292) of the second shell (220) can be substantially 180 degrees, and the orientation (291) of the first shell (210) and the orientation (292) of the second shell (220) can be distinguished from each other.
[0041] According to an embodiment, in the folded state, the angle (205) between the first surface (211) and the second surface (221) may be greater than or equal to 0 degrees and less than 180 degrees. For example, in state (201), the angle (205-2) between the first surface (211) and the second surface (221) may be 135 degrees. In state (202), the angle (205-3) between the first surface (211) and the second surface (221) may be 60 degrees. In state (203), the angle (205-4) between the first surface (211) and the second surface (221) may be substantially 0 degrees. For example, the folded state may be referred to as a foldable state.
[0042] According to an embodiment, unlike the unfolded state, the folded state may include a plurality of sub-folded states. Figure 2bThe folded state may include a plurality of sub-folded states, including state (203) (which is a fully folded state in which the first surface (211) is substantially overlapped on the second surface (221) by the rotation provided by the folding shell (265)) and state (201) and state (202) (which are in the state (203) and the unfolded state (e.g., Figure 2a The electronic device (101) may provide a state (203) in which the first display area (231) is substantially completely overlapped with the second display area (232) by the first surface (211) and the second surface (221) facing each other via the folding shell (265). For example, the electronic device (101) may provide a state (203) in which the orientation (291) of the first shell (210) is substantially opposite to the orientation (292) of the second shell (220). For example, the state (203) may refer to a state in which the flexible display (230) is blocked in the field of view of the user observing the electronic device (101). However, it is not limited thereto.
[0043] According to an embodiment, the flexible display (230) can be bent by rotation provided by the folding housing (265). For example, in the flexible display (230), unlike the first display area (231) and the second display area (232), the third display area (233) can be bent according to the folding operation. For example, the third display area (233) can be in an arc-shaped bent state to prevent damage to the flexible display (230) in the fully folded state. In the fully folded state, unlike the third display area (233) being curved in an arc, the entire first display area (231) can be completely overlapped on the entire second display area (232).
[0044] According to an embodiment, in state (200), the electronic device (101) may generate a data file based on a data file stored in a memory (e.g., Figure 1 The electronic device (101) can display a screen by using all of the first display area (231), the second display area (232) and the third display area (233) of the flexible display (230). For example, the electronic device (101) can use a sensor (e.g., Figure 1The electronic device (101) can use a sensor (176) to determine an angle (e.g., angle (205-3)) between the first shell (210) and the second shell (220). Based on the determined angle, the electronic device (101) can reduce the screen and display the screen in a portion of the flexible display (230). When the screen is reduced and displayed in the portion, the electronic device (101) can display another screen reflecting the screen displayed in the portion on another portion of the flexible display (230) different from the portion. When the screen is reduced and displayed in the portion, the electronic device (101) can match the upper end of the reduced screen with the folding axis (237) and display it.
[0045] In the following, Figure 3a and Figure 3b In the embodiment, a sensor (e.g., Figure 1 An example of a sensor (176) determining the posture (or angle, movement) of an electronic device.
[0046] Figure 3a and Figure 3b An example of the locations of multiple acceleration sensors in an electronic device is shown. Figure 3a electronic device (101) and Figure 3b The electronic device (101) can indicate Figure 1 The electronic device (101) has examples of different shapes.
[0047] refer to Figure 3a and Figure 3b , shows an example of an electronic device that is distinguished by the shape and / or structure of the housing. For example, the electronic device (101) may include a housing that is deformable based on at least one folding axis (e.g., Figure 2a a first shell (210) Figure 2a The second housing (220) and Figure 2a Folding housing (265)). Acceleration sensors (360, 361, 370, 371) can be understood as Figure 1 The first housing (320, 321) can be understood as Figure 2a The second shell (330, 331) can be understood as being substantially the same as the first shell (210). Figure 2a The folding shell (340, 341) can be understood as the second shell (220) of Figure 2a The folding shell (265) is basically the same as the folding shell (265). The folding axis (310, 311) can be understood as Figure 2a The folding axis (237) of the flexible display (350, 351) can be understood as being substantially the same as Figure 1The angles (355, 356) can be understood as being substantially the same as the flexible display (160). Figure 2a and Figure 2b The angles (205-1, 205-2, 205-3, 205-4) are basically the same.
[0048] refer to Figure 3a According to an embodiment, the deformable housing of the electronic device (101) can be distinguished by a folding housing (340) including a folding axis (310) and a first housing (320) and a second housing (330) connected to the folding housing (340). According to an embodiment, the flexible display (350) of the electronic device (101) can be an example of a display provided across the first housing (320) and the second housing (330).
[0049] According to an embodiment, the electronic device (101) may include acceleration sensors (360, 370) respectively provided in the first housing (320) and the second housing (330). The acceleration sensors (360, 370) may be included in the electronic device (101) to measure the shape and / or posture of the electronic device (101). Each of the acceleration sensors (360, 370) may be included in a six-axis motion sensor including a six-axis motion sensor based on Figure 3a The electronic device (101) includes an acceleration sensor for three axes: +x axis, +y axis, and +z axis, and a gyroscope sensor based on these three axes. The acceleration sensors (360, 370) can determine the acceleration applied to each of the three axes. The acceleration can be a vector based on the orientation and / or magnitude of the resultant force applied to the electronic device (101). For example, the acceleration can be a vector representing the amount of change in the speed of the electronic device (101) caused by the resultant force. The resultant force applied to the electronic device (101) can include a combination of gravity and another force different from gravity (for example, a force applied to the electronic device (101) by a user holding the electronic device (101)). According to an embodiment, the acceleration sensors (360, 370) of the electronic device (101) can determine the rotation of the acceleration sensor based on one or more axes. According to an embodiment, the electronic device (101) can determine the movement of the electronic device (101) based on the acceleration and / or rotation determined by each of the acceleration sensors (360, 370).
[0050] Using the acceleration sensors (360, 370) according to the embodiment, the electronic device (101) can obtain the angle (355) between the first shell (320) and the second shell (330) and the folding axis (310). The electronic device (101) can determine the state of the electronic device (101) (e.g., folded state, unfolded state, or sub-folded state) based on the angle (355). For example, referring to Figure 3a, the electronic device (101) can use the acceleration sensors (360, 370) to determine the angle (355) between the first shell (320) and the second shell (330). For example, when the second shell (330) is fixed, the electronic device (101) can use the acceleration sensor (360) included in the first shell (320) to obtain Figure 3a The values of the three axes of +x axis, +y axis, and +z axis. For example, the electronic device (101) can use the obtained values to determine the position of the first shell (320) or the angle (355) between the first shell (320) and the second shell (330). For example, the electronic device (101) can determine the angle (355) included in the specified range. The specified range can be greater than or equal to 20 degrees and less than or equal to 60 degrees. For example, the electronic device (101) can display at least one picture in a part of the flexible display (350) based on the determined angle (355). While displaying at least one picture, the electronic device (101) can receive input through a part different from the part. Figures 4 to 9b An example in which an electronic device (101) recognizes an input based on at least one input from an external object is described.
[0051] According to an embodiment, the electronic device (101) can determine the movement of the electronic device (101) using an acceleration sensor (360, 370) while at least one screen is displayed in a portion of the flexible display (350). For example, the electronic device (101) can determine the angle between the first shell (320) and the ground or the angle between the second shell (320) and the ground based on the determined movement. The electronic device (101) can determine at least one shell parallel to the ground in the first shell (320) or the second shell (330) based on these angles. As an example, when the electronic device (101) is displaying a screen in a portion of the flexible display provided in the first shell (320), the electronic device (101) can determine the movement of the electronic device (101). As an example, the electronic device (101) can determine the first shell (320) parallel to the ground based on the determined movement. The electronic device (101) can display the screen in a portion of the second shell (330) that is different from the portion based on the determination of the first shell (320) being parallel to the ground. However, it is not limited to the above-mentioned embodiment.
[0052] According to an embodiment, the shape of the electronic device (101) is not limited to Figure 3a (In this embodiment, the folding axis (310) is formed to be parallel to the width of the flexible display (350) and a length shorter than the width.) Figure 3b, shows an example of an electronic device (101) including the following items: a flexible display (351) having a width and a length longer than the width, and a folding axis (311) formed parallel to the width. The deformable shell of the electronic device (101) may include: a folding shell (341) having a folding axis (311), and a first shell (321) and a second shell (331) distinguished by the folding axis (311). The electronic device (101) may include acceleration sensors (361, 371) respectively arranged in the first shell (321) and the second shell (331). The electronic device (101) can obtain an angle (356) between the first shell (321) and the second shell (331) and the folding axis (311) by using the acceleration sensors (361, 371). The electronic device (101) can determine the state of the electronic device (101) based on the angle (356). The electronic device (101) can determine the angle (356) included in the specified range.
[0053] In an embodiment, the acceleration sensors (361, 371) included in the electronic device (101) can be provided on printed circuit boards respectively included in the first housing (321) and the second housing (331). A processor (e.g., Figure 1 The PCB of the processor (120) of the computer may be referred to as a main board. Among these PCBs, another PCB different from the PCB serving as the main board may be referred to as a sub-board. Among the acceleration sensors (361, 371), the acceleration sensor provided on the main board may be referred to as a main acceleration sensor (e.g., a main six-axis acceleration sensor), and the other acceleration sensor may be referred to as a sub-acceleration sensor (e.g., a sub-six-axis acceleration sensor).
[0054] According to an embodiment, the electronic device (101) can use an acceleration sensor (360, 361, 370, 371) to determine the movement of the electronic device (101). For example, the electronic device (101) can use the acceleration sensor (360, 361, 370, 371) to determine the bending angle of the flexible display (350, 51). For example, the electronic device (101) can use a sensor different from these sensors to determine the shell of the first shell (320, 321) and / or the second shell (330, 331) that is parallel to the ground. Based on the determined shell, the electronic device (101) can display a picture in a portion of the flexible display included in the shell that is not parallel to the ground.
[0055] As described above, the electronic device (101) can use the acceleration sensor (360, 361, 370, 371) to determine the angle (356, 356) included in the specified range related to the acute angle. The electronic device (101) can determine the first shell (320, 321) and / or the second shell (330, 331) parallel to the ground based on the determined angle (355, 356). The electronic device (101) can display a picture in a part of the flexible display (350, 351) included in the shell that is not parallel to the ground. While displaying the picture, the electronic device (101) can use the acceleration sensor (360, 361, 370, 371) of the electronic device (101) to determine the movement of the electronic device (101). The electronic device (101) can determine the shell parallel to the ground based on the determined movement. For example, in the case where the shell including the part displaying the picture is parallel to the ground, the electronic device (101) can replace and display the picture in a different part of the shell that is different from the shell. The electronic device (101) can provide user convenience based on the characteristics of moving a screen using an acceleration sensor (360, 361, 370, 371).
[0056] Figure 4 An example of input to a flexible display in a folded state of an electronic device is shown.
[0057] refer to Figure 4 , the electronic device (101) shows an example of determining the input of the external object (460) when the flexible display (160) is in a folded state. For example, the electronic device (101) can be understood as Figures 1 to 3b The electronic device (101) is basically the same.
[0058] refer to Figure 4 The electronic device (101) may be in a folded state. For example, the flexible display (160) may be bent about a folding axis (400) based on an angle between a first housing corresponding to a first region (410) of the flexible display (160) and a second housing corresponding to a second region (420) of the flexible display (160). For example, the first housing may be rotatably coupled to the second housing about the folding axis (400).
[0059] According to an embodiment, the electronic device (101) may determine input to a specific area (405) of the flexible display (160) as being different from expected. For example, the electronic device (101) may determine input to the flexible display (160) by an external object (460). In this case, the electronic device (101) may identify input to the first area (410) and the second area (420) by the external object (460) as being substantially the same as expected. However, the electronic device (101) may identify input to the area (405) by the external object (460) as being substantially different from expected. For example, a user of the electronic device (101) may wish to input to a portion of the folding axis (400) in the area (405) by the external object (460), but input to the folding axis (400) may be difficult due to the flexible display (160) being in a folded state. In Figure 4 In the example of FIG, the electronic device (101) may determine both ends of the region (405) as input, rather than input for the folding axis (400). The region (405) may be referred to as a difficult-to-touch region.
[0060] According to an embodiment, the touch difficulty area may be determined based on at least one of the following: a folding radius (R) relative to a folding axis (400) of the electronic device (101), an angle around the folding axis (400), or a size of the external object (460). For example, the folding R may indicate a curvature or a radius of curvature relative to the folding axis (400). The folding R may be determined based on the thickness of the housing of the electronic device (101). For example, the angle may indicate an angle between a first housing corresponding to the first area (410) and a second housing corresponding to the second area (420). For example, the size of the external object (460) may include the thickness of the external object (460) and the shape of the external object (460).
[0061] An electronic device (101) including a flexible display (160) (e.g., a foldable laptop computer) can accurately determine a touch directed to the area (405) when the folding R is greater than or equal to a reference value. However, when the folding R is less than the reference value, the electronic device (101) may have difficulty determining an input that matches a portion of the input to be performed by the external object (460) using only input including a contact point and a hover input caused by the external object (460). For example, in the case of a drag input directed to an area including the area (405), the electronic device (101) may not be able to identify the portion of the drag input corresponding to the area (405).
[0062] As described above, with the advancement of technology, in an electronic device (101) that becomes lighter and includes a thinner housing, the touch difficulty area of the electronic device (101) may be expanded based on the relationship between the folding R and the thickness of the housing. Although the hovering touch technology is used to more accurately determine input to the touch difficulty area, a device and method for more accurately determining input to the touch difficulty area are needed.
[0063] Hereinafter, the apparatus and method according to the embodiments of the present disclosure may determine (or recognize) input to a touch difficulty area based on input including a contact point and a hovering input performed by an external object. The apparatus and method according to the embodiments of the present disclosure may accurately determine input to a variable touch difficulty area based on the folding angle. Furthermore, even in the case where a drag input includes a touch difficulty area, the apparatus and method according to the embodiments of the present disclosure may accurately determine a drag input including a variable touch difficulty area based on the folding angle.
[0064] Figure 5 An example of an area of a flexible display of an electronic device is shown.
[0065] refer to Figure 5 The electronic device (101) may include a foldable flexible display (160). For example, when a first housing (e.g., the first housing (210) of FIG. 2 ) is rotated relative to a second housing (e.g., the second housing (220) of FIG. 2 ) via a hinge structure (not shown) (e.g., the folding housing (265) of FIG. 2 ) of the electronic device (101), the flexible display (160) may be folded.
[0066] According to an embodiment, the flexible display (160) may include a plurality of regions located in the display area of the flexible display (160). For example, the flexible display (160) may include: a first region (510) corresponding to the first shell, a second region (520) corresponding to the second shell, and a third region (530) between the first region (510) and the second region (520). For example, when the flexible display (160) is folded, the first region (510) and the second region (520) may indicate a flat region. For example, the third region (530) may be referred to as a region of the flexible display (160) corresponding to a hinge structure. For example, when the flexible display (160) is folded, the third region (530) may indicate a curved region.
[0067] According to an embodiment, the third area (530) of the flexible display (160) may include a plurality of partial areas. For example, the third area (530) may include: a first partial area (531) corresponding to the first area (510) and a second partial area (532) corresponding to the second area (520). For example, the first partial area (531) may be located in an area around the folding axis (500) of the electronic device (101) and close to the first area (510). The second partial area (532) may be located in an area around the folding axis (500) of the electronic device (101) and close to the second area (520).
[0068] According to an embodiment, the electronic device (101) may determine the first partial area (531) and the second partial area (532) based on the folding angle of the flexible display (160), the distance indicating the height of the hovering input from the flexible display (160), or the reference distance indicating the maximum distance at which the flexible display (160) can determine the hovering input. Figure 9a and Figure 9b described in .
[0069] According to an embodiment, the electronic device (101) may determine at least one input to the flexible display (160). For example, the electronic device (101) may determine an input including a contact point made by an external object to the flexible display (160). For example, the electronic device (101) may determine a hovering input made by an external object to the flexible display (160). The at least one input may include at least one of an input including a contact point and a hovering input. The input including a contact point and the hovering input may be referred to as examples of touch-based input.
[0070] According to an embodiment, the electronic device (101) can determine an input including a contact point and a hovering input based on a plurality of nodes in the flexible display (160) and a threshold value for determining input. For example, the electronic device (101) can determine a change in the value of a first node among a plurality of nodes based on an input including a contact point according to contact of an external object with respect to a first area (510). The value of the first node can indicate a change in a signal (e.g., voltage, light amount, resistance, or charge amount) of the first node that changes according to contact of the external object. For example, the electronic device (101) can determine a position of the input including the contact point by comparing the value of the first node with a first threshold value for determining input including the contact point. In addition, the electronic device (101) can determine a change in the value of a second node among a plurality of nodes based on a hovering input of an external object with respect to the first area (510). The value of the second node can indicate a change in a signal (e.g., voltage, light amount, resistance, or charge amount) of the second node that changes according to hovering input of the external object. For example, the electronic device (101) can determine a position of the hovering input by comparing the value of the second node with a second threshold value for determining hovering input. The second threshold value can be smaller than the first threshold value.
[0071] According to an embodiment, the electronic device (101) may determine a touch input based on at least one input to the flexible display (160). For example, the touch input may indicate an input corresponding to a location determined by the electronic device (101) as input from the outside (or an external object) based on the at least one input. In other words, the touch input may indicate an input corresponding to an area on the flexible display (160) where the user of the electronic device (101) intends to input using an external object (e.g., the user's finger or a pen, etc.). For example, the electronic device (101) may determine the touch input based on an input including a contact point to the first area (510) or an input including a contact point to the second area (520). In this case, the touch input may correspond to the location of the contact point. For example, the electronic device (101) may determine the touch input based on an input including a contact point to the first partial area (531) and a hover input to the second partial area (532) (or based on a hover input to the first partial area (531) and an input including a contact point to the second partial area (532)). In this case, the touch input can be determined based on the location of the contact point and the location of the hover input. Figures 6a to 7b described in .
[0072] Figures 6a to 6c An example of a method of determining input according to an area of a flexible display is shown.
[0073] Figures 6a to 6c The electronic device (101) can be understood as Figure 5 The electronic devices (101) are substantially the same. For example, Figures 6a to 6c The flexible display (160) can be understood as Figure 5 The flexible display (160) is substantially the same. For example, the third region (530) may include a first partial region (531) corresponding to the first region (510) and a second partial region (532) corresponding to the second region (520) based on the folding axis (500).
[0074] Figures 6a to 6c An example (601, 602, 603) of an electronic device (101) determining a touch input based on inputs to multiple areas of a flexible display (160) is shown. The input may include at least one of an input made by an external object, an input including a contact point, or a hover input made by an external object. For example, the touch input may indicate an input corresponding to a location determined by the electronic device (101) as input from the outside (or an external object) based on at least one input.
[0075] Figure 6a An example (601) of an electronic device (101) determining an input by an external object (660) to a first area (510) is shown. For ease of explanation, Figure 6a An example is shown in which the electronic device (101) is in a state where the flexible display (160) is folded at a right angle (90°). However, the embodiments of the present disclosure are not limited thereto. For example, the embodiments of the present disclosure may also be applied to a state in which the electronic device (101) is in a state in which the flexible display (160) is folded at an angle greater than or less than a right angle.
[0076] Referring to example (601), the electronic device (101) may determine an input made by an external object (660) to the first area (510). For example, the electronic device (101) may determine an input (610) including a contact point to the first area (510). According to an embodiment, the electronic device (101) may determine a position of the first area (510) corresponding to the input (610) including the contact point as a touch input. For example, the electronic device (101) may determine an input to a position on the first area (510) that is substantially the same as the position of the contact point of the input (610) as a touch input.
[0077] According to an embodiment, the range in which the electronic device (101) can determine the position of the contact point of the input (610) and the position of the touch input as the same on the first area (510) can be determined based on a reference distance, and the reference distance is the maximum distance at which a hover input by an external object (660) can be determined. For example, in a case where the electronic device (101) performs an input (610) in an area where a hover input by an external object (660) cannot be determined (for example, in a case where the external object (660) performs an input (610) with respect to the first area (510) at a position higher than the reference distance), the position of the contact point of the first area (510) and the position of the touch input can be determined to be the same. For example, the electronic device (101) can determine the position of the input including the contact point performed by the external object (660) on the first area (510) at the maximum distance at which the hover input can be determined (or the maximum hover detection distance) to be the same as the position of the touch input.
[0078] Referring to the above, since the first area (510) is an area that is easy to touch regardless of the folding state of the flexible display (160), the electronic device (101) can determine the position on the first area (510) corresponding to the position of the input (610) including the contact point as the touch input.
[0079] Figure 6b An example (602) of the electronic device (101) determining an input made by an external object (660) to the third area (530) is shown. For ease of explanation, Figure 6b An example is shown in which the electronic device (101) is in a state where the flexible display (160) is folded at a right angle (90°). However, the embodiments of the present disclosure are not limited thereto. For example, the embodiments of the present disclosure may also be applied to a state in which the electronic device (101) is in a state in which the flexible display (160) is folded at an angle greater than or less than a right angle.
[0080] Referring to example (602), the electronic device (101) may determine a plurality of inputs made by an external object (660) to the third area (530). For example, the electronic device (101) may determine an input (621) including a contact point to the first partial area (531) of the third area (530). For example, the electronic device (101) may determine a hover input (622) to the second partial area (532) of the third area (530).
[0081] Referring to example (602a) representing the amplified input state of example (602), the electronic device (101) may determine an input (621) including a contact point for a first partial area (531) of a third area (530). The electronic device (101) may determine a hover input (622) for a second partial area (532) of the third area (530). According to an embodiment, the hover input (622) may correspond to a portion (665) where the distance (625) between the external object (660) and the second partial area (532) is the shortest distance. For example, the hover input (622) may indicate a change in a signal (e.g., voltage, light amount, resistance, or charge amount) of a node changed by the portion (665).
[0082] According to an embodiment, the electronic device (101) may determine a touch input based on an input (621) including a contact point and a hovering input (622). For example, the electronic device (101) may determine a touch input based on a position of a contact point of the input (621) and a ratio between a distance (625) and a reference distance. For example, the electronic device (101) may determine a touch input corresponding to a position (620) at which the position of the contact point of the input (621) is corrected based on a ratio between a reference distance, which is a maximum distance at which the hovering input (622) can be determined, and a distance (625). For example, as the distance (625) becomes shorter (for example, in a case where the external object (660) has a contact point in the first partial area (531) and has a hovering input for the second partial area (532), the position (620) may become closer to the folding axis (500).
[0083] Referring to the above, since the third area (530) is an area that is difficult to touch according to the folded state of the flexible display (160), the electronic device (101) can determine the position (620) on the third area (530) as a touch input based on the position of the input (621) including the contact point and the hovering input (622).
[0084] Figure 6c An example (603) of the electronic device (101) determining an input made by an external object (660) to the third area (530) is shown. For ease of explanation, Figure 6c An example is shown in which the electronic device (101) is in a state where the flexible display (160) is folded at a right angle (90°). However, the embodiments of the present disclosure are not limited thereto. For example, the embodiments of the present disclosure may also be applied to a state in which the electronic device (101) is in a state in which the flexible display (160) is folded at an angle greater than or less than a right angle.
[0085] Referring to example (603), the electronic device (101) may determine a plurality of inputs made by an external object (660) to the third area (530). For example, the electronic device (101) may determine an input (631) including a contact point to the first partial area (531) of the third area (530). For example, the electronic device (101) may determine an input (632) including a contact point to the second partial area (532) of the third area (530).
[0086] Referring to example (603), the electronic device (101) may determine an input (631) including a contact point for a first partial area (531) of the third area (530). The electronic device (101) may determine an input (632) including a contact point for a second partial area (532) of the third area (530). According to an embodiment, the electronic device (101) may determine a touch input based on an input (631) including a contact point and an input (632) including a contact point. For example, in the case of determining an input (631, 632) including multiple contact points in the third area (530), the electronic device (101) may determine a touch input for a position (630) corresponding to the folding axis (500). In other words, the electronic device (101) may determine (or recognize) the input (631) including a contact point and the input (632) including a contact point as touch input for the position (630). The position (630) may be referred to as the origin of the folding axis (500) or the boundary between the first partial area (531) and the second partial area (532).
[0087] Referring to the above, since the third area (530) is an area that is difficult to touch according to the folded state of the flexible display (160), the electronic device (101) can determine the position (630) on the third area (530) as a touch input based on the position of the input (631) including the contact point and the position of the input (632) including the contact point.
[0088] Figure 7a and Figure 7b An example of a method of determining input according to an area of a flexible display is shown.
[0089] Figure 7a and Figure 7b The electronic device (101) can be understood as Figure 5 The electronic devices (101) are substantially the same. For example, Figure 7a and Figure 7b The flexible display (160) can be understood as Figure 5The flexible display (160) is substantially the same. For example, the third region (530) may include a first partial region (531) corresponding to the first region (510) and a second partial region (532) corresponding to the second region (520) based on the folding axis (500).
[0090] Figure 7a and Figure 7b An example (701, 702) of an electronic device (101) determining a touch input based on inputs to multiple areas of a flexible display (160) is shown. The input may include at least one of an input made by an external object, an input including a contact point, or a hover input made by an external object. For example, the touch input may indicate an input corresponding to a location determined by the electronic device (101) as input from the outside (or an external object) based on at least one input.
[0091] Figure 7a An example (701) of an electronic device (101) determining an input made by an external object (760) to a third area (530) is shown. For ease of explanation, Figure 7a An example is shown in which the electronic device (101) is in a state where the flexible display (160) is folded at a right angle (90°). However, the embodiments of the present disclosure are not limited thereto. For example, the embodiments of the present disclosure may also be applied to a state in which the electronic device (101) is in a state in which the flexible display (160) is folded at an angle greater than or less than a right angle.
[0092] Referring to example (701), the electronic device (101) may determine a plurality of inputs made by an external object (660) to the third area (530). For example, the electronic device (101) may determine an input (711) including a contact point to the second partial area (532) of the third area (530). For example, the electronic device (101) may determine a hover input (712) to the first partial area (531) of the third area (530).
[0093] Referring to example (701a) representing the amplified input state of example (701), the electronic device (101) may determine an input (711) including a contact point for the second partial area (532) of the third area (530). The electronic device (101) may determine a hover input (712) for the first partial area (531) of the third area (530). According to an embodiment, the hover input (712) may correspond to a portion (765) where the distance (715) between the external object (760) and the first partial area (531) is the shortest distance. For example, the hover input (712) may indicate a change in a signal (e.g., voltage, light amount, resistance, or charge amount) of a node changed by the portion (765).
[0094] According to an embodiment, the electronic device (101) may determine a touch input based on an input (711) including a contact point and a hovering input (712). For example, the electronic device (101) may determine a touch input based on a position of a contact point of the input (711) and a ratio between a distance (715) and a reference distance. For example, the electronic device (101) may determine a touch input corresponding to a position (710) at which the position of the contact point of the input (711) is corrected based on a ratio between a reference distance, which is a maximum distance at which the hovering input (712) can be determined, and a distance (715). For example, as the distance (715) becomes shorter (for example, in a case where the external object (760) has a contact point in the second partial area (532) and has a hovering input for the first partial area (531), the position (710) may become closer to the folding axis (500).
[0095] Referring to the above, since the third area (530) is an area that is difficult to touch according to the folded state of the flexible display (160), the electronic device (101) can determine the position (710) on the third area (530) as a touch input based on the position of the input (711) including the contact point and the position of the hover input (712).
[0096] Figure 7b An example (702) of the electronic device (101) determining an input by an external object (760) to the second area (520) is shown. For ease of explanation, Figure 7b An example is shown in which the electronic device (101) is in a state where the flexible display (160) is folded at a right angle (90°). However, the embodiments of the present disclosure are not limited thereto. For example, the embodiments of the present disclosure may also be applied to a state in which the electronic device (101) is in a state in which the flexible display (160) is folded at an angle greater than or less than a right angle.
[0097] Referring to example (702), the electronic device (101) may determine an input made by an external object (760) to the second area (520). For example, the electronic device (101) may determine an input (720) including a contact point to the second area (520). According to an embodiment, the electronic device (101) may determine a position of the second area (520) corresponding to the input (720) including the contact point as a touch input. For example, the electronic device (101) may determine an input to a position on the second area (520) that is substantially the same as the position of the contact point of the input (720) as a touch input.
[0098] According to an embodiment, the range in which the electronic device (101) can determine the position of the contact point of the input (720) and the position of the touch input on the second area (520) as the same can be determined based on a reference distance, and the reference distance is the maximum distance at which a hover input by the external object (760) can be determined. For example, in a case where the electronic device (101) performs an input (720) in an area where a hover input by the external object (760) cannot be determined (for example, in a case where the external object (760) performs an input (720) with respect to the second area (520) at a position higher than the reference distance), the position of the contact point of the second area (520) and the position of the touch input can be determined to be the same. For example, the electronic device (101) can determine the position of the input including the contact point performed by the external object (760) on the second area (520) at the maximum distance at which the hover input can be determined (or the maximum hover detection distance) to be the same as the position of the touch input.
[0099] Referring to the above, since the second area (520) is an area that is easy to touch regardless of the folding state of the flexible display (160), the electronic device (101) can determine the position on the second area (520) corresponding to the position of the input (720) including the contact point as the touch input.
[0100] exist Figures 6a to 7b , an example of the electronic device (101) determining a touch input for a specific position is described, but the embodiments of the present disclosure are not limited thereto. According to an embodiment, the electronic device (101) may determine a touch input having a specific length in response to a drag input for at least one area. The drag input may indicate an input that moves to another point of the flexible display (160) while maintaining the contact state after being in contact with one point of the flexible display (160) for a certain time (after maintaining contact with the one point). For example, the electronic device (101) may determine a drag input regarding the movement of an external object in response to the external object moving from the first area (510) toward the second area (520) across (acrossover) the third area (530). Alternatively, the electronic device (101) may determine a drag input regarding the movement of an external object in response to the external object moving from the second area (520) toward the first area (510) across the third area (530).
[0101] For example, the electronic device (101) may determine a drag input regarding the movement of the external object in response to the external object moving in the first area (510). For example, the electronic device (101) may determine (or identify) a touch input having a first length based on a first set of contact points located on the first area (510) according to the drag input. For example, the electronic device (101) may determine a drag input regarding the movement of the external object in response to the external object moving in the second area (520). For example, the electronic device (101) may determine a touch input having a second length based on a second set of contact points located on the second area (520) according to the drag input. Alternatively, the electronic device (101) may determine a drag input regarding the movement of the external object in response to the external object moving in the third area (530). For example, the electronic device (101) may determine a touch input having a third length based on a third set of contact points in the third area (530) and a hover input caused by the external object.
[0102] Figure 8a and Figure 8b An example of a flow chart representing the operation of a method of determining input according to an area of a flexible display is shown.
[0103] Figure 8a and Figure 8b Can be Figure 5 For example, Figure 8a Methods and Figure 8b The method can be executed by the processor (120) of the electronic device (101).
[0104] Figure 8a and Figure 8b The touch input may indicate an input corresponding to a position determined by the electronic device (101) as input from the outside (or an external object) based on at least one input to the flexible display (160). In other words, in the present disclosure, the touch input may indicate an input recognized by the electronic device (101) as input to the flexible display (160) based on at least one of an input including a contact point, a hovering input, or a dragging input actually input by an external object.
[0105] Figure 8a An example of a method for determining a touch input directed to a specific location for a folded flexible display (160) according to an embodiment is shown. In operation (800), the processor (120) may determine a third area between the first area and the second area based on an angle between the first area and the second area. For example, the processor (120) may determine a third area between the first area and the second area based on at least one sensor (e.g., Figure 1The sensor (176) of the flexible display (160) determines a first area (eg, a first housing (210) of the electronic device (101)) corresponding to the first housing (eg, the first housing (210) of FIG. 2) of the flexible display (160). Figure 5 The first area (510) of the flexible display (160) corresponds to the second housing (e.g., the second housing (220) of FIG. 2) of the electronic device (101). Figure 5 For example, the angle may be referred to as a folding angle. For example, the processor (120) may determine a third area between the first area and the second area based on the angle. For example, the third area may be referred to as a touch difficulty area. The third area may be based on a folding axis (e.g., Figure 5 The folding axis (500) includes a first partial area corresponding to the first area (eg, Figure 5 a first partial region (531)) and a second partial region corresponding to the second region (e.g., Figure 5 According to an embodiment, the third area may be changed based on a folding radius (R) relative to a folding axis of the electronic device (101), a folding angle, or a size of an external object touching the device. For example, the processor (120) may determine the third area based on the folding angle. For example, the processor (120) may determine the third area based on the folding angle, a distance indicating a height from the flexible display (160) to the hovering input under a condition in which an input including a contact point in the third area and a hovering input are simultaneously included, and a reference distance indicating a maximum distance from which the hovering input can be determined.
[0106] In operation (805), the processor (120) may identify a touch input based on an input made by an external object to an area of the flexible display (160). For example, the processor (120) may determine an input to the flexible display (160) based on the external object. The processor (120) may determine a touch input based on the input. The input may include at least one of an input including a contact point, a hovering input, or a dragging input.
[0107] For example, in response to an input having a contact point on a first area, such as in Figure 6a In the example (601), the processor (120) may recognize the input as a touch input directed to a location on the first area, the location on the first area corresponding to the location of the contact point of the external object.
[0108] For example, in response to an input having a contact point on a third area, such as in Figure 6bIn the example (602), the processor (120) may recognize the input as a touch input directed to a location on the third area, the location on the third area being determined based on the location of the contact point of the external object and the location of the hovering input caused by the external object. In this case, the location of the touch input may be different from the location of the contact point on the third area. Assume that the input with the contact point made by the external object is located in a first partial area of the third area, and the hovering input is located in a second partial area of the third area. For example, the location of the touch input may indicate a point that is changed from the location of the contact point based on a ratio between a reference distance and a distance indicating a height from the second partial area to the hovering input, the reference distance being a maximum distance from the surface of the second partial area at which the hovering input can be determined. The distance indicating a height from the second partial area to the hovering input may indicate the shortest distance from the flexible display (160) to the external object.
[0109] For example, in response to an input having a contact point on a first partial area of the third area and having a contact point on a second partial area of the third area, as in Figure 6c In example (603), the processor (120) may recognize the input as a touch input for a boundary between the first partial area and the second partial area. For example, the processor (120) may recognize the input as a touch input for a boundary indicating a folding axis based on an input having a contact point on the first partial area and an input having a contact point on the second partial area performed by an external object.
[0110] For example, in response to an input having a contact point on a third area, such as in Figure 7a In the example (701), the processor (120) may recognize the input as a touch input to a location on the third area, the location on the third area being determined based on the location of the contact point of the external object and the location of the hover input caused by the external object. In this case, the location of the touch input may be different from the location of the contact point on the third area. Assume that the input with the contact point made by the external object is located in the second partial area of the third area, and the hover input is located in the first partial area of the third area. For example, the location of the touch input may indicate a point that is changed from the location of the contact point based on a ratio between a reference distance and a distance indicating a height from the first partial area to the hover input, the reference distance being a maximum distance from the surface of the first partial area at which the hover input can be determined.
[0111] For example, in response to an input having a contact point on the second area, such as in Figure 7b In the example (702), the processor (120) may recognize the input as a touch input directed to a location on the second area, the location on the second area corresponding to the location of the contact point of the external object.
[0112] According to an embodiment, the processor (120) may determine the values of signals for a plurality of nodes of the flexible display (160) to determine a contact point (or input with a contact point) and a hovering input made by an external object. For example, the processor (120) may determine a signal (e.g., voltage, light amount, resistance, or charge amount) for each of a plurality of nodes included in the flexible display (160). For example, the processor (120) may determine a change in a value measured by a signal in response to a contact point or hovering input made by an external object. For example, in the case of an input with a contact point, the processor (120) may determine a first position of the input with a contact point based on the value of each first node corresponding to the contact of the external object with respect to the area of the flexible display (160) and a first threshold. For example, the processor (120) may determine the first position based on a value greater than or equal to a first threshold among the values for each first node. The first node may be included in the plurality of nodes. The first threshold may indicate a reference value for determining an input with a contact point. Alternatively, the processor (120) may determine the second position with respect to the hover input based on the value of each second node corresponding to the hover input of the external object with respect to the area of the flexible display (160) and the second threshold value. For example, the processor (120) may determine the second position based on a value equal to or greater than the second threshold value among the values for each second node. The second node may be included in a plurality of nodes. The second threshold value may be a reference value for determining the hover input and may be smaller than the first threshold value.
[0113] In operation (810), the processor (120) may provide a response to the touch input. For example, the processor (120) may perform a response to the touch input for a specific location identified according to operation (805). For example, the response may perform an operation on a visual object corresponding to the location of the touch input. For example, the operation on the visual object may include executing a software application, displaying another visual object indicating the selection of the visual object, etc. For example, the processor (120) may provide a response to a touch input determined based on an input with a contact point made by an external object. Alternatively, the processor (120) may provide a response to a touch input determined based on an input with a contact point and a hover input made by an external object. Alternatively, the processor (120) may provide a response to a touch input determined based on a plurality of inputs with contact points made by an external object.
[0114] Figure 8bAn example of a method for determining a touch input having a specific length in response to a drag input for a folded flexible display (160) according to an embodiment is shown. In operation (850), the processor (120) may determine a third area between the first area and the second area based on an angle between the first area and the second area. For example, the processor (120) may determine a third area between the first area and the second area based on at least one sensor (e.g., Figure 1 The sensor (176) of the flexible display (160) determines a first area (eg, a first housing (210) of the electronic device (101)) corresponding to the first housing (eg, the first housing (210) of FIG. 2) of the flexible display (160). Figure 5 The first area (510) of the flexible display (160) corresponds to the second housing (e.g., the second housing (220) of FIG. 2) of the electronic device (101). Figure 5 For example, the angle may be referred to as a folding angle. For example, the processor (120) may determine a third area between the first area and the second area based on the angle. For example, the third area may be referred to as a touch difficulty area. The third area may be based on a folding axis (e.g., Figure 5 The folding axis (500) includes a first partial area corresponding to the first area (eg, Figure 5 a first partial region (531)) and a second partial region corresponding to the second region (e.g., Figure 5 According to an embodiment, the third area may be changed based on a folding radius (R) relative to a folding axis of the electronic device (101), a folding angle, or a size of an external object touching the device. For example, the processor (120) may determine the third area based on the folding angle. For example, the processor (120) may determine the third area based on the folding angle, a distance indicating a height from the flexible display (160) to the hovering input under a condition in which both an input with a contact point in the third area and a hovering input are included, and a reference distance indicating a maximum distance from which the hovering input can be determined.
[0115] In operation (855), the processor (120) may recognize a touch input based on a drag input performed by an external object on an area of the flexible display (160). For example, the drag input may indicate an input of moving to another point of the flexible display (160) while maintaining contact with one point after a certain time (after maintaining contact with the one point).
[0116] For example, the processor (120) may determine a drag input regarding the movement of the external object in response to the external object moving from the first area toward the second area across the third area. For example, the processor (120) may determine a first drag input on the first area and a second drag input on the third area. For example, the processor (120) may determine a touch input having a first length on the first area based on a contact point located on the first area according to the first drag input. For example, the processor (120) may determine a touch input having a second length on the third area based on a contact point and a hover input located on the third area according to the second drag input. In other words, the processor (120) may identify a touch input having a first length and a touch input having a second length in response to a drag input (including a first drag input and a second drag input) according to the movement of the external object.
[0117] For example, in the case where the movement of the external object extends beyond (across) the third area to the second area, the processor (120) may determine a touch input having a second length on the second area based on a contact point located on the second area according to the third drag input on the second area. Figure 8b In the description, the movement of the external object is described as starting from the first area, but the movement may start from the second area. For example, the electronic device (101) may determine the drag input related to the movement of the external object in response to the external object moving from the second area toward the first area across the third area.
[0118] For example, a method of determining a touch input having a length based on a contact point (or an input having a contact point) caused by a drag input and a hover input may be performed in the same manner as Figure 8a The method is applied in a substantially similar manner. For example, in the case of a contact point and a hovering input located on the third area according to the second drag input, the processor (120) may identify a touch input for a specific location based on one contact point among the contact points and one hovering input corresponding to the one contact point among the hovering inputs. The processor (120) may determine a touch input having a specific length by continuously identifying touch inputs for a specific location with respect to the contact point and the hovering input. Therefore, the specific content will be omitted hereinafter.
[0119] In operation (860), the processor (120) may provide a response to the touch input. For example, the processor (120) may perform a response to the touch input having a specific length identified according to operation (855). For example, the response may perform an operation on a visual object corresponding to the location of the touch input. For example, the operation on the visual object may include executing a software application, displaying another visual object indicating a selection of at least one visual object including the visual object, and / or moving the visual object.
[0120] Figure 9a An example of a method of determining an input according to an area of a flexible display of an electronic device that is folded at an angle other than a right angle is shown.
[0121] exist Figure 9a and Figure 9b In the embodiment, it is assumed that the folding radius (R) of the electronic device (101) and the size of the external object (960) remain unchanged, and an example in which the third area (530) changes according to the folding angle of the electronic device (101) is described. However, the embodiments of the present disclosure are not limited thereto, and the third area (530) may also be changed by the folding R and the size of the external object (960).
[0122] Figure 9a The electronic device (101) can be understood as Figure 5 The electronic devices (101) are substantially the same. For example, Figure 9a The flexible display (160) can be understood as Figure 5 The flexible display (160) is substantially the same as the flexible display (160). For example, the third area (530) may include a first partial area (531) corresponding to the first area (510) and a second partial area (532) corresponding to the second area (520) based on the folding axis (500). Figures 6a to 7b The electronic device (101) in which the flexible display (160) is folded at a right angle is different, as an example, Figure 9a An electronic device (101) is described that includes a flexible display (160) that folds at an angle other than a right angle.
[0123] Figure 9a An example (900) of determining touch input based on input to multiple areas of a flexible display (160) having a folding angle greater than 90° is shown. The input may include at least one of an input made by an external object, including a contact point, or a hovering input made by an external object. For example, the touch input may indicate an input corresponding to a location determined by the electronic device (101) as input from the outside (or an external object) based on at least one input.
[0124] Referring to example (900), the electronic device (101) may determine a plurality of inputs made by an external object (960) to a third area (530). For example, the electronic device (101) may determine an input (911) including a contact point to a first partial area (531) of the third area (530). For example, the electronic device (101) may determine a hover input (912) to a second partial area (532) of the third area (530).
[0125] Referring to example (900a) representing the amplified input state of example (900), the electronic device (101) may determine an input (911) including a contact point for a first partial area (531) of a third area (530). The electronic device (101) may determine a hover input (912) for a second partial area (532) of the third area (530). According to an embodiment, the hover input (912) may correspond to a portion (965) where the distance (915) between the external object (960) and the second partial area (532) is the shortest distance. For example, the hover input (912) may indicate a change in a signal (e.g., voltage, light amount, resistance, or charge amount) of a node changed by the portion (965).
[0126] According to an embodiment, the electronic device (101) may determine a touch input based on an input (911) including a contact point and a hovering input (912). For example, the electronic device (101) may determine a touch input based on a position of the contact point of the input (911) and a ratio between a distance (915) and a reference distance. For example, the electronic device (101) may determine a touch input corresponding to a position (910) at which the position of the contact point of the input (911) is corrected based on a ratio between a reference distance, which is a maximum distance at which the hovering input (912) can be determined, and the distance (915). For example, as the distance (915) becomes shorter (for example, in a case where the external object (960) has a contact point in the first partial area (531) and has a hovering input for the second partial area (532), the position (910) may become closer to the folding axis (500).
[0127] Referring to the above, since the third area (530) is an area that is difficult to touch according to the folded state of the flexible display (160), the electronic device (101) can determine the position (910) on the third area (530) as a touch input based on the position of the input (911) including the contact point and the hovering input (912).
[0128] refer to Figure 9a According to an embodiment, the electronic device (101) can set a touch-difficulty area (e.g., the third area (530)) based on the folding angle of the flexible display (160). For example, the first partial area (531) and the second partial area (532) can be changed based on the folding angle. Figure 9b described in .
[0129] Figure 9b An example of a method of determining an area of a flexible display of an electronic device that is folded at an angle other than a right angle is shown.
[0130] Figure 9b The electronic device (101) can be understood as Figure 5 The electronic devices (101) are substantially the same. For example, Figure 9b The flexible display (160) can be understood as Figure 5 The flexible display (160) is substantially the same as the third region (530). For example, the third region (530) may include a first partial region (531) corresponding to the first region (510) and a second partial region (532) corresponding to the second region (520) based on the folding axis (500).
[0131] refer to Figure 9b In a flexible display (160) having a folding angle greater than 90°, examples (951, 952) are shown for determining a touch-difficulty area (e.g., a third area (530)) according to the folding angle. Example (951) may indicate an example of determining a first partial area (531). Example (952) may indicate an example of determining a second partial area (532). For ease of explanation, examples (951) and (952) assume that the side surface of the electronic device (101) is located on the xy plane, and the point where the folding axis (500) intersects the flexible display (160) is the origin.
[0132] Referring to example (951), the electronic device (101) may determine multiple inputs for the third area (530). For example, the electronic device (101) may determine an input (911) including a contact point performed by an external object (960) in the first partial area (531) and a hover input (912) performed by the external object (960) in the second partial area (532). According to an embodiment, the electronic device (101) may determine the first partial area (531) based on the folding angle of the flexible display (160) and the input (911). For example, the folding angle may be 90°+θ. For example, the electronic device (101) may determine the coordinates corresponding to the position of the input (911) on the flexible display (160). For example, the coordinates of the input (911) may be (x1, y1). The electronic device (101) may determine the distance spaced from the folding axis (500) based on the coordinates determined for the input (911). The electronic device (101) can determine the first partial area (531) based on the spaced-apart distance and the folding angle. The equation for determining the first partial area (531) is as follows.
[0133] [Equation 1]
[0134]
[0135] L1 may represent the distance from the point where the folding axis (500) intersects the flexible display (160) (e.g., the origin (0, 0)) to the boundary between the first partial area (531) and the first area (510) in the xy plane, l(y1) may represent the distance from the origin to the input (911), Hmax may represent the maximum distance (or reference distance, or maximum hovering detection distance) at which the hovering input can be detected from the surface of the flexible display (160), H may represent the distance (or hovering detection distance) from the surface of the flexible display (160) to the hovering input, and θ may represent the folding angle. In this case, the input (911) may indicate an input to the flexible display (160) made by an external object (960) related to the input (911) and simultaneously with the hovering input (912). In addition, l in the equation is described as a distance in a two-dimensional plane, but the embodiments of the present disclosure are not limited thereto. For example, l may represent a distance in a three-dimensional space, wherein the distance is a distance from a specific point of the flexible display (160) as a reference point to an input determined based on the coordinates of an input (e.g., input (911) or hovering input (912)) and the curvature of the flexible display (160).
[0136] With reference to the above, the first partial area (531) can be determined based on the folding angle of the flexible display (160), the coordinates indicating the position of the input (911), the hovering input (912) of the external object (960) related to the input (911), and the reference distance capable of determining the hovering input (912). For example, the first partial area (531) can include an area where the distance from the origin on the folding axis (500) to the input (911) is changed by the distance (931a) determined based on the folding angle. For example, the electronic device (101) can determine the touch input of the position (910) moved from the input (911) based on the ratio between the distance to the hovering input (912) and the reference distance in the changed first partial area (531).
[0137] Referring to example (952), the electronic device (101) may determine multiple inputs for the third area (530). For example, the electronic device (101) may determine an input (911) including a contact point performed by an external object (960) in the first partial area (531) and a hovering input (912) performed by the external object (960) in the second partial area (532). According to an embodiment, the electronic device (101) may determine the first partial area (531) based on the folding angle of the flexible display (160) and the input (911). For example, the folding angle may be 90°+θ. For example, the electronic device (101) may determine the coordinates on the flexible display (160) corresponding to the position of the hovering input (912). For example, the coordinates of the hovering input (912) may be (x2, y2). The electronic device (101) may determine the distance spaced from the folding axis (500) based on the coordinates determined for the hovering input (912). The electronic device (101) can determine the first partial area (531) based on the spaced-apart distance and the folding angle. The equation for determining the first partial area (531) is as follows.
[0138] [Equation 2]
[0139] L2=l(y2)+Htanθ+Hmax
[0140] L2 may represent the distance from the point where the folding axis (500) intersects the flexible display (160) (e.g., the origin (0, 0)) to the boundary between the second partial area (532) and the second area (520) in the xy plane, l(y2) may represent the distance from the origin to the hovering input (912), Hmax may represent the maximum distance (or reference distance, or maximum hovering detection distance) at which the hovering input can be detected from the surface of the flexible display (160), H may represent the distance (or hovering detection distance) from the surface of the flexible display (160) to the hovering input, and θ may represent the folding angle. In this case, the hovering input (912) may indicate an input to the flexible display (160) made by an external object (960) related to the hovering input (912) and simultaneously with the input (911) including the contact point. In addition, l in the equation is described as a distance in a two-dimensional plane, but the embodiments of the present disclosure are not limited thereto. For example, l may represent a distance in a three-dimensional space, wherein the distance is a distance from a specific point of the flexible display (160) as a reference point to an input determined based on the coordinates of an input (e.g., input (911) or hovering input (912)) and the curvature of the flexible display (160).
[0141] With reference to the above, the second partial area (532) may be determined based on the folding angle of the flexible display (160), the coordinates indicating the position of the hovering input (912), the distance indicating the height of the hovering input (912), and the reference distance capable of determining the hovering input (912). For example, the first partial area (531) may include an area changed by the distance (932b) determined based on the folding angle with respect to the distance from the origin on the folding axis (500) to the hovering input (912).
[0142] refer to Figures 1 to 9b , the apparatus and method according to the embodiments of the present disclosure can determine (or recognize) input to the touch difficulty area based on input and hovering input made by an external object, including a contact point. The apparatus and method according to the embodiments of the present disclosure can accurately determine input to the variable touch difficulty area according to the folding angle. In addition, even in the case of a drag input including a touch difficulty area, the apparatus and method according to the embodiments of the present disclosure can accurately determine the drag input including the variable touch difficulty area according to the folding angle.
[0143] Figure 10 is a block diagram illustrating electronic devices in a network environment according to various embodiments.
[0144] refer to Figure 10In the network environment (1000), an electronic device (1001) can communicate with an electronic device (1002) via a first network (1098) (e.g., a short-range wireless communication network), or can communicate with at least one of an electronic device (1004) and a server (1008) via a second network (1099) (e.g., a long-range wireless communication network). According to an embodiment, the electronic device (1001) can communicate with the electronic device (1004) via the server (1008). According to an embodiment, the electronic device (1001) may include a processor (1020), a memory (1030), an input module (1050), a sound output module (1055), a display module (1060), an audio module (1070), a sensor module (1076), an interface (1077), a connection terminal (1078), a haptic module (1079), a camera module (1080), a power management module (1088), a battery (1089), a communication module (1090), a user identification module (1096), or an antenna module (1097). In some embodiments, at least one component (e.g., the connection terminal (1078)) may be omitted from the electronic device (1001), or one or more other components may be added to the electronic device (1001). In some embodiments, some components (e.g., the sensor module (1076), the camera module (1080), or the antenna module (1097)) may be implemented as a single component (e.g., the display module (1060)).
[0145] The processor (1020) can execute, for example, software (e.g., program (1040)) to control at least one other component (e.g., hardware or software component) of the electronic device (1001) coupled to the processor (1020), and can perform various data processing or calculations. According to an embodiment, as at least part of the data processing or calculation, the processor (1020) can load commands or data received from another component (e.g., sensor module (1076) or communication module (1090)) into the volatile memory (1032), process the commands or data stored in the volatile memory (1032), and store the resultant data in the non-volatile memory (1034). According to an embodiment, the processor (1020) may include a main processor (1021) (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor (1023) (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor (1021). For example, when the electronic device (1001) includes the main processor (1021) and the auxiliary processor (1023), the auxiliary processor (1023) may be adapted to consume less power than the main processor (1021), or may be adapted to be specifically used for a specified function. The auxiliary processor (1023) may be implemented as a separate processor from the main processor (1021), or as a part of the main processor (1021).
[0146] When the main processor (1021) is in an inactive (e.g., sleep) state, the auxiliary processor (1023) may control at least some of the functions or states related to at least one component (e.g., display module (1060), sensor module (1076), or communication module (1090)) among the components of the electronic device (1001) (not the main processor (1021)), or when the main processor (1021) is in an active state (e.g., running an application), the auxiliary processor (123) may control at least some of the functions or states related to at least one component (e.g., display module (160), sensor module (176), or communication module (190)) among the components of the electronic device (1001) together with the main processor (1021). According to an embodiment, the auxiliary processor (1023) (e.g., image signal processor or communication processor) may be implemented as part of another component (e.g., camera module (1080) or communication module (1090)) that is functionally related to the auxiliary processor (1023). According to an embodiment, the auxiliary processor (1023) (e.g., a neural processing unit) may include a hardware structure specified for artificial intelligence model processing. The artificial intelligence model may be generated by machine learning. Such learning may be performed, for example, by an electronic device (1001) that executes artificial intelligence or via a separate server (e.g., server (1008)). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q network, or a combination of two or more thereof, but is not limited thereto. Additionally or alternatively, the artificial intelligence model may include a software structure in addition to the hardware structure.
[0147] The memory (1030) may store various data used by at least one component of the electronic device (1001), such as the processor (1020) or the sensor module (1076). The various data may include, for example, software (e.g., the program (1040)) and input data or output data for commands related thereto. The memory (1030) may include a volatile memory (1032) or a non-volatile memory (1034).
[0148] The program ( 1040 ) may be stored as software in the memory ( 1030 ), and may include, for example, an operating system (OS) ( 1042 ), middleware ( 1044 ), or applications ( 1046 ).
[0149] The input module (1050) can receive commands or data from outside the electronic device (1001) (e.g., a user) to be used by other components of the electronic device (1001) (e.g., the processor (1020)). The input module (1050) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).
[0150] The sound output module (1055) can output sound signals to the outside of the electronic device (1001). The sound output module (1055) can include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. Depending on the embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0151] The display module (1060) can visually provide information to the outside of the electronic device (1001) (e.g., a user). The display module (1060) can include, for example, a display, a holographic device, or a projector, and a control circuit system for controlling a corresponding one of the display, the holographic device, and the projector. Depending on the embodiment, the display module (1060) can include a touch sensor suitable for detecting a touch, or a pressure sensor suitable for measuring the intensity of the force caused by the touch.
[0152] The audio module (1070) can convert sound into an electrical signal, and vice versa. According to an embodiment, the audio module (1070) can obtain sound via the input module (1050), or output sound via the sound output module (1055) or an earphone of an external electronic device (e.g., electronic device (1002)) directly (e.g., wired) or wirelessly coupled to the electronic device (1001).
[0153] The sensor module (1076) can detect an operating state (e.g., power or temperature) of the electronic device (1001) or an environmental state (e.g., a user's state) outside the electronic device (1001), and then generate an electrical signal or data value corresponding to the detected state. Depending on the embodiment, the sensor module (1076) may include, for example, a gesture sensor, a gyroscope sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.
[0154] The interface (1077) may support one or more specific protocols to be used to connect the electronic device (1001) directly (e.g., wired) or wirelessly to an external electronic device (e.g., electronic device (1002)). Depending on the embodiment, the interface (1077) may include, for example, a High-Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital (SD) card interface, or an audio interface.
[0155] The connection end (1078) may include a connector, and the electronic device (1001) can be physically connected to an external electronic device (e.g., the electronic device (1002)) via the connector (1078). According to an embodiment, the connection end (1078) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0156] The haptic module (1079) may convert the electrical signal into a mechanical stimulus (e.g., vibration or motion) or an electrical stimulus that can be recognized by the user via his sense of touch or kinesthetic sense. Depending on the embodiment, the haptic module (1079) may include, for example, a motor, a piezoelectric element, or an electrical stimulator.
[0157] The camera module (1080) can capture still images or moving images. Depending on the embodiment, the camera module (1080) may include one or more lenses, image sensors, image signal processors, or flashes.
[0158] The power management module (1088) may manage power supply to the electronic device (1001). According to an embodiment, the power management module (1088) may be implemented as at least part of a power management integrated circuit (PMIC), for example.
[0159] The battery (1089) can power at least one component of the electronic device (1001). Depending on the embodiment, the battery (1089) can include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0160] The communication module (1090) can support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1001) and an external electronic device (e.g., electronic device (1002), electronic device (1004), or server (1008)), and perform communication via the established communication channel. The communication module (1090) may include one or more communication processors capable of operating independently from the processor (1020) (e.g., application processor (AP)) and support direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module (1090) may include a wireless communication module (1092) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1094) (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network (1098) (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network (1099) (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or can be implemented as multiple components (e.g., multiple chips) separated from each other. The wireless communication module (1092) can determine and authenticate the electronic device (1001) in a communication network (e.g., the first network (1098) or the second network (1099)) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module (1096).
[0161] The wireless communication module (1092) can support 5G networks following 4G networks and next-generation communication technologies, such as new radio (NR) access technology. NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module (1092) can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module (1092) can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module (1092) can support various requirements specified in the electronic device (1001), an external electronic device (e.g., electronic device (1004)), or a network system (e.g., a second network (1099)). According to an embodiment, the wireless communication module (1092) can support peak data rates for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 1064 dB or less), or U-plane latency for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 10 ms or less round trip).
[0162] The antenna module (1097) can transmit or receive signals or power to or from the outside of the electronic device (1001) (e.g., an external electronic device). According to an embodiment, the antenna module (1097) can include an antenna including a radiating element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module (1097) can include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (e.g., a first network (1098) or a second network (1099)) can be selected from the plurality of antennas by, for example, the communication module (1090) (e.g., the wireless communication module (1092)). Signals or power can then be transmitted or received between the communication module (1090) and the external electronic device via the selected at least one antenna. According to an embodiment, further components other than the radiating element (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1097).
[0163] According to various embodiments, the antenna module (1097) may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., millimeter wave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving signals in the specified high frequency band.
[0164] At least some of the above components can be coupled to each other via an inter-peripheral communication scheme (e.g., a bus, general-purpose input output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.
[0165] According to an embodiment, commands or data can be sent or received between the electronic device (1001) and the external electronic device (1004) via a server (1008) connected to the second network (1099). Each of the electronic devices (1002) or (1004) can be a device of the same type as the electronic device (1001), or a device of a different type than the electronic device (101). According to an embodiment, all or some operations to be executed on the electronic device (1001) can be executed on one or more of the external electronic device (1002), the external electronic device (1004), or the server (1008). For example, if the electronic device (1001) should automatically execute a function or service or execute a function or service in response to a request from a user or another device, the electronic device (1001) can request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device (1001) can request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute at least part of the requested function or service, or execute another function or service related to the request, and transmit the result of the execution to the electronic device (1001). The electronic device (1001) may provide the result as at least a partial response to the request, with or without further processing the result. To this end, for example, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology, or client-server computing technology may be used. The electronic device 1001 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device (1004) may include an Internet of Things (IoT) device. The server (1008) may be an intelligent server that uses machine learning and / or neural networks. According to an embodiment, the external electronic device (1004) or the server (1008) may be included in the second network (1099). The electronic device (1001) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology or IoT-related technologies.
[0166] As described above, the electronic device (101) may include a first housing (210). The electronic device (101) may include a second housing (220). The electronic device (101) may include a hinge structure (265) that rotatably couples the second housing (220) to the first housing (210). The electronic device (101) may include a flexible display (160) disposed on a surface of the first housing (210) and a surface of the second housing (220) across the hinge structure (265). The flexible display (160) may include a first area corresponding to the first housing (210), a second area corresponding to the second housing (220), and a third area located between the first area and the second area. The electronic device (101) may include a memory (130) storing instructions. The electronic device (101) may include at least one sensor (176). The electronic device (101) may include a processor (120). When the instructions are executed by the processor (120), the electronic device (101) may determine input to the flexible display (160) based on an external object. When the instructions are executed by the processor (120), the electronic device (101) may, in response to the input having a first contact point on the first area, recognize the input as a touch input for a first position on the first area, the first position corresponding to the position of the first contact point. When the instructions are executed by the processor (120), the electronic device (101) may, in response to the input having a second contact point on the third area, recognize the input as a touch input for a second position on the third area, the second position being determined based on the position of the second contact point of the external object and the position of the hover input caused by the external object. When the instructions are executed by the processor (120), the electronic device (101) may provide a response to the touch input.
[0167] According to an embodiment, when the processor (120) executes the instructions, the electronic device (101) may determine an angle between a first area and a second area based on at least one sensor (176). When the processor (120) executes the instructions, the electronic device (101) may determine a first partial area of a third area corresponding to the first area and a second partial area of the third area corresponding to the second area based on the angle and a reference distance for determining a hover input.
[0168] According to an embodiment, when the instructions are executed by the processor (120), the electronic device (101) can determine the distance from the flexible display (160) of the second partial area to the external object when the second contact point is located on the first partial area and the position of the hover input of the external object is located on the second partial area. When the instructions are executed by the processor (120), the electronic device (101) can determine the second position on the first partial area based on the ratio between the distance and the reference distance.
[0169] According to an embodiment, the reference distance may be a maximum distance at which a hovering input can be determined. The distance may be shorter than the reference distance and may be the shortest distance from the flexible display (160) of the second area to an external object.
[0170] According to an embodiment, when the processor (120) executes the instructions, the electronic device (101) can determine the distance from the flexible display (160) of the first partial area to the external object when the second contact point is located on the second partial area and the position of the hover input of the external object is located on the first partial area. When the processor (120) executes the instructions, the electronic device (101) can determine a second position on the second partial area based on a ratio between the distance and a reference distance.
[0171] According to an embodiment, when the instructions are executed by the processor (120), the electronic device (101) may recognize the input as a touch input for the boundary between the first partial area and the second partial area in response to the input having a third contact point on the first partial area and a fourth contact point on the second partial area.
[0172] According to an embodiment, the first position may be determined based on a first threshold and a first node, the first node corresponding to contact of an external object with respect to the first area. The second position may be determined based on a first partial position and a second partial position. The first partial position may be determined based on a first threshold and a second node, the second node corresponding to contact of an external object with respect to a third area. The second partial position may be determined based on a second threshold less than the first threshold and a third node, the third node corresponding to the position of a hover input of an external object with respect to the third area.
[0173] According to the above, a method performed by an electronic device (101) may include: determining an input to a flexible display (160) of the electronic device (101) based on an external object. The method may include: in response to the input having a first contact point on a first area of the flexible display (160) corresponding to the first housing (210), recognizing the input as a touch input to a first position on the first area, the first position corresponding to the position of the first contact point. The method may include: in response to the input having a second contact point on a third area of the flexible display (160) located between the first area and the second area, recognizing the input as a touch input to a second position on the third area, the second area corresponding to the second housing (220), the second position being determined based on the position of the second contact point of the external object and the position of the hover input caused by the external object. The method may include providing a response to the touch input. The flexible display (160) may include a hinge structure (265) that rotatably couples the second housing (220) to the first housing (210).
[0174] According to an embodiment, the method may include determining an angle between a first area and a second area based on at least one sensor (176). The method may include determining a first partial area of a third area corresponding to the first area and a second partial area of the third area corresponding to the second area based on the angle and a reference distance for determining a hover input.
[0175] According to an embodiment, the method may include: determining a distance from the flexible display (160) of the second partial area to the external object when the second contact point is located on the first partial area and the position of the hover input of the external object is located on the second partial area. The method may include: determining a second position on the first partial area based on a ratio between the distance and a reference distance.
[0176] According to an embodiment, the reference distance may be a maximum distance at which a hovering input can be determined. The distance may be shorter than the reference distance and may be the shortest distance from the flexible display (160) of the second area to an external object.
[0177] According to an embodiment, the method may include: determining a distance from the flexible display (160) of the first partial area to the external object when the second contact point is located on the second partial area and the position of the hover input of the external object is located on the first partial area. The method may include: determining a second position on the second partial area based on a ratio between the distance and a reference distance.
[0178] According to an embodiment, the method may include recognizing the input as a touch input targeting a boundary between the first partial area and the second partial area in response to the input having a third contact point on the first partial area and a fourth contact point on the second partial area.
[0179] According to an embodiment, the first position may be determined based on a first threshold and a first node, the first node corresponding to contact of an external object with respect to the first area. The second position may be determined based on a first partial position and a second partial position. The first partial position may be determined based on a first threshold and a second node, the second node corresponding to contact of an external object with respect to a third area. The second partial position may be determined based on a second threshold less than the first threshold and a third node, the third node corresponding to the position of a hover input of an external object with respect to the third area.
[0180] As described above, the electronic device (101) may include a first housing (210). The electronic device (101) may include a second housing (220). The electronic device (101) may include a hinge structure (265) that rotatably couples the second housing (220) to the first housing (210). The electronic device (101) may include a flexible display (160) disposed on a surface of the first housing (210) and a surface of the second housing (220) across the hinge structure (265). The flexible display (160) may include a first area corresponding to the first housing (210), a second area corresponding to the second housing (220), and a third area located between the first area and the second area. The electronic device (101) may include a memory (130) storing instructions. The electronic device (101) may include at least one sensor (176). The electronic device (101) may include a processor (120). When the instructions are executed by the processor (120), the electronic device (101) may determine the third area based on an angle between the first area and the second area. When the instructions are executed by the processor (120), the electronic device (101) may determine the movement of the external object on the first area as a first drag input and the movement of the external object on the third area as a second drag input in response to the external object moving from the first area across the third area. When the instructions are executed by the processor (120), the electronic device (101) may identify a touch input having a first length on the first area based on a first group of contact points located on the first area according to the first drag input. When the instructions are executed by the processor (120), the electronic device (101) may identify a touch input having a second length on the third area based on a second group of contact points located on the third area according to the second drag input and a hover input caused by the external object on the third area. When the instructions are executed by the processor (120), the electronic device (101) may provide a response to the touch input having the first length and the touch input having the second length.
[0181] According to an embodiment, when the processor (120) executes the instructions, the electronic device (101) may determine an angle between a first area and a second area based on at least one sensor (176). When the processor (120) executes the instructions, the electronic device (101) may determine a first partial area of a third area corresponding to the first area and a second partial area of the third area corresponding to the second area based on the angle and a reference distance for determining a hover input.
[0182] According to an embodiment, when the processor (120) executes the instructions, the electronic device (101) may determine, for each hovering input, a distance from the flexible display (160) of the second partial area to the external object when the second group of contact points according to the second drag input are located on the first partial area and the hovering input caused by the external object is located on the second partial area. When the processor (120) executes the instructions, the electronic device (101) may determine a second length based on a ratio between the distance and a reference distance.
[0183] According to an embodiment, the reference distance may be a maximum distance at which a hovering input can be determined. The distance may be shorter than the reference distance and may be the shortest distance from the flexible display (160) of the second area to an external object.
[0184] According to an embodiment, when the instruction is executed by the processor (120), the electronic device (101) can respond to the second drag input including an input having a contact point on the first partial area and a contact point on the second partial area, and recognize the input as a touch input for the boundary between the first partial area and the second partial area.
[0185] According to an embodiment, when the instructions are executed by the processor (120), the electronic device (101) may determine the movement of the external object extending from the third area to the second area as a third drag input. When the instructions are executed by the processor (120), the electronic device (101) may recognize a touch input having a third length on the second area based on a third group of contact points located on the second area according to the third drag input. When the instructions are executed by the processor (120), the electronic device (101) may provide a response based on the touch input having the first length, the touch input having the second length, and the touch input having the third length.
[0186] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those described above.
[0187] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalents or replacement forms for corresponding embodiments. For the description of the accompanying drawings, the same figure numerals can be used to refer to identical or related elements. It will be understood that the noun in the singular form corresponding to the term can include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each phrase in the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" can be included in any one or all possible combinations of the items listed together in the corresponding phrases in the multiple phrases. As used herein, terms such as "the 1st" and "the 2nd" or "first" and "second" can be used to simply distinguish a corresponding component from another component, and do not limit the component in other aspects (for example, importance or order). It will be understood that if an element (e.g., a first element) is referred to as being "coupled to" or "connected to" another element (e.g., a second element), whether or not the terms "operably" or "communicatively" are used, it means that the element can be directly (e.g., wired) coupled to the other element, wirelessly coupled to the other element, or coupled to the other element via a third element.
[0188] As used in conjunction with various embodiments of the present disclosure, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuitry"). A module may be a single integrated component adapted to perform one or more functions, or the smallest unit or portion of the single integrated component. For example, depending on the embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0189] The various embodiments described herein may be implemented as software (e.g., a program (1040)) comprising one or more instructions stored in a storage medium (e.g., an internal memory (1036) or an external memory (1038)) readable by a machine (e.g., an electronic device (1001)). For example, under the control of a processor, a processor (e.g., a processor (1020)) of the machine (e.g., an electronic device (1001)) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the called at least one instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. The term "non-transitory" refers only to the fact that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between the case where data is semi-permanently stored in the storage medium and the case where data is temporarily stored in the storage medium.
[0190] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., the Play Store). TM ) The computer program product may be published online (e.g., downloaded or uploaded) or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smartphones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).
[0191] According to various embodiments, each component (e.g., module or program) in the above-mentioned components may include a single entity or multiple entities, and some entities in the multiple entities may be separately arranged in different components. According to various embodiments, one or more components in the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform one or more functions of each component in the multiple components in the same or similar manner as a corresponding one of the multiple components performed one or more functions before integration. According to various embodiments, the operations performed by a module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operation may be performed in a different order or omitted, or one or more other operations may be added.
Claims
1. An electronic device (101), comprising: a first housing (210); a second housing (220); a hinge structure (265) rotatably coupling the second housing (220) to the first housing (210); a flexible display (160), the flexible display (160) being arranged on a surface of the first shell (210) and a surface of the second shell (220) across the hinge structure (265), wherein the flexible display (160) includes a first area corresponding to the first shell (210), a second area corresponding to the second shell (220), and a third area located between the first area and the second area; a memory (130), wherein the memory stores instructions; at least one sensor (176); and a processor (120), When the instructions are executed by the processor (120), the electronic device (101) is caused to: determining an input to the flexible display (160) based on an external object; In response to the input having a first contact point on the first area, recognizing the input as a touch input directed to a first position on the first area, the first position corresponding to a position of the first contact point; in response to the input having a second contact point on the third area, recognizing the input as a touch input directed to a second location on the third area, the second location being determined based on a location of the second contact point and a location of the hover input caused by the external object; and A response to the touch input is provided.
2. The electronic device (101) according to claim 1, in, When the instructions are executed by the processor (120), the electronic device (101) is caused to: determining an angle between the first area and the second area based on the at least one sensor (176); as well as A first partial area of the third area corresponding to the first area and a second partial area of the third area corresponding to the second area are determined based on the angle and a reference distance for determining the hovering input.
3. The electronic device (101) according to claim 2, in, When the instructions are executed by the processor (120), the electronic device (101) is caused to: In a case where the second contact point is located on the first partial area and the position of the hover input of the external object is located on the second partial area, determining a distance from the flexible display (160) of the second partial area to the external object; as well as The second position on the first partial area is determined based on a ratio between the distance and the reference distance.
4. The electronic device (101) according to claim 3, in, The reference distance is the maximum distance at which the hovering input can be determined, and The distance is shorter than the reference distance and is the shortest distance from the flexible display (160) in the second area to the external object.
5. The electronic device (101) according to claim 2, in, When the instructions are executed by the processor (120), the electronic device (101) is caused to: In a case where the second contact point is located on the second partial area and the position of the hover input of the external object is located on the first partial area, determining a distance from the flexible display (160) of the first partial area to the external object; as well as The second position on the second partial area is determined based on a ratio between the distance and the reference distance.
6. The electronic device (101) according to claim 2, in, When the instructions are executed by the processor (120), the electronic device (101) is caused to: In response to the input having a third contact point on the first partial area and a fourth contact point on the second partial area, the input is recognized as a touch input for a boundary between the first partial area and the second partial area.
7. The electronic device (101) according to claim 1, in, The first position is determined based on a first threshold and a first node, the first node corresponding to contact of the external object with respect to the first area, wherein the second position is determined based on the first partial position and the second partial position, wherein the first partial position is determined based on the first threshold and a second node, the second node corresponding to the contact of the external object with respect to the third area, and The second portion of the position is determined based on a second threshold value smaller than the first threshold value and a third node, and the third node corresponds to a position of the hover input of the external object to the third area.
8. A method performed by an electronic device (101), the method comprising: determining an input to a flexible display (160) of the electronic device (101) based on an external object; In response to the input having a first contact point on a first area of the flexible display (160) corresponding to the first housing (210), recognizing the input as a touch input directed to a first position on the first area, the first position corresponding to a position of the first contact point; In response to the input having a second contact point on a third area of the flexible display (160) between the first area and the second area, recognizing the input as a touch input directed to a second position on the third area, the second area corresponding to the second housing (220), the second position being determined based on a position of the second contact point of the external object and a position of a hovering input caused by the external object; as well as providing a response to the touch input, The flexible display (160) includes a hinge structure (265), and the hinge structure (265) rotatably connects the second shell (220) to the first shell (210).
9. The method according to claim 8, comprising: determining an angle between the first area and the second area based on the at least one sensor (176); as well as A first partial area of the third area corresponding to the first area and a second partial area of the third area corresponding to the second area are determined based on the angle and a reference distance for determining the hovering input.
10. The method according to claim 9, comprising: In a case where the second contact point is located on the first partial area and the position of the hover input of the external object is located on the second partial area, determining a distance from the flexible display (160) of the second partial area to the external object; as well as The second position on the first partial area is determined based on a ratio between the distance and the reference distance.
11. The method according to claim 10, in, The reference distance is the maximum distance at which the hovering input can be determined, and The distance is shorter than the reference distance and is the shortest distance from the flexible display (160) in the second area to the external object.
12. The method according to claim 9, comprising: In a case where the second contact point is located on the second partial area and the position of the hover input of the external object is located on the first partial area, determining a distance from the flexible display (160) of the first partial area to the external object; as well as The second position on the second partial area is determined based on a ratio between the distance and the reference distance.
13. The method according to claim 9, comprising: In response to the input having a third contact point on the first partial area and a fourth contact point on the second partial area, the input is recognized as a touch input for a boundary between the first partial area and the second partial area.
14. The method according to claim 8, in, The first position is determined based on a first threshold and a first node, the first node corresponding to contact of the external object with respect to the first area, wherein the second position is determined based on the first partial position and the second partial position, wherein the first partial position is determined based on the first threshold and a second node, the second node corresponding to the contact of the external object with respect to the third area, and The second portion of the position is determined based on a second threshold value smaller than the first threshold value and a third node, and the third node corresponds to a position of the hover input of the external object to the third area.
15. An electronic device (101), comprising: a first housing (210); a second housing (220); a hinge structure (265) rotatably coupling the second housing (220) to the first housing (210); a flexible display (160), the flexible display (160) being arranged on a surface of the first shell (210) and a surface of the second shell (220) across the hinge structure (265), wherein the flexible display (160) includes a first area corresponding to the first shell (210), a second area corresponding to the second shell (220), and a third area located between the first area and the second area; a memory (130), wherein the memory stores instructions; at least one sensor (176); and a processor (120), When the instructions are executed by the processor (120), the electronic device (101) is caused to: determining the third area based on an angle between the first area and the second area; In response to the external object moving from the first area toward the second area across the third area, determining the movement of the external object on the first area as a first drag input, and determining the movement of the external object on the third area as a second drag input; identifying a touch input having a first length on the first area based on a first set of contact points located on the first area according to the first drag input; recognizing a touch input having a second length on the third area based on a second group of contact points located on the third area according to the second drag input and a hover input caused by the external object on the third area; and Responses are provided to the touch input having the first length and the touch input having the second length.