Electronic device and method for displaying visual object indicating execution of software application in display area
The electronic device addresses the challenge of displaying real-time software application execution status across various form factors by using a dual-display system that adapts to shape changes, ensuring a seamless user experience through sensor-driven layout adjustments.
Patent Information
- Application Number
- PCT/KR2024/007010
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-04
- Filing Date
- 2024-05-23
- Publication Date
- 2025-01-23
AI Technical Summary
Current electronic devices with flexible displays struggle to effectively display real-time execution status information of software applications across different form factors, particularly when transitioning between unfolded and folded states, leading to a disjointed user experience.
An electronic device with a rotatable housing and dual displays, where a flexible display and a cover display work together to display a default screen and visual objects representing software application execution status, allowing for seamless transitions and overlapping information in real-time, using sensors to detect changes in the device's state and adjust the visual layout accordingly.
This solution provides a cohesive and intuitive user experience by maintaining the display of execution status information across different device configurations, ensuring continuous visibility of application status without interrupting the user interface during shape changes.
Smart Images

Figure KR2024007010_23012025_PF_FP_ABST
Abstract
Description
Electronic device and method for displaying a visual object representing the execution of a software application within an area of a display
[0001] The present disclosure relates to an electronic device and method for displaying a visual object representing the execution of a software application within an area of a display.
[0002] Electronic devices with transformable form factors are being developed using flexible displays. For example, an electronic device comprising a plurality of foldable housings can provide a user experience based on the form of the electronic device by utilizing a flexible display positioned on the plurality of housings. For example, based on the form of the flexible display being folded or unfolded by an external force from the user, the electronic device can change the content displayed on the flexible display.
[0003] An electronic device according to one embodiment may include a housing including a first housing part and a second housing part rotatably coupled to the first housing part, a flexible display extending from one side of the first housing part to one side of the second housing part, a cover display located on the other side of the first housing part, and a memory storing at least one processor and instructions, the memory including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a default screen in a first area of the cover display when the cover display performs an operation of turning on the cover display by a user input or a system input when the instructions are executed. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, in a second area that is a portion of the first area, a visual object overlapping the default screen, indicating execution status information that updates in real time or periodically the operation of at least one software application running on the electronic device when the instructions are executed.
[0004] In a method of an electronic device according to one embodiment, the method may include an operation of displaying a default screen in a first area of the cover display when an operation of turning on the cover display is performed by a user input or a system input. The method may include an operation of displaying a visual object representing execution status information that updates the operation of at least one software application running on the electronic device in real time or periodically, overlapping the default screen, in a second area that is a part of the first area.
[0005] In one embodiment, an electronic device may include a housing including a first housing part and a second housing part rotatably coupled to the first housing part, a flexible display extending from one side of the first housing part to one side of the second housing part, a cover display positioned on another side of the first housing part opposite to the one side on which the flexible display is positioned, at least one processor, and a memory storing instructions, the memory including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, on the cover display, a second visual object representing a first widget among a plurality of widgets provided from a plurality of software applications executed by the at least one processor, together with a first visual object representing time, based on a specified condition, in a folded state in which the one side of the first housing part and the one side of the second housing part face each other. The instructions, when individually or collectively executed by the at least one processor, may be configured to cause the electronic device to, based on an input for the second visual object, stop displaying the second visual object on the cover display and display a third visual object corresponding to the second widget among the plurality of widgets.
[0006] In one embodiment, a method of an electronic device may include an operation of displaying, on a cover display in a folded state in which one side of a first housing part of the electronic device and one side of a second housing part of the electronic device face each other, a second visual object representing a first widget among a plurality of widgets provided from a plurality of software applications executed by at least one processor, together with a first visual object representing time, based on a specified condition. The method may include an operation of stopping displaying the second visual object on the cover display based on an input for the second visual object, and displaying a third visual object corresponding to the second widget among the plurality of widgets.
[0007] In one embodiment, an electronic device may include a housing including a first housing part and a second housing part rotatably coupled to the first housing part, a flexible display extending from one side of the first housing part to one side of the second housing part, a cover display positioned on another side of the first housing part opposite to the one side on which the flexible display is positioned, at least one processor, and a memory storing instructions, the memory including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to initiate execution of a first software application in an unfolded state distinct from a folded state in which the one side of the first housing part and the one side of the second housing part face each other. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify whether the first software application is associated with a second software application for managing widgets to be displayed on the cover display based on identifying a change from the unfolded state to the folded state. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a visual object indicating execution of the first software application in an area corresponding to one of the corners of the cover display, in a first state in which the first software application is associated with the second software application.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, on the cover display, a screen for linking the second software application and the first software application in a second state distinct from the first state.
[0008] FIG. 1 illustrates an example of a block diagram of an electronic device according to one embodiment.
[0009] FIGS. 2A and 2B illustrate an example of a positional relationship between a first housing part and a second housing part in an unfolded state and a folded state of an electronic device according to one embodiment.
[0010] FIGS. 3A and 3B illustrate examples of locations of a plurality of acceleration sensors within an electronic device according to one embodiment.
[0011] FIG. 4 illustrates an example of a flowchart illustrating the operation of an electronic device according to one embodiment.
[0012] FIG. 5 illustrates an example of an operation of an electronic device according to one embodiment of the present invention to display a visual object on a cover display indicating execution of a software application based on specified settings.
[0013] FIG. 6 illustrates an example of a visual object representing the execution of a software application displayed on a cover display according to one embodiment.
[0014] FIGS. 7A to 7C illustrate an example of an operation for an electronic device according to one embodiment to display at least one of visual objects corresponding to a plurality of software applications.
[0015] FIG. 8 illustrates an example of an operation for an electronic device to temporarily suspend execution of a widget in response to a specified input to a visual object, according to one embodiment.
[0016] FIG. 9 illustrates an example of a visual object displayed on a cover display according to one embodiment.
[0017] FIGS. 10A and 10B illustrate an example of an operation for displaying at least one of visual objects corresponding to a plurality of software applications according to one embodiment.
[0018] FIG. 11 illustrates an example of an operation of an electronic device according to one embodiment of the present invention to display a visual object indicating execution of a software application on a cover display.
[0019] FIG. 12 illustrates an example of a flowchart illustrating the operation of an electronic device according to one embodiment.
[0020] FIG. 13 illustrates an example of an operation of an electronic device displaying a default screen according to one embodiment.
[0021] FIG. 14 illustrates an example of an operation of an electronic device displaying a widget screen according to one embodiment.
[0022] FIG. 15 illustrates an example of a widget screen provided from a software application according to one embodiment.
[0023] FIG. 16 illustrates an example of a flowchart illustrating the operation of an electronic device according to one embodiment.
[0024] FIG. 17 illustrates an example of an operation of an electronic device displaying a visual object according to one embodiment.
[0025] FIG. 18 is a block diagram of an electronic device within a network environment according to various embodiments.
[0026] Hereinafter, various embodiments of this document are described with reference to the attached drawings.
[0027] FIG. 1 illustrates an example block diagram of an electronic device according to one embodiment. Referring to FIG. 1 , in one embodiment, the electronic device (101) may be referred to as a terminal (or user terminal) in terms of being owned by a user. The terminal may include, for example, a personal computer (PC) such as a laptop or desktop. The terminal may include, for example, a smartphone, a smartpad, and / or a tablet PC. The terminal may include a smart accessory such as a smartwatch and / or a head-mounted device (HMD).
[0028] According to one embodiment, the electronic device (101) may include at least one of a processor (120), a memory (130), a display (150), or a sensor (160). The processor (120), the memory (130), the display (150), and the sensor (160) may be electrically and / or operably coupled with each other by an electronic component, such as a communication bus. Although illustrated based on different blocks, the embodiment is not limited thereto. The type and / or number of hardware components included in the electronic device (101) is not limited to that illustrated in the block diagram of FIG. 1. For example, the electronic device (101) may include only some of the hardware components illustrated based on the block diagram of FIG. 1.
[0029] According to one embodiment, the processor (120) of the electronic device (101) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an Arithmetic and Logic Unit (ALU), a Floating Point Unit (FPU), a Field Programmable Gate Array (FPGA), an Application Processor (AP), and / or a Central Processing Unit (CPU). The number of processors (120) may be one or more. For example, the processor (120) may have a multi-core processor structure such as a dual core, a quad core, or a hexa core.
[0030] According to one embodiment, the memory (130) of the electronic device (101) may include hardware components for storing data and / or instructions input and / or output to the processor (120). The memory (130) may include, for example, volatile memory such as random-access memory (RAM), and / or non-volatile memory such as read-only memory (ROM). The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo-SRAM (PSRAM). The non-volatile memory may include, for example, at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disk, and embedded multi media card (eMMC).
[0031] According to one embodiment, the display (150) of the electronic device (101) can output visualized information to the user. For example, the display (150) can be controlled by a controller, such as a graphic processing unit (GPU), to output visualized information to the user. The display (150) can include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs can include organic LEDs (OLEDs). The display (150) can include electronic paper. The display (150) can have an at least partially curved shape and / or a deformable shape.
[0032] According to one embodiment, the display (150) of the electronic device (101) may include a sensor (e.g., a touch sensor panel (TSP)) for detecting an external object (e.g., a user's finger) on the display (150). For example, based on the TSP, the electronic device (101) may detect an external object that is in contact with the display (150) or floating on the display (150). In response to detecting the external object, the electronic device (101) may execute a function related to a specific visual object corresponding to a position of the external object on the display (150) among visual objects displayed within the display (150). The display (150) may include a flexible display (153) and / or a cover display (155) having at least a partially curved shape and / or a deformable shape.
[0033] According to one embodiment, the flexible display (153) and / or the cover display (155) of the electronic device (101) may be provided to output visualized information to the user, similar to the display (150). In the description of the flexible display (153) and the description of the cover display (155), any description overlapping with the display (150) is omitted for convenience of explanation. The cover display (155) may be referred to as a sub-display, an external display, or a front display.
[0034] For example, the cover display (155) may be disposed on a different side from one side of the electronic device (101) on which the flexible display (153) is disposed. The location of the cover display (155) may be disposed on one side of the housing that is viewable in a state in which the flexible display (153) is covered (e.g., in a folded state). The cover display (155) may be implemented similarly to the display (150). The cover display (155) may be referred to as a sub-display, an external display, or a front display. In the description of the cover display (155), descriptions that overlap with those of the display (150) are omitted for convenience of explanation.
[0035] For example, a housing of an electronic device (101) may include a first housing part including a first side and a second side opposite the first side, and a second housing part including a third side and a fourth side opposite the third side. The electronic device (101) may include a flexible display (153) disposed on the first side of the first housing part and the third side of the second housing part. The electronic device (101) may include a flexible display (153) extending from the first side of the first housing part to the third side of the second housing part. The electronic device (101) may include a cover display (155) disposed on the second side of the first housing part. As an example, the electronic device (101) may include a camera (not shown) configured to sense the direction in which the second side of the first housing part faces. For example, the electronic device (101) can identify an angle between the first housing part and the second housing part using the sensor (160). The electronic device (101) can identify a folded state, a sub-folded state, and / or an unfolded state based on the angle between the first housing part and the second housing part. The operation of the electronic device (101) identifying a state based on the angle is described below with reference to FIGS. 2A and 2B.
[0036] According to one embodiment, a sensor (160) of an electronic device (101) may generate electrical information, which may be processed by a processor (120) and / or a memory (130), from non-electronic information related to the electronic device (101). The electrical information generated by the sensor (160) may be stored in the memory (130), processed by the processor (120), and / or transmitted to another electronic device distinct from the electronic device (101). There may be one or more sensors (160).
[0037] For example, the sensor (160) may include a Hall sensor for identifying an angle between housings included in the electronic device (101). The Hall sensor may include one or more magnets and / or one or more magnetic sensors. At least one of the one or more magnets included in the Hall sensor or the one or more magnetic sensors may be placed at different locations within the electronic device (101). The positional relationship of the one or more magnets and / or the one or more magnetic sensors within the electronic device (101) may vary depending on the shape of the electronic device (101). The electronic device (101) may measure a change in the positional relationship through the one or more magnetic sensors. The change in the positional relationship may cause a change in a magnetic field formed by the one or more magnets. The electronic device (101) may obtain a power signal representing a change in the magnetic field using the Hall sensor. For example, the electronic device (101) can distinguish a posture or state (e.g., a folded state or an unfolded state) using the power signal acquired from the Hall sensor. For example, the electronic device (101) can receive data indicating a state of the electronic device (101) from the Hall sensor. For example, the Hall sensor can output data indicating the shape of the flexible display (153). The shape of the flexible display (153) can change as it is folded or unfolded by a folding axis (e.g., the folding axis (237) described later in FIG. 2A). For example, the Hall sensor can output different data indicating the shape of the flexible display (153). The embodiment is not limited thereto, and according to one embodiment, the processor (120) can identify the angle using an IMU (inertia measurement unit) sensor.
[0038] For example, the sensor (160) may include an acceleration sensor (e.g., acceleration sensors 360, 361, 370, 371 of FIGS. 3A and 3B) for measuring physical movement of the electronic device (101). The acceleration sensor may output electrical information indicating the magnitude of gravitational acceleration measured in each of a plurality of designated axes (e.g., x-axis, y-axis, z-axis) that are perpendicular to each other. The processor (120) of the electronic device (101) according to one embodiment may measure the posture of the electronic device (101) in a physical space based on the electrical information output from the acceleration sensor. The posture measured by the electronic device (101) may indicate the orientation of the electronic device (101) and / or the shape of the electronic device (101) measured by the acceleration sensor. The electronic device (101) can determine the mode of the electronic device (101) based on the measured posture. For example, the electronic device (101) can identify a mode corresponding to the posture of the electronic device (101) among a plurality of designated modes, including a landscape mode and a portrait mode.
[0039] According to one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by the processor (120) may be stored within the memory (130) of the electronic device (101). A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or an application. For example, the electronic device (101) and / or the processor (120) may perform at least one of the operations of FIG. 4, FIG. 12, or FIG. 16 when a set of a plurality of instructions distributed in the form of an operating system, firmware, a driver, and / or an application is executed. Hereinafter, the fact that an application is installed in an electronic device (101) may mean that one or more instructions provided in the form of an application are stored in the memory (130) of the electronic device (101), and that the one or more applications are stored in a format executable by the processor (120) of the electronic device (101) (e.g., a file having an extension specified by the operating system of the electronic device (101)).
[0040] An electronic device (101) according to one embodiment can control the display of at least one screen on a cover display (155) based on the execution of a widget management application (133). The widget management application (133) provides resources of a wallpaper screen, and the electronic device (101) can edit at least a portion of the wallpaper screen using the resources.
[0041] For example, the electronic device (101) can identify a wallpaper screen to be displayed on the cover display (155) using wallpaper screen information (133-1). The wallpaper screen can include a visual object indicating the time (e.g., the current time). The wallpaper screen can be referred to as a main screen screen, a cover screen, a home screen, a launcher screen, a default screen, and / or a background screen. For example, the widget managing application (133) can be referred to as a clock widget application in terms of including a visual object indicating the time. The widget managing application (133) can be an example of an application provided by the operating system of the electronic device (101). The widget managing application (133) can include a software application provided by the operating system to manage at least one widget executable through the cover display (155). The widget managing application (133) can be referred to as a widget launcher application in terms of being able to manage at least one widget. However, the present invention is not limited thereto. The widget managing application (133) may be an example of an application (e.g., a clock face application) installed by a user to change the displayed screen of the cover display (155).
[0042] For example, the memory (130) of the electronic device (101) may include a plurality of software applications (135, 137). The plurality of software applications (135, 137) may be provided by a user (or a server) different from the user of the electronic device (101). The plurality of software applications (135, 137) may include software applications that provide a type of widget (e.g., a music-related widget, a timer-related widget, a weather-related widget, and / or a recording-related widget) that can be executed by the widget managing application (133) of the electronic device (101). For example, a widget may include a user interface (UI) element used to notify a user of at least one piece of information. The electronic device (101) may use the widget to provide at least one piece of information to the user or may use the widget to perform at least one function.
[0043] For example, the electronic device (101) may cause execution of a plurality of widgets (135-1, 137-1) provided by a plurality of software applications (135, 137) installed in the electronic device (101) based on execution of the widget managing application (133). The electronic device (101) may edit each of the plurality of widgets (135-1, 137-1) using the widget managing application (133). The electronic device (101) may register a first widget (135-1) provided by a first software application (135) based on execution of the widget managing application (133). The electronic device (101) may link the widget managing application (133) and the first software application (135) to register the first widget (135-1) in the widget managing application (133). The electronic device (101) can execute the first widget (135-1) registered using the widget managing application (133).
[0044] For example, the electronic device (101) may use the widget managing application (133) to display a second widget (137-1) of a second software application (137) on the cover display (155). The electronic device (101) may use the widget managing application (133) to link the second software application (137) and the widget managing application (133) to cause execution of a second widget (137-1) corresponding to the second software application (137). By linking the widget managing application (133) with the second software application (137), the electronic device (101) may display the second widget (137-1) within a user interface provided by the widget managing application (133).
[0045] According to one embodiment, an electronic device (101) may display a visual object on a cover display (155) indicating execution of a widget (e.g., a first widget (135-1) or a second widget (137-1)) corresponding to another software application (e.g., a first software application (135) or a second software application (137)) using a widget managing application (133). When a plurality of widgets are executed, the electronic device (101) may select at least one of the plurality of visual objects indicating execution of the plurality of widgets. An example of an operation for the electronic device (101) to select at least one of the plurality of widgets is described below with reference to FIGS. 7A to 7C .
[0046] Hereinafter, an example of a state of an electronic device (101) identified according to an angle of the electronic device (101) will be described with reference to FIGS. 2a and 2b.
[0047] FIGS. 2A and 2B illustrate an example of a positional relationship between a first housing part and a second housing part in an unfolded state and a folded state of an electronic device according to one embodiment. The electronic device (101) of FIGS. 2A and 2B may be referenced to the electronic device (101) of FIG. 1 . The first housing part (210), the second housing part (220), and the folding housing part (265) may be included in a housing of the electronic device (101). The electronic device (101) may include a first housing part including a first face (211) and a second face (212) opposite the first face. The electronic device (101) may include a second housing part (220) including a third face (221) and a fourth face (not shown) opposite the third face. The electronic device (101) may include a folding housing part (265) that pivotally connects the first housing part (210) and the second housing part (220). The folding housing part (265) may include a rotatable hinge structure. The folding housing part (265) may be referred to as a hinge assembly in that it includes a hinge structure that rotates the first housing part (210) and the second housing part (220). By the hinge assembly, the relative position, angle, shape, and / or distance of the first housing part (210) and the second housing part (220), which are rigid bodies, may be changed by an external force.
[0048] For example, at least a portion of the flexible display (153) may be disposed on one side of the first housing part (210) (e.g., the first side (211)) and one side of the second housing part (e.g., the third side (221)). For example, at least a portion of the flexible display (153) may be disposed on the first side (211) and the third side (221) across the folding housing part (265). The first display area (231), the second display area (232), and the third display area (233) may be included in the flexible display (153). The cover display (155) may be disposed on the second side (212). The electronic device (101) may include a camera facing the direction in which the second side (212) faces. The camera may be disposed within a portion area (250) of the second side (212). For example, the area (250) may be referred to as a notch area from the perspective of where the camera is positioned. Within the area (250), at least a portion of the cover display (250) may be positioned. For example, when at least a portion of the cover display (250) is positioned within the area (250), the shape of the cover display (250) may correspond to a polygon (e.g., a square). For example, when at least a portion of the cover display (250) is positioned within the area (250), a camera hole may be positioned within the at least portion. The camera hole may be used to transmit light to or output light from a camera positioned within the at least portion. The camera positioned within the at least portion may be referred to as an under-display camera (UDC).
[0049] For example, another camera distinct from the above camera may be positioned on at least a portion of one side (e.g., the first side (211)) of the first housing part (210) where the flexible display (153) is positioned and one side (e.g., the third side (221)) of the second housing part.
[0050] According to one embodiment, the electronic device (101) can provide an unfolding state (or unfolded state) in which the first housing part (210) and the second housing part (220) are fully folded out by the folding housing part (265). For example, referring to FIG. 2A, the electronic device (101) can be in a state (200) which is the unfolding state. For example, the state (200) can mean a state in which a first direction (291) toward which the first face (211) faces corresponds to a second direction (292) toward which the third face (221) faces. For example, within the state (200), the first direction (291) can be parallel to the second direction (292). For example, within state (200), the first direction (291) may be the same as the second direction (292).
[0051] According to one embodiment, within the state (200), the first side (211) may form substantially one plane with the third side (221). For example, the angle (205-1) between the first side (211) and the third side (221) within the state (200) may be 180 degrees. For example, the state (200) may mean a state in which the entire display area of the flexible display (153) may be provided substantially on one plane. For example, the state (200) may mean a state in which the first display area (231), the second display area (232), and the third display area (233) may all be provided on one plane. For example, within the state (200), the third display area (233) may not include a curved surface. For example, the unfolded state may be referred to as an outspread state, an outspreading state, a fully unfolded state, an opened state, an unfolded state, a flat state, and / or a planar state. Different states of the electronic device (101) based on angles (205-2, 205-3, 205-4) are described below.
[0052] Referring to FIG. 2B, an electronic device (101) according to one embodiment can provide a folding state (or folded state) in which a first housing part (210) and a second housing part (220) are folded in by a folding housing part (265). For example, the electronic device (101) can be in a folding state including a state (201), a state (202), and a state (203). For example, the folding state including a state (201), a state (202), and a state (203) can mean a state in which a first direction (291) toward which a first face (211) faces is distinct from a second direction (292) toward which a third face (221) faces. For example, in state (201), the angle between the first direction (291) and the second direction (292) is 45 degrees, and the first direction (291) and the second direction (292) can be distinguished from each other. For example, in state (202), the angle between the first direction (291) and the second direction (292) is 150 degrees, and the first direction (291) and the second direction (292) can be distinguished from each other. For example, in state (203), the angle between the first direction (291) and the second direction (292) is substantially 180 degrees, and the first direction (291) and the second direction (292) can be distinguished from each other.
[0053] According to one embodiment, the angle between the first side (211) and the third side (221) within the folded state may be greater than or equal to 0 degrees and less than 180 degrees. For example, in state (201), the angle (205-2) between the first side (211) and the third side (221) may be 135 degrees. In state (202), the angle (205-3) between the first side (211) and the third side (221) may be 30 degrees. In state (203), the angle (205-4) between the first side (211) and the third side (221) may be substantially 0 degrees. For example, the folded state may be referred to as a folded state, a fully folded state, and / or a closed state.
[0054] In one embodiment, the folding state may include a plurality of sub-folding states, unlike the unfolding state. For example, referring to FIG. 2B, the folding state may include a plurality of sub-folding states, including a state (203) which is a fully folded state in which the first side (211) substantially overlaps the third side (221) by rotation provided through the folding housing part (265), and a state (201) and a state (202) which are intermediate folding states between the state (203) and the unfolding state (e.g., the state (200) of FIG. 2A). For example, the electronic device (101) may provide a state (203) in which the entire area of the first display area (231) substantially completely overlaps the entire area of the second display area (232) by causing the first side (211) and the third side (221) to face each other by the folding housing part (265). For example, the electronic device (101) may provide a state (203) in which the first direction (291) is substantially opposite to the second direction (292). For example, the state (203) may mean a state in which the flexible display (153) is occluded within the field of view of a user looking at the electronic device (101). For example, in the state (203) (e.g., a fully folded state), the flexible display (153) may be substantially occluded by the housing of the electronic device (101). However, the present invention is not limited thereto.
[0055] According to one embodiment, the flexible display (153) can be bent by the rotation provided through the folding housing part (265). For example, in the flexible display (153), unlike the first display area (231) and the second display area (232), the third display area (233) can be bent according to the folding operation. For example, the third display area (233) can be in a curvedly bent state to prevent damage to the flexible display (153) within the fully folded state. In the fully folded state, unlike the third display area (233) being curved, the entire first display area (231) can be completely overlapped over the entire second display area (232).
[0056] Referring to FIGS. 3A and 3B , examples are shown in which the flexible display (153) of the electronic device (101) includes one folding display area (e.g., the third display area (233)) or the electronic device (101) includes one folding housing part (e.g., the folding housing part (265)), but this is for convenience of explanation. According to embodiments, the flexible display (153) of the electronic device (101) may include a plurality of folding display areas. For example, the flexible display (153) of the electronic device (101) may include two or more folding display areas, and the electronic device (101) may include two or more folding housing parts for providing the two or more folding areas, respectively.
[0057] An electronic device (101) according to one embodiment can display multiple visual objects in an overlapping manner on a cover display when in a folded state. An operation of identifying a designated input for changing the order of multiple visual objects displayed by the electronic device (101) in a folded state will be described in more detail below with reference to FIGS. 7A to 7C .
[0058] Hereinafter, with reference to FIGS. 3a and 3b, an exemplary description of an acceleration sensor for identifying the posture of an electronic device (101) will be described.
[0059] FIGS. 3A and 3B illustrate examples of locations of a plurality of acceleration sensors within an electronic device according to one embodiment. The electronic device (101) of FIG. 3A and the electronic device (101) of FIG. 3B may be examples of the electronic device (101) of FIG. 1. Referring to FIGS. 3A and 3B, examples of electronic devices distinguished by the shape and / or structure of a housing part are illustrated. The electronic devices of FIGS. 3A and 3B may be terminals owned by different users. For example, the electronic device (101) may include a housing part (e.g., a first housing part (210) of FIG. 2A, a second housing part (220) of FIG. 2A, and a folding housing part (265) of FIG. 2A) that is deformable based on at least one folding axis. Acceleration sensors (360, 361, 370, 371) may be included in the sensor (160) of FIG. 1. First housing parts (320, 321) may be referenced to the first housing part (210) of FIG. 2A. Second housing parts (330, 331) may be referenced to the second housing part (220) of FIG. 2A. Folding housing parts (340, 341) may be referenced to the folding housing part (265) of FIG. 2B. Folding axes (310, 311) may be referenced to the folding axes (237) of FIG. 2A. Flexible displays (350, 351) may be referenced to the flexible display (153) of FIG. 1.
[0060] Referring to FIG. 3A, a deformable housing of an electronic device (101) according to one embodiment may be distinguished by a folding housing part (340) including a folding axis (310), and a first housing part (320) and a second housing part (330) connected to the folding housing part (340). A flexible display (350) of the electronic device (101) according to one embodiment may be an example of a display disposed across the first housing part (320) and the second housing part (330).
[0061] According to one embodiment, the electronic device (101) may include acceleration sensors (360, 370) disposed in each of the first housing part (320) and the second housing part (330). The acceleration sensors (360, 370) may be included in the electronic device (101) to measure the shape and / or attitude of the electronic device (101). Each of the acceleration sensors (360, 370) may be included in a six-axis motion sensor including an acceleration sensor based on three axes of the +x axis, the +y axis, and the +z axis of FIG. 3A, and a gyro sensor based on the three axes. The acceleration sensors (360, 370) may identify an acceleration applied to each of the three axes. The acceleration may be a vector based on a direction and / or magnitude of a net force applied to the electronic device (101). For example, the acceleration may be a vector representing the amount of change in the velocity of the electronic device (101) due to the net force. The net force applied to the electronic device (101) may include a combination of gravity or another force distinct from the gravity (e.g., a force applied to the electronic device (101) by a user holding the electronic device (101). According to one embodiment, the acceleration sensors (360, 370) of the electronic device (101) may identify the rotation of the acceleration sensor based on the one or more axes. According to one embodiment, the electronic device (101) may identify the movement of the electronic device (101) based on the acceleration and / or the rotation identified by each of the acceleration sensors (360, 370).
[0062] According to one embodiment, the electronic device (101) can identify an angle (355) between the first housing part (320) and the second housing part (330) using acceleration sensors (360, 370). Based on the angle (355), the electronic device (101) can identify a state of the electronic device (101) (e.g., a folded state, an unfolded state, or a sub-unfolded state). For example, in a state where the second housing part (330) is fixed, the electronic device (101) can obtain values of three axes, namely, the +x axis, the +y axis, and the +z axis of FIG. 3A, using the acceleration sensor (360) included in the first housing part (330). The shape of the device (101) according to one embodiment is not limited to the embodiment of FIG. 3A, in which the folding axis (310) is formed parallel to the length of the flexible display (350), or a length shorter than the width.
[0063] Referring to FIG. 3B, an example of an electronic device (101) is illustrated, which includes a flexible display (351) having a width and a length longer than the width, and a folding axis (311) formed parallel to the width. A deformable housing part of the electronic device (101) may include a folding housing part (341) including the folding axis (311), and a first housing part (321) and a second housing part (331) distinguished by the folding axis (311). The electronic device (101) may include acceleration sensors (361, 371) arranged in each of the first housing part (321) and the second housing part (331). The electronic device (101) can obtain an angle (356) between the first housing part (321), the second housing part (331), and the folding axis (311) using acceleration sensors (361, 371). Based on the angle (356), the electronic device (101) can identify the state of the electronic device (101).
[0064] In one embodiment, acceleration sensors (361, 371) included in the electronic device (101) may be arranged on printed circuit boards (PCBs) included in each of the first housing part (321) and the second housing part (331). Among the PCBs, a PCB on which a processor (e.g., the processor (120) of FIG. 1) is arranged may be referred to as a main board. Among the PCBs, another PCB different from one PCB that is a main board may be referred to as a sub board. Among the acceleration sensors (361, 371), one acceleration sensor arranged on the main board may be referred to as a main acceleration sensor (e.g., a main 6-axis acceleration sensor), and the other acceleration sensor may be referred to as a sub acceleration sensor (e.g., a sub 6-axis acceleration sensor).
[0065] As described above, according to one embodiment, the electronic device (101) may include a plurality of acceleration sensors for identifying the shape and / or posture of the deformable housing part. Accelerations measured by the acceleration sensors (360, 361, 370, 371) disposed in the deformable housing parts (320, 321, 330, 331, 340, 341) of the electronic device (101) according to one embodiment may be different from each other. For example, depending on the shape of the electronic device (101), the parts where the acceleration sensors are disposed may move or rotate differently, and thus the accelerations measured by the acceleration sensors may be different. Based on the measured acceleration, the electronic device (101) may identify the posture of the electronic device (101) based on the direction of the gravitational acceleration obtained using the measured acceleration. For example, the electronic device (101) may identify a change to a folded state while executing a software application in an unfolded state. The electronic device (101) may display a visual object indicating the execution of the software application in the folded state on the cover display (e.g., the cover display (155) of FIG. 1).
[0066] FIG. 4 illustrates an example of a flowchart illustrating the operation of an electronic device according to one embodiment. The electronic device of FIG. 4 may include the electronic device (101) of FIGS. 1 to 3B. At least one of the operations of FIG. 4 may be performed by the electronic device (101) of FIG. 1. At least one of the operations of FIG. 4 may be controlled by the processor (120) of FIG. 1. Each of the operations of FIG. 4 may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each of the operations may be changed, and at least two operations may be performed in parallel.
[0067] FIG. 5 illustrates an example of an operation of an electronic device according to one embodiment of the present invention to display a visual object indicating the execution of a software application on a cover display based on specified settings. The electronic device (101) of FIG. 5 may include the electronic device (101) of FIGS. 1 to 4 .
[0068] Referring to FIG. 4, in operation 410, an electronic device according to one embodiment may initiate execution of a software application in an unfolded state. The software application may include the first software application (135) of FIG. 1.
[0069] Referring to FIG. 5, an electronic device (101) according to one embodiment may display an execution screen (501) of a software application (e.g., the software application of FIG. 1) on a flexible display (153) in a state (500). The state (500) may be included in the state (200) of FIG. 2A. For example, the electronic device (101) may identify an input for a visual object (502) (e.g., audio recording) indicating execution of at least one function of the software application. In response to the input for the visual object (502), the electronic device (101) may perform at least one function (e.g., recording). While performing the at least one function, the electronic device (101) may identify a change from an unfolded state (e.g., state (200) of FIG. 2A) to a folded state (e.g., state (203) of FIG. 2B). The electronic device (101) may display a wallpaper screen (506) on the cover display (155) based on identifying the change. The wallpaper screen (506) may be provided by the widget managing application (133) of FIG. 1. The wallpaper screen (506) may refer to a cover screen (or main screen) that the electronic device (101) sets as a default value for displaying at least one screen on the cover display (155). For example, the electronic device (101) may display the wallpaper screen (506) on the cover display (155) after obtaining at least one input for the cover display (155) based on identifying the change.
[0070] Referring to FIG. 4, in operation 420, an electronic device according to one embodiment may identify whether a software application is linked with a widget managing application for managing widgets to be displayed on a cover display based on identifying a change from an unfolded state to a folded state.
[0071] Referring to FIG. 5, for example, the electronic device (101) can identify whether a software application (e.g., the first software application (135) of FIG. 1) and a widget managing application (e.g., the widget managing application (133) of FIG. 1) are linked based on identifying a change from an unfolded state to a folded state while executing at least one function of the software application. The electronic device (101) can identify whether the software application (e.g., the first software application (135) of FIG. 1) and the widget managing application (e.g., the widget managing application (133) of FIG. 1) are linked using a screen (530). The screen (530) can indicate whether widgets of a plurality of software applications provided by the widget managing application are running. For example, the screen (530) can include a text object (e.g., a text object (531)) representing a plurality of software applications. The screen (530) may include a visual object (532) for setting whether widgets of multiple software applications can be executed via the cover display. The electronic device (101) may use the visual object (532) in the form of a toggle to identify whether widgets are executable via the widget management application. The electronic device may use the visual object (532) to identify whether the widget management application and the software application are linked.
[0072] For example, the electronic device (101) can identify that the widget is executable through the widget management application when the visual object (532) is in the active position. For example, the electronic device (101) can identify that the execution of the widget is at least temporarily restricted through the widget management application when the visual object (532) is in the inactive position. However, this is not limited thereto.
[0073] Referring to FIG. 4, when the widget managing application and the software application are linked (operation 420 - Yes), in operation 430, the electronic device according to one embodiment may display a visual object indicating execution of the software application in an area corresponding to one of the corners of the cover display.
[0074] Referring to FIG. 5, an electronic device (101) according to one embodiment may enter a state (505) from a state (500) based on whether a widget of a software application (e.g., the first widget (135-1) of FIG. 1) can be executed using a widget managing application. For example, the electronic device (101) may display a visual object (507) indicating execution of a software application in an area (510) corresponding to one corner (522-2) among the corners of the cover display (155). The shape of the visual object (507) is illustrated based on a capsule shape, but is not limited thereto. For example, the shape of the visual object (507) may have a polygonal shape such as a circle, a triangle, and a square, or a closed curve shape. The visual object (507) may be referred to as a visual element, a user interface (UI) element, and / or a view object, a capsule UI.
[0075] A description of an area (510) corresponding to one corner (522-2) of the corners of the cover display (155) will be described later with reference to the state (520).
[0076] For example, the electronic device (101) may place a navigation area (508-1) adjacent to an area (510) of the cover display (155). The navigation area (508-1) may include an area for identifying a designated gesture. The navigation area (508-1) may be visually displayed, as illustrated in FIG. 5 . In some embodiments, the electronic device (101) may temporarily refrain from displaying the navigation area (508-1) by adjusting an alpha value (e.g., a parameter for adjusting transparency) of the navigation area (508-1). An operation of the electronic device (101) for identifying the designated gesture is described below with reference to FIG. 6 .
[0077] Referring to FIG. 4, when the widget managing application and the software application are not linked (operation 420 - No), in operation 440, an electronic device according to an embodiment may display a screen for linking the widget managing application and the software application on the cover display. For example, the electronic device may register a widget of the software application to the widget managing application using the screen (530). However, the present invention is not limited thereto. For example, the electronic device may register a widget of the software application to the widget managing application independently of displaying the screen.
[0078] Referring to FIG. 5, an electronic device (101) according to one embodiment may enter a state (505) from a state (500) based on identifying that execution of a widget of a software application (e.g., the first widget (135-1) of FIG. 1) is at least temporarily restricted using a widget managing application. For example, the electronic device (101) may temporarily refrain from displaying a visual object (507) indicating execution of the software application in an area (510). For example, based on temporarily refraining from displaying the visual object (507), the electronic device (101) may display a screen (not shown) on the cover display (155) indicating whether to execute a widget of the software application corresponding to the visual object (507) through the cover display (155). The screen may include at least a portion of the screen (530). For example, when the execution of a widget of a software application is temporarily suspended (or stopped) through the cover display, the electronic device (101) may display a screen for registering the widget on the cover display (155). For example, when the widget of the software application is not registered using a widget management application, the electronic device (101) may display a screen for registering the widget on the cover display (155). Through the registration of the widget, the electronic device (101) may display a visual object indicating the execution of the software application on the cover display (155).
[0079] For example, the screen may include a list of all software applications installed in the electronic device (101). For example, the screen may include a pop-up screen for indicating whether to display a software application registered as a widget through the cover display (155). The electronic device may determine, through the pop-up screen, whether to display a software application registered as a widget on the cover display (155).
[0080] According to one embodiment, the region (510) may be formed based on the shape of the cover display (155). For example, the electronic device (101) may include the cover display (155) positioned on one side (540) (e.g., the second side (212) of FIG. 2B) of a first housing part (e.g., the first housing part (210) of FIG. 2A). At least some of the edges of the one side may match at least some of the edges (521-1, 521-2, 521-3, 521-4) of the cover display (155). For example, the cover display (155) may include a first edge (521-1), a third edge (521-3) parallel separated from the first edge (521-1), a second edge (521-2) extending from one end of the first edge (521-1) to one end of the third edge (521-3), and a fourth edge (521-4) extending from the other end of the first edge (521-1) to the other end of the third edge (521-3). For example, the first edge (521-1), the second edge (521-2), and / or the fourth edge (521-4) of the cover display (155) may match at least one of the edges of the one surface (e.g., the second surface (212) of FIG. 2B). For example, since the camera is arranged within a partial area (550) of one side (540) of the first housing part (e.g., the first housing part (210) of FIG. 2A), at least a portion of the third edge (521-3) of the cover display (155) may have a curved shape. For example, the third edge (521-3) of the cover display (155) may be formed based on a curved shape by the partial area (550) where the camera is arranged. From the perspective of including the third edge (521-3) formed based on the curved shape, the cover display (155) may be referred to as an L-cut display. However, the present invention is not limited thereto.The number of cameras (e.g., 2) placed within the area (550) is not limited to that shown in FIG. 5.
[0081] For example, at least some of the corners of one side (540) of the first housing part (e.g., the first housing part (210) of FIG. 2A) of the electronic device (101) may match at least some of the corners (522-1, 522-2, 522-3, 522-4) of the cover display (155). The first corner (522-1) may be formed by the first edge (521-1) and the second edge (521-2). The second edge (522-2) may be formed by the second edge (521-2) and the third edge (521-3). The third edge (522-3) may be defined by the third edge (521-3) and the fourth edge (521-4). The fourth edge (522-4) may be defined by the fourth edge (521-4) and the first edge (521-1). For example, the region (510) may refer to a region corresponding to the second edge (522-2) among the edges (522-1, 522-2, 522-3, 522-4) of the cover display (155). The region (510) may be formed adjacent to at least a portion of the third edge (521-3) based on a curved shape. The region (510) may be referred to as an L-cut region in that it is defined adjacent to at least a portion of the third edge (521-3) based on a curved shape.
[0082] For example, the region (510) may include a region (550) in which a camera is positioned. The region (550) in which the camera is positioned may be defined adjacent to at least a portion of the third edge (521-3) based on a curved shape and a different portion. The region (550) may be referred to as a notch region. In some embodiments, the camera positioned in the region (550) may be located within the cover display (155).
[0083] In one embodiment, the electronic device (101) may, in response to an input for acquiring a screen (506) displayed on the cover display (155), acquire another screen having a different shape (e.g., a square) from the shape of the cover display (155). For example, the electronic device (101) may acquire the other screen including a portion covered by the screen (506) due to a third edge (521-3) based on a curved shape. The covered portion may correspond to an area (550). From a perspective in which the other screen includes the covered portion, the area (510) may include the area (550). For example, from a perspective in which another screen having a square shape is obtainable, the area (510) may include at least a portion of the area (550).
[0084] The electronic device (101) can determine a location (e.g., an area (510)) on which a visual object (507) is to be displayed on the cover display (155) based on the shape of the cover display (155) formed by placing a camera on one side (540). The area (510) can be referred to as an L-cut area, a corner area, a partial area, or an edge area in terms of an area corresponding to a corner. For example, the screen (506) can include an icon (555) related to a camera. The electronic device (101) can display the icon (555) adjacent to a third corner (522-3) adjacent to the camera among the corners (522-1, 522-2, 522-3, 522-4).
[0085] As described above, the electronic device (101) according to one embodiment can notify the user of the execution status of a software application executed in an unfolded state in the form of a visual object (507) in a folded state. The electronic device (101) can identify whether the widget of the software application is executable through the cover display (155) based on identifying a change from the unfolded state to the folded state. If the widget is executable through the cover display (155), the electronic device (101) can display the visual object (507) in the area (510). If the execution of the widget is restricted through the cover display (155), the electronic device (101) can display a screen for registering the widget on the cover display (155). The electronic device (101) can determine whether to display the visual object (507) indicating the execution of the software application corresponding to the widget on the cover display (155) depending on whether the widget is registered. The electronic device (101) can visually display the continuity of execution of a software application by displaying information of the software application running in an unfolded state in the form of a visual object in a folded state.
[0086] FIG. 6 illustrates an example of a visual object indicating the execution of a software application displayed on a cover display according to one embodiment. The electronic device (101) of FIG. 6 may include the electronic device (101) of FIGS. 1 to 5.
[0087] According to one embodiment, the electronic device (101) can display a first widget screen (601) on the cover display (155) in a state (600). The first widget screen (601) can be provided from the first widget (135-1) of the first software application (135) of FIG. 1. For example, the electronic device (101) can display the first widget screen (601) on the cover display (155) by linking the first software application (135) and the widget managing application (133) of FIG. 1. Linking the first software application (135) and the widget managing application (133) of FIG. 1 can include enabling the execution of the first widget (135-1) of the first software application (135) using the widget managing application. Hereinafter, the widget screen displayed on the cover display (155) may be provided from a widget registered (or set) to be executable through the cover display (155). The electronic device (101) may identify the registration of the widget using the screen (530) of FIG. 5, but is not limited thereto.
[0088] For example, the electronic device (101) may obtain an input for a visual object (602) to initiate execution of a widget (e.g., the first widget (135-1) of FIG. 1) that provides the first widget screen (601) using the first widget screen (601). Initiating execution of the widget may include initiating execution of at least one function of the widget. Initiating execution of at least one function of the widget may include initiating execution of at least one function of a software application of the widget. For example, the electronic device (101) may enter a state (610) in response to the input.
[0089] An electronic device (101) according to one embodiment may identify an input performed along a first direction (612) while executing at least one function of a widget providing a first widget screen (601) in a state (610). The electronic device (101) may identify the input using a navigation area (611) formed in at least a portion of a third edge (521-3) of FIG. 5. The electronic device (101) may identify the input that is released after moving from a point of the navigation area (611) along the first direction (612). The input may include an input indicating moving to a wallpaper screen (506). The input may be referred to as a swipe input. In response to the input, the electronic device (101) may enter a state (620).
[0090] For example, the electronic device (101) may display an icon (e.g., icon (915) of FIG. 9) for moving from the first widget screen (601) to the wallpaper screen (506) within the area (510). The electronic device (101) may enter a state (620) in response to an input for the icon. A more detailed description of the icon will be described later with reference to FIG. 9.
[0091] According to one embodiment, the electronic device (101) can display a wallpaper screen (506) on the cover display (155) in a state (620). The electronic device (101) can display a visual object (621) indicating execution of a widget that provides a first widget screen (601) within an area (510). The electronic device (101) can display the visual object (621) within the area (510) of the cover display (155) by overlapping the wallpaper screen (506). For example, the electronic device (101) can display the visual object (621) together with a visual object (625) indicating time (e.g., current time) provided from the widget managing application (133) of FIG. 1.
[0092] As described above, the electronic device (101) according to one embodiment may display a visual object (621) indicating that at least one widget is running in the background state on the cover display (155) while displaying the wallpaper screen (506). The electronic device (101) may use the visual object (621) to guide the user with information about the widget (or software application corresponding to the widget) running in the background state.
[0093] Referring to FIGS. 7A to 7C below, an example of an operation of an electronic device (101) according to one embodiment of the present invention to display at least one of visual objects indicating the execution of a plurality of software applications is described below.
[0094] FIGS. 7A to 7C illustrate an example of an operation for an electronic device according to an embodiment to display at least one of visual objects corresponding to a plurality of software applications. The electronic device (101) of FIGS. 7A to 7C may include the electronic device (101) of FIGS. 1 to 6 . The state (620) may be referenced to the state (620) of FIG. 6 .
[0095] Referring to FIG. 7A, an electronic device (101) according to one embodiment may display a visual object (621) representing a first widget (e.g., the first widget (135-1) of FIG. 1) executed using a first widget screen (e.g., the first widget screen (601) of FIG. 6) in a state (620) within an area (510). For example, the electronic device (101) may identify a swipe input performed along a second direction (630). Based on identifying the swipe input, the electronic device (101) may display a second widget screen (701). The second widget screen (701) may be provided from a software application (e.g., the second software application (137) of FIG. 1) different from a software application (e.g., the first software application (135) of FIG. 1) that provides the first widget screen (601) of FIG. 6.
[0096] For example, the electronic device (101) may, at least temporarily, refrain from displaying a visual object (621) indicating execution of a first widget (e.g., the first widget (135-1) of FIG. 1) corresponding to the first widget screen (601) of FIG. 6 based on displaying the second widget screen (701) on the cover display (155). For example, since the second widget screen (701) is provided by a different software application (e.g., the software application (135) of FIG. 1) that is distinct from the software application corresponding to the first widget (e.g., the software application (135) of FIG. 1), the electronic device (101) may, at least temporarily, refrain from displaying the visual object (621) while displaying the second widget screen (701). However, the present invention is not limited thereto.
[0097] For example, the electronic device (101) may identify an input to a visual object (702) for executing at least one function of a second widget (e.g., the second widget (137-1) of FIG. 1) that provides the second widget screen (701) by using the second widget screen (701). As an example, the electronic device (101) may play music in response to the input.
[0098] For example, the electronic device (101) may identify a swipe input performed along a first direction (612) from at least one point in the navigation area (611) while executing at least one function. The swipe input may include an input for moving to a home screen (e.g., a wallpaper screen (506)). The electronic device (101) may enter a state (705) in response to the swipe input.
[0099] In a state (705) according to one embodiment, in response to the swipe input, a visual object (706) may be displayed overlapping at least a portion of the wallpaper screen (506). For example, the electronic device (101) may display a visual object (706) indicating execution of a second widget (e.g., the second widget (137-1) of FIG. 1) corresponding to the second widget screen (701) within the area (510).
[0100] For example, the electronic device (101) may temporarily suspend display of the visual object (621) displayed in the state (620) and display the visual object (706). For example, the electronic device (101) may display the visual object (706) together with a visual object indicating time included in the wallpaper screen (506) (e.g., the visual object (625) of FIG. 6). The electronic device (101) may temporarily suspend display of the visual object (621) and display the visual object (706) based on a specified condition.
[0101] For example, a specified condition may display a visual object (706) based on the execution of a second software application (e.g., the second software application (137) of FIG. 1) providing a second widget screen (701) after the execution of a first software application (e.g., the first software application (135) of FIG. 1) providing a first widget screen (601) of FIG. 6. The electronic device (101) may display a visual object (706) corresponding to the last executed software application on the cover display (155) based on the execution order.
[0102] For example, the electronic device (101) may display a visual object (706) overlapping at least a portion of a visual object (621). At least a portion of the visual object (621) may be obscured by the visual object (706), but is not limited thereto.
[0103] For example, while the electronic device (101) displays the visual object (706), the electronic device (101) may maintain the execution of a second widget corresponding to the visual object (706) (e.g., the second widget (137-1) of FIG. 1) and a first widget corresponding to the visual object (621) (e.g., the first widget (135-1) of FIG. 1) in the background. For example, while the electronic device (101) displays the visual object (706) by overlaying it on the visual object (621), the electronic device (101) may maintain the execution of the function of the second widget corresponding to the visual object (706) and the execution of the function of the first widget corresponding to the visual object (621). However, the present invention is not limited thereto. For example, the electronic device (101) may at least temporarily suspend the execution of the first widget corresponding to the visual object (621) by displaying the visual object (706) by overlaying it on the visual object (621).
[0104] For example, a background state may include a state in which the execution screen of a software application is not displayed on the display. In the background state, the operation of the electronic device (101) to maintain the execution of the first widget may include an operation of processing resources or tasks required for the execution of the first widget.
[0105] Referring to FIG. 7B, an electronic device (101) according to one embodiment may display a second widget screen (701) in a state (710). For example, in a state (705) of FIG. 7A, the electronic device (101) may display a second widget screen (701) on the cover display (155) in response to a swipe input having a second direction (630). For example, in response to an input for a visual object (706) of FIG. 7A, the electronic device (101) may enter a state (710).
[0106] For example, the electronic device (101) may identify an input for temporarily suspending the execution of a software application (e.g., the second software application (137) of FIG. 1) providing the second widget screen by using the second widget screen (701). The electronic device (101) may identify an input for a visual object (711) indicating that the execution is to be temporarily suspended. The electronic device (101) may identify an input for a visual object (711) indicating that the execution of a function (e.g., music playback) provided by the software application is to be at least temporarily suspended. In response to the input, the electronic device (101) may at least temporarily suspend the execution of the function. For example, after identifying the input, the electronic device (101) may identify a designated gesture having a first direction (612) by using the navigation area (611). The designated gesture may include a swipe input having a first direction (612). For example, the electronic device (101) may enter state (715) in response to the identification of a designated gesture, but is not limited thereto. In one embodiment, the electronic device (101) may identify a swipe input having a third direction (713) in state (710). The electronic device (101) may enter state (715) in response to the swipe input.
[0107] In one embodiment, the electronic device (101) may, in state (715), temporarily suspend the display of the visual object (706) and display the visual object (621) within the area (510). For example, the visual object (621) may be displayed within the area (510) because the display of the visual object (706) that covers at least a portion of the visual object (621) has been temporarily suspended. The electronic device (101) may indicate that the execution of a widget (e.g., the first widget (135-1) of FIG. 1) corresponding to the visual object (621) is maintained based on the display of the visual object (621).
[0108] For example, the electronic device (101) may display a visual object (621) on at least a portion of the visual object (706). If the execution of a second widget corresponding to the visual object (706) is temporarily suspended for a specified period of time, the electronic device (101) may refrain from displaying the visual object (706) independently of the visual object (621) after a specified period of time, but is not limited thereto.
[0109] Referring to FIG. 7C, an electronic device (101) according to one embodiment may display a visual object (721) indicating execution of a software application related to a call on a cover display (155) by overlaying the wallpaper screen (506). While displaying the visual object (721), the electronic device (101) may identify a swipe input along a second direction (630). In response to the swipe input, the electronic device (101) may enter a state (700). The visual object (721) may include a visual object indicating an outgoing call or an incoming call.
[0110] For example, in state (700), the electronic device (101) may temporarily stop displaying the visual object (721) and display the second widget screen (701). However, this is not limited thereto. The electronic device (101) may display the second widget screen (701) along with displaying the visual object (721).
[0111] For example, in response to an input to a visual object (702), the electronic device (101) may initiate execution of a second widget (e.g., the second widget (137-1) of FIG. 1) corresponding to the second widget screen (701). For example, in response to an input to a visual object (702), the electronic device (101) may initiate execution of a function of the second widget corresponding to the second widget screen (701).
[0112] For example, the electronic device (101) may identify a designated gesture (or swipe input) along a first direction (612) using the navigation area (611) while executing a function of the second widget. Based on the identification of the designated gesture, the electronic device (101) may display a wallpaper screen (506). In response to the identification of the designated gesture, the electronic device (101) may enter a state (725).
[0113] For example, the electronic device (101) can maintain the display of the visual object (721) in the state (725). After the execution of the software application related to the call, by executing the software application corresponding to the second widget screen (701) (e.g., the second software application (137) of FIG. 1), the electronic device (101) can identify the execution order of the software applications executed by the processor. The electronic device (101) can maintain the display of the visual object (721) independently of the execution order. For example, an operation of displaying a visual object (721) indicating the execution of a software application related to the call can be set to be prioritized over an operation of displaying at least one visual object based on the execution order. The electronic device (101) can maintain the display of the visual object (721) based on a priority between the action of displaying a visual object (721) representing the execution of a software application related to a call and the action of displaying at least one visual object based on the execution order.
[0114] For example, the electronic device (101) may place a layer corresponding to the visual object (706) between the layer corresponding to the visual object (721) and the layer corresponding to the wallpaper screen (506). By placing the layer corresponding to the visual object (706), the electronic device (101) may display the visual object (721) by overlapping at least a portion of the visual object (706). For example, when at least one function of a software application related to a call (e.g., an outgoing call) is terminated, the electronic device (101) may refrain from displaying the visual object (721) and display the visual object (706).
[0115] As described above, the electronic device (101) according to one embodiment may determine the order of visual objects to be displayed in the region (510) based on the order in which the widgets of a plurality of software applications are executed. The electronic device (101) may prioritize a second condition for displaying a visual object (721) indicating the execution of at least one software application (e.g., a software application related to a call) among the plurality of software applications over a first condition for displaying at least one visual object based on the order. The electronic device (101) may guide information about a software application running in the background based on displaying at least one visual object in the region (510).
[0116] FIG. 8 illustrates an example of an operation for temporarily suspending execution of a widget in response to a specified input for a visual object by an electronic device according to one embodiment. The electronic device (101) of FIG. 8 may include the electronic device (101) of FIGS. 1 to 7C. State (800) may be included in state (705) of FIG. 7A.
[0117] Referring to FIG. 8, an electronic device (101) according to one embodiment may display a visual object (706) overlapping at least a portion of a visual object (621) within an area (510) in a state (800).
[0118] For example, the electronic device (101) may identify an input for the visual object (706) while displaying the visual object (706) by overlaying it on the visual object (621). The input may include an input for terminating the execution (or function) of a second widget (e.g., the second widget (137-1) of FIG. 1) corresponding to the visual object (706). The electronic device (101) may identify a swipe input based on a second direction (801). For example, the electronic device (101) may change the shape of the visual object (706) according to the swipe input. The electronic device (101) may change the position of the visual object (706) within the area (510) according to the swipe input.
[0119] For example, the electronic device (101) may reduce the size of the visual object (706) based on a swipe input having a second direction (801). For example, the electronic device (101) may display a visual object (621) overlapping at least a portion of the visual object (706) within the area (510) based on reducing the size of the visual object (706) based on a swipe input having a second direction (801). The electronic device (101) may terminate the execution of a second widget (e.g., the second widget (137-1) of FIG. 1) corresponding to the visual object (706) running in the background based on identifying a visual object (706) having a size smaller than a specified size.
[0120] For example, the electronic device (101) can change the position of the visual object (706) according to a swipe input having a second direction (801). The electronic device (101) can move the visual object (706) based on the swipe input. The electronic device (101) can terminate the execution of a second widget (e.g., the second widget (137-1) of FIG. 1) corresponding to the visual object (706) running in the background based on the visual object (706) moving to a designated position.
[0121] For example, the electronic device (101) may temporarily refrain from displaying the visual object (706) based on terminating the execution of the second widget corresponding to the visual object (706). The electronic device (101) may display the visual object (621) within the area (510) in the state (810) based on temporarily refraining from displaying the visual object (706). In one embodiment, the electronic device (101) may maintain the execution of the widget (e.g., the first widget (135-1) of FIG. 1) corresponding to the visual object (621) in the background state in the state (810).
[0122] Although not shown, an electronic device (101) according to one embodiment can change the order of visual objects (621, 706) in a state (800). In response to the swipe input, the electronic device (101) can change the order of visual objects (621, 706) while maintaining execution of widgets (e.g., the first widget (135-1) of FIG. 1 and the second widget (137-1) of FIG. 1) corresponding to each of the visual objects (621, 706).
[0123] For example, the electronic device (101) may identify a swipe input along the second direction (801) while displaying a visual object (706) overlaid on a visual object (621). In response to the swipe input, the electronic device (101) may temporarily refrain from displaying the visual object (706) and display the visual object (621) within the area (510). In response to the swipe input, the electronic device (101) may display the visual object (621) within the area (510) by overlapping at least a portion of the visual object (706). However, the present invention is not limited to the above-described embodiments.
[0124] As described above, the electronic device (101) according to one embodiment can control the execution of the software applications by using the visual objects while displaying the visual objects (621, 706) representing the execution of a plurality of software applications within the area (510) of the cover display (155). The electronic device (101) can control the execution of the software applications by using the visual objects (621, 706) displayed together with the wallpaper screen (506) without displaying the widget screen (e.g., the first widget screen (601) or the second widget screen (701)) provided by the software applications on the cover display (155).
[0125] FIG. 9 illustrates an example of a visual object displayed on a cover display according to one embodiment. The electronic device (101) of FIG. 9 may include the electronic device (101) of FIGS. 1 to 8 . The state (900) may be included in the state (700) of FIG. 7A .
[0126] Referring to FIG. 9, in a state (900), an electronic device (101) according to one embodiment may display a second widget screen (701) on a cover display (155). While displaying the second widget screen (701), the electronic device (101) may also display an icon (915) for moving to a wallpaper screen (506). The icon (915) may visually represent a navigation area (611). The icon (915) may be referred to as a visual object, a home button, a navigation button, a back button, a home icon, or a navigation icon for moving to the wallpaper screen (506).
[0127] For example, the electronic device (101) may enter a state (900) in response to a swipe input along a second direction (630) while displaying a visual object (621) within an area (510) together with a wallpaper screen (506) in a state (620) of FIG. 7A. The electronic device (101) may temporarily stop displaying the visual object (621) and display an icon (915) within the area (510). However, the present invention is not limited thereto. The electronic device (101) may enter a state (705) in response to an input for the icon (915). The state (705) may be referred to as the state (705) of FIG. 7A.
[0128] FIGS. 10A and 10B illustrate an example of an operation for displaying at least one of visual objects corresponding to a plurality of software applications according to one embodiment. The electronic device (101) of FIGS. 10A and 10B may include the electronic device (101) of FIGS. 1 to 9 . The state (1000) may be included in the state (200) of FIG. 2A .
[0129] Referring to FIG. 10A, in state (1000), an electronic device (101) according to one embodiment can display multiple screens (1001, 1002) on a flexible display (153). The multiple screens (1001, 1002) may each be provided by different software applications. The multiple screens (1001, 1002) displayed by the electronic device (101) on the flexible display (153) may be referred to as a multi-window screen.
[0130] For example, the electronic device (101) may display a first screen (1001) of a first software application (e.g., the first software application (135) of FIG. 1) on a portion of a flexible display (153) positioned on one side of a first housing part (210). The electronic device (101) may display a second screen (1002) of a second software application (e.g., the second software application (137) of FIG. 1) on another portion of a flexible display (153) positioned on one side of a second housing part (220). The first software application and the second software application may include applications configured to interoperate with the widget managing application (133) of FIG. 1. The first widget of the first software application (e.g., the first widget (135-1) of FIG. 1) and the second widget of the second software application (e.g., the second widget (137-1) of FIG. 1) may include widgets registered in the widget managing application.
[0131] For example, while displaying a first screen (1001) and a second screen (1002) on a flexible display (153), the electronic device (101) may indicate the order of the first screen (1001) and the second screen (1002). To indicate the order, the electronic device (101) may display an indicator (1004) corresponding to the first screen (1001) and an indicator (1005) corresponding to the second screen (1002).
[0132] For example, the electronic device (101) can use indicators (1004, 1005) to indicate the execution order of a first software application corresponding to a first screen (1001) and a second software application corresponding to a second screen (1002). For example, the indicator (1005) can indicate the execution of the second software application corresponding to the second screen (1002) in a foreground state. The indicator (1004) can indicate the execution of the first software application corresponding to the first screen (1001) in a background state. The electronic device (101) can identify the execution order of the first software application and the second software application based on indicating, using the indicators (1004, 1005), that the first software application is executed in the background state and the second software application is executed in the foreground state. For example, the electronic device (101) may identify that a second software application is executed after a first software application is executed. Based on the execution order, the electronic device (101) may identify the second software application that was last executed in the foreground before executing the first and second software applications in the background. For example, the state (1000) may include a state in which the second screen (1002) is focused.
[0133] An electronic device (101) according to one embodiment can identify an angle between a first housing part (210) and a second housing part (220) using a sensor (e.g., sensor (160) of FIG. 1) in a state (1000). The electronic device (101) can identify an angle between the first housing part (210) and the second housing part (220) having a designated angle corresponding to a folded state. The electronic device (101) can change from the state (1000) to the state (705) based on identifying the folded state. In an embodiment, the electronic device (101) can display a visual object (510) representing a second software application executed in a foreground state within an area (510) in the state (705). The state (705) can be referenced to the state (705) of FIG. 7A.
[0134] Referring to FIG. 10b, an electronic device (101) according to one embodiment may enter at least one of the states (1010, 1020, 1030, 1040) based on identifying a fold state after a plurality of softwares are executed.
[0135] According to one embodiment, the electronic device (101) may display a wallpaper screen (506) on the cover display (155) in a state (1010). For example, the electronic device (101) may enter the state (1010) from a state in which multiple software applications are executed based on a multi-window (e.g., state (1000) of FIG. 10A). While displaying the wallpaper screen (506), the electronic device (101) may display visual objects (1011, 1012) indicating the execution of a first software application and / or a second software application within the region (510). For example, the electronic device (101) may display the visual objects (1011, 1012) using execution state information that updates the operations of the first software application and the second software application in real time or periodically. The electronic device (101) can arrange visual objects (1011, 1012) based on the execution order of software applications executed by the processor.
[0136] For example, the electronic device (101) may display a size of a visual object (1012) indicating execution of a second software application corresponding to the second screen (1002) of FIG. 10A in focus in a state (1000) larger than a size of a visual object (1011) indicating execution of a first software application.
[0137] According to one embodiment, an electronic device (101) may enter a state (1020) after executing a plurality of software applications. In the state (1020), the electronic device (101) according to one embodiment may display visual objects (1023, 1024, 1025) corresponding to each of the plurality of software applications within an area (510). For example, the electronic device (101) may arrange the visual objects (1023, 1024, 1025) within the area (510) based on a specified order. For example, the electronic device (101) may place a visual object (1024) corresponding to a first software application executed in a foreground state among the plurality of software applications before entering the state (1020) at the topmost position among the visual objects (1024, 1025, 1023). For example, the electronic device (101) can identify the size of each of the visual objects (1023, 1024, 1025). The electronic device (101) can set the size of the visual object (1024) placed at the top to be larger than the sizes of the other visual objects (1023, 1025).
[0138] For example, before entering state (1020), the electronic device (101) may execute a third software application corresponding to the visual object (1023) and a second software application corresponding to the visual object (1025). After executing the second software application, the electronic device (101) may execute a first software application corresponding to the visual object (1024). The electronic device (101) may identify an execution order of the third software application, the second software application, and the first software application. Based on the execution order, the electronic device (101) may display the visual object (1025) within the region (510) by overlapping at least a portion of the visual object (1023). Based on the execution order, the electronic device (101) may display the visual object (1024) by overlapping at least a portion of the visual object (1025).
[0139] An electronic device (101) according to one embodiment may arrange visual objects (1023, 1024, 1025) within an area based on an execution order. For example, the electronic device (101) may display indicators (1027) indicating the order of the visual objects (1023, 1024, 1025). For example, the electronic device (101) may change the order of the visual objects (1023, 1024, 1025) based on a swipe input for the visual objects (1023, 1024, 1025). The number of indicators (1027) may change based on the number of visual objects (1023, 1024, 1025). The electronic device (101) may change the size of each of the visual objects (1023, 1024, 1025) in response to a swipe input. For example, the electronic device (101) may display the size of at least one visual object positioned at the top among the visual objects (1024, 1024, 1025) to be larger than the other visual objects in response to the swipe input. For example, the swipe input may include a swipe input having a third direction (713) of FIG. 7B or a second direction (630) of FIG. 7C.
[0140] According to one embodiment, the electronic device (101) may display visual objects (1035, 1034) having the same size within an area (510) in a state (1030). The size of each of the visual objects (1035, 1034) may be smaller than the size of the visual object (507) of FIG. 5. As an example, the electronic device (101) may display a visual object (1034) corresponding to a software application that was last executed among the visual objects (1035, 1034) within the area (510) adjacent to the camera.
[0141] A state (1040) according to one embodiment may include an electronic device (101) executing a plurality of software applications. For example, in state (1040), the electronic device (101) may display a visual object (1044) corresponding to a first software application that was executed last among the plurality of software applications. The electronic device (101) may display the first software application and other software applications using a visual object (1045). The visual object (1045) may indicate the number of other software applications. The size of the visual object (1045) may be smaller than the size of the visual object (1044). In response to an input to the visual object (1045), the electronic device (101) may enter state (1020). However, the present invention is not limited thereto. For example, the electronic device (101) may identify a priority for each of the plurality of software applications. The electronic device (101) can display a visual object on the display for the first software application with a relatively higher priority among the first software application and the second software application based on the identified priority. The priority can be changed by user input.
[0142] As described above, the electronic device (101) according to one embodiment can execute multiple software applications in an unfolded state based on the multi-window function. The electronic device (101) can display multiple screens (1001, 1002) on the flexible display (153) based on the execution of the multiple software applications. While the electronic device (101) displays multiple screens (1001, 1002) on the flexible display (153), the electronic device (101) can identify a change from the unfolded state to the folded state. In the folded state, the electronic device (101) can display at least one of the visual objects representing the multiple software applications (e.g., the visual object (706)) on the cover display (155) according to the execution order of the multiple software applications.
[0143] FIG. 11 illustrates an example of an operation of an electronic device according to one embodiment of the present invention to display a visual object indicating the execution of a software application on a cover display. Referring to FIG. 11, an electronic device (101) according to one embodiment of the present invention may be included in the electronic device (101) of FIG. 1. For example, a flexible display (153) may be referenced to the flexible display (153) of FIG. 1. A cover display (155) may be referenced to the cover display (155) of FIG. 1.
[0144] Referring to FIG. 11, in state (1100), the electronic device (101) can display a screen (1105) of at least one software application (e.g., the second software application (137) of FIG. 1) on the flexible display (153). The electronic device (101) can initiate execution of a function of the at least one software application using the screen (1105). For example, the electronic device (101) can initiate execution of the function in response to an input to a visual object (1106). While executing the function, the electronic device (101) can identify an angle between the first housing part (1101) and the second housing part (1102) based on the folding axis (1103). The first housing part (1101) can be referred to as the first housing part (210) of FIG. 2A. The second housing part (1102) may be referenced to the second housing part (220) of FIG. 2A. The folding axis (1103) may be referenced to the folding axis (237) of FIG. 2A.
[0145] For example, the electronic device (101) can identify an angle between the first housing part (1101) and the second housing part (1102) included in a designated angle (e.g., 0 degrees) corresponding to a folding state. Based on identifying the angle, the electronic device (101) can enter from state (1100) to state (1100).
[0146] According to one embodiment, an electronic device (101) may display a wallpaper screen (1107) on a cover display (155) in a state (1110). The electronic device (101) may maintain execution of at least one software application corresponding to the screen (1105) in the state (1110). For example, the electronic device (101) may maintain execution of the at least one software application in a background state. The electronic device (101) may display a visual object (1115) indicating the execution within at least one area of the cover display (155). The location of the at least one area of the cover display (155) may vary depending on the embodiment. The electronic device (101) may notify the user of the execution of the at least one software application through the cover display (155) based on displaying the visual object (1115) within the at least one area while displaying the wallpaper screen (1107).
[0147] Although not shown, an electronic device (101) according to one embodiment may include a flexible display that can be inserted or withdrawn into a housing of the electronic device (101). The electronic device (101) may include an actuator for inserting at least a portion of the flexible display into the housing or withdrawing at least a portion of the flexible display out of the housing.
[0148] For example, when the electronic device (101) is in a state where at least a portion of the flexible display is retracted into the housing (e.g., a slide-in state or a contracted state), the size of the flexible display may have a first size. When the electronic device (101) is in a state where at least a portion of the flexible display is pulled out of the housing (e.g., a slide-out state or an expanded state), the size of the flexible display may have a second size. The first size may be smaller than the second size. The electronic device (101) may display a visual object indicating execution of a software application on at least a portion (e.g., a corner region) of the flexible display having the first size.
[0149] FIG. 12 illustrates an example of a flowchart illustrating the operation of an electronic device according to one embodiment. The electronic device of FIG. 12 may include the electronic device (101) of FIGS. 1 to 11. At least one of the operations of FIG. 12 may be performed by the electronic device (101) of FIG. 1. At least one of the operations of FIG. 12 may be controlled by the processor (120) of FIG. 1. Each of the operations of FIG. 12 may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each of the operations may be changed, and at least two operations may be performed in parallel.
[0150] Referring to FIG. 12, in operation 1210, a processor according to an embodiment may display, on a cover display in a folded state, a first visual object representing time, and a second visual object representing a first widget among a plurality of widgets, based on a specified condition.
[0151] For example, the processor may display, in a folded state (e.g., state (800) of FIG. 8), a second visual object (e.g., visual object (706) of FIG. 8) representing a first widget (e.g., second widget (135-2) of FIG. 1) among a plurality of widgets together with a first visual object (e.g., visual object (625) of FIG. 6). The second visual object may represent execution of the first widget. The processor may display, on the cover display, the second visual object representing the first widget among the plurality of widgets based on an execution order of the plurality of widgets.
[0152] Referring to FIG. 12, in operation 1220, a processor according to one embodiment may stop displaying a second visual object on the cover display based on an input for the second visual object, and display a third visual object (e.g., a visual object (621) of FIG. 8) corresponding to the second widget (e.g., the first widget (135-1) of FIG. 1) among a plurality of widgets. For example, the processor may identify a swipe input based on a specified direction (e.g., the second direction (801) of FIG. 8). Based on identifying the swipe input, the processor may refrain from displaying the second visual object. As an example, the processor may terminate execution of a first widget corresponding to the second visual object based on refraining from displaying the second visual object. However, the present invention is not limited thereto.
[0153] For example, the processor may identify a touch input for a second visual object. Based on the identification of the touch input for the second visual object, the processor may display a first widget screen (e.g., the second widget screen (701) of FIG. 7A) corresponding to the second visual object on the cover display. The processor may use the first widget screen to temporarily suspend execution of a function of the first widget. The processor may temporarily suspend display of the second visual object based on the temporary suspension of execution of the function of the first widget.
[0154] For example, the processor may display a second visual object overlaid on a third visual object based on the execution order of a plurality of widgets. For example, the processor may identify the execution of a first widget corresponding to the second visual object after the execution of a second widget corresponding to the third visual object. The processor may display a second visual object corresponding to the first widget that was executed relatively later than the second widget on the third visual object. Since the second visual object is displayed overlaid on the third visual object, the processor may stop displaying the second visual object, thereby displaying the third visual object on the cover display.
[0155] FIG. 13 illustrates an example of an operation of an electronic device displaying a default screen according to one embodiment. The electronic device (101) of FIG. 13 may include the electronic device (101) of FIG. 1 to the electronic device (101) of FIG. 12.
[0156] Referring to FIG. 13, in a state (1300), an electronic device (101) according to an embodiment may display a screen (1301) including a plurality of executable widgets through a cover display (155). In response to an input for at least one widget (1305) among the plurality of widgets included in the screen (1301), the electronic device (101) may execute a software application (e.g., a timer software application) corresponding to the at least one widget (1305). The screen (1301) may be referred to as a map view screen for guiding the plurality of widgets.
[0157] Referring to FIG. 13, an electronic device (101) according to one embodiment may display a screen (1305) on a flexible display (153) based on an unfolded state in a state (1310). The electronic device (101) may indicate that the operation of a software application running in the background is updated in real time or periodically using the screen (1305) provided by the software application. The electronic device (101) may identify a change from the unfolded state to the folded state. For example, the electronic device (101) may deactivate the cover display (155) in the folded state based on identifying the change. However, the present invention is not limited thereto. For example, the electronic device may display at least one screen on the cover display (155) based on identifying the change. For example, the at least one screen may be referred to as a default screen. The default screen may include an always-on display (AOD) screen or a wallpaper screen (or a main screen screen) depending on the embodiment.
[0158] According to one embodiment, the electronic device (101) may display an AOD screen (1325) on the cover display (155) in a state (1320). The AOD screen (1325) may include a visual object indicating the time. The electronic device (101) may display a visual object (1326) indicating the execution of a software application executed in the state (1310) within an area (510) together with the AOD screen (1325). The electronic device (101) may display a dim visual object (1326) together with the AOD screen (1325) based on an alpha value indicating transparency. However, the present invention is not limited thereto. For example, the electronic device (101) may enter the state (1330) based on an input (e.g., a touch input) to the cover display (155). For example, when the electronic device (101) performs an operation to turn on the cover display (155) by a user input or a system input, the electronic device (101) may display a default screen (or wallpaper screen) in a first area of the cover display (155). The first area may include a display area of the cover display (155).
[0159] According to one embodiment, the electronic device (101) may display a wallpaper screen (1335) on the cover display (155) in a state (1330). The electronic device (101) may display a visual object (1336) representing a software application executed in a state (1310). For example, the brightness corresponding to the visual object (1336) may be brighter than the brightness corresponding to the visual object (1326).
[0160] According to one embodiment, the electronic device (101) may display a screen other than the wallpaper screen (1335) based on identifying a gesture specified in the state (1330). For example, the electronic device (101) may display the screen (1301) based on identifying a pinch zoom gesture. For example, the electronic device (101) may display a screen of at least one widget among executable widgets through the cover display (155) in response to a swipe input (e.g., a swipe input having a second direction (630) of FIG. 7C). For example, the electronic device (101) may display the wallpaper screen (1335) or a user interface for editing the executable widgets in response to an input that maintains contact for a specified period of time (e.g., a long press input).
[0161] Fig. 14 illustrates an example of an operation of an electronic device displaying a widget screen according to one embodiment. The electronic device (101) of Fig. 14 may include the electronic device (101) of Figs. 1 to 13.
[0162] Referring to FIG. 14, an electronic device (101) according to one embodiment may display a widget screen (1405) on a cover display (155) in a state (1400). The widget screen (1405) may be provided from a first widget among a plurality of widgets executable through the cover display. For example, the electronic device (101) may display visual objects (1406, 1407) by overlapping at least a portion of the widget screen (1405). For example, the electronic device (101) may display visual objects (1406, 1407) within an area (510).
[0163] For example, visual objects (1407) may include icons (915) of FIG. 9. Visual objects (1407) may include a home button and a back button. The home button may refer to a visual object for moving to a default screen (or wallpaper screen). The back button may refer to a visual object for moving from a first screen to a second screen among a plurality of screens provided from a first widget when the plurality of screens are displayed at least partially overlapping. However, the present invention is not limited thereto. In other words, the back button may be used to change from a first function to a second function among the functions provided from a single widget while the single widget is being executed. The second function may be a function that is executed relatively earlier than the first function.
[0164] For example, the visual object (1406) may represent the execution of a second widget that is different from the first widget that provides the widget screen (1405). For example, the electronic device (101) may display a visual object (1406) that represents execution status information that updates the operation of the second widget in real time or periodically by overlapping it on the widget screen (1405). For example, when the second widget includes a plurality of widgets, the electronic device (101) may display a visual object (1415), such as the status (1410). The visual object (1415) may represent the number of the plurality of widgets.
[0165] Fig. 15 illustrates an example of a widget screen provided from a software application according to one embodiment. The electronic device (101) of Fig. 15 may include the electronic device (101) of Figs. 1 to 14.
[0166] Referring to FIG. 15, an electronic device (101) according to one embodiment may display a screen (1500) on a flexible display (153) based on the execution of at least one software application. The at least one software application may include a third-party application (or an on-going application) provided (or installed) from an external server. A package of the at least one software application may include a plurality of visual objects (or a plurality of user interfaces). For example, the plurality of visual objects may include an icon (1503) for visually representing the at least one software application. For example, when displaying a widget of at least one software application on the flexible display (153), the electronic device (101) may display a visual object (1501). For example, when displaying a widget of at least one software application on the cover display (155), the electronic device (101) may display a visual object (1502).
[0167] An electronic device (101) according to one embodiment as described above can display a plurality of visual objects representing software applications provided from an external server as well as software applications provided from an operating system through a flexible display or a cover display using at least one software package.
[0168] FIG. 16 illustrates an example of a flowchart illustrating the operation of an electronic device according to one embodiment. The electronic device of FIG. 16 may include the electronic device (101) of FIGS. 1 to 15. At least one of the operations of FIG. 16 may be performed by the electronic device (101) of FIG. 1. At least one of the operations of FIG. 16 may be controlled by the processor (120) of FIG. 1. Each of the operations of FIG. 16 may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each of the operations may be changed, and at least two operations may be performed in parallel.
[0169] Referring to FIG. 16, in one embodiment, when a processor performs an operation of turning on the cover display by a user input or a system input in operation 1610, the processor may display a default screen in a first area of the cover display. For example, the electronic device may include a housing including a first housing part (e.g., the first housing part (210) of FIG. 2A) and a second housing part (e.g., the second housing part (220) of FIG. 2A) rotatably coupled to the first housing part. The electronic device may include a flexible display (e.g., the flexible display (153) of FIG. 1) extending from one side of the first housing part (e.g., the first side (211) of FIG. 2A) to one side of the second housing part (e.g., the first side (221) of FIG. 2A). The electronic device may include a cover display (e.g., the cover display (155) of FIG. 1) positioned on another side of the first housing part (e.g., the second side (212) of FIG. 2B). The electronic device may include one or more cameras. For example, a first camera of the one or more cameras may be positioned on the same side as the cover display. A second camera of the one or more cameras may be positioned on the same side as the flexible display.
[0170] For example, since the camera is arranged within the notch area (e.g., partial area (550) of FIG. 5) of the other side of the first housing part (e.g., the first housing part (210) of FIG. 2A), at least a portion of one edge of the cover display (e.g., the third edge (521-3) of FIG. 5) may have a curved shape. The cover display defined along the third edge may be referred to as an L-cut display. For example, the screen displayed through the cover display may be at least partially covered by the camera arranged in the notch area. When the processor displays a screen having a rectangular shape through the cover display, the screen, with at least a portion corresponding to the notch area covered, may be shown to the user of the electronic device. However, the present invention is not limited thereto. For example, when the camera includes an under display camera (UDC) positioned within the cover display, at least a portion of one edge of the cover display may have a straight shape that is distinct from the curved shape. The processor may provide a screen having a rectangular shape to the user when the camera includes a UDC positioned within the cover display.
[0171] For example, the first area of the cover display may include a display area of the cover display. For example, the default screen may include an always-on display (AOD) screen and / or a wallpaper screen (or a main screen screen). For example, the default screen may include a visual object indicating the current time provided from an external server (e.g., the visual object (625) of FIG. 6). The processor may display a default screen including the visual object based on numbers. The processor may display a default screen including the visual object in the form of a clock. However, the present invention is not limited thereto.
[0172] For example, the processor may display the default screen on the cover display in a folded state in which one side of the first housing part and one side of the second housing part face each other. For example, the processor may display a default screen corresponding to the AOD screen in the folded state. The processor may transition from a first state in which the AOD screen is displayed to a second state in which the wallpaper screen is displayed based on identifying at least one input from among a user input and a system input. For example, the processor may transition from the first state to the second state if, in the first state, it identifies a system input indicating the receipt of a notification message provided from one of a plurality of software applications installed in the memory. For example, the processor may transition from the first state to the second state based on a user input including an input to at least one button (e.g., a physical button) included in the electronic device in the first state and / or a touch input on the cover display. For example, the processor may transition from the first state to the second state based on identifying a change from an unfolded state to a folded state, which is distinct from the folded state. However, it is not limited to the above-described embodiments.
[0173] Referring to FIG. 16, in one embodiment, a processor may display, in operation 1620, a visual object representing execution status information that updates the operation of at least one software application running on an electronic device in real time or periodically in a second area, which is a part of the first area, by overlapping the default screen.
[0174] For example, the second region may include an area defined by a curved edge of the cover display (e.g., the third edge (521-3) of FIG. 5). The second region may be referred to as an L-cut region. The processor may display a visual object in the second region and display an icon related to a camera (e.g., the icon (555) of FIG. 5) in a third region that is distinct from the second region. When the second region is positioned adjacent to one edge of the cover display (e.g., the second edge (522-2) of FIG. 5), the third region may be formed adjacent to another edge (e.g., the third edge (522-3) of FIG. 5). As an example, the icon (e.g., the icon (555) of FIG. 5) may represent an icon of a software application related to a camera. As an example, the icon may represent at least one of a plurality of software applications installed in the electronic device (101). The electronic device (101) may display another icon representing at least one of a plurality of software applications installed in the electronic device (101) in the third area.
[0175] For example, the processor may provide a plurality of executable widgets via the cover display in the second state. For example, the processor may display a screen of one of the plurality of widgets based on a swipe input in the second state. For example, the processor may display a screen (e.g., screen (1301) of FIG. 13) including a plurality of widgets based on identifying a pinch zoom gesture in the second state. For example, the processor may display a user interface for editing a plurality of widgets based on identifying a long press input in the second state.
[0176] For example, in response to an input for a visual object, the processor may display a widget screen of at least one software application corresponding to the visual object on the cover display. For example, while displaying the widget screen on the cover display, the processor may at least temporarily refrain from displaying the visual object. For example, while displaying the widget screen, the processor may display a visual object and a navigation button, at least partially overlapping the widget screen. The navigation button may include an icon (915) of FIG. 9 and / or a visual object (1407) of FIG. 14.
[0177] In one embodiment, the visual object may be one or more. For example, the processor may display a plurality of visual objects corresponding to each of a plurality of software applications executed by the processor within a second area of the cover display. The processor may adjust the sizes of the plurality of visual objects. The processor may change the sizes and / or positions of the plurality of visual objects based on execution status information of each of the plurality of software applications. For example, the processor may change the sizes of the plurality of visual objects in response to an input (e.g., a swipe input) for changing the plurality of visual objects. For example, at least one of the plurality of visual objects may indicate the number of the plurality of software applications.
[0178] FIG. 17 illustrates an example of an operation of an electronic device displaying a visual object according to one embodiment. The electronic device (101) of FIG. 17 may include the electronic device (101) of FIGS. 1 to 16.
[0179] Referring to FIG. 17, in a state (1700), an electronic device (101) according to an embodiment may display a visual object (1705) having a first size within a capsule area (1701) within a screen (506). The visual object (1705) may indicate the execution of a widget. The visual object (1705) may indicate the execution of a function provided from the widget. The color of the visual object (1705) may be determined based on the color provided from the widget. However, the present invention is not limited thereto. The capsule area (1701) may be included in at least a portion of the area (510) of FIG. 5.
[0180] For example, the electronic device (101) can gradually increase the size of a visual object (1705) having a first size. For example, the electronic device (101) can obtain a visual object (1706) having a second size based on the gradually increasing size of the visual object (1705). The second size of the visual object (1706) can be larger than the first size of the visual object (1705). For example, the electronic device (101) can gradually change the position of the visual object (1706) to a line (1711). The electronic device (101) can gradually change the position of the visual object (1705) while gradually increasing the first size of the visual object (1705) to the second size of the visual object (1706). For example, the electronic device (101) may change the color of the visual object (1705) independently of changing the size of the visual object (1705) or changing the position of the visual object (1705), but is not limited thereto.
[0181] An electronic device (101) according to one embodiment can express a visual effect for placing a visual object (1706) within a capsule region (1710) in a state (1710). For example, the electronic device (101) can alternately change the position of the visual object (1706) along a first direction (1750-1) or a second direction (1750-2). Based on the alternating change of the position of the visual object (1706) along the first direction (1750-1) or the second direction (1750-2), the electronic device (101) can display a visual effect (or animation effect) of the visual object (1706) shaking.
[0182] For example, after displaying a visual effect (or graphical effect), the electronic device (101) may enter a state (1720). In the state (1720), the electronic device (101) may display a visual object (1706) within the capsule area (1701), but is not limited thereto.
[0183] Although not shown, for example, the electronic device (101) may obtain an input to temporarily refrain from displaying a visual object (1706). In response to the input, the electronic device (101) may reduce the size of the visual object (1706) to the size of the visual object (1705) in Braille. The electronic device (101) may gradually reduce the size of the visual object (1706) while moving the position of the visual object (1706) to match the line (1711). After gradually reducing the size of the visual object (1706), the electronic device (101) may obtain the visual object (1705). The electronic device (101) may display a visual effect of gradually stopping the display of the visual object (1705) while moving the visual object (1705) to a navigation area (e.g., navigation area (508-1) of FIG. 5). However, the present invention is not limited thereto.
[0184] FIG. 18 is a block diagram of an electronic device (1801) within a network environment (1800) according to various embodiments. Referring to FIG. 18, in the network environment (1800), the electronic device (1801) may communicate with the electronic device (1802) via a first network (1898) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (1804) or the server (1808) via a second network (1899) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1801) may communicate with the electronic device (1804) via the server (1808). According to one embodiment, the electronic device (1801) may include a processor (1820), a memory (1830), an input module (1850), an audio output module (1855), a display module (1860), an audio module (1870), a sensor module (1876), an interface (1877), a connection terminal (1878), a haptic module (1879), a camera module (1880), a power management module (1888), a battery (1889), a communication module (1890), a subscriber identification module (1896), or an antenna module (1897). In some embodiments, the electronic device (1801) may omit at least one of these components (e.g., the connection terminal (1878)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1876), camera module (1880), or antenna module (1897)) may be integrated into a single component (e.g., display module (1860)).
[0185] The processor (1820) may control at least one other component (e.g., a hardware or software component) of the electronic device (1801) connected to the processor (1820) by executing, for example, software (e.g., a program (1840)), and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1820) may store commands or data received from other components (e.g., a sensor module (1876) or a communication module (1890)) in a volatile memory (1832), process the commands or data stored in the volatile memory (1832), and store result data in a non-volatile memory (1834). According to one embodiment, the processor (1820) may include a main processor (1821) (e.g., a central processing unit or an application processor) or an auxiliary processor (1823) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1821). For example, when the electronic device (1801) includes the main processor (1821) and the auxiliary processor (1823), the auxiliary processor (1823) may be configured to use less power than the main processor (1821) or to be specialized for a given function. The auxiliary processor (1823) may be implemented separately from the main processor (1821) or as a part thereof.
[0186] The auxiliary processor (1823) may control at least a portion of functions or states associated with at least one component (e.g., the display module (1860), the sensor module (1876), or the communication module (1890)) of the electronic device (1801), for example, on behalf of the main processor (1821) while the main processor (1821) is in an inactive (e.g., sleep) state, or together with the main processor (1821) while the main processor (1821) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1823) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1880) or a communication module (1890)). In one embodiment, the auxiliary processor (1823) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1801) where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1808)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0187] The memory (1830) can store various data used by at least one component (e.g., the processor (1820) or the sensor module (1876)) of the electronic device (1801). The data can include, for example, software (e.g., the program (1840)) and input data or output data for commands related thereto. The memory (1830) can include volatile memory (1832) or non-volatile memory (1834).
[0188] The program (1840) may be stored as software in memory (1830) and may include, for example, an operating system (1842), middleware (1844), or an application (1846).
[0189] The input module (1850) can receive commands or data to be used in a component of the electronic device (1801) (e.g., a processor (1820)) from an external source (e.g., a user) of the electronic device (1801). The input module (1850) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0190] The audio output module (1855) can output audio signals to the outside of the electronic device (1801). The audio output module (1855) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0191] The display module (1860) can visually provide information to an external party (e.g., a user) of the electronic device (1801). The display module (1860) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (1860) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0192] The audio module (1870) can convert sound into an electrical signal, or vice versa. According to one embodiment, the audio module (1870) can acquire sound through the input module (1850), output sound through the sound output module (1855), or an external electronic device (e.g., electronic device (1802)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1801).
[0193] The sensor module (1876) can detect the operating status (e.g., power or temperature) of the electronic device (1801) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1876) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0194] The interface (1877) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1801) with an external electronic device (e.g., the electronic device (1802)). In one embodiment, the interface (1877) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0195] The connection terminal (1878) may include a connector through which the electronic device (1801) may be physically connected to an external electronic device (e.g., the electronic device (1802)). In one embodiment, the connection terminal (1878) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0196] The haptic module (1879) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1879) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0197] The camera module (1880) can capture still images and moving images. In one embodiment, the camera module (1880) may include one or more lenses, image sensors, image signal processors, or flashes.
[0198] The power management module (1888) can manage the power supplied to the electronic device (1801). According to one embodiment, the power management module (1888) can be implemented as at least a part of, for example, a power management integrated circuit (PMIC).
[0199] A battery (1889) may power at least one component of the electronic device (1801). In one embodiment, the battery (1889) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0200] The communication module (1890) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1801) and an external electronic device (e.g., electronic device (1802), electronic device (1804), or server (1808)), and the performance of communication through the established communication channel. The communication module (1890) may operate independently from the processor (1820) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1890) may include a wireless communication module (1892) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1894) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1804) via a first network (1898) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1899) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a local area network or a wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1892) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1896) to identify or authenticate the electronic device (1801) within a communication network such as the first network (1898) or the second network (1899).
[0201] The wireless communication module (1892) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimizing terminal power and connecting multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1892) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1892) may support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1892) may support various requirements specified in the electronic device (1801), an external electronic device (e.g., the electronic device (1804)), or a network system (e.g., the second network (1899)). According to one embodiment, the wireless communication module (1892) can support a peak data rate (e.g., 20 Gbps or more) for eMBB implementation, a loss coverage (e.g., 164 dB or less) for mMTC implementation, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC implementation.
[0202] The antenna module (1897) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1897) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1897) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1898) or the second network (1899), may be selected from the plurality of antennas by, for example, the communication module (1890). A signal or power may be transmitted or received between the communication module (1890) and the external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1897).
[0203] According to various embodiments, the antenna module (1897) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
[0204] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0205] According to one embodiment, commands or data may be transmitted or received between the electronic device (1801) and an external electronic device (1804) via a server (1808) connected to a second network (1899). Each of the external electronic devices (1802 or 1304) may be of the same or a different type as the electronic device (1801). According to one embodiment, all or part of the operations executed in the electronic device (1801) may be executed in one or more of the external electronic devices (1802, 1304, or 1308). For example, when the electronic device (1801) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1801) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1801). The electronic device (1801) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1801) may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1804) may include an Internet of Things (IoT) device. The server (1808) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1804) or server (1808) may be included within the second network (1899). The electronic device (1801) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.
[0206] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0207] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0208] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0209] Various embodiments of the present document may be implemented as software (e.g., a program (1840)) including one or more instructions stored in a storage medium (e.g., an internal memory (1836) or an external memory (1838)) readable by a machine (e.g., an electronic device (1801)). For example, a processor (e.g., a processor (1820)) of the machine (e.g., an electronic device (1801)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0210] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0211] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0212] For example, the electronic device (101) of FIG. 18 may be referenced to the electronic device (101) of FIG. 1.
[0213] An electronic device according to one embodiment may display at least one of visual objects representing the execution of a plurality of software applications on a portion of a cover display. A method may be required for the electronic device to display at least one of the visual objects on the portion based on the execution order of the plurality of software applications.
[0214] In an electronic device (101) according to one embodiment as described above, the electronic device may include a housing including a first housing part (210) and a second housing part (220) rotatably coupled to the first housing part, a flexible display (153) extending from one side (211) of the first housing part to one side (221) of the second housing part, a cover display (155) positioned on the other side (212) of the first housing part opposite to the one side on which the flexible display is positioned, and at least one processor (120). The at least one processor may be configured to display, on the cover display, a first visual object (625) indicating time, a second visual object (706) representing a first widget (137-1) among a plurality of widgets (135-1, 137-1) provided from a plurality of software applications (135, 137) executed by the at least one processor, based on a specified condition, in a folded state (203) in which the one side of the first housing part and the one side of the second housing part face each other. The at least one processor may be configured to stop displaying the second visual object on the cover display and display a third visual object (621) corresponding to the second widget (135-1) among the plurality of widgets, based on an input for the second visual object.
[0215] For example, the at least one processor may be configured to display the first visual object on the cover display. The at least one processor may be configured to display the second visual object in an area corresponding to one corner (522-2) among the corners (522-1, 522-2, 523-2, 524-2) of the cover display.
[0216] For example, the input may include a first input. The at least one processor may be configured to, based on the first input for the second visual object, temporarily suspend display of the second visual object and display the first widget on the cover display. The at least one processor may be configured to identify a second input for temporarily suspending execution of the first software application corresponding to the first widget. The at least one processor may be configured to, after identifying the second input, display the first visual object and the third visual object on the cover display based on identifying a third input for displaying the first visual object.
[0217] For example, the at least one processor may be configured to display the first visual object and the third visual object based on identifying the third input performed along a first direction (612) that is perpendicular to the direction of one edge (521-3) among the edges (521-2, 521-3) forming the one corner.
[0218] For example, the at least one processor may be configured to display the first widget on the cover display based on the first input and display an icon (915) for displaying the first visual object in the area, and in response to the third input for the icon, display the first visual object.
[0219] For example, the above-mentioned condition may be set to display the second visual object overlapping the third visual object together with the first visual object based on the execution of the first software application (137) providing the first widget after the execution of the second software application (135) providing the second widget.
[0220] For example, the at least one processor may be configured to, in response to the input performed along the second direction (801), stop displaying the second visual object and display the third visual object.
[0221] For example, the plurality of widgets may be set to be displayed on the cover display based on a widget management application for managing widgets to be displayed on the cover display. The first visual object may be provided by the widget management application.
[0222] In the method of the electronic device (101) according to one embodiment as described above, the method may include an operation of displaying, on a cover display (155), a second visual object (706) representing a first widget (137-1) among a plurality of widgets (135-1, 137-1) provided from a plurality of software applications (135, 137) executed by at least one processor, based on a specified condition, together with a first visual object (625) representing time, in a folded state (203) in which one side (211) of a first housing part (210) of the electronic device and one side (221) of a second housing part (220) of the electronic device face each other. The method may include an operation of, based on an input for the second visual object, stopping displaying the second visual object on the cover display and displaying a third visual object (621) corresponding to the second widget (135-1) among the plurality of widgets.
[0223] For example, the operation of displaying the second visual object may include an operation of displaying the first visual object on the cover display. The operation of displaying the second visual object may include an operation of displaying the second visual object in an area corresponding to one corner (522-2) among the corners (522-1, 522-2, 523-2, 524-2) of the cover display.
[0224] For example, the input may include a first input. The operation of displaying the third visual object may include an operation of temporarily suspending display of the second visual object and displaying the first widget on the cover display based on the first input for the second visual object. The operation of displaying the third visual object may include an operation of identifying a second input for temporarily suspending execution of the first software application corresponding to the first widget. The operation of displaying the third visual object may include an operation of displaying the first visual object and the third visual object on the cover display based on identifying a third input for displaying the first visual object after identifying the second input.
[0225] For example, the operation of displaying the first visual object and the third visual object may include an operation of displaying the first visual object and the third visual object based on identifying the third input performed along a first direction (612) that is perpendicular to the direction of one edge (521-3) among the edges (521-2, 521-3) forming the one corner.
[0226] For example, the action of displaying the first visual object may include an action of displaying the first widget on the cover display based on the second input and displaying an icon (915) for displaying the first visual object in the area. The action of displaying the first visual object may include an action of displaying the first visual object in response to the third input for the icon.
[0227] For example, the above-mentioned condition may be set to display the second visual object overlapping the third visual object together with the first visual object based on the execution of the first software application (137) providing the first widget after the execution of the second software application (135) providing the second widget.
[0228] For example, the action of displaying the third visual object may include an action of, in response to the input performed along the second direction (801), stopping displaying the second visual object and displaying the third visual object.
[0229] In an electronic device (101) according to one embodiment as described above, the electronic device may include a housing including a first housing part (210) and a second housing part (220) rotatably coupled to the first housing part, a flexible display (153) extending from one side (211) of the first housing part to one side (221) of the second housing part, a cover display positioned on another side (212) of the first housing part opposite to the one side on which the flexible display is positioned, and at least one processor (120). The at least one processor may be configured to initiate execution of a first software application (135) in an unfolded state (200) that is distinct from a folded state (203) in which the one side of the first housing part and the one side of the second housing part face each other. The at least one processor may be configured to identify whether the first software application is linked with a second software application (133) for managing widgets to be displayed on the cover display based on identifying a change from the unfolded state to the folded state. The at least one processor may be configured to display a visual object (510) indicating execution of the first software application in an area (510) corresponding to one corner (522-2) among the corners (522-1, 522-2, 522-3, 522-4) of the cover display in a first state (505) in which the first software application is linked with the second software application. The at least one processor may be configured to display a screen (530) for linking the second software application and the first software application on the cover display in a second state (520) that is distinct from the first state.
[0230] For example, the at least one processor may be configured to identify the first state in which the first software application is linked with the second software application based on the first widget (135-1) of the first software application being executable using the second software application.
[0231] For example, the at least one processor may be configured to, in the first state, display the first widget on the cover display in response to an input for the visual object.
[0232] For example, the at least one processor may be configured to display the visual object together with a wallpaper screen (506) provided by the second software application on the cover display.
[0233] For example, the at least one processor may be configured to display, while displaying the visual object, another visual object (721) representing execution of a third software application associated with the phone, overlapping the visual object, based on the execution of the third software application.
[0234] In a computer-readable storage medium storing one or more programs according to one embodiment as described above, when the one or more programs are executed by at least one processor (120) of an electronic device (101), in a folded state (203) in which one side (211) of a first housing part (210) of the electronic device and one side (221) of a second housing part (220) of the electronic device face each other, the one or more programs may be configured to display, on a cover display (155), a second visual object (706) representing a first widget (137-1) among a plurality of widgets (135-1, 137-1) provided from a plurality of software applications (135, 137) executed by the at least one processor, together with a first visual object (625) representing time, based on a specified condition. The at least one processor may be configured to, based on an input for the second visual object, stop displaying the second visual object on the cover display and display a third visual object (621) corresponding to the second widget (135-1) among the plurality of widgets.
[0235] In the method of the electronic device (101) according to one embodiment as described above, the method may include an operation of initiating execution of the first software application (135) in an unfolded state (200) that is distinct from a folded state (203) in which one side (211) of the first housing part (210) and one side (221) of the second housing part (220) face each other. The method may include an operation of identifying whether the first software application is linked with a second software application (133) for managing a widget to be displayed on the cover display (155), based on identifying a change from the unfolded state to the folded state. The method may include an operation of displaying a visual object (510) indicating execution of the first software application in an area (510) corresponding to one corner (522-2) among the corners (522-1, 522-2, 522-3, 522-4) of the cover display in a first state (505) in which the first software application is linked with the second software application. The method may include an operation of displaying a screen (530) for linking the second software application and the first software application on the cover display in a second state (520) distinct from the first state.
[0236] In a computer-readable storage medium storing one or more programs according to one embodiment as described above, the one or more programs may be configured to cause the electronic device (101) to initiate execution of a first software application (135) in an unfolded state (200) distinct from a folded state (203) in which one side (211) of a first housing part (210) and one side (221) of a second housing part (220) face each other when executed by at least one processor (120). The one or more programs may be configured to cause the electronic device to identify whether the first software application is linked with a second software application (133) for managing a widget to be displayed on a cover display (155) based on identifying a change from the unfolded state to the folded state when executed by the at least one processor of the electronic device. The one or more programs may be configured to cause the electronic device, when executed by the processor of the electronic device, to display a visual object (510) indicating execution of the first software application in an area (510) corresponding to one corner (522-2) of the corners (522-1, 522-2, 522-3, 522-4) of the cover display in a first state (505) in which the first software application is linked with the second software application. The one or more programs may be configured to cause the electronic device, when executed by the processor of the electronic device, to display a screen (530) for linking the second software application with the first software application on the cover display in a second state (520) distinct from the first state.
[0237] In an electronic device (101) according to one embodiment as described above, the electronic device may include a housing including a first housing part (210) and a second housing part (220) rotatably coupled to the first housing part, a flexible display (153) extending from one side (211) of the first housing part to one side (221) of the second housing part, a cover display (155) located on the other side (212) of the first housing part, and at least one processor (120). The at least one processor may be configured to display a default screen (1325, 1335) in a first area of the cover display when instructions are executed to turn on the cover display by a user input or a system input. The at least one processor may be configured to display, overlapping the default screen, a visual object (507) representing execution status information that updates in real time or periodically the operation of at least one software application running on the electronic device in a second area (510), which is a part of the first area, when instructions are executed.
[0238] For example, the at least one processor may be configured to display the visual object in the second area corresponding to one corner (522-2) of the corners (522-1, 522-2, 523-2, 524-2) of the cover display when the instructions are executed.
[0239] For example, the electronic device may include a camera located on the other side of the first housing part. The at least one processor may be configured to display an icon (555) associated with the camera adjacent to another edge (522-3) of the edges adjacent to the camera when the instructions are executed.
[0240] For example, the at least one processor may be configured to, when the instructions are executed, display a widget of the at least one software application being executed in response to an input for the visual object. The at least one processor may be configured to, when the instructions are executed, at least temporarily refrain from displaying the visual object.
[0241] For example, the at least one processor may be configured to display an icon (915) in the second area for changing from the widget to the default screen based on, at least temporarily, refraining from displaying the visual object when the instructions are executed.
[0242] In the method of the electronic device (101) according to one embodiment as described above, when an operation of turning on the cover display (155) is performed by a user input or a system input, the method may include an operation of displaying a default screen (1325, 1335) in a first area of the cover display. The method may include an operation of displaying a visual object (507) indicating execution status information that updates the operation of at least one software application running on the electronic device in real time or periodically, overlapping the default screen, in a second area (510), which is a part of the first area.
[0243] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, electronic devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0244] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0245] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0246] Various embodiments of the present document may be implemented as software (e.g., a program) including one or more instructions stored in a storage medium (e.g., built-in memory or external memory) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., the processor (120)) of the machine (e.g., the electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0247] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0248] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (101), A housing including a first housing part (210) and a second housing part (220) rotatably coupled with the first housing part; A flexible display (153) extending from one side (211) of the first housing part to one side (221) of the second housing part; A cover display (155) located on the other side (212) of the first housing part; At least one processor (120) comprising a processing circuit; and A memory (130) storing instructions and including one or more storage media, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: When the cover display is turned on by a user input or a system input, a default screen (1325; 1335) is displayed in the first area of the cover display, and Causing a visual object (507) to be displayed in a second area (510), which is a part of the first area, overlapping the default screen and indicating execution status information that updates the operation of at least one software application running on the electronic device in real time or periodically. Electronic devices.
2. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Causing the visual object to be displayed in the second area corresponding to one corner (522-2) of the corners (522-1; 522-2; 523-2; 524-2) of the cover display. Electronic devices.
3. In paragraph 2, comprising a camera located on the other side of the first housing part, and The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Causing an icon (555) related to the camera to be displayed adjacent to another corner (522-3) adjacent to the camera among the above corners, and Electronic devices.
4. In the first paragraph, when the instructions are individually or collectively executed by the at least one processor, the electronic device, In response to input to said visual object, displaying a widget of at least one software application that is being executed, and causing the display of said visual object to be at least temporarily suppressed; Electronic devices.
5. In paragraph 4, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Causing, based on at least temporarily refraining from displaying the visual object, to display an icon (915) in the second area for changing from the widget to the default screen. Electronic devices.
6. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: In a folded state (203) in which the one side of the first housing part and the one side of the second housing part face each other, a second visual object (706) representing a first widget (137-1) among a plurality of widgets (135-1; 137-1) provided from a plurality of software applications (135; 137) executed by the at least one processor is displayed as the visual object, based on a specified condition, together with a first visual object (625) representing time on the cover display; and Based on the input for the second visual object, causing the display of the second visual object on the cover display to be stopped and the third visual object (621), corresponding to the second widget (135-1) among the plurality of widgets, to be displayed as the visual object. Electronic devices.
7. In the sixth paragraph, when the instructions are individually or collectively executed by the at least one processor, the electronic device, On the above cover display, the first visual object is displayed, and Causing the second visual object to be displayed in the second area corresponding to one corner (522-2) of the corners (522-1; 522-2; 523-2; 524-2) of the cover display. Electronic devices.
8. In paragraph 7, The above input includes a first input, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the first input to the second visual object, temporarily suspending the display of the second visual object and displaying the first widget on the cover display; Identify a second input for temporarily suspending execution of the first software application corresponding to the first widget, and After identifying the second input, based on identifying the third input for displaying the first visual object, causing the first visual object and the third visual object to be displayed on the cover display. Electronic devices.
9. In the 8th paragraph, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on identifying the third input performed along a first direction (612) that is perpendicular to the direction of one edge (521-3) among the edges (521-2; 521-3) forming the one corner, causing the first visual object and the third visual object to be displayed, Electronic devices.
10. In the 8th paragraph, when the instructions are individually or collectively executed by the at least one processor, the electronic device, Displaying the first widget on the cover display based on the first input and displaying an icon (915) for displaying the first visual object in the area, and In response to said third input for said icon, causing said first visual object to be displayed, Electronic devices.
11. In paragraph 6, The above specified condition is set to display the second visual object overlapping the third visual object together with the first visual object based on the execution of the first software application (135) providing the first widget after the execution of the second software application (137) providing the second widget. Electronic devices.
12. In the sixth paragraph, when the instructions are individually or collectively executed by the at least one processor, the electronic device, In response to the input performed along the second direction (801), causing the display of the second visual object to be stopped and the display of the third visual object to be caused. Electronic devices.
13. In paragraph 6, The above plurality of widgets are set to be displayed on the cover display based on a widget managing application for managing widgets to be displayed on the cover display, The above first visual object is provided by the widget managing application, Electronic devices.
14. In the method of electronic device (101), the method comprises: An operation of displaying, on a cover display (155), a second visual object (706) representing a first widget (137-1) among a plurality of widgets (135-1; 137-1) provided from a plurality of software applications (135; 137) executed by at least one processor, based on a specified condition, a first visual object (625) representing time, in a folded state (203) in which one side (211) of a first housing part (210) of the electronic device and one side (221) of a second housing part (220) of the electronic device face each other; and An operation including, based on an input for the second visual object, stopping displaying the second visual object on the cover display and displaying a third visual object (621) corresponding to the second widget (135-1) among the plurality of widgets. method.
15. In the 14th paragraph, the action of displaying the second visual object is: An operation of displaying the first visual object on the cover display; and Including an action of displaying the second visual object in an area corresponding to one corner (522-2) of the corners (522-1; 522-2; 523-2; 524-2) of the cover display. method.
Citation Information
Patent Citations
Cover attachment with flexible display
KR1020160096731A
Watch type terminal and method for controlling the same
KR1020170082196A
Apparatus and method for document recognition
KR1020220050356A
Drawing overlaid virtual space design method
KR1020240155628A
Electronic device and method controlling user interface in electronic device
KR102497550B1