Electronic device for displaying user interface and operating method thereof
By dynamically adjusting frame rates based on the number of user interface objects, the method optimizes power usage and reduces waste in electronic devices, addressing inefficiencies in power consumption.
Patent Information
- Application Number
- PCT/KR2025/002792
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-12
- Filing Date
- 2025-02-28
- Publication Date
- 2025-11-06
AI Technical Summary
Existing electronic devices face inefficiencies in power consumption and resource waste due to frequent screen refreshes at high frame rates, especially when unnecessary, leading to unnecessary current consumption.
Implementing a method and device that dynamically adjust frame rates based on the number of user interface objects displayed or hidden, using a first frame rate for fewer objects and a higher second frame rate for more objects, thereby optimizing power usage and reducing unnecessary screen refreshes.
This approach reduces resource waste and improves power efficiency by adapting frame rates to the number of UI objects, minimizing unnecessary power consumption during screen updates.
Smart Images

Figure KR2025002792_06112025_PF_FP_ABST
Abstract
Description
Electronic device displaying a user interface and method of operating the same
[0001] Various embodiments according to the present disclosure relate to an electronic device displaying a user interface and a method of operating the same.
[0002] Electronic devices have become equipped with complex functions, such as taking photos and videos, playing music and videos, playing games, receiving broadcasts, and supporting wireless Internet, and are being implemented as comprehensive multimedia devices. As examples of this advancement, electronic devices are taking various forms, including mobile terminals, smartphones, wearable devices, and social robots.
[0003] In particular, electronic devices provide users with a variety of information and complex functions through displays. The user interface (UI), which serves as a communication medium between the user and the electronic device, is provided to ensure efficient operation and user control of the electronic device, and is often implemented on the display.
[0004] An electronic device may display a user interface via a display capable of displaying a screen. For example, the display may include an organic light emitting diode (OLED) display, an active-matrix OLED (AMOLED) display, a passive-matrix organic LED (PMOLED) display, or a liquid crystal display (LCD). The electronic device may generate an image frame containing information about a screen to be displayed on the display, and control an integrated circuit (IC) that drives the display to update the screen displayed on the display with a screen corresponding to the generated image frame. The electronic device may consume resources or power during the process of performing operations to generate the image frame.
[0005] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.
[0006] An electronic device according to one embodiment may include a display, at least one processor, and a memory storing instructions. When the instructions are executed, the at least one processor may display a UI including at least one first user interface (UI) object through the display. When the instructions are executed, the at least one processor may identify a UI interaction event that causes at least one second UI object to be displayed or hidden while the first UI object is displayed. When the instructions are executed, the at least one processor may output an image frame for displaying the UI based on a first frame rate while a first number of UI objects among the at least one second UI object are displayed. When the instructions are executed, the at least one processor may output an image frame for displaying the UI based on a second frame rate that is higher than the first frame rate while a second number of UI objects, which is greater than the first number of UI objects among the at least one second UI object, are displayed.
[0007] A method of operating an electronic device according to one embodiment may include an operation of displaying a UI including at least one first user interface (UI) object through a display, an operation of identifying a UI interaction event that causes at least one second UI object to be displayed or hidden while the first UI object is displayed, an operation of outputting an image frame for displaying the UI based on a first frame rate while a first number of UI objects among the at least one second UI object are displayed based on the operation of identifying the UI interaction event, and an operation of outputting an image frame for displaying the UI based on a second frame rate that is higher than the first frame rate while a second number of UI objects among the at least one second UI object are displayed based on the operation of identifying the UI interaction event.
[0008] A computer-readable non-transitory recording medium according to one embodiment may record a computer program that is executed by at least one processor of an electronic device to cause the electronic device to perform the method described above.
[0009] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments of the present disclosure.
[0010] FIG. 2 is a block diagram illustrating interactions between functional components of an electronic device according to various embodiments of the present disclosure.
[0011] FIG. 3 is a flowchart illustrating a process by which an electronic device controls a frame rate according to one embodiment of the present disclosure.
[0012] FIG. 4 is a diagram illustrating an example of a display state of a UI of an electronic device according to a UI interaction event, according to one embodiment of the present disclosure.
[0013] FIG. 5 is a flowchart illustrating a process for outputting image frames according to a frame rate determined based on the number of UI objects when a UI interaction event causing an electronic device to display a second UI object is detected, according to one embodiment of the present disclosure.
[0014] FIG. 6 is a diagram illustrating an example of an electronic device displaying a second UI object according to one embodiment of the present disclosure.
[0015] FIG. 7 is a flowchart illustrating a process for causing an electronic device to output image frames according to a frame rate determined based on the number of UI objects when a UI interaction event causing a second UI object to be hidden is detected, according to one embodiment of the present disclosure.
[0016] FIG. 8 is a diagram illustrating an example of an electronic device hiding a second UI object according to one embodiment of the present disclosure.
[0017] FIG. 9 is a flowchart illustrating a process for causing an electronic device to output image frames according to a frame rate determined based on the number, width, or area of UI objects, according to one embodiment of the present disclosure.
[0018] FIG. 10 is a drawing for explaining the width of a UI object displayed on a display with respect to a reference direction within the screen according to one embodiment of the present disclosure.
[0019] FIG. 11 is a drawing for explaining the area within the screen of a UI object displayed on a display according to one embodiment of the present disclosure.
[0020] FIG. 12 is a drawing for explaining the number value of UI objects displayed on a display according to one embodiment of the present disclosure.
[0021] FIG. 13 is a diagram for explaining the interrelationship between the UI framework layer and the graphic layer according to one embodiment of the present disclosure.
[0022] FIG. 14 is a drawing for explaining an example of displaying a second UI object when the angle is greater than a threshold angle in an electronic device including a flexible display according to one embodiment of the present disclosure.
[0023] FIG. 15 is a drawing for explaining an example of displaying a second UI object when the angle is greater than a threshold angle in an electronic device including a flexible display according to one embodiment of the present disclosure.
[0024] FIG. 16 is a drawing for explaining an example of displaying a second UI object when the angle is greater than a threshold angle in an electronic device including a flexible display according to one embodiment of the present disclosure.
[0025] FIG. 17 is a drawing for explaining an example of displaying a second UI object according to an angle in an electronic device including a flexible display according to an embodiment of the present disclosure.
[0026] FIG. 18 is a drawing for explaining an example of displaying a second UI object according to an angle in an electronic device including a flexible display according to an embodiment of the present disclosure.
[0027] FIG. 19 is a drawing for explaining an example of displaying a second UI object according to an angle in an electronic device including a flexible display according to one embodiment of the present disclosure.
[0028] FIG. 20 is a drawing for explaining an example of displaying a second UI object according to a slide-out operation in an electronic device including a flexible display according to an embodiment of the present disclosure.
[0029] FIG. 21 is a drawing for explaining an example of displaying a second UI object according to a slide-out operation in an electronic device including a flexible display according to an embodiment of the present disclosure.
[0030] FIG. 22 is a drawing for explaining an example of displaying a second UI object according to a slide-out operation in an electronic device including a flexible display according to an embodiment of the present disclosure.
[0031] FIG. 23 is a drawing for explaining an example of displaying a second UI object in a wearable electronic device according to one embodiment of the present disclosure.
[0032] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0033] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.
[0034] The terms used in this disclosure are described as currently common terms, taking into account the functions mentioned herein. However, these terms may mean various other terms depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Therefore, the terms used in this disclosure should not be interpreted solely based on their names, but rather based on the meanings of the terms and the overall content of this disclosure.
[0035] Additionally, while terms such as first, second, etc. may be used to describe various components, the components are not limited by these terms. These terms are used to distinguish one component from another.
[0036] In this disclosure, the connection lines or connecting members between components depicted in the drawings are merely exemplary representations of functional connections and / or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that may be replaced or added.
[0037] In this document, the frame rate refers to the frequency with which the screen to be displayed on the display (e.g., the display (160) of FIG. 2) is updated, and may refer to the frequency with which an image frame to be displayed on the display is generated or the frequency with which an image frame is output to the display. For example, the frame rate may refer to the number of frames (e.g., frames per second) that an electronic device generates to display on the screen per unit time. The refresh rate may refer to the number of times the display updates the screen displayed on the display with the received image frames per unit time. The frame rate and the refresh rate may have the same value, but may also have different values. For example, if the refresh rate is higher than the frame rate and no new image frame is received at the time of refreshing the screen according to the refresh rate after displaying the screen on the display, the display may display the same screen as the previous screen. The frame rate may refer to the frequency with which an application updates an image frame to be output through the display. The frame rate may correspond to the rendering frequency, which refers to the frequency with which an image to be included in an image frame is rendered. For example, in an electronic device with a refresh rate of 120 Hz, image frames can be output at a frame rate (rendering frequency) of 60 Hz.
[0038] In this document, a user interface (UI) may refer to a medium for interaction between an electronic device (e.g., an electronic device (101) of FIG. 1, a wearable electronic device (2301) of FIG. 23) and a user through software contact or physical contact. The UI may include, for example, a screen (including a list, icons, text, and images) output through a display when an electronic device executes an application to provide information to a user on the electronic device.
[0039] In this document, a UI object may be a term meaning a unit of visual elements corresponding to a single item in the UI. A UI object may include UI components displayed on a display. For example, a UI object may mean a combination of at least one UI component (e.g., at least one of an image, an icon, or text) that includes a list.
[0040] In this document, a UI interaction event may refer to an action defined to be performed by a UI when identified by an electronic device. For example, a UI interaction event may include an action of receiving a touch input for a specific area within an area where a specific first UI object is displayed. For example, a UI interaction event may include an action of receiving a drag input corresponding to a specified direction from an area where a specific first UI object is displayed. For example, a UI interaction event may include an action of detecting that an angle between a first and second housing of a flexible electronic device changes by more than a threshold angle.
[0041] In this document, the first UI object or the second UI object may include UI components that are displayed or hidden before or after the UI interaction event occurs in relation to the UI interaction event. For example, the first UI object may include UI components that are displayed before the UI interaction event. For example, the second UI object may include UI components that are displayed or hidden after the UI interaction event.
[0042] In various electronic devices with displays, when the number of UI objects changes during the display process of a user interface (UI), the image frames representing the UI objects are updated by setting the maximum frame rate. However, this method alone can result in frequent current consumption and inefficient power consumption when generating image frames based on high frame rates in situations where frequent screen refresh is unnecessary.
[0043] Accordingly, various embodiments of the present invention are directed to providing a method and device for reducing resource waste and improving power efficiency of a display in an electronic device.
[0044] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description of this disclosure.
[0045] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present invention. However, the disclosed embodiments may be implemented in various different forms and are not limited to the embodiments described herein.
[0046] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments of the present disclosure.
[0047] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0048] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0049] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0050] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0051] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0052] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0053] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0054] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0055] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0056] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0057] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0058] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0059] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0060] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0061] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0062] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0063] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0064] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0065] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0066] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0067] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0068] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0069] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0070] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0071] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0072] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0073] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0074] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0075] FIG. 2 is a block diagram illustrating interactions between functional components of an electronic device according to various embodiments of the present disclosure.
[0076] According to one embodiment, the electronic device (101) may include at least one processor (210) (e.g., the processor (120) of FIG. 1), a memory (220) (e.g., the memory (130) of FIG. 1), and a display (230) (e.g., the display module (160) of FIG. 1). For example, the electronic device (200) may correspond to the electronic device (101) of FIG. 1. For example, the at least one processor (210) may correspond to the processor (120) of FIG. 1. For example, the memory (220) may correspond to the memory (130) of FIG. 1.
[0077] In the present disclosure, the operation of the electronic device (200) can be understood as being performed by executing instructions stored in a memory (220) by at least one processor (210).
[0078] According to one embodiment, the electronic device (200) may display a first UI object on the display (230). For example, the electronic device (200) may display a UI object (such as a charging alarm, a messenger alarm, or a system alarm) for providing an alarm to the user on the display (230). For example, the electronic device (200) may display a UI object (such as a menu list, a settings menu list, a messenger list, or a photo list) for providing a list from which the user can select on the display (230).
[0079] According to one embodiment, the electronic device (200) may detect a UI interaction event that causes a second UI object to be displayed or hidden. For example, the electronic device (200) may cause the second UI object to be displayed on the display (230) in response to detecting a user's touch input. For example, the electronic device (200) may cause the second UI object displayed on the display (230) to be hidden in response to detecting a user's motion event. For example, the electronic device (200) may cause the second UI object to be displayed on the display (230) in response to detecting a user's voice event. For example, the electronic device (200) may play an animation effect that causes the second UI object to be gradually displayed or hidden based on the identification of a UI interaction event.
[0080] According to one embodiment, the electronic device (200) may output the UI based on the first frame rate while displaying a first number of UI objects among the second UI objects. The electronic device (200) may output the UI based on the second frame rate, which is higher than the first frame rate, while displaying a second number of UI objects, which is greater than the first number. For example, the electronic device (200) may output the UI based on 60 Hz while displaying four UI objects while playing an animation that displays a second UI object including ten UI objects on the display (230). For example, the electronic device (200) may output the UI based on 120 Hz while displaying eight UI objects while playing an animation that displays a second UI object including ten UI objects on the display (230). For example, the electronic device (200) may output the UI based on 120 Hz in a state of displaying 8 UI objects and may output the UI based on 60 Hz in a state of displaying 4 UI objects while playing an animation in which the second UI objects including 10 UI objects are hidden from the state of being displayed on the display (230).
[0081] According to one embodiment, the display (230) may include a fixed display or a flexible display. For example, the electronic device (200) may include a plurality of pivotable housings that are connected to each other via a hinge assembly. The flexible display may fold or unfold as the housings rotate relative to each other by the hinge assembly. For example, the flexible display may be configured to be inserted into and rolled up within the housing of the electronic device (200) or to be ejected from the interior of the housing. For example, the electronic device may include a first housing and a second housing that is slidable relative to the first housing. The movement of the second housing relative to the first housing causes the flexible display to slide into or out of the interior space of the housing of the electronic device.
[0082] According to one embodiment, there may be multiple displays (230). The first display may be arranged across multiple housings. The second display may be arranged facing the opposite side of the side on which the first display is arranged.
[0083] According to one embodiment, the display (230) can display a user interface including UI objects. For example, the display (230) can display a list of items for displaying information delivered to the user (e.g., 331, 335, 351, 353 of FIG. 3). For example, the display (230) can display application items that the user can select (e.g., 2303, 2305, 2307 of FIG. 23) in a circular shape.
[0084] According to one embodiment, the memory (220) may store instructions. The instructions may be executed by at least one processor (210). The instructions may include code for the electronic device (200) to perform various data processing or calculations. For example, the memory (220) may store instructions for the electronic device (200) to perform data processing or calculations according to at least one of the embodiments described with reference to FIGS. 1 to 23.
[0085] According to one embodiment, the memory (220) may store data obtained by at least one processor (210) performing a calculation. For example, the memory (220) may store data obtained by the electronic device (200) performing data processing or calculation according to at least one of the embodiments described below with reference to FIGS. 1 to 23.
[0086] FIG. 3 is a flowchart (300) illustrating a process for controlling a frame rate by an electronic device according to an embodiment of the present disclosure. In the following embodiments, the respective operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the respective operations may be changed, and at least two operations may be performed in parallel. At least some of the operations of FIG. 3 will be described below with reference to FIG. 4 and FIG. 12. FIG. 4 is a diagram illustrating an example of a display state of a UI of an electronic device according to a UI interaction event in an electronic device according to an embodiment of the present disclosure. FIG. 12 is a diagram for explaining a value of the number of UI objects displayed on a display according to an embodiment of the present disclosure.
[0087] Referring to FIG. 3, in operation 301, an electronic device (e.g., the electronic device (200) of FIG. 2) may display a first UI object (e.g., 411, 431, 451 of FIG. 4) on a display (e.g., the electronic device (230) of FIG. 2). According to one embodiment, at least one processor (210) may display a UI including the first UI object on the display (230) from at least one component (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2). For example, the first UI object may be a UI component including at least one of text, an image, and a video. For example, the first UI object may include a UI component (e.g., 415 of FIG. 4) indicating that at least one second UI object that is not displayed exists. For example, a first UI object may include a UI element (e.g., 851 of FIG. 8) that indicates that at least one second UI object that is displayed can be hidden. For example, the electronic device may display the first UI object (e.g., 411 of FIG. 4) on at least a portion of the display (230).
[0088] Referring to FIG. 3, in operation 303, an electronic device (e.g., the electronic device (200) of FIG. 2) may detect a UI interaction event (e.g., 413 of FIG. 4) that causes a second UI object (e.g., 435, 455 of FIG. 4) to be displayed or hidden. According to one embodiment, the electronic device (200) may output an image frame that causes the second UI object to appear on the display (230). For example, for a second UI object having four UI objects, the electronic device (200) may output a screen that progresses from a screen (301) displaying zero UI objects, to a screen (430) displaying two UI objects (435), to a screen (450) displaying four UI objects (455). For example, when an animation progresses from a screen (410) displaying 0 UI objects to a screen (430) displaying 2 UI objects (435) to a screen (450) displaying 4 UI objects (455), the electronic device (200) may continuously display the first UI objects (411, 431, 451) on the display (230). For example, the electronic device (200) may sequentially switch the screens to screen 410 of FIG. 4, screen 430 of FIG. 4, and screen 450 of FIG. 4 as it displays the second UI object. The electronic device (200) may display an animation in which the second UI object is gradually displayed on the display (230). According to one embodiment, the electronic device (200) may output an image frame that hides the second UI object on the display (230) from a state in which the second UI object is displayed. For example, when moving from a screen (430) displaying four UI objects (455) to a screen (450) displaying two UI objects (435) to a screen (410) displaying zero UI objects, the electronic device (200) can display the first UI object (411, 431, 451) on the display (230).For example, as the electronic device (200) hides the second UI object, the screens may be switched in the order of screen 450 of FIG. 4, screen 430 of FIG. 4, and screen 410 of FIG. 4. For example, the electronic device (200) may display an animation in which the second UI object is gradually hidden. According to one embodiment, the electronic device (200) may detect a UI interaction event. For example, the electronic device (200) may detect the UI interaction event through a sensor module (e.g., 176 of FIG. 1). For example, the UI interaction event may include a touch input to a UI component (415) that causes the second UI object to be displayed. For example, the UI interaction event may include a change in an angle between a first housing and a second housing connected to the first housing by a hinge in a flexible display. For example, the UI interaction event may include an event in which an angle between a first housing and a second housing connected to the first housing by a hinge in the flexible display becomes greater or smaller than a critical angle. For example, the UI interaction event may include a slide-in motion in which, in the flexible display disposed in at least a portion of a third housing and a fourth housing slidably coupled with respect to the third housing, at least a portion of the flexible display is drawn into an internal space of the third housing or the fourth housing as the fourth housing moves in a first direction toward the third housing with respect to the third housing. In the flexible display disposed in at least a portion of the third housing and a fourth housing slidably coupled with respect to the third housing, at least a portion of the flexible display is pulled out from an internal space of the third housing or the fourth housing as the fourth housing moves in a second direction opposite to the first direction toward the third housing with respect to the third housing.For example, UI interaction events may include non-contact recognition events such as voice recognition and motion recognition.
[0089] Referring to FIG. 3, in operation 305, the electronic device (200) may output the UI based on the first frame rate while displaying a first number of UI objects among the second UI objects on the display (230). According to one embodiment, the electronic device may determine the first frame rate based on the first number of UI objects displayed on the display (230) among the second UI objects. For example, when the total number of second UI objects is 10, the electronic device (200) may output image frames by applying a frame rate of 60 Hz when 1 to 3 UI objects are displayed on the display, a frame rate of 100 Hz higher than a frame rate of 80 Hz when 4 to 6 UI objects are displayed on the display, and a frame rate of 120 Hz higher than a frame rate of 100 Hz when 7 to 10 UI objects are displayed on the display.
[0090] Referring to FIG. 3, in operation 307, the electronic device (200) may output the UI based on a second frame rate that is higher than the first frame rate while displaying a second number of UI objects, which is greater than the first number of second UI objects, on the display (230). According to one embodiment, the electronic device (200) may determine the second frame rate based on the second number of UI objects being displayed on the display (230) among the second UI objects.
[0091] According to one embodiment, in operation 305 or operation 307, the electronic device may determine the first frame rate or the second frame rate based on the number of UI objects being displayed on the display among the second UI objects. For example, as in FIG. 4, if the number of second UI objects (455) is 4, if 1 or 2 UI objects are being displayed on the display among the second UI objects, the electronic device may output image frames by applying a frame rate of 80 Hz, and if 3 or 4 UI objects are being displayed on the display, the electronic device may output image frames by applying a frame rate of 120 Hz. For example, in the screen 430 of FIG. 4, since the first number of 2 UI objects (435) are being displayed, the electronic device (200) may output image frames for displaying the UI of the screen 430 based on the first frame rate. The first frame rate may be 80 Hz. For example, in screen 450 of FIG. 4, since the electronic device (200) displays four UI objects (455), which is a second number greater than the first number, the electronic device (200) can output image frames for displaying the UI of screen 450 based on a second frame rate higher than the first frame rate. The second frame rate may be 120 Hz, which is higher than the first frame rate of 80 Hz.
[0092] According to one embodiment, in operation 305 or operation 307, the electronic device may determine the first frame rate or the second frame rate based on a first threshold value, which is a threshold value for the number of UI objects. Examples of this embodiment are discussed below in FIGS. 5 to 8.
[0093] According to one embodiment, in operation 305 or operation 306, the electronic device may determine the first frame rate or the second frame rate based on the width of the UI object displayed on the display relative to the reference direction within the screen. The electronic device may also determine the first frame rate or the second frame rate based on the area of the UI object displayed on the display within the screen. Examples of this embodiment are discussed below in FIGS. 9 and 10 .
[0094] According to one embodiment, the number of UI objects of the second UI object may be the number of UI objects at least partially displayed on the display (230) of the electronic device (200). For example, if a part of the UI object is displayed on the display (230), the number of UI objects may be calculated. For example, as illustrated in FIG. 12, in the case of state 1201, four second UI objects (1231) are displayed on the display (230), so the number of UI objects may be determined to be four. For example, as illustrated in FIG. 12, in the case of state 1203, two fully displayed second UI objects (1233) and one partially displayed UI object (1253) may be displayed on the display (230). Even in the case of a partially displayed UI object (1253), it can be determined as one UI object when determining the number by judging that the UI object is at least partially displayed on the display (230), and the electronic device (200) can determine the number of UI objects to be three in state 1203. For example, as illustrated in FIG. 12, in the case of state 1205, the second UI object (1235) can be displayed on the display (230) with four UI objects that are fully displayed and one UI object (1255) that is partially displayed. Even in the case of a partially displayed UI object (1255), it can be determined as one UI object when determining the number by judging that the UI object is at least partially displayed on the display (230), and the electronic device (200) can determine the number of UI objects to be five in state 1205. However, the above-described example is an example of a criterion for an electronic device to determine the number of objects, and the method for determining the number of objects may be implemented differently.
[0095] According to one embodiment, in operation 305 or operation 307, the electronic device (200) may display an animation on the display (230) that gradually displays at least one second UI object, or may display an animation that gradually hides at least one second object displayed on the display (230). For example, based on a third number of at least one second UI object, the electronic device may determine a time interval for displaying the animation. The electronic device may determine a first sub-time interval and a second sub-time interval within the determined time interval. The electronic device may display the animation based on a first frame rate during the first sub-time interval. The electronic device may display the animation based on a second frame rate during the second sub-time interval. For example, referring to FIG. 4, when the entire animation progresses from screen 410 to screen 430 to screen 450 over 1 second by the electronic device (200), the first sub-time interval can be set to a 0 to 0.5 second interval and the second sub-time interval can be set to a 0.5 to 1 second interval based on four second UI objects. The electronic device (200) can display the animation based on 80 Hz during the first sub-time interval and can display the animation based on 120 Hz during the second sub-time interval.
[0096] According to one embodiment, in operation 305 or operation 307, when the electronic device (200) displays on the display (230) an animation that gradually displays at least one second UI object on the display (230), the display may output based on at least one of the first frame rate or the second frame rate. The electronic device (200) may determine the first frame rate or the second frame rate by considering the number of second UI objects and the number of frame rate change sections. The electronic device (200) may determine the number of frame rate change sections based on the number of second UI objects. For example, if there are three frame rate change sections in the animation that displays the second UI objects and the total number of second UI objects is 10, the electronic device (200) may calculate the number of UI objects per sub-time section as the quotient of 'the number of second UI objects / the number of frame rate change sections' and set it to '3'. The electronic device (200) can set the number of UI objects for each sub-time section, depending on the number of second UI objects and the number of frame rate change sections, when the number of UI objects is 1 to 3, when the number of UI objects is 4 to 6, or when the number of UI objects is 7 to 10. The electronic device (200) can determine a frame rate for outputting image frames by comparing the number of UI objects displayed on the display (230) among at least one second UI object with a first threshold value. The electronic device (200) can output image frames for playing animation based on the first frame rate in a state where the first number of UI objects displayed on the display (230) among at least one second UI object is less than the first threshold value. For example, when the first threshold value is 4, the electronic device (200) can output image frames for playing animation based on the first frame rate during the first sub-time section in which the first number is 1 to 3.The electronic device (200) may output image frames for playing back animation based on a second frame rate in a state where a second number of UI objects displayed on the display (230) among at least one second UI object is greater than or equal to a first threshold value and less than a third threshold value having a value greater than the first threshold value. The second frame rate may have a higher value than the first frame rate. For example, the electronic device (200) may output image frames for playing back animation based on the second frame rate during a second sub-time interval in which the second number is 4 to 6. The electronic device (200) may output image frames for playing back animation based on a fifth frame rate in a state where a fourth number of UI objects displayed on the display (230) among at least one second UI object is greater than or equal to a third threshold value. The fifth frame rate may have a higher value than the second frame rate. For example, the electronic device (200) can output image frames for playing animation based on a fifth frame rate during a third sub-time interval in which the number of second UI objects is 7 to 10.
[0097] FIG. 5 is a flowchart (500) illustrating a process for causing an electronic device (200) to output an image frame according to a frame rate determined based on the number of UI objects when a UI interaction event for displaying a second UI object is detected, according to an embodiment of the present disclosure. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel. At least some operations of FIG. 5 will be described below with reference to FIG. 6 and FIG. 13. FIG. 6 is a diagram for explaining an example of causing an electronic device to display a second UI object, according to an embodiment of the present disclosure. FIG. 12 is a diagram for explaining a value of the number of UI objects displayed on a display, according to an embodiment of the present disclosure. FIG. 13 is a diagram for explaining the relationship between a UI framework layer and a graphic layer, according to an embodiment of the present disclosure.
[0098] Referring to FIG. 5, in operation 501, the electronic device (200) may display a UI including a first UI object on the display (230). According to one embodiment, the electronic device (200) may display a UI including a first UI object on the display (230). For example, in screen 601 of FIG. 6, the electronic device (200) may display a UI including a first UI object (611) on the display (230). For example, the first UI object (611) displayed on the display (230) may include a UI component (631) indicating that at least one second UI object that is not displayed exists. For example, the first UI object (611) may include at least one of text, an image, or a video. For example, the electronic device (200) may display the first UI object (611) on the display (230) while the second UI object is not displayed, as shown in screen 601 of FIG. 6.
[0099] Referring to FIG. 5, in operation 503, the electronic device (200) may determine whether a UI interaction event is detected. According to one embodiment, the electronic device (200) may detect a user's touch input as a UI interaction event. For example, in screen 601 of FIG. 6, the electronic device (200) may detect a touch input (651) for a UI component (631) included in a first UI object as a UI interaction event. For example, the UI interaction event may include a tap input that touches at least once. For example, the UI interaction event may include a swipe-up action that swipes upward while touching a location where the first UI object is displayed on the display (230), a swipe-down (or drag and drop) action that swipes downward while touching, or a press action that maintains a touched state. According to one embodiment, the electronic device (200) can detect various inputs other than touch input as UI interaction events. For example, the UI interaction event can include at least one of a user's posture, motion, action, or voice. According to one embodiment, if a UI interaction event is not detected, the electronic device (200) can maintain a state of displaying a UI including a first UI object on the display in operation 501. For example, if there is no user touch input (651) for the UI component (631), the electronic device (200) can display a screen 601 on the display (230) that displays the first UI object (611) and does not display the second UI object.
[0100] According to one embodiment, when a UI interaction event is detected, the electronic device (200) may display a second UI object on the display (230) in operation 505. For example, the electronic device (200) may display the second UI object on the display (230) according to an animation in which at least one second UI object is gradually displayed. For example, as illustrated in state 601, state 603, state 605, and state 607 of FIG. 6, the operation in which the electronic device (200) displays the second UI objects (633, 635, and 637) on the display (230) may be performed in the order of state 603, state 605, and state 607 according to an animation in which the second UI object is gradually displayed on screen 601 in which no second UI object is displayed.
[0101] Referring to FIG. 5, in operation 507, the electronic device (200) may determine whether the number of UI objects has changed. According to one embodiment, the electronic device (200) may determine whether the number of second UI objects appearing on the display (230) has changed. For example, as illustrated in states 603 and 605 of FIG. 6, if the number of second UI objects (633) is displayed as 2 in state 603 and then the number of second UI objects (635) is displayed as 4 in state 605, it may be determined that the number of UI objects has changed. For example, as illustrated in FIG. 13, an application (1301) in the electronic device (200) may request a value of the number of objects displayed on the display from the UI framework layer (1303) (1311). In the electronic device (200), the UI framework layer (1303) can determine the number of objects displayed on the display and return the number of objects (1313). The electronic device (200) can determine whether the number of objects has changed by comparing the information returned from the UI framework layer with the number of previous UI objects to determine the frame rate. For example, the itemmanger module of the UI framework layer of the electronic device can be responsible for checking the number of objects displayed on the display (230). The animationhandler module of the UI framework layer of the electronic device can be responsible for managing the operation of animations on the display (230). For example, as illustrated in state 603 of FIG. 6, when the number of second UI objects gradually increases through the display and two are displayed, the application can receive from the UI framework layer a return that the number of second UI objects displayed on the display is two. The electronic device can determine that the number of UI objects of the second UI object has changed from one to two compared to the previous time.According to one embodiment, if the number of UI objects of the second UI object has not changed, the electronic device (200) may maintain a state of determining whether the number of UI objects has changed in operation 507.
[0102] According to one embodiment, the electronic device (200) may determine the number of UI objects, at least part of which is displayed on the display (230) of the electronic device (200), as the number of UI objects of the second UI object. For example, if a part of the UI object is displayed on the display (230), it may be determined as the number of UI objects. For example, as illustrated in FIG. 12, in the case of state 1201, four second UI objects (1231) are displayed on the display (230), so the electronic device (200) may determine the number of UI objects as four. For example, as illustrated in FIG. 12, in the case of state 1203, two fully displayed second UI objects (1233) and one partially displayed UI object (1253) may be displayed on the display (230). Even in the case of a partially displayed UI object (1253), the electronic device (200) can determine that the UI object is at least partially displayed on the display (230) and determine it as one UI object when determining the number. The electronic device (200) can determine that the number of UI objects is 3 in state 1203. For example, as illustrated in FIG. 12, in the case of state 1205, the second UI object (1235) can be displayed on the display (230) with four fully displayed UI objects and one partially displayed UI object (1255). Even in the case of a partially displayed UI object (1255), the electronic device (200) can determine that the UI object is at least partially displayed on the display (230) and determine it as one UI object when determining the number. The electronic device (200) can determine that the number of UI objects is 5 in state 1205. However, the above-described example is an example of a criterion for an electronic device to determine the number of objects, and the method for determining the number of objects may be implemented differently.
[0103] According to one embodiment, when the number of UI objects of the second UI object is changed, the electronic device (200) may determine whether the number of UI objects is greater than or equal to a first threshold value in operation 509. For example, in state 603 of FIG. 6, the number of UI objects displayed on the display among the second UI objects may be 2, and in state 605 of FIG. 6, the number of UI objects displayed on the display among the second UI objects may be 4. When the first threshold value is 4, the number of UI objects (633) of state 603 of FIG. 6 may not be greater than or equal to the first threshold value, and the number of UI objects (635) of state 605 of FIG. 6 may be greater than or equal to the first threshold value. For example, the electronic device may determine the first threshold value in consideration of the number of second UI objects. For example, when the number of second UI objects is 4, the electronic device may set 2, which corresponds to 50% of 4, as the first threshold value. For example, if the number of second UI objects is 10, the electronic device can set the first threshold value to 3, which is 2.5, which is 25% of 10, rounded to the first decimal place.
[0104] According to one embodiment, when the number of UI objects displayed on the display is less than the first threshold value, the electronic device (200) may output an image frame for displaying the UI on the display (230) based on the first frame rate in operation 513. For example, as illustrated in FIG. 13, the application (1301) in the electronic device (200) may determine the first frame rate based on the number of second UI objects and the number of objects displayed on the display. The electronic device (200) may request the first frame rate from the graphics layer (1305). The graphics layer (1305) in the electronic device (200) may generate and return a signal to the application (1301) based on the first frame rate. For example, when the range of frame rates that the electronic device (200) may output is 120 Hz to 80 Hz, the electronic device (200) may set the first frame rate to 80 Hz, which is lower than 120 Hz.
[0105] According to one embodiment, when the number of UI objects displayed on the display is greater than or equal to a first threshold value, the electronic device (200) may output an image frame for displaying the UI on the display (230) based on a second frame rate in operation 511. For example, as illustrated in FIG. 13, the application (1301) in the electronic device (200) may determine the first frame rate based on the number of second UI objects and the number of objects displayed on the display. The application (1301) in the electronic device (200) may request the first frame rate from the graphics layer (1305). The graphics layer (1305) in the electronic device (200) may generate and return a signal to the application (1301) based on the first frame rate. For example, when the maximum frame rate that the electronic device (200) can output is 120 Hz, the electronic device (200) may set the second frame rate to 120 Hz, which is higher than the first frame rate.
[0106] According to one embodiment, the electronic device (200) may, in operation 511, output an image frame for displaying a UI based on a second frame rate, and then set a third threshold value having a value greater than the first threshold value. For example, as illustrated in FIG. 6, when the first threshold value is set to 4, the electronic device (200) may output an image frame for displaying a UI based on a second frame rate of 90 Hz when the number of UI objects (635) is 4, as illustrated in state 605 of FIG. 6. Thereafter, the electronic device (200) may set the third threshold value to 6, which is greater than 4. For example, the third threshold value set by the electronic device (200) may be set to various values for each electronic device depending on the number of second UI objects, the frame rate of the electronic device, the animation time for displaying the second UI object, etc.
[0107] Referring to FIG. 5, in operation 515, the electronic device (200) may determine whether the display of the second UI object is completed. According to one embodiment, the electronic device (200) may determine whether the display of the second UI object shown on the display (230) is completed. For example, as illustrated in FIG. 13, the electronic device (200) may receive a value of the number of objects displayed on the display from the UI framework layer (1303). The electronic device may compare the value with the number of second UI objects to determine whether the display of the second UI object is completed. According to one embodiment, if the display of the second UI object is not completed, the electronic device (200) may determine whether the number of UI objects has changed in operation 507. For example, in state 605 of FIG. 6, the number of UI objects displayed on the display (230) among a total of six second UI objects may be four, and the electronic device may perform an operation of determining whether the number of UI objects has changed when the display of the second UI objects is not complete. According to one embodiment, when the display of the second UI objects is complete, the electronic device (200) may output an image frame for displaying the UI based on the third frame rate in operation 517. For example, in state 607 of FIG. 6, the number of UI objects displayed on the display (230) among a total of six second UI objects may be six. State 607 is a case where the display of the second UI objects is complete, and the electronic device may perform an operation of outputting the UI based on the third frame rate.
[0108] Referring to FIG. 5, in operation 517, the electronic device (200) may output the UI based on a third frame rate. According to one embodiment, the electronic device (200) may output an image frame for displaying the UI based on the third frame rate. For example, in state 607 of FIG. 6, the electronic device may output an image frame for displaying a UI including a second UI object (637) based on the third frame rate. For example, the third frame rate may have a lower frame rate than the second frame rate. For example, the third frame rate may be a minimum frame rate of the electronic device (200). For example, the UI may be an image frame including the second UI object (637). The UI may be a UI in a state where the display of the second UI object is completed and the playback of an animation in which the second UI object is gradually displayed is terminated.
[0109] FIG. 7 is a flowchart (700) illustrating a process for causing an electronic device (200) to output an image frame according to a frame rate determined based on the number of UI objects when a UI interaction event that causes a second UI object to be hidden is detected, according to one embodiment of the present disclosure. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel. At least some operations of FIG. 7 will be described below with reference to FIG. 8 and FIG. 13. FIG. 7 is a diagram for explaining an example of causing an electronic device to hide a second UI object, according to one embodiment of the present disclosure. FIG. 12 is a diagram for explaining a value of the number of UI objects displayed on a display, according to one embodiment of the present disclosure. FIG. 13 is a diagram for explaining the relationship between a UI framework layer and a graphic layer, according to various embodiments of the present disclosure.
[0110] Referring to FIG. 7, in operation 701, a UI including a first UI object and at least one second UI object may be displayed on a display. According to one embodiment, the electronic device (200) may display a UI including a first UI object and at least one second UI object on the display (230). For example, in state 801 of FIG. 8, the entire UI including the first UI object (811) and six second UI objects (831) may be displayed on the display (230). For example, the first UI object (811) may include a UI component (851) indicating that at least one second UI object that is being displayed can be hidden. For example, the first UI object (811) or the second UI object (831) may include at least one of text, an image, or a video. For example, the electronic device (200) can display the first UI object (811) on the display (230) in a state in which the entire second UI object (831) is displayed, as shown in state 801 of FIG. 8.
[0111] Referring to FIG. 7, it may be determined whether a UI interaction event is detected in operation 703. According to one embodiment, the electronic device (200) may detect a user's touch input to the display (230) as a UI interaction event. For example, in state 801 of FIG. 8, a touch input (871) to a UI component (851) included in a first UI object may be detected as a UI interaction event. For example, the UI interaction event may include a tap input that touches at least once. For example, the UI interaction event may include a swipe-up action of swiping down while touching a location where the first UI object is displayed on the display (230), a swipe-down (or drag and drop) action of swiping down while touching, or a press action of maintaining a touched state. According to one embodiment, the electronic device (200) can detect various inputs other than touch input as UI interaction events. For example, the UI interaction event can include at least one of a user's posture, motion, action, or voice. According to one embodiment, if a UI interaction event is not detected, the electronic device (200) can maintain a state of displaying a UI including a first UI object and at least one second object on the display in operation 701. For example, if there is no user touch input (871) for the UI component (851), the electronic device (200) can display a state 801 displaying a first UI object (811) and a second UI object (831) on the display (230).
[0112] According to one embodiment, when a UI interaction event is detected, the electronic device (200) may hide the second UI object on the display (230) in operation 705. For example, the electronic device (200) may hide the second UI object on the display (230) according to an animation in which the second UI object is gradually hidden from a state in which at least one second UI object is displayed. For example, as illustrated in state 801, state 803, state 805, and state 807 of FIG. 8, the operation in which the electronic device hides the second UI object on the display may occur in the order of state 803, state 805, and state 807 according to an animation in which the second UI object is gradually hidden from a state 801 in which all second UI objects are displayed.
[0113] Referring to FIG. 7, in operation 707, the electronic device (200) may determine whether the number of UI objects has changed. According to one embodiment, the electronic device (200) may determine whether the number of second UI objects appearing on the display (230) has changed. For example, as illustrated in states 803 and 805 of FIG. 8, if the electronic device displays the number of second UI objects (833) as 4 in state 803 and then displays the number of second UI objects (835) as 2 in state 805, the electronic device may determine that the number of UI objects has changed. For example, as illustrated in FIG. 13, an application (1301) in the electronic device (200) may request a value of the number of objects displayed on the display from the UI framework layer (1303) (1311). In the electronic device (200), the UI framework layer (1303) can determine the number of objects displayed on the display and return the number of objects (1313). The electronic device (200) can determine the frame rate by comparing the information returned from the UI framework layer with the number of previous UI objects to determine whether the number of objects has changed. For example, the itemmanger module of the UI framework layer of the electronic device can check the number of objects displayed on the display (230). The animationhandler module of the UI framework layer of the electronic device can manage the operation of animation on the display (230). For example, as illustrated in state 803 of FIG. 8, when the number of second UI objects (833) on the display gradually decreases to four, the application on the electronic device can receive from the UI framework layer a return indicating that the number of second UI objects (833) displayed on the display is four. The electronic device can determine that the number of UI objects of the second UI object has changed from five to four compared to the previous time.According to one embodiment, if the number of UI objects of the second UI object has not changed, the electronic device (200) may maintain a state of determining whether the number of UI objects has changed in operation 707.
[0114] According to one embodiment, the electronic device (200) may determine the number of UI objects, at least part of which is displayed on the display (230), as the number of UI objects of the second UI object. For example, if a part of the UI object is displayed on the display (230), it may be determined as the number of UI objects. For example, as illustrated in FIG. 12, in the case of state 1201, four second UI objects (1231) are displayed on the display (230), so the electronic device (200) may determine the number of UI objects as four. For example, as illustrated in FIG. 12, in the case of state 1203, two fully displayed second UI objects (1233) and one partially displayed UI object (1253) may be displayed on the display (230). Even in the case of a partially displayed UI object (1253), the electronic device (200) can determine that the UI object is at least partially displayed on the display (230) and determine it as one UI object when determining the number. The electronic device (200) can determine that the number of UI objects is 3 in state 1203. For example, as illustrated in FIG. 12, in the case of state 1205, the second UI object (1235) can be displayed on the display (230) with four fully displayed UI objects and one partially displayed UI object (1255). Even in the case of a partially displayed UI object (1255), the electronic device (200) can determine that the UI object is at least partially displayed on the display (230) and determine it as one UI object when determining the number. The electronic device (200) can determine that the number of UI objects is 5 in state 1205. However, the above-described example is an example of a criterion for an electronic device to determine the number of objects, and the method for determining the number of objects may be implemented differently.
[0115] According to one embodiment, when the number of UI objects of the second UI object is changed, the electronic device (200) may determine whether the number of UI objects is greater than or equal to a first threshold value in operation 709. For example, in state 803 of FIG. 8, the number of UI objects displayed on the display among the second UI objects may be 4, and in state 805 of FIG. 8, the number of UI objects displayed on the display among the second UI objects may be 2. When the first threshold value is 2, the number of UI objects (833) of state 803 of FIG. 8 may be greater than or equal to the first threshold value, and the number of UI objects (835) of state 805 of FIG. 8 may not be greater than or equal to the first threshold value. For example, the electronic device may determine the first threshold value in consideration of the number of second UI objects. For example, when the number of second UI objects is 4, the electronic device may set 2, which corresponds to 50% of 4, as the first threshold value. For example, if the number of second UI objects is 10, the electronic device can set the first threshold value to 3, which is 2.5, which is 25% of 10, rounded to the first decimal place.
[0116] According to one embodiment, when the number of UI objects displayed on the display is less than the first threshold value, the electronic device (200) may output an image frame for displaying the UI on the display (230) based on the first frame rate in operation 713. For example, as illustrated in FIG. 13, the application (1301) in the electronic device (200) may determine the first frame rate based on the number of second UI objects and the number of objects displayed on the display. The electronic device (200) may request the first frame rate from the graphics layer (1305). The graphics layer (1305) in the electronic device (200) may generate and return a signal to the application (1301) based on the first frame rate. For example, when the range of frame rates that the electronic device (200) may output is 120 Hz to 80 Hz, the electronic device (200) may set the first frame rate to 80 Hz, which is lower than 120 Hz.
[0117] According to one embodiment, the electronic device (200) may, in operation 713, output an image frame for displaying a UI based on a first frame rate, and then set a fourth threshold value having a value smaller than the first threshold value. For example, as illustrated in FIG. 8, when the first threshold value is set to 3, the number of UI objects (635) may be 2 in state 805 of FIG. 8, and an image frame for displaying a UI based on a first frame rate of 60 Hz may be output. Thereafter, the electronic device (200) may set the fourth threshold value to 1, which is smaller than 3. For example, the fourth threshold value set by the electronic device (200) may be set to vary for each electronic device depending on the number of second UI objects, the frame rate of the electronic device, the animation time for hiding the second UI object, etc.
[0118] According to one embodiment, when the number of UI objects displayed on the display is greater than or equal to a first threshold value, the electronic device (200) may output an image frame for displaying the UI on the display (230) based on a second frame rate in operation 711. For example, as illustrated in FIG. 13, the application (1301) in the electronic device (200) may determine the first frame rate based on the number of second UI objects and the number of objects displayed on the display. The application (1301) in the electronic device may request the first frame rate from the graphics layer (1305). The graphics layer (1305) in the electronic device (200) may generate and return a signal to the application (1301) based on the first frame rate. For example, when the maximum frame rate that the electronic device (200) can output is 120 Hz and the first frame rate is 80 Hz, the second frame rate may be set to 120 Hz, which is higher than the first frame rate.
[0119] Referring to FIG. 7, it may be determined whether hiding of the second UI object is completed in operation 715. According to one embodiment, the electronic device (200) may determine whether hiding of the second UI object displayed on the display (230) is completed. For example, as illustrated in FIG. 13, the electronic device (200) may receive a value of the number of objects displayed on the display from the UI framework layer (1303), and the electronic device may compare the value with the number of second UI objects to determine whether hiding of the second UI object is completed. According to one embodiment, if hiding of the second UI object is not completed, the electronic device (200) may determine whether the number of UI objects has changed in operation 707. For example, in state 805 of FIG. 8, the number of UI objects displayed on the display (230) among a total of six second UI objects may be two, and the electronic device may perform an operation to determine whether the number of UI objects has changed when the display of the second UI objects is not complete. According to one embodiment, when the display of the second UI objects is complete, the electronic device (200) may output an image frame for displaying the UI based on the third frame rate in operation 717. For example, in state 807 of FIG. 8, the number of UI objects displayed on the display (230) among a total of six second UI objects may be zero. State 807 is a case where the hiding of the second UI objects is complete, and the electronic device may perform an operation to output based on the third frame rate.
[0120] Referring to FIG. 7, in operation 717, an output may be performed based on a third frame rate. According to one embodiment, the electronic device (200) may output an image frame for displaying a UI based on the third frame rate. For example, in state 807 of FIG. 8, an image frame for displaying a UI may be output based on the third frame rate. For example, the third frame rate may have a lower frame rate than the second frame rate. For example, the third frame rate may be the minimum frame rate of the electronic device (200). The UI of state 807 may be a UI in which the hiding of the second UI object is completed and the playback of the animation in which the second UI object is gradually hidden has ended.
[0121] FIG. 9 is a flowchart (900) illustrating a process for causing an electronic device (200) to output image frames according to a frame rate determined based on the number, width, or area of UI objects, according to one embodiment of the present disclosure. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel. At least some operations of FIG. 9 will be described below with reference to FIGS. 6, 10, 11, 12, and 13. FIG. 6 is a diagram for explaining an example of causing an electronic device to display a second UI object, according to one embodiment of the present disclosure. FIG. 10 is a diagram for explaining a width with respect to a reference direction within a screen of a UI object displayed on a display, according to one embodiment of the present disclosure. FIG. 11 is a diagram for explaining an area within a screen of a UI object displayed on a display, according to one embodiment of the present disclosure. FIG. 12 is a diagram for explaining the number of UI objects displayed on a display according to one embodiment of the present disclosure. FIG. 13 is a diagram for explaining the relationship between the UI framework layer and the graphic layer according to one embodiment of the present disclosure.
[0122] Referring to FIG. 9, in operation 901, the electronic device (200) may display a UI including a first UI object on the display (230). According to one embodiment, the electronic device (200) may display a UI including a first UI object on the display (230). For example, in state 601 of FIG. 6, the electronic device (200) may display a UI including a first UI object (611) on the display (230). For example, the first UI object (611) displayed on the display (230) may include a UI component (631) indicating that at least one second UI object that is not displayed exists. For example, the first UI object (611) may include at least one of text, an image, or a video. For example, the electronic device (200) may display the first UI object (611) on the display (230) while the second UI object is not displayed, as shown in state 601 of FIG. 6.
[0123] Referring to FIG. 5, in operation 903, the electronic device (200) may determine whether a UI interaction event is detected. According to one embodiment, the electronic device (200) may detect a user's touch input as a UI interaction event. For example, in state 601 of FIG. 6, the electronic device (200) may detect a touch input (651) for a UI component (631) included in a first UI object as a UI interaction event. For example, the UI interaction event may include a tap input that touches at least once. For example, the UI interaction event may include a swipe-up action that swipes upward while touching a location where the first UI object is displayed on the display (230), a swipe-down (or drag and drop) action that swipes downward while touching, or a press action that maintains a touched state. According to one embodiment, the electronic device (200) can detect various inputs other than touch input as UI interaction events. For example, the UI interaction event can include at least one of a user's posture, motion, action, or voice. According to one embodiment, if a UI interaction event is not detected, the electronic device (200) can maintain a state of displaying a UI including a first UI object on the display in operation 501. For example, if there is no user touch input (651) for the UI component (631), the electronic device (200) can display a state 601 in which the first UI object (611) is displayed and the second UI object is not displayed on the display (230).
[0124] According to one embodiment, when a UI interaction event is detected, the electronic device (200) may display a second UI object on the display (230) at operation 905. For example, the second UI object may be displayed according to an animation in which at least one second UI object is gradually displayed. For example, the second UI object may appear on the display at a constant speed while being displayed according to the animation in which the second UI object is gradually displayed. For example, as illustrated in state 601, state 603, state 605, and state 607 of FIG. 6, the operation of displaying the second UI object on the display may occur in the order of state 601, in which no second UI object is displayed, state 603, state 605, and state 607, in which the second UI object is gradually displayed, according to the animation.
[0125] Referring to FIG. 5, in operation 907, the electronic device (200) may determine whether the number of UI objects has changed. According to one embodiment, the electronic device (200) may determine whether the number of second UI objects appearing on the display (230) has changed. For example, as illustrated in states 603 and 605 of FIG. 6, if the number of second UI objects (633) is displayed as 2 in state 603 and then the number of second UI objects (635) is displayed as 4 in state 605, it may be determined that the number of UI objects has changed. For example, as illustrated in FIG. 13, an application (1301) in the electronic device (200) may request a value of the number of objects displayed on the display from the UI framework layer (1303) (1311). In the electronic device (200), the UI framework layer (1303) can determine the number of objects displayed on the display and return the number of objects (1313). The electronic device (200) can determine whether the number of objects has changed by comparing the information returned from the UI framework layer with the number of previous UI objects to determine the frame rate. For example, the itemmanger module of the UI framework layer of the electronic device can be responsible for checking the number of objects displayed on the display (230). The animationhandler module of the UI framework layer of the electronic device can be responsible for managing the operation of animations on the display (230). For example, as illustrated in state 603 of FIG. 6, when the number of second UI objects gradually increases through the display and two are displayed, the application can receive from the UI framework layer a return that the number of second UI objects displayed on the display is two. The electronic device can determine that the number of UI objects of the second UI object has changed from one to two compared to the previous time.According to one embodiment, if the number of UI objects of the second UI object has not changed, the electronic device (200) may maintain a state of determining whether the number of UI objects has changed in operation 507.
[0126] According to one embodiment, the electronic device (200) may determine the number of UI objects, at least part of which is displayed on the display (230) of the electronic device (200), as the number of UI objects of the second UI object. For example, if a part of the UI object is displayed on the display (230), it may be determined as the number of UI objects. For example, as illustrated in FIG. 12, in the case of state 1201, four second UI objects (1231) are displayed on the display (230), so the electronic device (200) may determine the number of UI objects as four. For example, as illustrated in FIG. 12, in the case of state 1203, two fully displayed second UI objects (1233) and one partially displayed UI object (1253) may be displayed on the display (230). Even in the case of a partially displayed UI object (1253), the electronic device (200) can determine that the UI object is at least partially displayed on the display (230) and determine it as one UI object when determining the number. The electronic device (200) can determine that the number of UI objects is 3 in state 1203. For example, as illustrated in FIG. 12, in the case of state 1205, the second UI object (1235) can be displayed on the display (230) with four fully displayed UI objects and one partially displayed UI object (1255). Even in the case of a partially displayed UI object (1255), the electronic device (200) can determine that the UI object is at least partially displayed on the display (230) and determine it as one UI object when determining the number. The electronic device (200) can determine that the number of UI objects is 5 in state 1205. However, the above-described example is an example of a criterion for an electronic device to determine the number of objects, and the method for determining the number of objects may be implemented differently.
[0127] Referring to FIG. 9, in operation 909, the electronic device (200) may determine whether the width or area of the UI object is greater than or equal to a second threshold value. According to one embodiment, the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2) may determine whether the width of the UI object displayed on the display (230) with respect to a reference direction (1005) within the screen is greater than or equal to the second threshold value. For example, the reference direction (1005) may correspond to a direction corresponding to a direction in which the second UI object is displayed and gradually appears on the display (203) of the electronic device (200). For example, the reference direction (1005) may correspond to a direction corresponding to a direction having an aspect ratio of 16 in a display (203) having an aspect ratio of 16:9. For example, the reference direction (1005) may correspond to a direction corresponding to a direction having a ratio of 4 in a display (203) having an aspect ratio of 4:3. For example, as illustrated in FIG. 10, the reference direction may correspond to a direction corresponding to the direction of 1005. For example, as illustrated in FIG. 10, the width for the reference direction may correspond to a width corresponding to 1031 in state 1001. As illustrated in FIG. 10, the width corresponding to 1033 in 1003 may correspond to the width for the reference direction. For example, the electronic device may set the second threshold value based on the total width of the display (230) corresponding to the reference direction. For example, the electronic device may set the second threshold value to a value obtained by dividing the total width of the display corresponding to the reference direction (1005) of state 1001 in FIG. 10 by 10. The electronic device can determine a frame rate for outputting image frames for displaying the UI by comparing the width (1031) of the UI object with a second threshold value.For example, the electronic device may set the second threshold value to a value equal to the total width of the display corresponding to the reference direction (1005) of 1003 in FIG. 10 divided by 5. For example, the electronic device may compare the width (1033) of the UI object with the second threshold value, and may compare the width (1031) of the UI object with the second threshold value to determine a frame rate for outputting an image frame for displaying the UI. For example, the total width of the display (230) corresponding to the reference direction (1005) set in the electronic device (200) may vary depending on the characteristics of the electronic device (200). For example, the total width of the display (230) may correspond to one of the horizontal pixel number or the vertical pixel number of the resolution of the display (230).
[0128] According to one embodiment, the electronic device (200) may determine whether the area of the UI object displayed on the display (203) within the screen is greater than or equal to a second threshold value. For example, as illustrated in FIG. 11, the electronic device (1101) may determine whether the area (1131) of the region corresponding to the second UI object is greater than or equal to the second threshold value. For example, as illustrated in FIG. 11, the electronic device may determine whether the area (1133) of the region corresponding to the second UI object in the wearable electronic device (1103) is greater than or equal to the second threshold value. For example, the electronic device (200) may set the second threshold value based on the area occupied by the second UI object relative to the total area of the display (230) of the electronic device (200). For example, when the total area of the display (230) of the electronic device (200) is A, the second threshold value may be set to a value of A / 20, which is 20% of the total area. For example, the total area of the display (230) can be determined based on the number of horizontal pixels and the number of vertical pixels of the display (230).
[0129] According to one embodiment, if the width of the UI object displayed on the display in the reference direction within the screen or the area of the UI object displayed on the display in the screen is equal to or greater than the second threshold value, the electronic device (200) may output an image frame for displaying the UI on the display (230) based on a fourth frame rate in operation 911. For example, the fourth frame rate may be greater than or equal to the second frame rate. For example, the fourth frame rate may correspond to a maximum frame rate of the electronic device (200). For example, in an animation operation in which a second UI object is displayed, if the number of UI objects of the second UI object is 1 and the width of the UI object displayed on the display (230) in the reference direction is equal to or greater than the second threshold value, the electronic device (200) having a maximum frame rate of 120 Hz may output an image frame for displaying the UI including the second UI object at 120 Hz.
[0130] According to one embodiment, when the number of UI objects displayed on the display is greater than or equal to a first threshold value, the electronic device (200) may determine whether the number of UI objects displayed on the display is greater than or equal to the first threshold value in operation 913. For example, in state 603 of FIG. 6, the number of UI objects displayed on the display among the second UI objects may be 2, and in state 605 of FIG. 6, the number of UI objects displayed on the display among the second UI objects may be 4. When the first threshold value set by the electronic device is 4, the number of UI objects (633) in state 603 of FIG. 6 may be less than the first threshold value, and the number of UI objects (635) in state 605 of FIG. 6 may be greater than or equal to the first threshold value. For example, the electronic device may determine the first threshold value in consideration of the number of second UI objects. For example, when the number of second UI objects is 4, the electronic device may set 2, which corresponds to 50% of 4, as the first threshold value. For example, if the number of second UI objects is 10, the electronic device can set the first threshold value to 3, which is 2.5, which is 25% of 10, rounded to the first decimal place.
[0131] According to one embodiment, when the number of UI objects displayed on the display is less than the first threshold value, the electronic device (200) may output an image frame for displaying the UI on the display (230) based on the first frame rate in operation 917. For example, as illustrated in FIG. 13, the application (1301) may determine the first frame rate based on the number of second UI objects and the number of objects displayed on the display, request the first frame rate to the graphics layer (1305), and the graphics layer (1305) may generate and return a signal based on the first frame rate to the application (1301). For example, when the range of frame rates that can be output from the electronic device (200) is 120 Hz to 80 Hz, the electronic device may set the first frame rate to 80 Hz, which is lower than 120 Hz.
[0132] According to one embodiment, when the number of UI objects displayed on the display is greater than or equal to a first threshold value, the electronic device (200) may output an image frame for displaying the UI on the display (230) based on a second frame rate in operation 915. For example, as illustrated in FIG. 13, the application (1301) in the electronic device (200) may determine the first frame rate based on the number of second UI objects and the number of objects displayed on the display. The application (1301) in the electronic device (200) may request the first frame rate from the graphics layer (1305). The graphics layer (1305) in the electronic device (200) may generate and return a signal to the application (1301) based on the first frame rate. For example, when the maximum frame rate that the electronic device (200) can output is 120 Hz, the electronic device (200) may set the second frame rate to 120 Hz, which is higher than the first frame rate.
[0133] According to one embodiment, the electronic device (200) may, in operation 915, output an image frame for displaying a UI based on a second frame rate, and then set a third threshold value having a value greater than the first threshold value. For example, as illustrated in FIG. 6, when the first threshold value is set to 4, the electronic device (200) may output an image frame for displaying a UI based on a second frame rate of 90 Hz when the number of UI objects (635) is 4, as illustrated in state 605 of FIG. 6. Thereafter, the electronic device (200) may set the third threshold value to 6, which is greater than 4. For example, the third threshold value set by the electronic device (200) may be set to vary for each electronic device depending on the number of second UI objects, the frame rate of the electronic device, the animation time for displaying the second UI object, etc.
[0134] Referring to FIG. 9, in operation 919, the electronic device (200) may determine whether the display of the second UI object is completed. According to one embodiment, the electronic device (200) may determine whether the display of the second UI object shown on the display (230) is completed. For example, as illustrated in FIG. 13, the electronic device (200) may receive a value of the number of objects displayed on the display from the UI framework layer (1303). The electronic device may compare the value with the number of second UI objects to determine whether the display of the second UI object is completed. According to one embodiment, if the display of the second UI object is not completed, the electronic device (200) may determine whether the number of UI objects has changed in operation 907. For example, in state 605 of FIG. 6, the number of UI objects displayed on the display (230) among a total of six second UI objects may be four, and the electronic device may perform an operation of determining whether the number of UI objects has changed when the display of the second UI objects is not complete. According to one embodiment, when the display of the second UI objects is complete, the electronic device (200) may output an image frame for displaying the UI based on the third frame rate in operation 921. For example, in state 607 of FIG. 6, the number of UI objects displayed on the display (230) among a total of six second UI objects may be six. State 607 is a case where the display of the second UI objects is complete, and the electronic device may perform an operation of outputting the UI based on the third frame rate.
[0135] Referring to FIG. 9, in operation 919, it may be determined whether the display of the second UI object is complete. According to one embodiment, the electronic device (200) may determine whether the display of the second UI object shown on the display (230) is complete. For example, as illustrated in FIG. 13, the electronic device (200) may receive a value of the number of objects displayed on the display from the UI framework layer (1303), and may compare the value with the number of second UI objects to determine whether the display of the second UI object is complete. According to one embodiment, when the display of the second UI object is not complete, the electronic device (200) may determine whether the number of UI objects has changed in operation 907. For example, in operation 605 of FIG. 6, the number of UI objects displayed on the display (230) may be 4 out of a total of 6 second UI objects, and when the display of the second UI object is not complete, an operation of determining whether the number of UI objects has changed may be performed. According to one embodiment, when the display of the second UI object is completed, the electronic device (200) may output an image frame for displaying the UI based on the third frame rate in operation 921. For example, in state 607 of FIG. 6, the number of UI objects displayed on the display (230) among a total of six second UI objects may be six, and this may be a case where the display of the second UI object is completed, and thus an operation for outputting based on the third frame rate may be performed.
[0136] Referring to FIG. 9, in operation 921, the electronic device (200) may output a UI based on a third frame rate. According to one embodiment, the electronic device (200) may output an image frame for displaying the UI based on the third frame rate. For example, in state 607 of FIG. 6, the electronic device may output an image frame for displaying a UI including a second UI object (637) based on the third frame rate. For example, the third frame rate may have a lower frame rate than the second frame rate. For example, the third frame rate may be a minimum frame rate of the electronic device (200). For example, the UI may be an image frame including the second UI object (637). The UI may be a UI in a state where the display of the second UI object is completed and the playback of an animation in which the second UI object is gradually displayed is terminated.
[0137] FIG. 14, FIG. 15, and FIG. 16 are drawings for explaining examples of displaying a second UI object when the angle is greater than a threshold angle in an electronic device including a flexible display according to one embodiment of the present disclosure.
[0138] According to one embodiment, an electronic device (200) including a first housing and a second housing connected to the first housing via a hinge may include a flexible display and may display a second UI object depending on the angle of the first housing and the second housing.
[0139] Referring to FIG. 14, an electronic device (200) according to one embodiment may include a first housing (1401) and a second housing (1403) connected to the first housing via a hinge. The flexible display of the electronic device (200) may include a display (1402) disposed on one side of the first housing and a display (1404) disposed on one side of the second housing, and one side of the first housing (1401) and one side of the second housing (1403) may form a first angle (1405) (e.g., a right angle). For example, the displays disposed on at least a portion of the first housing (1401) and the second housing (1403) may be flexible displays. For example, as illustrated in FIG. 14, when the angle (1405) between one side of the first housing (1401) and one side of the second housing (1403) is a right angle or an angle less than a right angle, a screen (1407) including a first UI object (1410) may be displayed on the display of the electronic device (200). For example, when the angle (1405) is a right angle or less than a right angle, the first UI object (1410) may be displayed on the display (1404) disposed on one side of the second housing (1403).
[0140] Referring to FIG. 15, an electronic device (200) according to one embodiment may include a first housing (1501) and a second housing (1503) connected to the first housing via a hinge. The flexible display of the electronic device (200) may include a display (1502) disposed on one side of the first housing and a display (1504) disposed on one side of the second housing, and a second angle (1505) between one side of the first housing (1501) and one side of the second housing (1503) may be an obtuse angle and have an angle smaller than a critical angle. For example, the displays disposed on at least a portion of the first housing (1501) and the second housing (1503) may include flexible displays. For example, when the second angle (1505) is less than the critical angle, the electronic device (200) may display a screen (1507) including a first UI object (1510) on the display. For example, the electronic device may display the first UI object (1510) on a display (1504) disposed on one side of the second housing (1503) when the angle (1505) is less than the critical angle. For example, the critical angle may be an obtuse angle, and when the second angle (1505) is less than the critical angle, the second UI object may not be displayed on the display (1503) disposed on one side of the first housing (1501).
[0141] Referring to FIG. 16, an electronic device (200) according to one embodiment may include a first housing (1601) and a second housing (1603) connected to the first housing via a hinge. The flexible display of the electronic device (200) may include a display (1602) disposed on one side of the first housing and a display (1604) disposed on one side of the second housing, and a third angle (1605) between one side of the first housing (1601) and one side of the second housing (1603) may have an angle greater than or equal to a critical angle. For example, the displays disposed on at least a portion of the first housing (1601) and the second housing (1603) may be flexible displays. For example, the electronic device may display a screen (1607) including a first UI object (1610) and second UI objects (1620, 1630) on a display of the electronic device (200) when one side of the first housing (1601) and a third angle (1605) of the second housing (1603) have an angle greater than or equal to a critical angle. For example, the electronic device may display the first UI object (1610) on a display (1604) disposed on one side of the second housing (1603) and may display the second UI object (1620, 1630) on a display (1602) disposed on one side of the first housing (1601) when the third angle (1605) is greater than or equal to the critical angle. For example, the critical angle may be an obtuse angle, and if the third angle (1605) is greater than or equal to the critical angle, an animation may appear in which a second UI object (1620, 1630) is gradually displayed on a display (1603) disposed on one side of the first housing (1601).
[0142] According to one embodiment, the electronic device (200) can identify a UI interaction event based on an angle between a first housing and a second housing connected to the first housing by a hinge being greater than or equal to a threshold angle. For example, referring to FIG. 16, when an angle (1605) between one side of the first housing (1601) and one side of the second housing (1603) is the threshold angle (1605), the electronic device can display an animation in which second UI objects (1620, 1630) are gradually displayed on a display (1603) disposed on one side of the first housing (1601). The electronic device can display the first UI object (1610) on a display (1604) disposed on one side of the second housing (1603). The electronic device can display an animation in which second UI objects (1620, 1630) are gradually displayed on screens 1607 and 1609 that sequentially appear on a display (1602) disposed on one side of a first housing (1601). The electronic device can output image frames at a frame rate of 80 Hz when displaying (1620) two UI objects on a screen (1607) on the display, and the electronic device can output image frames at a frame rate of 120 Hz when displaying three UI objects (1630) on a screen (1609) on the display.
[0143] FIG. 17, FIG. 18, and FIG. 19 are drawings for explaining examples of displaying a second UI object according to an angle in an electronic device including a flexible display according to one embodiment of the present disclosure.
[0144] According to one embodiment, an electronic device (200) including a first housing and a second housing connected to the first housing via a hinge may include a flexible display and may display a second UI object (1820, 1920) as the angles of the first housing and the second housing change.
[0145] Referring to FIG. 17, an electronic device (200) according to one embodiment may include a first housing (1701) and a second housing (1703) connected to the first housing via a hinge, and may include a display (1702) disposed on one surface of the first housing and a display (1704) disposed on one surface of the second housing, and an angle (1705) between one surface of the first housing (1701) and one surface of the second housing (1703) may be a right angle. For example, the displays disposed on at least a portion of the first housing (1701) and the second housing (1703) may be flexible displays. For example, as illustrated in FIG. 17, when the angle (1705) between one side of the first housing (1701) and one side of the second housing (1703) is a right angle or an angle less than a right angle, the electronic device (200) can display a screen (1707) including a first UI object (1710) on the display (230). For example, the electronic device can display a screen (1707) including a first UI object (1710) on the display (1704) disposed on one side of the second housing (1703) when the angle (1705) is a right angle or an angle less than a right angle.
[0146] Referring to FIGS. 18 and 19, an electronic device (200) according to one embodiment may include a first housing (1801, 1901) and a second housing (1803, 1903) connected to the first housing via a hinge, may include a display (1802, 1902) disposed on one side of the first housing, and may include a display (1804, 1904) disposed on one side of the second housing, and may display a screen (1807, 1907) including a second UI object (1820, 1920) on the display as an angle (1805, 1905) between one side of the first housing (1801, 1901) and one side of the second housing (1803, 1903) increases. For example, according to FIG. 18, as the angle (1805) between one side of the first housing (1801) and one side of the second housing (1803) increases, the first UI object (1810) can be continuously displayed on the screen (1807) on the display. For example, according to FIG. 19, as the angle (1905) between one side of the first housing (1901) and one side of the second housing (1903) increases, the first UI object (1910) can be continuously displayed on the screen (1907) on the display. For example, as the angle (1805) between one side of the first housing (1801) and one side of the second housing (1803) increases beyond 90 degrees, the electronic device can display a screen (1807) including a second UI object (1820) on the display (1802) disposed on one side of the first housing (1801). For example, the electronic device can identify a UI interaction event based on an increase in an angle (1805) between one side of the first housing (1801) and one side of the second housing (1803) and display a second UI object (1820). For example, as illustrated in FIGS. 18 and 19 , the electronic device can display a different number of second UI objects (1820, 1920) based on an increase in an angle (1805, 1905) between one side of the first housing (1801, 1901) and one side of the second housing (1803, 1903).When the angle (1805) of FIG. 18 is smaller than the angle (1905) of FIG. 19, the electronic device can display a smaller number of UI objects (1820) on the screen (1807) of the display than the number of UI objects (1920) displayed on the screen (1907) of FIG. 19. When the angle (1905) of FIG. 19 is larger than the angle (1805) of FIG. 18, the electronic device can display a larger number of UI objects (1920) on the screen (1907) of the display than the number of UI objects (1820) displayed on the screen (1807) of FIG. 18. For example, as illustrated in FIGS. 18 and 19, the electronic device can output image frames on the display (230) based on a frame rate of 80 Hz in a state where two second UI objects (1820) are displayed on the screen (1807) of the display. The electronic device can output image frames on the display (230) based on a frame rate of 120 Hz while three second UI objects (1920) are displayed on the screen (1907) on the display.
[0147] FIG. 20, FIG. 21, and FIG. 22 are drawings for explaining examples of displaying a second UI object according to a slide-out operation in an electronic device including a flexible display according to one embodiment of the present disclosure.
[0148] According to one embodiment, the electronic device (200) may include a third housing (2001, 2101, 2201) and a fourth housing (2103, 2203) coupled with the third housing to slide relative to the third housing, and may include a flexible display, and may display a second UI object according to an operation in which the third housing slides in or out of the fourth housing. For example, the electronic device may perform a slide-in operation in which the fourth housing (2103, 2203) slides in a first direction toward the third housing (2001, 2101, 2201) relative to the third housing (2001, 2101, 2201) so that at least a portion of the flexible display is introduced into the electronic device (200). For example, in an electronic device, a fourth housing (2103, 2203) may slide in a direction opposite to a first direction toward the third housing (2001, 2101, 2201) with respect to the third housing (2001, 2101, 2201) such that at least a portion of the flexible display may be pulled out from inside the electronic device (200). For example, the electronic device may identify a UI interaction event based on at least one of a slide-in or a slide-out operation. For example, the electronic device may display a second UI object (2110, 2210) on the flexible display based on a slide-out operation performed according to state 2005, state 2105, and state 2205. The electronic device may hide the display of at least one second UI object (2110, 2210) on the flexible display based on the slide-in operation.
[0149] According to one embodiment, the electronic device (200) may include a third housing (2001, 2101, 2201) and a fourth housing (2103, 2203) coupled to the third housing so as to slide relative to the third housing, and may include a flexible display. The electronic device may display the number of second UI objects according to an area of the fourth housing (2103, 2203) pulled out from the electronic device (200) when the third housing (2001, 2101, 2201) slides in or out of the fourth housing (2103, 2203). For example, when a slide-out operation or a slide-in operation occurs in the electronic device, the larger the area of the fourth housing (2103, 2203) pulled out, the greater the number of second UI objects that the electronic device may display on the display (230). For example, while a slide-out operation occurs in an electronic device, as illustrated in FIGS. 20, 21, and 22, the electronic device may not display a second UI object in a state 2005 in which the fourth housing is not withdrawn. The electronic device may display one second UI object (2110) in a state 2105 in which the fourth housing (2103) is partially withdrawn. The electronic device may display four second UI objects (2210) in a state 2205 in which the fourth housing (2203) is fully withdrawn. For example, while a slide-out operation occurs, as illustrated in FIGS. 20, 21, and 22, the electronic device may output an image frame for displaying a UI based on a frame rate of 60 Hz in a state 2105 in which one second UI object (2110) is displayed. In state 2205, where the electronic device displays four second UI objects (2210), the electronic device can output image frames for displaying the UI based on a frame rate of 120 Hz, which is higher than 60 Hz.For example, during a slide-in operation on an electronic device, the electronic device may display all of the second UI objects when the fourth housing is fully extended. The electronic device may display some of the second UI objects when the fourth housing is partially retracted, and may hide the second UI objects when the fourth housing (2203) is fully retracted. For example, during a slide-in operation on an electronic device, when the display of the electronic device fully displays the second UI objects, the electronic device may output image frames for displaying the UI based on a frame rate of 120 Hz. When the display of the electronic device partially displays the second UI objects, the electronic device may output image frames for displaying the UI based on a frame rate of 60 Hz, which is lower than 120 Hz.
[0150] According to one embodiment, as illustrated in the drawings of FIG. 20, FIG. 21, or FIG. 22, the area of the visible display (230) may vary based on a slide operation of the electronic device (200), and the number of second UI objects displayed on the display (230) may vary. For example, as illustrated in FIG. 20, FIG. 21, or FIG. 22, the visible area of the fourth housing may vary. The visible area (2210) of the display (230) located on one side of the fourth housing (2203) of FIG. 22 may be wider than the visible area (2110) located on one side of the display (230) of the fourth housing (2103) of FIG. 21. The electronic device (220) may display a greater number of UI objects in the second state (2210) having a wider visible area than in the first state (2110) having a narrower visible area.
[0151] FIG. 23 is a drawing for explaining an example of displaying a second UI object in a wearable electronic device according to one embodiment of the present disclosure.
[0152] According to one embodiment, the wearable electronic device (200) may identify a UI interaction event to display a second UI object, and output image frames for displaying the UI based on different frame rates according to the number of second UI objects. For example, the UI interaction event may be a user's touch input or voice input to the wearable electronic device (200). For example, as illustrated in FIG. 23, the electronic device may display an animation in which second UI objects are gradually displayed in states 2301, 2303, 2305, and 2307 according to the UI interaction event. For example, as illustrated in FIG. 23, the electronic device may output four second UI objects at 60 Hz in state 2303. The electronic device may output seven second UI objects at 90 Hz in state 2305. The electronic device can output 10 secondary UI objects at 120Hz in state 2307.
[0153] An electronic device (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIG. 2) according to various embodiments of the present disclosure may include a display (e.g., a display module (160) of FIG. 1, a display (e.g., a display module (160) of FIG. 1, a display (230) of FIG. 2), at least one processor (e.g., a processor (120) of FIG. 1, a processor (210) of FIG. 2)) and a memory (e.g., a memory (130) of FIG. 1, a memory (220) of FIG. 2)) that stores instructions. The at least one processor (e.g., a processor (120) of FIG. 1, a processor (210) of FIG. 2)) may, when the instructions are executed, display a UI including at least one first UI object through the display (e.g., a display module (160) of FIG. 1, a display (230) of FIG. 2)), and the first UI A UI interaction event that causes at least one second UI object to be displayed or hidden in a displayed state of an object can be identified, and in a state where a first number of UI objects among the at least one second UI object are displayed, an image frame for displaying the UI can be output based on a first frame rate, and in a state where a second number of UI objects, which is greater than the first number of UI objects among the at least one second UI object, an image frame for displaying the UI can be output based on a second frame rate that is higher than the first frame rate.
[0154] In an electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2), the first UI object may include a UI component indicating the presence of at least one second UI object that is not displayed, and the UI interaction event may include a touch input associated with the UI component.
[0155] In an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2), the instructions may be executed by the at least one processor (e.g., the processor (120) of FIG. 1, the processor (210) of FIG. 2) to, in response to the UI interaction event, cause the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2)) to display an animation in which the at least one second UI object is gradually displayed based on at least one of the first frame rate or the second frame rate, and after displaying the animation, cause an image frame including the UI to be output based on a third frame rate lower than the second frame rate.
[0156] In an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2), the instructions may be executed by the at least one processor (e.g., the processor (120) of FIG. 1, the processor (210) of FIG. 2) to determine a time interval for displaying the animation based on a third number of the at least one second UI object, and, within the time interval, determine a first sub-time interval and a second sub-time interval, and display the animation based on the first frame rate during the first sub-time interval, and display the animation based on the second frame rate during the second sub-time interval.
[0157] In an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2), the instructions may be executed by the at least one processor (e.g., the processor (120) of FIG. 1, the processor (210) of FIG. 2) to determine a time interval during which a number of UI objects less than a first threshold value among the at least one second UI object are displayed within the time interval as the first sub-time interval, and to determine a time interval during which a number of UI objects greater than or equal to the first threshold value among the at least one second UI object are displayed within the time interval as the second sub-time interval.
[0158] In an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2), the instructions may be executed by the at least one processor (e.g., the processor (120) of FIG. 1, the processor (210) of FIG. 2) to output an image frame based on a fourth frame rate that is greater than or equal to the second frame rate, when a width of a UI object displayed on the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2) among the at least one second UI object in a reference direction within the screen or an area of a UI object displayed on the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2) among the at least one second UI object) in a screen is equal to or greater than a second threshold value, and when the width or the area is less than the second threshold value, the number of UI objects may be compared with the first threshold value to determine the first sub-time interval or the second sub-time interval.
[0159] In an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2), the instructions may be executed by the at least one processor (e.g., the processor (120) of FIG. 1, the processor (210) of FIG. 2)) to request a value of the number of UI objects displayed on the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2) among the at least one second UI object from a UI framework layer that manages an operation of an animation associated with the UI, and based on the request, obtain a value of the number of UI objects displayed on the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2) among the at least one second UI object from the UI framework layer, and the value of the number may correspond to a value of the number of UI objects, at least a portion of which is displayed on the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2)).
[0160] In an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2), the instructions may be executed by the at least one processor (e.g., the processor (120) of FIG. 1, the processor (210) of FIG. 2) to determine a frame rate for displaying the UI based on the number value, transmit a request including the determined frame rate to a graphics layer, and output an image frame for displaying the UI according to a signal generated by the graphics layer based on the frame rate transmitted to the graphics layer.
[0161] In an electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2), the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2) may further include a first housing and a second housing connected to the first housing via a hinge, and the display (e.g., display module (160) of FIG. 1, display (230) of FIG. 2) may include a flexible display (e.g., display module (160) of FIG. 1, display (230) of FIG. 2)) disposed on at least a portion of the first housing and the second housing, and the instructions may be executed by the at least one processor (e.g., processor (120) of FIG. 1, processor (210) of FIG. 2) to identify the UI interaction event based on a change in an angle between one side of the first housing and one side of the second housing, and based on an increase in the angle, The second UI object can be displayed through a flexible display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2), and the display of the at least one second UI object can be hidden based on a decrease in the angle while the at least one second UI object is displayed through the flexible display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2).
[0162] In an electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2), the instructions may be executed by at least one processor (e.g., processor (120) of FIG. 1, processor (210) of FIG. 2) to display the first number of UI objects while the angle is a first angle, and to display the second number of UI objects while the angle is a second angle greater than the first angle, while the angle is increased.
[0163] In an electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2), the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2) may further include a third housing, a fourth housing coupled with the third housing and coupled to be slidably moved with respect to the third housing, and the display (e.g., display module (160) of FIG. 1, display (230) of FIG. 2)) may include a flexible display (e.g., display module (160) of FIG. 1, display (230) of FIG. 2) disposed on at least a portion of the third housing and the fourth housing, and the instructions are executed by the at least one processor (e.g., processor (120) of FIG. 1, processor (210) of FIG. 2) to cause the fourth housing to slide in a first direction toward the third housing with respect to the third housing, thereby causing the flexible display (e.g., display module (160) of FIG. 1, display (230) of FIG. 2)) to slide with respect to the third housing. The UI interaction event can be identified based on a slide-in operation in which at least a part of the display module (160), the display (230) of FIG. 2) is introduced into the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2) or a slide-out operation in which the fourth housing slides in a second direction opposite to the first direction with respect to the third housing so that at least a part of the flexible display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2) is withdrawn from the inside of the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2)), and based on the identified slide-in operation while displaying the at least one second UI object, the display of the at least one second UI object can be hidden on the flexible display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2)), and based on the slide-out operation,The second UI object can be displayed on the flexible display (e.g., display module (160) of FIG. 1, display (230) of FIG. 2).
[0164] In an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2), the instructions are executed by the at least one processor (e.g., the processor (120) of FIG. 1, the processor (210) of FIG. 2) so that, while the slide-out operation occurs, in a first state in which the area of the flexible display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2) visible from the front of the fourth housing is a first size, the first number of UI objects can be displayed, and in a second state in which the area of the flexible display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2) visible is larger than the first state, the second number of UI objects can be displayed.
[0165] According to one embodiment of the present disclosure, a method of operating an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2) may include an operation of displaying a UI including at least one first UI object through a display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2), an operation of identifying a UI interaction event that causes at least one second UI object to be displayed or hidden in a state in which the first UI object is displayed, an operation of outputting an image frame for displaying the UI based on a first frame rate in a state in which a first number of UI objects among the at least one second UI object are displayed based on the operation of identifying the UI interaction event, and an operation of outputting an image frame for displaying the UI based on a second frame rate that is higher than the first frame rate in a state in which a second number of UI objects greater than the first number of UI objects among the at least one second UI object are displayed based on the operation of identifying the UI interaction event.
[0166] In a method of operating an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2) according to one embodiment, the first UI object may include a UI component that indicates that at least one second UI object that is not displayed exists or indicates that the at least one second UI object that is displayed can be hidden, and the UI interaction event may include a touch input associated with the UI component.
[0167] In an operating method of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2) according to one embodiment, the method may include an operation of displaying an animation in which the at least one second UI object is gradually displayed through the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2) in response to the UI interaction event, based on at least one of the first frame rate or the second frame rate, and an operation of outputting an image frame including the UI based on a third frame rate lower than the second frame rate after displaying the animation.
[0168] In an operating method of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2) according to one embodiment, the method may include an operation of determining a time section for displaying the animation based on a third number of the at least one second UI object, an operation of determining a first sub-time section and a second sub-time section within the time section, an operation of displaying the animation based on the first frame rate during the first sub-time section, and an operation of displaying the animation based on the second frame rate during the second sub-time section.
[0169] In an operating method of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2) according to one embodiment, the method may include an operation of determining, within the time interval, a time interval in which a number of UI objects less than a first threshold value among the at least one second UI object are displayed as the first sub-time interval, and an operation of determining, within the time interval, a time interval in which a number of UI objects greater than or equal to the first threshold value among the at least one second UI object are displayed as the second sub-time interval.
[0170] In an operating method of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2) according to one embodiment, if a width of a UI object displayed on the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2) among the at least one second UI object in a reference direction within a screen or an area of a UI object displayed on the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2) among the at least one second UI object within a screen is equal to or greater than a second threshold value, an operation of outputting an image frame based on a fourth frame rate that is greater than or equal to the second frame rate may be included, and if the width or the area is less than the second threshold value, an operation of comparing the number of UI objects with the first threshold value to determine the first sub-time interval or the second sub-time interval may be included.
[0171] In an operating method of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2) according to one embodiment, the method may include an operation of requesting a UI framework layer that manages an operation of an animation associated with the UI, for a value of the number of UI objects displayed on the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2)) among the at least one second UI object, and an operation of obtaining, from the UI framework layer, a value of the number of UI objects displayed on the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2)) among the at least one second UI object based on the request, and the value of the number may be a value corresponding to a value of the number of UI objects, at least a portion of which is displayed on the display (e.g., the display module (160) of FIG. 1, the display (230) of FIG. 2).
[0172] In an operating method of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2) according to one embodiment, the method may include an operation of determining a frame rate for displaying the UI based on the number value, an operation of transmitting a request including the determined frame rate to a graphics layer, and an operation of outputting an image frame for displaying the UI according to a signal generated by the graphics layer based on the frame rate transmitted to the graphics layer.
[0173] Electronic devices according to various embodiments of the present disclosure (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2) can output image frames by changing the frame rate according to the number of UI objects, thereby limiting unnecessary rendering, thereby reducing the usage of CPU and GPU resources, thereby improving the overall system speed. In addition, by limiting unnecessary rendering, power consumption can be reduced, thereby extending battery life, improving power efficiency, and contributing to improving user experience.
[0174] Electronic devices and their operating methods according to various embodiments of the present disclosure can improve overall system speed by outputting image frames at a frame rate varying according to the number of UI objects, thereby limiting unnecessary rendering, thereby reducing CPU and GPU resource usage. Furthermore, by limiting unnecessary rendering, power consumption can be reduced, thereby extending battery life and improving power efficiency, contributing to an improved user experience.
[0175] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.
[0176] The methods according to the embodiments described in the claims or specification of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.
[0177] When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. The one or more programs stored in the computer-readable storage medium are configured for execution by one or more processors within an electronic device. The one or more programs include instructions that cause the electronic device to execute methods according to embodiments described in the claims or specification of the present disclosure.
[0178] In the present disclosure, the functions or operations performed by the electronic device may be performed by one or more processors executing one or more instructions stored in a memory. The functions or operations of the electronic device mentioned in the present disclosure may be performed by one processor executing one or more instructions, or may be performed by a combination of multiple processors executing one or more instructions. The processor mentioned in the present disclosure may be understood to include circuitry for performing calculations or controlling other components of the electronic device. For example, the one or more processors may include a central processing unit (CPU), a microprocessor unit (MPU), an application processor (AP), a communication processor (CP), a neural processing unit (NPU), a system on a chip (SoC), or an integrated circuit (IC) configured to execute one or more instructions. The one or more processors may be configured to perform the operations of the electronic device described above.
[0179] In the present disclosure, a program (software module, software) may be stored in a non-volatile memory including a random access memory (RAM), a flash memory, a read only memory (ROM), an electrically erasable programmable read only memory (EEPROM), a magnetic disc storage device, a compact disc ROM (CD-ROM), digital versatile discs (DVDs) or other forms of optical storage devices, a magnetic cassette. Or, it may be stored in a memory formed by a combination of some or all of these. The memory may be formed by a single storage medium, or may be formed by a combination of a plurality of storage media. The one or more commands may be stored in a single storage medium, or may be distributed and stored in a plurality of storage media.
[0180] Additionally, the program may be stored on an attachable storage device that is accessible via a communication network such as the Internet, an intranet, a local area network (LAN), a wide LAN (WLAN), or a storage area network (SAN), or a combination thereof. Such a storage device may be connected to a device performing an embodiment of the present disclosure via an external port. Additionally, a separate storage device on the communication network may be connected to a device performing an embodiment of the present disclosure.
[0181] In the specific embodiments of the present disclosure described above, components included in the disclosure are expressed in the singular or plural form, depending on the specific embodiment presented. However, the singular or plural expressions are selected to suit the presented situation for convenience of explanation, and the present disclosure is not limited to singular or plural components. Components expressed in the plural form may be composed of singular elements, or components expressed in the singular form may be composed of plural elements.
[0182] Additionally, in the present disclosure, terms such as “part”, “module”, etc. may refer to a hardware component such as a processor or circuit, and / or a software component executed by a hardware component such as a processor.
[0183] A "component" or "module" may be implemented by a program stored in an addressable storage medium and executed by a processor. For example, a "component" or "module" may be implemented by components such as software components, object-oriented software components, class components, and task components, as well as processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables.
[0184] The specific implementations described in this disclosure are merely exemplary and do not limit the scope of the present disclosure in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted.
[0185] Additionally, in the present disclosure, “comprising at least one of a, b, or c” may mean “comprising only a, including only b, including only c, or including a combination of two or more (including a and b, including b and c, including a and c, or including all of a, b, and c).
[0186] While the detailed description of this disclosure has described specific embodiments, it should be understood that various modifications are possible without departing from the scope of this disclosure. Therefore, the scope of this disclosure should not be limited to the described embodiments, but should be defined not only by the scope of the claims described below, but also by equivalents thereof.
Claims
1. In electronic devices, display; Memory that stores instructions; at least one processor; and The instructions are executed by the at least one processor, such that the electronic device: Through the above display, display a UI including at least one first user interface (UI) object, Based on identifying a UI interaction event that causes at least one second UI object to be shown or hidden while the first UI object is displayed: In a state where a first number of UI objects among the at least one second UI object are displayed, an image frame for displaying the UI is output based on a first frame rate, In a state where a second number of UI objects, which is greater than a first number of at least one second UI object, is displayed, an image frame for displaying the UI is output based on a second frame rate that is higher than the first frame rate. Electronic devices.
2. In claim 1, The first UI object includes a UI component that indicates that at least one second UI object that is not displayed exists or that the at least one second UI object that is displayed can be hidden, The above UI interaction event includes a touch input associated with the UI component. Electronic devices.
3. In claim 1, The instructions are executed by the at least one processor, such that the electronic device: In response to the UI interaction event, display an animation in which the at least one second UI object is gradually displayed through the display based on at least one of the first frame rate or the second frame rate; After displaying the above animation, outputting an image frame including the UI based on a third frame rate lower than the second frame rate. Electronic devices.
4. In claim 3, The instructions are executed by the at least one processor, such that the electronic device: Determine a time interval for displaying the animation based on a third number of at least one second UI object; Within the above time interval, a first sub-time interval and a second sub-time interval are determined, Displaying the animation based on the first frame rate during the first sub-time interval; To display the animation based on the second frame rate during the second sub-time interval; Electronic devices.
5. In claim 4, The instructions are executed by the at least one processor, such that the electronic device: A time interval in which a number of UI objects less than a first threshold value among the at least one second UI object is displayed within the time interval is determined as the first sub-time interval, Determine the time period in which a number of UI objects greater than or equal to the first threshold value among the at least one second UI object is displayed as the second sub-time period within the time period. Electronic devices.
6. In claim 5, The above instructions, when executed by the at least one processor, cause the electronic device to: If the width of the UI object displayed on the display among the at least one second UI object in the reference direction within the screen or the area of the UI object displayed on the display among the at least one second UI object within the screen is greater than or equal to the second threshold value, output an image frame based on a fourth frame rate that is greater than or equal to the second frame rate, If the width or the area is less than the second threshold value, the number of UI objects is compared with the first threshold value to determine the first sub-time interval or the second sub-time interval. Electronic devices.
7. In claim 1, The instructions are executed by the at least one processor, such that the electronic device: Requesting a value of the number of UI objects displayed on the display among the at least one second UI object to the UI framework layer that manages the operation of the animation associated with the UI; Based on the above request, obtain a value of the number of UI objects displayed on the display among the at least one second UI object from the UI framework layer, The above number value corresponds to the number value of UI objects at least partially displayed on the display. Electronic devices.
8. In claim 7, The instructions are executed by the at least one processor, such that the electronic device: Determine the frame rate for displaying the UI based on the above count value, Passing a request including the above-determined frame rate to the graphics layer, Based on the frame rate transmitted to the graphic layer, the graphic layer outputs an image frame for displaying the UI according to a signal generated by the graphic layer. Electronic devices.
9. In claim 1, The electronic device further includes a first housing and a second housing connected to the first housing via a hinge. The display includes a flexible display disposed on at least a portion of the first housing and the second housing, The instructions are executed by the at least one processor, such that the electronic device: Identifying the UI interaction event based on a change in the angle between one side of the first housing and one side of the second housing, Based on the increase of the above angle, the second UI object is displayed through the flexible display, Hiding the display of the at least one second UI object based on a decrease in the angle while displaying the at least one second UI object through the flexible display. Electronic devices.
10. In claim 9, The instructions are executed by the at least one processor, such that the electronic device: As the above angle increases, Displaying the first number of UI objects in a state where the above angle is the first angle, Displaying the second number of UI objects in a state where the second angle is greater than the first angle; Electronic devices.
11. In claim 1, The electronic device further comprises a third housing, a fourth housing coupled with the third housing and slidably coupled with respect to the third housing, The display includes a flexible display disposed on at least a portion of the third housing and the fourth housing, The instructions are executed by the at least one processor, such that the electronic device: The UI interaction event is identified based on a slide-in operation in which the fourth housing slides in a first direction toward the third housing with respect to the third housing so that at least a portion of the flexible display is introduced into the electronic device, or a slide-out operation in which the fourth housing slides in a second direction opposite to the first direction with respect to the third housing so that at least a portion of the flexible display is withdrawn from the inside of the electronic device. Hiding the display of the at least one second UI object on the flexible display based on the identified slide-in action while displaying the at least one second UI object; Based on the slide-out action, displaying the second UI object on the flexible display. Electronic devices.
12. In claim 11, The instructions are executed by the at least one processor, such that the electronic device: While the above slide-out action is taking place, In a first state where the area of the flexible display recognizable from the front of the fourth housing is a first size, the first number of UI objects are displayed, In a second state in which the area of the flexible display that can be recognized is larger than that of the first state, the second number of UI objects are displayed. Electronic devices.
13. In the method of operating an electronic device, An act of displaying a UI including at least one first user interface (UI) object via a display; An action to identify a UI interaction event that causes at least one second UI object to be displayed or hidden while the first UI object is displayed; An operation of displaying a first number of UI objects among the at least one second UI object based on an identifying operation of the UI interaction event, and outputting an image frame for displaying the UI based on a first frame rate; and A method comprising: an operation of displaying a second number of UI objects, which is greater than a first number of UI objects, among the at least one second UI object, based on an identifying operation of the UI interaction event; and an operation of outputting an image frame for displaying the UI based on a second frame rate higher than the first frame rate.
14. In claim 13, In response to the UI interaction event, an operation of displaying an animation in which the at least one second UI object is gradually displayed through the display based on at least one of the first frame rate or the second frame rate; and A method comprising, after displaying the above animation, an operation of outputting an image frame including the UI based on a third frame rate lower than the second frame rate.
15. In claim 14, An operation of determining a time interval for displaying the animation based on a third number of at least one second UI object; Within the above time interval, an operation of determining a first sub-time interval and a second sub-time interval; An operation of displaying the animation based on the first frame rate during the first sub-time interval; and A method comprising an action of displaying the animation based on the second frame rate during the second sub-time interval.
Citation Information
Patent Citations
Image display apparatus and method for operating the same
KR1020120023892A
Display panel and display panel test system
KR102507125B1
Mold structure for brazing filler wire, method for brazing filler wire using for thereof, ring filler material manufactured by using the brazing filler wire and method for ring filler material using for thereof
KR102844359B1
Dynamic Display Refresh Rate Based On Device Motion
US20150348511A1
Timing scheme for touch screen supporting variable refresh rate
US20160370915A1