Method for controlling window and electronic device thereof

By using a movable housing and processor in an electronic device to adjust the resolution of the display content in real time, the problem of unnatural window optimization when the state of the flexible display is changed is solved, and user experience and efficiency are improved.

CN114449073BActive Publication Date: 2024-11-22SAMSUNG ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110544473.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-10-19
Filing Date
2021-05-19
Publication Date
2024-11-22
Estimated Expiration
2041-05-19

AI Technical Summary

Technical Problem

In electronic devices of flexible displays, window optimization takes more time when state changes, resulting in a reduced user experience, especially when the window is unnatural during stretching or retraction.

Method used

An electronic device is designed, including a movable first and second housing, a display and a processor that adjusts the resolution of content in real time according to changes in the display area to match the extended or retracted area size of the display, ensuring that Natural optimization of windows when state changes.

Benefits of technology

It realizes a stable display window when the state of the flexible display changes, improves user experience, reduces window optimization time, and improves the efficiency of electronic devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114449073B_ABST
    Figure CN114449073B_ABST
Patent Text Reader

Abstract

An electronic device includes a first housing and a second housing overlapping the first housing. The electronic device includes a display having a first area and a second area. The electronic device includes a processor configured to: control the display to display at least one content. The processor is configured to determine the first content and the second content. The processor is configured to recognize that the area of ​​the display is extended. In response to recognizing that the area of ​​the display is extended, the processor is configured to change the resolution of the first content to correspond to the size of the extended area of ​​the display when the display is extended. The processor is configured to change the resolution of the second content to correspond to the size of the extended area of ​​the display after the extension of the display is completed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Various embodiments of the present disclosure are directed to a technology of controlling a screen of an electronic device provided with a flexible display. Background Art

[0002] Electronic devices are provided with complex functions, such as taking photos or making videos, playing music files or video files, playing games, receiving broadcasts, supporting wireless Internet, etc., and are implemented in the form of integrated multimedia players. Therefore, electronic devices are developing new forms in hardware or software to improve portability and convenience while meeting user expectations. As an example of such development, electronic devices can be implemented in a rollable type including a flexible display.

[0003] The above information is presented as background information only to assist with understanding the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with respect to the present disclosure. Summary of the invention

[0004] A rollable electronic device including a flexible display can have its mechanical state changed by a user gesture. In addition, the rollable electronic device can control the operation of the electronic device based on the change of state. For example, the rollable electronic device can change from a state in which a portion of the flexible display is rolled into the electronic device to a state in which the portion is rolled out. When the rollable electronic device changes the resolution of the display in the middle of changing its state, the electronic device can simultaneously refine at least one window displayed on the display. In this case, more time may be required to optimize the window or the window may be optimized unnaturally (e.g., optimized at long time intervals), so the user experience may be reduced.

[0005] Various embodiments of the present disclosure may provide that, when a state of an electronic device including a flexible display is changed, a window is stably displayed for a user in the electronic device.

[0006] In an embodiment, an electronic device includes: a first shell; a second shell that at least partially overlaps with the first shell and is movable; a display having at least a first area exposed to the outside of the electronic device through the front surface of the electronic device and a second area extending from the first area of ​​the display, when the electronic device switches from a first state to a second state, the second area is pulled out from the inside of the first shell and exposed to the outside of the electronic device together with the first area, and when the electronic device switches from the second state to the first state, the second area is pulled into the first shell; and at least one processor operably connected to the display, wherein the at least one processor is configured to: control the display to display multiple contents on the display; determine a first content among the multiple contents and a second content different from the first content based on attribute information of each of the multiple contents; when the multiple contents are displayed on the display, identify that an area of ​​the display is extended; in response to identifying that the area of ​​the display is extended, change the resolution of the first content to correspond to the size of the extended area of ​​the display when the display is extended; and after the extension of the display is completed, change the resolution of the second content to correspond to the size of the extended area of ​​the display.

[0007] According to an embodiment, an operating method of an electronic device includes: controlling a display to display multiple contents on the display; determining a first content among the multiple contents, and a second content different from the first content, based on attribute information of each of the multiple contents; when the multiple contents are displayed on the display, identifying that an area of ​​the display is extended; in response to identifying that the area of ​​the display is extended, changing the resolution of the first content when the display is extended to correspond to the size of the extended area of ​​the display; and after the extension of the display is completed, changing the resolution of the second content to correspond to the size of the extended area of ​​the display.

[0008] According to an embodiment, an electronic device includes: a first housing; a second housing that at least partially overlaps with the first housing and is movable; a display having at least a first area exposed to the outside of the electronic device through a front surface of the electronic device and a second area extending from the first area of ​​the display, wherein when the electronic device is switched from a first state to a second state, the second area is pulled out from the inside of the first housing and exposed to the outside of the electronic device together with the first area, and when the electronic device is switched from the second state to the first state, the second area is pulled into the first housing; and at least one processor operably connected to the display, wherein the at least one processor is The invention is configured to: control a display to display a plurality of contents on the display; determine a first content among the plurality of contents, and a second content different from the first content, based on attribute information of each of the plurality of contents; identify that an area of ​​the display is retracted when the plurality of contents are displayed on the display; in response to identifying that the area of ​​the display is retracted, change a resolution of the first content to correspond to a size of the retracted area of ​​the display when the display is retracted; and change a resolution of the second content to correspond to a size of the retracted area of ​​the display from a time when a length of the display exposed to the outside in a retracted direction is shorter than a length of a window displaying the second content in the retracted direction.

[0009] Before proceeding to the following detailed description, it may be helpful to set forth definitions of certain words and phrases used throughout this patent document: the terms "include" and "comprise" and their derivatives mean including but not limited; the term "or" is inclusive, meaning and / or; the phrases "associated with" and "associated with" and their derivatives refer to including, included within, interconnected with, containing, contained within, connected to or connected with, coupled to or coupled with, communicable with, cooperating with, interleaved with, juxtaposed with, adjacent to, bound to or bound with, having, having properties thereof, etc.; and the term "controller" refers to any device, system, or portion thereof that controls at least one operation, which device may be implemented in hardware, firmware, or software, or some combination of at least two of them. It should be noted that the functionality associated with any particular controller may be centralized or distributed, whether locally or remotely.

[0010] In addition, various functions described below can be implemented or supported by one or more computer programs, each of which is formed by a computer-readable program code and implemented with a computer-readable medium. The terms "application" and "program" refer to one or more computer programs, software components, instruction sets, processes, functions, objects, classes, examples, related data, or a part thereof that are suitable for being implemented with a suitable computer-readable program code. The phrase "computer-readable program code" includes any type of computer code, including source code, object code, and executable code. The phrase "computer-readable medium" includes any type of medium that can be accessed by a computer, such as a read-only memory (ROM), a random access memory (RAM), a hard drive, a compact disk (CD), a digital video disk (DVD), or any other type of memory. "Non-temporary" computer-readable medium excludes wired, wireless, optical, or other communication links that transmit temporary electrical signals or other signals. Non-temporary computer-readable medium includes a medium that can permanently store data, and a medium in which data can be stored and overwritten later, such as a rewritable optical disk or an erasable memory device.

[0011] Definitions for certain words and phrases are provided throughout this patent document, those of ordinary skill in the art should understand that in many, if not most instances, such definitions apply to prior, as well as future uses of such defined words and phrases. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] For a more complete understanding of the present disclosure and advantages thereof, reference is now made to the following description taken in conjunction with the accompanying drawings, in which like reference numerals represent like parts:

[0013] Figure 1A A front perspective view showing a first state (eg, a retracted state) of an electronic device according to an embodiment;

[0014] Figure 1B A front perspective view showing a second state (eg, extended state) of the electronic device according to an embodiment;

[0015] Figure 2A shows a cross-sectional view of an electronic device in a first state (eg, a retracted state) according to another embodiment;

[0016] Figure 2B shows a cross-sectional view of an electronic device in a second state (eg, an extended state) according to another embodiment;

[0017] Figure 3 A block diagram of an electronic device in another network environment according to an embodiment is shown;

[0018] Figure 4 A block diagram showing hardware of an electronic device according to an embodiment;

[0019] Figure 5 shows a block diagram of software modules according to an embodiment;

[0020] Fig. 6A A flowchart illustrating an operation of selectively changing a resolution according to a content attribute in an electronic device according to an embodiment;

[0021] Figure 6B A flowchart illustrating an operation of selectively changing resolution according to content attributes in an electronic device according to another embodiment;

[0022] Figure 7 A flowchart showing an operation of processing an event according to an extended state of a display in an electronic device according to an embodiment;

[0023] Figure 8 A flowchart showing an operation of optimizing the size of a window on which content is displayed in an electronic device according to an embodiment;

[0024] Fig. 9 A flowchart illustrating an operation of optimizing a resizing mode of a display in an electronic device according to an embodiment;

[0025] Fig.10 A view showing that a resolution of each content changes when an electronic device is extended according to an embodiment; and

[0026] Fig.11 A view showing that a resolution of each content is changed when an electronic device is retracted according to an embodiment.

[0027] With regard to the description of the drawings, the same or similar reference numerals may be used for the same or similar components. DETAILED DESCRIPTION

[0028] The following discussed in this patent document Figures 1A to 11 The various embodiments used to describe the principles of the present disclosure are for illustration only and should not be construed in any way as limiting the scope of the present disclosure. Those skilled in the art will appreciate that the principles of the present disclosure can be implemented in any appropriately arranged system or device.

[0029] Figure 1A A front perspective view showing a first state (eg, a retracted state) of the electronic device 100 according to an embodiment is shown. Figure 1B A front perspective view showing a second state (eg, extended state) of the electronic device 100 according to an embodiment.

[0030] According to various embodiments disclosed in the present disclosure, a surface facing a direction substantially the same as a direction of at least a portion (e.g., the first portion 121) of the flexible display 120 of the electronic device may be defined as a front surface of the electronic device 100, and an opposite surface of the front surface may be defined as a rear surface of the electronic device 100. A surface surrounding a space between the front surface and the rear surface may be defined as a side surface of the electronic device 100.

[0031] The flexible display 120 may be arranged on at least a portion of the electronic device 100 according to an embodiment. According to an embodiment, the flexible display 120 may be arranged to include at least some planar shapes and at least some curved shapes. According to an embodiment, the flexible display 120 and the slidable housing 110 surrounding at least a portion of the periphery of the flexible display 120 may be arranged on the front surface of the electronic device 100.

[0032] According to an embodiment, the slidable housing 110 may form a front surface (eg, a surface facing the electronic device 100). Figure 1A and Figure 1B The surface in the +z direction), the rear surface (eg, the surface facing the electronic device 100 Figure 1A and Figure 1B According to another embodiment, the slidable housing 110 may form some areas of the side surface and the rear surface of the electronic device 100.

[0033] According to an embodiment, the slidable housing 110 may include a first housing 111 and a second housing 112 coupled to be movable within a predetermined range with respect to the first housing 111 .

[0034] According to an embodiment, the flexible display 120 may include a first portion 121 coupled to the second housing 112 , and a second portion 122 extending from the first portion 121 and pulled into the electronic device 100 .

[0035] According to an embodiment, the electronic device 100 may include a first state 100a and a second state 100b. For example, the first state 100a and the second state 100b of the electronic device 100 may be determined according to the relative position of the second housing 112 with respect to the slidable housing 110, and the electronic device 100 may be configured to be changeable between the first state 100a and the second state 100b by a user operation or a mechanical operation.

[0036] According to an embodiment, the first state 100a of the electronic device 100 may refer to a state before the slidable housing 110 is extended. The second state 100b of the electronic device 100 may refer to a state in which the slidable housing 110 is extended.

[0037] According to an embodiment, when the electronic device 100 switches from the first state 100a to the second state 100b according to the movement of the second housing 112, the second portion 122 of the flexible display 120 may be pulled out (or exposed) from the inside of the electronic device 100 to the outside. According to an embodiment, the flexible display 120 being pulled out (or exposed) may mean that the flexible display 120 is viewable from the outside of the electronic device 100. In another embodiment, when the electronic device 100 switches from the second state 100b to the first state 100a according to the movement of the second housing 112, the second portion 122 of the flexible display 120 may be pulled into the electronic device 100. According to an embodiment, the flexible display 120 being pulled in may mean that the flexible display 120 is not viewable from the outside of the electronic device 100.

[0038] Figure 2A A cross-sectional view of an electronic device in a first state (eg, a retracted state) according to an embodiment is shown. Figure 2B A cross-sectional view of the electronic device in a second state (eg, extended state) according to an embodiment is shown. The description of the electronic device 100 may be applied to the electronic device 200 described below.

[0039] According to an embodiment, the first state may be referred to as a first shape, and the second state may be referred to as a second shape. For example, the first shape may include a normal state, a retracted state, or a closed state, and the second shape may include an extended state or an open state.

[0040] refer to Figure 2A and Figure 2B , the electronic device 200 according to the embodiment may include a first housing 211 , a second housing 212 , a display 220 , a roller 240 , a sensor 250 , and a scroll track 260 .

[0041] According to an embodiment, the first housing 211 may form at least a portion of a side surface and / or a rear surface of the electronic device 200. According to an embodiment, the second housing 212 may form at least a portion of a front surface and / or a side surface of the electronic device 200. According to an embodiment, the display 220 may be coupled to at least a portion of the second housing 212.

[0042] According to an embodiment, some areas of the display 220 may be arranged to overlap with the second housing 212. For example, at least some areas of one surface of the display 220 may be located on at least some areas of the front surface of the second housing 212, and the other surface may be arranged to be exposed to the outside.

[0043] According to an embodiment, the rolling track 260 may include a plurality of joint structures 261 and a support plate 262. In an example, some areas of the plurality of joint structures 261 may have their shapes deformed during the process of switching the state of the electronic device 200. For example, in the process of the electronic device 200 switching from the first state 200a to the second state 200b or from the second state 200b to the first state 200a, some areas of the plurality of joint structures 261 may be bent or unbend to have a specified curvature. According to another embodiment, the second housing 212 may be fixed or coupled to one end of the plurality of joint structures 261, and a portion of the first portion 221 of the display 220 may be arranged on the upper end of the second housing 212. In another example, the support plate 262 may be fixed or coupled to one end of the plurality of joint structures 261.

[0044] According to an embodiment, the roller 240 may contact the plurality of engagement structures 261 of the rolling track 260, and the rolling track 260 may move within a specified range by the rotation of the roller 240. For example, when the roller 240 rotates in a clockwise direction during the process of switching the electronic device 200 from the first state 200a to the second state 200b, some areas of the plurality of engagement structures 261 that have been bent may be straightened, and the rolling track 260 may move in a first direction (e.g., a direction away from the roller 240). In another example, when the roller 240 rotates in a counterclockwise direction during the process of switching the electronic device 200 from the second state 200b to the first state 200a, some areas of the plurality of engagement structures 251 that have been straightened may be bent, and the rolling track 260 may move in a second direction (e.g., a direction opposite to the first direction). According to an embodiment, since the shapes of some areas of the plurality of joining structures 261 are deformed during the state change of the electronic device 200 , the shape of the second portion 222 of the display 220 supported by the plurality of joining structures 261 may be deformed to correspond to the shapes of the plurality of joining structures 261 .

[0045] According to an embodiment, the display 220 may be arranged on the outer circumference of the rolling track 260, and the display 220 may move along the rolling track 260 by the rotation of the roller 240. According to an embodiment, the display 220 may include a first portion 221 and / or a second portion 222 whose shape is deformed according to the state of the electronic device 220.

[0046] According to an embodiment, the first portion 221 of the display 220 may be located on the upper end of the second housing 212 and some areas of the plurality of joint structures 261 to be supported by the second housing 212 and the plurality of joint structures 261. In an example, the first portion 221 of the display 220 may be exposed to the outside of the electronic device 200 regardless of the state of the electronic device 200 (e.g., the first state or the second state).

[0047] According to an embodiment, the second portion 222 of the display 220 may be located on the upper end of some areas of the plurality of joint structures 261 of the rolling track 260 to be supported by the plurality of joint structures 261. In an example, the second portion 222 of the display 220 may be exposed to the outside of the electronic device 200 or not exposed to the outside according to the state of the electronic device 200.

[0048] For example, when the electronic device 200 is in the first state 200a, the second portion 222 of the display 220 may be supported by the plurality of engagement structures 261 and may be stored in the internal space of the electronic device 200 while being wound around the rotation axis of the roller 240, and as a result, the second portion 222 may not be exposed to the outside of the electronic device 200. In another example, when the electronic device 200 is switched from the first state 200a to the second state 200b, a region of the second portion 222 of the display 220 adjacent to the first portion 221 may be pulled out from the inside of the electronic device 200. Since some regions of the second portion 222 adjacent to the first portion 221 are pulled out from the inside of the electronic device 200, the display region of the display 220 exposed to the outside of the electronic device 200 may be extended. In another example, when the electronic device 200 is deformed from the second state 200b to the first state 200a, a region of the second portion 222 adjacent to the support plate 262 and exposed to the outside of the electronic device 200 may be retracted into the electronic device 200. Since some areas of the second portion 222 adjacent to the support plate 262 are retracted into the electronic device 200 , a display area of ​​the display 220 exposed to the outside of the electronic device 200 may be reduced.

[0049] The electronic device 200 according to various embodiments is not limited to Figure 2A and Figure 2B For example, the display 220 may be arranged to surround most of the front surface and a portion of the rear surface of the electronic device 200, so that even in the first state 200a, some areas of the display 220 are exposed to the outside on the rear surface.

[0050] According to an embodiment, at least one sensor 250 may be located in the electronic device 200. The electronic device 200 may detect a state change of the electronic device 200 by using the at least one sensor 250. According to the embodiment, the at least one sensor 250 may include at least one of a Hall sensor and a distance sensor, but is not limited thereto. For example, the at least one sensor 250 may include at least one of an optical sensor, an ultrasonic distance sensor, and a propagation distance sensor to detect the state of the electronic device 200 (e.g., the pulled-out, retracted state of the housing of the electronic device) or the moving distance of the second housing 212.

[0051] Figure 3is a block diagram illustrating an electronic device 301 in a network environment 300 according to various embodiments. Figure 3 , the electronic device 301 in the network environment 300 may communicate with the electronic device 302 via a first network 398 (e.g., a short-range wireless communication network), or communicate with at least one of the electronic device 304 or the server 308 via a second network 399 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 301 may communicate with the electronic device 304 via the server 308. According to an embodiment, the electronic device 301 may include a processor 320, a memory 330, an input module 350, a sound output module 355, a display module 360, an audio module 370, a sensor module 376, an interface 377, a connection terminal 378, a haptic module 379, a camera module 380, a power management module 388, a battery 389, a communication module 390, a user identification module (SIM) 396, or an antenna module 397. In some embodiments, at least one of the above components (e.g., the connection terminal 378) may be omitted from the electronic device 301, or one or more other components may be added to the electronic device 301. In some embodiments, some of the above-described components (eg, sensor module 376, camera module 380, or antenna module 397) may be implemented as a single integrated component (eg, display module 360).

[0052] The processor 320 may run, for example, software (e.g., program 340) to control at least one other component (e.g., hardware component or software component) of the electronic device 301 connected to the processor 320, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 320 may store a command or data received from another component (e.g., sensor module 376 or communication module 390) in a volatile memory 332, process the command or data stored in the volatile memory 332, and store the resultant data in a non-volatile memory 334. According to an embodiment, the processor 320 may include a main processor 321 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 323 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 321 in operation. For example, when the electronic device 301 includes a main processor 321 and an auxiliary processor 323, the auxiliary processor 323 may be adapted to consume less power than the main processor 321, or adapted to be dedicated to a specific function. The auxiliary processor 323 may be implemented as a separate part from the main processor 321, or as part of the main processor 321.

[0053] When the main processor 321 is in an inactive (e.g., sleep) state, the auxiliary processor 323 (rather than the main processor 321) may control at least some of the functions or states related to at least one component among the components of the electronic device 301 (e.g., display module 360, sensor module 376, or communication module 390), or when the main processor 321 is in an active state (e.g., running an application), the auxiliary processor 323 may control at least some of the functions or states related to at least one component among the components of the electronic device 301 (e.g., display module 360, sensor module 376, or communication module 390) together with the main processor 321. According to an embodiment, the auxiliary processor 323 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., a camera module 380 or a communication module 390) that is functionally related to the auxiliary processor 323. According to an embodiment, the auxiliary processor 323 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model may be generated by machine learning. For example, such learning may be performed by the electronic device 301 where the artificial intelligence is executed or via a separate server (e.g., server 308). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, for example. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q network or a combination of two or more thereof, but is not limited thereto. Additionally or alternatively, the artificial intelligence model may include a software structure in addition to a hardware structure.

[0054] The memory 330 may store various data used by at least one component of the electronic device 301 (e.g., the processor 320 or the sensor module 376). The various data may include, for example, software (e.g., the program 340) and input data or output data for commands related thereto. The memory 330 may include a volatile memory 332 or a non-volatile memory 334.

[0055] The program 340 may be stored as software in the memory 330 , and may include, for example, an operating system (OS) 342 , middleware 344 , or an application 346 .

[0056] The input module 350 may receive commands or data to be used by other components (e.g., the processor 320) of the electronic device 301 from outside (e.g., a user) of the electronic device 301. The input module 350 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).

[0057] The sound output module 355 can output a sound signal to the outside of the electronic device 301. The sound output module 355 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive an incoming call. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as part of the speaker.

[0058] The display module 360 ​​may visually provide information to the outside (e.g., user) of the electronic device 301. The display device 360 ​​may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 360 ​​may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of a force caused by a touch.

[0059] The audio module 370 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 370 may obtain sound via the input module 350, or output sound via the sound output module 355 or an earphone of an external electronic device (e.g., electronic device 302) directly (e.g., wired) connected to the electronic device 301 or wirelessly connected thereto.

[0060] The sensor module 376 may detect an operating state (e.g., power or temperature) of the electronic device 301 or an environmental state (e.g., a state of a user) outside the electronic device 301, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 376 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0061] The interface 377 may support one or more specific protocols to be used to connect the electronic device 301 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 302). According to an embodiment, the interface 377 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0062] The connection end 378 may include a connector, wherein the electronic device 301 can be physically connected to an external electronic device (e.g., the electronic device 302) via the connector. According to an embodiment, the connection end 378 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0063] The haptic module 379 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 379 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0064] The camera module 380 may capture a still image or a moving image. According to an embodiment, the camera module 380 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0065] The power management module 388 may manage power supply to the electronic device 301. According to an embodiment, the power management module 388 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0066] The battery 389 may power at least one component of the electronic device 301. According to an embodiment, the battery 389 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0067] The communication module 390 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 301 and an external electronic device (e.g., electronic device 302, electronic device 304, or server 308), and perform communication via the established communication channel. The communication module 390 may include one or more communication processors capable of operating independently from the processor 320 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 390 may include a wireless communication module 392 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 394 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 398 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 399 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 392 can identify and authenticate the electronic device 301 in a communication network (such as the first network 398 or the second network 399) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 396.

[0068] The wireless communication module 392 can support 5G networks after 4G networks and next-generation communication technologies (e.g., new radio (NR) access technology). NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 392 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 392 can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 392 can support various requirements specified in the electronic device 301, an external electronic device (e.g., electronic device 304), or a network system (e.g., a second network 399). According to an embodiment, the wireless communication module 392 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip).

[0069] The antenna module 397 may transmit a signal or power to the outside of the electronic device 301 (e.g., an external electronic device) or receive a signal or power from the outside of the electronic device 301 (e.g., an external electronic device). According to an embodiment, the antenna module 397 may include an antenna including a radiating element, the radiating element being formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 397 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 398 or the second network 399) may be selected from the plurality of antennas by, for example, the communication module 390 (e.g., the wireless communication module 392). A signal or power may then be transmitted or received between the communication module 390 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as a part of the antenna module 397.

[0070] According to various embodiments, the antenna module 397 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a specified high frequency band (e.g., millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., top surface or side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the specified high frequency band.

[0071] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0072] According to an embodiment, a command or data may be sent or received between the electronic device 301 and the external electronic device 304 via the server 308 connected to the second network 399. Each of the electronic device 302 or the electronic device 304 may be a device of the same type as the electronic device 301, or a device of a different type from the electronic device 301. According to an embodiment, all or some operations to be executed in the electronic device 301 may be executed in one or more of the external electronic device 302, the external electronic device 304, or the server 308. For example, if the electronic device 301 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 301 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 301 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices receiving the request may execute at least part of the function or service requested, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 301. The electronic device 301 may provide the result as at least a partial reply to the request in the case of further processing the result or in the case of not further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology or client-server computing technology, for example, may be used. The electronic device 301 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 304 may include an Internet of Things (IoT) device. The server 308 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 304 or the server 308 may be included in the second network 399. The electronic device 301 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars or health care) based on 5G communication technology or IoT-related technologies.

[0073] Figure 4 A block diagram illustrating hardware of an electronic device according to an embodiment.

[0074] refer to Figure 4 , the electronic device 400 (eg, Figure 1A and Figure 1B The electronic device 100, or Figure 2A and Figure 2B The electronic device 200, or Figure 3 The electronic device 301 may include a bus 410, a sensor module 420, a processor 430, a display 440, a memory 450, and a communication interface 460. Figure 4 In addition to the components shown, the electronic device 400 may include additional components, or the electronic device 400 may omit the components shown. Figure 4 At least one of the components shown.

[0075] According to an embodiment, the bus 410 may include, for example, a circuit that connects components (eg, 420 to 460 ) to each other and transmits signals (eg, control messages and / or data) between the components.

[0076] According to an embodiment, the sensor module 420 may include at least one of a time of flight (ToF) sensor, a sliding sensor, a light sensor, a Hall sensor, and a motion sensor, but is not limited thereto. According to an embodiment, the sensor module 420 may include at least one of an optical sensor, an ultrasonic distance sensor, and a propagation distance sensor, which detects the state of the electronic device 400 or the moving distance of the housing. According to an embodiment, the sensor module 420 may transmit a signal detected by at least one sensor through the bus 410.

[0077] According to an embodiment, the processor 430 may perform calculations or data processing related to control and / or communication of at least one other component of the electronic device 400. According to an embodiment, the processor 510 may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), a microcontroller unit (MCU), a sensor hub, a supplemental processor, a communication processor, an application processor, an application specific integrated circuit (ASIC), and a field programmable gate array (FPGA), and may have multiple cores.

[0078] According to an embodiment, the processor 430 may identify the attributes of a plurality of contents including the first content and the second content. For example, the attributes of the content may include at least one of the size of the window displaying the content and the designated priority given to the content. According to an embodiment, when the state of the electronic device 400 changes, the processor 430 may selectively control the resolution of the content based on the attributes of the content. Fig. 6A , Figure 6B , Figure 7 , Figure 8 , Fig. 9 and Fig.10 The operation of the processor 430 will be described in detail.

[0079] According to an embodiment, the memory 450 may include a volatile memory and / or a non-volatile memory. According to an embodiment, the memory 450 may store commands or data related to at least one other component of the electronic device 400. For example, the memory 450 may store commands or data received from the processor 430 or generated by the processor 430 or other components. According to an embodiment, the memory 450 may store state information of the electronic device 400 as information including at least one of a static value and a dynamic state, which is obtained by using at least one sensor included in the sensor module 420. For example, the memory 450 may store a value corresponding to an area (area) of the display area exposed to the outside, and may store a value corresponding to a moving distance of the second shell moving about the first shell. In another example, the memory 450 may store the state of the electronic device 400 as information corresponding to one of a fully retracted state, a fully extended state, a partially extended state, and a partially retracted state.

[0080] According to an embodiment, the display 440 may display various contents (e.g., text, images, videos, icons, and / or symbols) to the user. For example, the display 440 may include a touch screen. According to an embodiment, the display 440 may receive a touch, gesture, approach, or hover input using an electronic pen or a part of the user's body.

[0081] The communication interface 460 may establish communication between the electronic device 400 and an external electronic device 464 or a server 466. For example, the communication interface 460 may be connected to the network 462 through wireless communication or wired communication to communicate with the external electronic device 464 or the server 466. For example, the communication interface 460 may communicate with the external electronic device 464 through short-range communication.

[0082] Figure 5 A block diagram of software modules according to an embodiment is shown.

[0083] refer to Figure 5 , the software modules of the electronic device 400 may include an input device driver 501, an event center 503, an input dispatcher 505, an input manager 507, a sensor driver 509, a sensor manager 511, a display extension state manager 513, a power controller 515, a power manager 517, a display manager 519, a window manager 521, a layout policy module 523, a buffer queue 525, a hardware renderer 527, a graphics synthesizer 529, a frame buffer driver 531, and an application 540. For example, the processor 430 of the electronic device 400 may implement the program or instruction stored in the memory 450 Figure 5 The various software modules described in .

[0084] In various embodiments, in addition to Figure 5 In addition to the components shown, the electronic device 400 may include additional components, or the electronic device 400 may omit the components shown. Figure 5 At least one of the components shown.

[0085] According to an embodiment, the input device driver 501 may receive various inputs. For example, the input device driver 501 may receive a touch input, a key input, a mouse input. According to an embodiment, the input device driver 501 may be omitted.

[0086] According to an embodiment, the event center 503 may receive events generated in various modules (such as a touch module and a sensor module), and may convert the events into standard input events of an operating system (OS).

[0087] According to an embodiment, the input dispatcher 505 may dispatch or send the input event to an event processing module of the system and / or application.

[0088] According to an embodiment, the input manager 507 may provide information of the input device, and may configure the viewport information of the display to interpret the raw data obtained from the input device. According to an embodiment, the viewport of the display may refer to the resolution information of the display. For example, the viewport may refer to information for converting a value (e.g., a physical distance) input from the input device into pixels corresponding to the resolution of the display.

[0089] According to an embodiment, the sensor driver 509 may control various sensors (such as ToF sensor, light sensor, bending sensor, Hall sensor, motion sensor) to detect the extended state of the display. According to an embodiment, the sensor driver 509 may provide information related to the state change of the electronic device to the sensor manager 511.

[0090] According to an embodiment, the sensor manager 511 may convert events generated in various sensors into standardized sensor events suitable for the OS through a conversion process such as fusing, and may control the events.

[0091] According to an embodiment, the display extension state manager 513 may analyze at least one sensor event, may determine the current extended state of the display, and may provide information to a module requesting the information. According to an embodiment, the display extension state manager 513 may control to stop or resume sending input events through the input manager 507 according to the extended state of the display.

[0092] According to an embodiment, the power controller 515 may control the power provided to system circuits, such as a CPU or a bus (eg, Figure 4 bus 410), and power supplied to the display.

[0093] According to an embodiment, the power manager 517 may manage at least one of battery capacity, temperature, and power based on a system state, and may determine or provide relevant information for the operation of the electronic device by using corresponding information.

[0094] According to an embodiment, the display manager 519 may manage hardware display mapping to output the life and screen GUI elements of the electronic device. According to an embodiment, the display manager 519 may change the display to be output through a system event.

[0095] According to an embodiment, the window manager 521 may manage at least one GUI resource used on the screen. According to an embodiment, the window manager 521 may change the size of the window in response to receiving information related to a state change of the electronic device.

[0096] According to an embodiment, the layout policy module 523 may control the window layout according to the extended state of the display. For example, the layout policy module 523 may control at least one of the position, size, and rotation processing of the layout.

[0097] According to an embodiment, the buffer queue 525 may control the memory buffer to transmit the graphic data obtained from a producer (eg, an application) to the graphic synthesizer 529 .

[0098] According to an embodiment, the hardware renderer 527 may be an acceleration module that inputs various graphic elements generated in an application to the buffer queue 525 to be sent to the graphic synthesizer 529 .

[0099] According to an embodiment, the graphics synthesizer 529 may combine graphics bitmap information acquired from various sources, and may output one piece of bitmap information to be output to a display.

[0100] According to an embodiment, the frame buffer driver 531 may control a buffer containing graphic information to be output to a display.

[0101] Fig. 6A A flowchart of an operation of selectively changing resolution according to content attributes in an electronic device according to an embodiment is shown. In the following embodiments, the various operations may be performed sequentially, but may not necessarily be performed sequentially. For example, the order of the various operations may be changed, and at least two operations may be performed in parallel.

[0102] refer to Fig. 6A In operation 610, a processor according to an embodiment (eg, Figure 4 The processor 430 may be displayed via a display (e.g., Figure 4The display 440 of the display 440 displays at least one content. According to an embodiment, the content displayed on the display 440 may include an image, text, video, contact, audio, icon, project, label (tab), or a combination of these. According to an embodiment, the window displaying the content may have a fixed size or may have a variable size proportional to the size of the content. For example, the window may include at least one of a page, a list view, a document, and a frame displaying the content.

[0103] According to an embodiment, the processor 430 may determine the first content and the second content based on content attributes in operation 620. For example, the content attributes may include at least one of the size of the window displaying the content and the priority given to the content (eg, processing order).

[0104] According to an embodiment, the electronic device 400 may extend in a first direction (e.g., horizontal direction). According to an embodiment, the processor 430 may determine the content displayed on the following window as the first content, the first direction length (e.g., horizontal length) of the window being equal to or longer than the first direction length of the display area of ​​the display exposed to the outside in the first state (e.g., retracted state). According to another embodiment, the electronic device 400 may extend in a third direction (e.g., vertical direction). According to an embodiment, the processor 430 may determine the content displayed on the following window as the first content, the third direction length (e.g., vertical length) of the window being equal to or longer than the third direction length of the display area of ​​the display exposed to the outside in the first state.

[0105] According to another embodiment, the processor 430 may determine content having a high designated priority as the first content, and may determine content having a lower designated priority than the first content as the second content.

[0106] According to an embodiment, in operation 630, the processor 430 may recognize that the display area exposed to the outside of the electronic device is extended. According to an embodiment, the processor 430 may recognize that the display area exposed to the outside of the electronic device is extended by using a sliding portion or a roller (eg, Figure 2A and Figure 2BA touch sensor on the roller 240 of the display detects a change in capacitance when the display moves. According to an embodiment, the processor 430 may detect the movement of the second housing about the first housing by a light sensor such as a ToF sensor or a proximity sensor. According to an embodiment, the processor 430 may detect the amount of movement by using a Hall sensor that detects magnetic force. According to an embodiment, the processor 430 may detect the amount of movement by using a predetermined number of magnets arranged on the sliding portion, or may detect the number of rotations of the roller by using magnets arranged on the roller 240, and may calculate the sliding length by multiplying the number of rotations by the circumference of the roller. According to an embodiment, the processor 430 may arrange a wire on the sliding portion, and may calculate a resistance value that is variable according to a change in the length of the wire. According to an embodiment, the processor 430 may detect a change in sliding by using a motion sensor such as an acceleration sensor or a gyro sensor.

[0107] According to an embodiment, in operation 640, the processor 430 may change the resolution of the first content in response to recognizing that the display area is extended. According to an embodiment, when the electronic device changes from a first state (e.g., a retracted state) to a second state (e.g., an extended state) and the size of the display area exposed to the outside of the display increases, the processor 430 may change the resolution of the first content in response to the increase in the size of the display. According to the above-mentioned embodiment, the electronic device 400 may change the resolution of the window constituting the background layer according to the change in the size of the display area, so that a natural and fast graphic effect can be provided to the user.

[0108] According to an embodiment, in operation 650, the processor 430 may change the resolution of the second content after completing the extension of the display. According to an embodiment, the processor 430 may determine the state of the electronic device. For example, the processor 430 may determine whether the electronic device is partially extended or fully extended by using a Hall integrated circuit (IC). According to an embodiment, when it is determined that a predetermined time has passed after stopping the extension of the display, the processor 430 may change the resolution of the second content according to the size of the extended display.

[0109] Figure 6B A flowchart of an operation of selectively changing resolution according to content attributes in an electronic device according to another embodiment is shown. Figure 6B , descriptions similar or corresponding to the above descriptions may be simplified or omitted.

[0110] In operation 611, a processor according to an embodiment (e.g., Figure 4 The processor 430 may be displayed via a display (e.g., Figure 4The display 440 of the display 440 displays at least one content. According to an embodiment, the content displayed on the display 440 may include an image, text, video, contact, audio, icon, project, label, or a combination of these. According to an embodiment, the window displaying the content may have a fixed size or may have a variable size proportional to the size of the content. For example, the window may include at least one of a page, a list view, a document, and a frame displaying the content.

[0111] According to an embodiment, in operation 613, the processor 430 may determine the first content and the second content based on the content attribute. According to an embodiment, the electronic device 400 may be in the second direction (eg, Fig. 6A According to an embodiment, the processor 430 may determine the content displayed on the following window as the first content, the second direction length (for example, horizontal length) of the window being equal to or longer than the second direction length of the display area of ​​the display exposed to the outside in the second state (for example, extended state). According to another embodiment, the electronic device 400 may be extended in the fourth direction (for example, Fig. 6A According to an embodiment, the processor 430 may determine the content displayed on the following window as the first content, the fourth direction length (for example, the vertical length) of the window being equal to or longer than the fourth direction length of the display area of ​​the display exposed to the outside in the second state.

[0112] According to another embodiment, the processor 430 may determine content having a high designated priority as the first content, and may determine content having a lower priority than the first content as the second content.

[0113] According to an embodiment, the processor 430 may recognize that the area of ​​the display exposed to the outside is retracted in operation 615. According to an embodiment, the processor 430 may determine the size of the retracted area of ​​the display by using at least one sensor of a touch sensor, a ToF sensor, a proximity sensor, and a Hall sensor.

[0114] According to an embodiment, in operation 617, the processor 430 may change the resolution of the first content to correspond to the size of the retracted display area in response to recognizing that the display area is retracted. According to an embodiment, when the electronic device 400 changes from the second state (e.g., the extended state) to the first state (e.g., the retracted state) and the size of the display exposed to the outside is reduced, the processor 430 may change the resolution of the first content according to the reduced display size. According to the above-mentioned embodiment, the electronic device 400 may change the resolution of the window constituting the background layer according to the change in the size of the display area, so that natural graphics can be provided to the user.

[0115] According to an embodiment, in operation 619, the processor 430 may change the resolution of the second content when a specified condition is satisfied. According to an embodiment, when the electronic device 400 in the second state (eg, the extended state) is in the second direction (eg, Fig. 6A When the display area is retracted in the opposite direction of the first direction), the processor 430 may change the resolution of the second content according to the size of the retracted display area from the time when the second direction length of the window displaying the content is equal to or longer than the second direction length of the display area of ​​the display exposed to the outside.

[0116] According to another embodiment, when the electronic device 400 is in a fourth direction (eg, Fig. 6A When the display area is retracted in a fourth direction (in the opposite direction of the third direction), the processor 430 may change the resolution of the second content according to the size of the retracted display area when the fourth direction length of the window displaying the content is equal to or longer than the fourth direction length of the display area of ​​the display exposed to the outside.

[0117] Figure 7 A flowchart of an operation of processing an event according to an extended state of a display in an electronic device according to an embodiment is shown. Figure 7 , descriptions similar to or corresponding to the above descriptions may be abbreviated or omitted, and may be Fig. 6A After operation 630 is performed Figure 7 The operation shown.

[0118] refer to Figure 7 In operation 710, the processor 430 according to an embodiment may calculate the size of the display area exposed to the outside based on the extended state of the electronic device. According to an embodiment, the processor 430 may determine the extended state of the display by analyzing the raw data of various sensors through the event converter. For example, the event converter may calculate the display area exposed to the outside by analyzing the raw data obtained from one of the ToF sensor, the illumination sensor or the proximity sensor, and the bend sensor.

[0119] According to an embodiment, in operation 720, the processor 430 may determine the extended state of the display. According to an embodiment, the processor 430 may determine the information corresponding to the extended state of the display determined by the event converter as a static value and / or a dynamic state. For example, the static value may include at least one of the size of the display area and the moving distance of the second housing relative to the first housing. In another example, the dynamic state may include at least one of a fully retracted state, a partially extended state, a fully extended state, and a partially retracted state.

[0120] According to an embodiment, in operation 730, the processor 430 may send an event related to a change in the extended state of the electronic device. According to an embodiment, the processor 430 may provide a state change event of the electronic device to a system module based on a system state. Alternatively, the processor 430 according to an embodiment may provide a state change event to all system modules and / or application modules based on a system state. According to an embodiment, in an operation of continuously optimizing the size of a window, the processor 430 may temporarily limit the provision of a state change event of the electronic device based on information related to the occurrence of a load in the operation of the processor 430.

[0121] According to an embodiment, in operation 740, the processor 430 may process an event related to a change in the extended state of the electronic device. According to an embodiment, the processor 430 may process a registered handler according to a priority. For example, a handler may be registered by various modules (such as a system module, an application module, a background service module). According to an embodiment, the processor 430 may process an event at a handler with a high priority, and may stop sending the event to the remaining handlers. According to another embodiment, when an event is not processed at a handler with a high priority, the processor 430 may process the event at a handler of the next priority.

[0122] Figure 8 A flow chart showing an operation of optimizing the size of a window in which content is displayed in an electronic device according to an embodiment. Figure 8 , descriptions similar or corresponding to the above descriptions may be simplified or omitted.

[0123] refer to Figure 8 In operation 810, the processor 430 according to an embodiment may receive an extension event of the display. For example, the processor 430 may detect the extension of the display by using a sensor (such as a ToF sensor, a slide sensor, a light sensor, a Hall sensor, a motion sensor).

[0124] According to an embodiment, in operation 820, the processor 430 may optimize the display size adjustment mode. According to an embodiment, the display size adjustment mode may refer to a mode in which, when the display is in an extended state, the processor 430 optimizes the properties of the window of the display screen (e.g., the size of the window). According to an embodiment, the processor 430 may turn on the display size adjustment mode when receiving a display extension event.

[0125] According to an embodiment, in operation 830, the processor 430 may determine whether the size of each window can be changed. According to an embodiment, when it is determined that the display is in an extended state, the processor 430 may determine whether the size of at least one window displayed on the display can be changed. For example, the determination method may include at least one of the following methods: a method of comparing pixel values ​​of the display and the window, and a method of comparing the size of the window with a size specified as a matching parent.

[0126] According to an embodiment, in operation 840, the processor 430 may optimize the size of the window determined to be resizable. According to an embodiment, the processor 430 may determine the following window as a resizable window: the length of the window in the extension direction of the display is equal to or longer than the length of the display in the same direction. According to another embodiment, the processor 430 may determine the following window as a resizable window: the length of the window in the extension direction of the display is equal to the specified matching parent. According to an embodiment, the processor 430 may change the size of the window determined to be resizable according to the size of the extended display.

[0127] According to an embodiment, in operation 850, the processor 430 may optimize the position of the window determined to be non-resizeable. According to an embodiment, the processor 430 may determine the following window as a non-resizeable window: the length of the window in the extension direction of the display is shorter than the length of the display in the same direction. According to another embodiment, the processor 430 may determine the following window as a non-resizeable window: the length of the window in the extension direction of the display is not equal to the specified matching parent. According to an embodiment, when the state of the electronic device changes, the processor 430 may change the position of the window determined to be non-resizeable. According to an embodiment, when the state of the electronic device changes, the processor 430 may change the definition of the window. For example, when the size of the display is extended, the processor 430 may control to display the window fuzzily.

[0128] Fig. 9 A flow chart illustrating operations for optimizing a resizing mode of a display of an electronic device according to an embodiment.

[0129] refer to Fig. 9 In operation 910, the processor 430 according to an embodiment may receive a first event in which the size of the display starts to change. According to an embodiment, the first event may include being in a first state (eg, Figure 1A The first state 100a or Figure 1B For example, the processor 430 may detect that the electronic device is extended by using at least one sensor of a ToF sensor, a sliding sensor, a light sensor, a Hall sensor, and a motion sensor.

[0130] According to an embodiment, the processor 430 may optimize the display size adjustment mode in operation 920. According to an embodiment, the processor 430 may turn on the display size adjustment mode when determining that the electronic device is extended.

[0131] According to an embodiment, in operation 930, the processor 430 may determine whether a second event in which the size of the display is changed is received within a specified time. Figure 1A The first state 100a or Figure 2A The first state 200a) changes to the second state ( Figure 1B The second state 100b or Figure 2B When the electronic device is in the second state 200b), the electronic device may receive the second event through a sensor for detecting a size change of the display.

[0132] According to an embodiment, in operation 940, when the second event is received within the specified time, the processor 430 may optimize the size of the window determined to be resizable. According to an embodiment, when it is detected through the sensor module that the size of the display area exposed to the outside is changing within the specified time, the processor 430 may optimize the size of the resizable window according to the size of the display area.

[0133] According to an embodiment, in operation 950, when the second event is not received within the specified time, the processor 430 may determine that the display size adjustment mode is closed. For example, when no event of the size change of the display occurs within the specified time, the processor 430 may determine that the extension is completed and may determine that the size adjustment mode is closed.

[0134] According to an embodiment, in operation 960, when it is determined that the display resize mode is off, the processor 430 may optimize the size of all windows. According to an embodiment, when it is determined that the extension of the display is completed, the processor 430 may optimize the resolution of all windows displaying content according to the size of the display.

[0135] Fig.10 A view showing that a resolution of each content changes when an electronic device is extended according to an embodiment.

[0136] refer to Fig.10 According to an embodiment, the processor 430 may display at least one content including a first content 1111 and a second content 1112 in a first state 1110 (e.g., a retracted state). For example, the first content 1111 may be content constituting some background layer, and the second content 1112 may be content not corresponding to the background layer, such as a dialog window, a list.

[0137] According to an embodiment, the processor 430 may display the first content 1113 whose resolution is changed in the second state (e.g., partially extended state). According to an embodiment, the processor 430 may change the resolution of the first content 1113 based on the second state 1120. According to an embodiment, the processor 430 may display the second content 1114 whose resolution is not changed. According to an embodiment, when the electronic device changes from the first state 1110 to the second state 1120, the processor 430 may change the position or definition of the second content 1114.

[0138] According to an embodiment, the processor 430 may display the first content 1115 whose resolution is changed and the second content 1116 whose resolution is changed in the third state 1130 (e.g., fully extended state). According to an embodiment, the processor 430 may change the resolution of the first content 1115 and the second content 1116 based on the third state 1130.

[0139] Fig.11 A view showing that a resolution of each content is changed when an electronic device is retracted according to an embodiment.

[0140] refer to Fig.11 According to an embodiment, the processor 430 may display at least one content including a first content 1211 and a second content 1212 in a first state 1210 (e.g., a fully extended state). For example, the first content 1211 may be content constituting some background layer, and the second content 1212 may be content not corresponding to the background layer, such as a dialog window, a list.

[0141] According to an embodiment, the processor 430 may display the first content 1213 whose resolution is changed in the second state (e.g., partially retracted state). According to an embodiment, the processor 430 may change the resolution of the first content 1213 based on the second state 1220. According to an embodiment, the processor 430 may display the second content 1214 whose resolution is not changed. According to an embodiment, when the electronic device changes from the first state 1210 to the second state 1220, the processor 430 may change the position or definition of the second content 1214.

[0142] According to an embodiment, the processor 430 may display the first content 1215 whose resolution is changed and the second content 1216 whose resolution is changed in the third state 1230 (e.g., partially retracted state). According to an embodiment, the processor 430 may change the resolution of the first content 1215 based on the third state 1230. According to an embodiment, when it is determined that the length of the window displaying the second content in the retracted direction of the electronic device is equal to or longer than the length of the display in the same direction, the processor 430 may change the resolution of the second content from that time. According to an embodiment, the processor 430 may display the second content 1216 whose resolution is changed according to the size of the retracted display area.

[0143] According to an embodiment, the processor 430 may display the first content 1217 whose resolution is changed and the second content 1218 whose resolution is changed in the fourth state 1240 (e.g., the fully retracted state). According to an embodiment, when it is determined that the retraction of the electronic device is completed, the processor 430 may change the resolution of the first content 1217 and the second content 1218 based on the fourth state 1240.

[0144] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those described above.

[0145] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, and include various changes, equivalents or replacements of the corresponding embodiments. With regard to the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It should be understood that the singular form of the noun corresponding to the project may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include all possible combinations of the items listed together in the corresponding one in the phrase. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to distinguish only the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It should be understood that if an element (e.g., a first element) is referred to as being "coupled", "coupled to", "connected to" or "connected to" another element (e.g., a second element) with or without the term "operably" or "communicatively", this means that the element may be coupled to the other element directly (e.g., wired), wirelessly, or via a third element.

[0146] As used herein, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "component," or "circuit"). A module may be a single, integrated component adapted to perform one or more functions, or may be its smallest unit or component. For example, according to an embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0147] The various embodiments described herein may be implemented as software (e.g., program 340) that includes one or more instructions stored in a storage medium (e.g., internal memory 336 or external memory 338) readable by a machine (e.g., electronic device 301). For example, a processor (e.g., processor 320) of a machine (e.g., electronic device 301) may use one or more other components under the control of the processor, or not use the components, to call at least one of the one or more instructions stored in the storage medium and execute the instructions. This allows the machine to be operated to perform at least one function according to at least one of the called instructions. The one or more instructions may include code generated by a compiler, or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Wherein, the term "non-transitory" refers only to the fact that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between where data is semi-permanently stored in the storage medium and where data is temporarily stored in the storage medium.

[0148] According to an embodiment, the method according to various embodiments of the present disclosure may be included in a computer program product and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., PLAYSTORE), or may be distributed directly between two user devices (e.g., smart phones). If distributed online, at least part of the computer program product may be temporarily generated or at least temporarily stored in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a relay server.

[0149] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities, and some of the multiple entities may be separately arranged in other components. According to various embodiments, one or more of the above-mentioned components or operations may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (e.g., a module or a program) may be integrated into a single component. In such a case, according to various embodiments, the integrated component may still perform one or more functions of each of the multiple components in the same or similar manner as the function performed by the corresponding one of the multiple components before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or heuristically, or one or more operations may be performed in a different order, or omitted, or one or more other operations may be added.

[0150] In the above-mentioned specific embodiment of the present disclosure, the elements included in the present disclosure are represented in singular or plural form according to the specific embodiment. However, for the convenience of explanation, the singular or plural form is appropriately selected according to the proposed situation, and the present disclosure is not limited to singular elements or plural elements. The elements represented in plural form can be configured in singular form, or the elements represented in singular form can be configured in plural.

[0151] Although specific embodiments have been described in the detailed description of the present disclosure, it will be understood by those skilled in the art that various changes in form and detail may be made to the present disclosure without departing from the spirit and scope of the present disclosure as defined in the appended claims. Therefore, the scope of the various embodiments of the present disclosure is not limited by the embodiments, but by the appended claims or the equivalents of the claims.

[0152] As described above, according to the electronic device (eg, Figure 4 The electronic device 400) may include: a first housing; a second housing that at least partially overlaps the first housing and is movable; a display having at least a first area exposed to the outside of the electronic device through the front surface of the electronic device, and a second area extending from the first area of ​​the display, wherein when the electronic device switches from the first state to the second state, the second area is pulled out from the inside of the first housing and exposed to the outside of the electronic device together with the first area, and when the electronic device switches from the second state to the first state, the second area is pulled into the first housing; and at least one processor operably connected to the display, wherein the at least one processor can control the display to display at least one content on the display, can determine a first content and a second content different from the first content based on attribute information related to the at least one content, can identify that an area of ​​the display is extended, and in response to identifying that the area of ​​the display is extended, can change the resolution of the first content when the display is extended to correspond to the size of the extended area of ​​the display; and after the extension of the display is completed, can change the resolution of the second content to correspond to the size of the extended area of ​​the display.

[0153] According to an embodiment, when the electronic device is extended in a first direction, at least one processor may determine content displayed on a window as a first content among at least one content, the length of which window in the first direction is longer than or equal to the length of the display exposed to the outside in the first state in the first direction.

[0154] According to an embodiment, at least one processor may determine first content and second content different from the first content according to a designated priority of at least one content.

[0155] According to an embodiment, at least one processor may recognize the extended state of the electronic device by using at least one sensor of a touch sensor, a ToF sensor, a proximity sensor, a Hall sensor, and an inertial sensor.

[0156] According to an embodiment, the electronic device may further include a memory, and the memory may store state information of the electronic device acquired by using the at least one sensor as information including at least one of a static value and a dynamic state.

[0157] According to an embodiment, the static value may include size information of a region of the display exposed to the outside or a distance between the second housing and the first housing.

[0158] According to an embodiment, at least one processor may change a screen brightness setting based on a size of an area of ​​the display exposed to the outside.

[0159] According to an embodiment, the electronic device may be one of a slidable display electronic device and a rollable display electronic device.

[0160] As described above, an electronic device (e.g., Figure 4 An operating method of an electronic device 400) may include: controlling a display to display at least one content on the display; determining, based on attribute information related to the at least one content, a first content and a second content different from the first content; recognizing that an area of ​​the display is extended; in response to recognizing that the area of ​​the display is extended, changing a resolution of the first content to correspond to a size of the extended area of ​​the display when the display is extended; and after the extension of the display is completed, changing a resolution of the second content to correspond to the size of the extended area of ​​the display.

[0161] According to an embodiment, the method may include: when the electronic device is extended in a first direction, determining content displayed on a window as a first content among at least one content, the length of the window in the first direction being longer than or equal to the length of the display exposed to the outside in the first state in the first direction.

[0162] According to an embodiment, the method may include determining first content and second content different from the first content according to a designated priority of at least one content.

[0163] According to an embodiment, the method may include recognizing an extended state of the electronic device by using at least one sensor of a touch sensor, a ToF sensor, a proximity sensor, a Hall sensor, and an inertial sensor.

[0164] According to an embodiment, the method may include storing, in a memory, state information of the electronic device acquired by using at least one sensor as information including at least one of a static value and a dynamic state.

[0165] According to an embodiment, the static value may include size information of a region of the display exposed to the outside or a distance between the second housing and the first housing.

[0166] According to an embodiment, the method may include changing a screen brightness setting based on a size of an area of ​​the display exposed to the outside.

[0167] According to an embodiment, the electronic device may be one of a slidable display electronic device and a rollable display electronic device.

[0168] As described above, according to the electronic device (eg, Figure 4 The electronic device 400 may include: a first housing; a second housing that at least partially overlaps with the first housing and is movable; a display having at least a first area exposed to the outside of the electronic device through a front surface of the electronic device, and a second area extending from the first area of ​​the display, wherein when the electronic device switches from a first state to a second state, the second area is pulled out from the inside of the first housing and exposed to the outside of the electronic device together with the first area, and when the electronic device switches from the second state to the first state, the second area is pulled into the first housing; and at least one processor operably connected to the display, and the at least one processor may control the display to display at least one content on the display, may determine a first content and a second content different from the first content based on attribute information related to the at least one content, may identify that an area of ​​the display is retracted, and in response to identifying that the area of ​​the display is retracted, may change the resolution of the first content to correspond to the size of the retracted area of ​​the display when the display is retracted; and may change the resolution of the second content to correspond to the size of the retracted area of ​​the display from the time when the length of the display exposed to the outside in the retracted direction is shorter than the length of the window displaying the second content in the retracted direction.

[0169] According to an embodiment, when the electronic device is retracted in a first direction, at least one processor may determine the content displayed on a window as a first content among at least one content, the length of which window in the first direction is longer than or equal to the length of the display exposed to the outside in the second state in the first direction.

[0170] According to an embodiment, at least one processor may determine first content and second content different from the first content according to a designated priority of at least one content.

[0171] According to an embodiment, the at least one processor may recognize the retracted state of the electronic device by using at least one sensor of a touch sensor, a ToF sensor, a proximity sensor, a Hall sensor, and an inertial sensor.

[0172] According to an embodiment, the electronic device may be one of a slidable display electronic device and a rollable display electronic device.

[0173] According to various embodiments of the present disclosure, when a display area of ​​a display is changed in an electronic device including a flexible display, a natural and fast screen change may be provided to a user.

[0174] According to various embodiments, when a display area of ​​a display is changed in an electronic device including a flexible display, a window in which resolution is changed is limited, so that efficiency of the electronic device related to battery, heat dissipation, and user experience can be improved.

[0175] Although the present disclosure has been described using various embodiments, various changes and modifications may be suggested to one skilled in the art. It is intended that the present disclosure includes such changes and modifications as fall within the scope of the appended claims.

Claims

1. An electronic device, include: first shell; a second housing that at least partially overlaps the first housing and is movable; Display, including: at least a first area exposed to the outside of the electronic device through a front surface of the electronic device; and a second area extending from the first area of ​​the display and configured to be pulled out from the interior of the first housing and exposed to the exterior of the electronic device together with the first area when the electronic device switches from the first state to the second state, wherein the second area is pulled into the first housing when the electronic device switches from the second state to the first state; and at least one processor operably connected to the display, wherein the at least one processor is configured to: controlling the display to display a plurality of contents on the display; determining, according to the attribute information of each of the plurality of contents, a first content among the plurality of contents and a second content different from the first content; identifying that a region of the display is extended when the plurality of contents are displayed on the display; When the area of ​​the display is being extended before the extension of the area of ​​the display is completed, changing a resolution of the first content among a plurality of displayed content to correspond to a size of the extended area of ​​the display; and In response to recognizing that the extension of the area of ​​the display is complete, a resolution of the second content among a plurality of displayed content is changed to correspond to a size of the extended area of ​​the display.

2. The electronic device according to claim 1, in, When the electronic device is extended in a first direction, the at least one processor is configured to determine the content displayed on the window as the first content among the multiple contents, wherein the length of the window in the first direction is longer than or equal to the length of the display in the first direction exposed to the outside of the electronic device in the first state.

3. The electronic device according to claim 1, in, The at least one processor is further configured to determine the first content and the second content according to a designated priority of the plurality of contents, wherein the second content is different from the first content.

4. The electronic device according to claim 1, in, The at least one processor is further configured to recognize an extended state of the electronic device by using at least one sensor of a touch sensor, a time-of-flight ToF sensor, a proximity sensor, a Hall sensor, or an inertial sensor.

5. The electronic device according to claim 4, further comprising a memory, in, The memory is configured to store state information of the electronic device acquired by using the at least one sensor as information including at least one of a static value and a dynamic state.

6. The electronic device according to claim 5, in, The static value includes size information of an extended area of ​​the display exposed to the outside of the electronic device, or a distance between the second housing and the first housing.

7. The electronic device according to claim 1, in, The at least one processor is also configured to change a screen brightness setting based on a size of an extended area of ​​the display exposed to an exterior of the electronic device.

8. The electronic device according to claim 1, in, The electronic device is a slidable display electronic device or a rollable display electronic device.

9. A method for operating an electronic device, the electronic device comprising a display, the display include: at least a first area exposed to the exterior of the electronic device through a front surface of the electronic device; as well as a second area extending from the first area of ​​the display and configured to be pulled out from the inside of the electronic device and exposed to the outside of the electronic device together with the first area when the electronic device is switched from the first state to the second state, wherein the second area is pulled into the electronic device when the electronic device is switched from the second state to the first state, The method comprises: controlling the display to display a plurality of contents on the display; determining, according to the attribute information of each of the plurality of contents, a first content among the plurality of contents and a second content different from the first content; identifying that a region of the display is extended when the plurality of contents are displayed on the display; When the area of ​​the display is being extended before the extension of the area of ​​the display is completed, changing a resolution of the first content among a plurality of displayed content to correspond to a size of the extended area of ​​the display; and In response to recognizing that the extension of the area of ​​the display is complete, a resolution of the second content among a plurality of displayed content is changed to correspond to a size of the extended area of ​​the display.

10. The method according to claim 9, include: When the electronic device is extended in a first direction, the content displayed on the window is determined as the first content among the multiple contents, wherein the length of the window in the first direction is longer than or equal to the length of the display in the first direction exposed to the outside of the electronic device in the first state.

11. The method according to claim 9, include: The extended state of the electronic device is recognized by using at least one sensor of a touch sensor, a time-of-flight (ToF) sensor, a proximity sensor, a Hall sensor, or an inertial sensor.

12. The method according to claim 11, include: The state information of the electronic device acquired by using the at least one sensor is stored in a memory as information including at least one of a static value and a dynamic state.

13. The method according to claim 12, in, The static value includes size information of an extended area of ​​the display exposed to the outside of the electronic device.

14. The method according to claim 9, include: The screen brightness setting is changed based on the size of the extended area of ​​the display exposed to the exterior of the electronic device.

15. The method according to claim 9, in, The electronic device is a slidable display electronic device or a rollable display electronic device.

16. An electronic device, include: first shell; a second housing that at least partially overlaps the first housing and is movable; Display, including: at least a first area exposed to the outside of the electronic device through a front surface of the electronic device; and a second area extending from the first area of ​​the display and configured to be pulled out from the interior of the first housing and exposed to the exterior of the electronic device together with the first area when the electronic device switches from the first state to the second state, wherein the second area is pulled into the first housing when the electronic device switches from the second state to the first state; and at least one processor operably connected to the display, wherein the at least one processor is configured to: controlling the display to display a plurality of contents on the display; determining, according to the attribute information of each of the plurality of contents, a first content among the plurality of contents and a second content different from the first content; identifying that an area of ​​the display is retracted when the plurality of contents are displayed on the display; When the area of ​​the display is being retracted before the retraction of the area of ​​the display is completed, changing a resolution of the first content among a plurality of displayed content to correspond to a size of the retracted area of ​​the display; and In response to identifying that retraction of the area of ​​the display is complete, from the time when the length of the display exposed to the outside in the retracted direction is shorter than the length of the window displaying the second content in the retracted direction, the resolution of the second content among the multiple displayed contents is changed to correspond to the size of the retracted area of ​​the display.

17. The electronic device according to claim 16, in, When the electronic device is retracted in a first direction, the at least one processor is configured to determine the content displayed on the window as the first content among the multiple contents, wherein the length of the window in the first direction is longer than or equal to the length of the display in the first direction exposed to the outside of the electronic device in the second state.

18. The electronic device according to claim 16, in, The at least one processor is configured to determine the first content and the second content according to a designated priority of the plurality of contents, wherein the second content is different from the first content.

19. The electronic device according to claim 16, in, The at least one processor is configured to identify a retracted state of the electronic device by using at least one sensor of a touch sensor, a time-of-flight ToF sensor, a proximity sensor, a Hall sensor, or an inertial sensor.

20. The electronic device according to claim 16, in, The electronic device is a slidable display electronic device or a rollable display electronic device.