Electronic device and method for controlling display thereof

Abstract

An electronic device according to one embodiment disclosed in this document may include a display panel, a display driving circuit, and at least one processor operatively connected to the display driving circuit. The at least one processor may determine the resolution of each of a plurality of applications, generate a frame image including the execution screen of each of the plurality of applications and regions corresponding to the determined resolution based on at least some information of a display area corresponding to the execution screen of each of the plurality of applications on the display panel, and transmit the frame image and coordinate information of each of the regions included in the frame image to the display driving circuit. The display driving circuit may, based on the frame image and the coordinate information of each of the regions, upscale at least some of the regions included in the frame image that have a resolution lower than the resolution of the display panel so that the frame image has a resolution corresponding to the resolution of the display panel, and control the display panel to display the execution screen of each of the plurality of applications based on the upscaled frame image. In addition to this, various embodiments identified through the specification are possible.

Description

Technology Field

[0001] The embodiments disclosed in this document relate to a technology for controlling a display to output a screen. Background Technology

[0003] Recently, electronic devices equipped with large-screen displays have become widely available. For example, electronic devices including flexible displays (foldable displays, rollable displays, or stretchable displays) are becoming widely available. For example, as the size of the display included in the electronic device increases, the electronic device can provide multiple contents within a single display. For example, the electronic device can simultaneously display the execution screens of multiple applications or provide a multi-window screen. The problem to be solved

[0005] When an electronic device provides multiple execution screens simultaneously on a display, it may be necessary to improve the image quality and visibility of each execution screen.

[0006] Various embodiments of the present disclosure aim to provide an electronic device and a method for providing a display of an electronic device that can provide a high-resolution display output while reducing power consumption by at least partially up-scale a frame image. means of solving the problem

[0008] An electronic device according to one embodiment disclosed in this document may include a display panel, a display driving circuit, and at least one processor operatively connected to the display driving circuit. The at least one processor may determine the resolution of each of a plurality of applications and, based on at least a portion of information regarding a display area corresponding to the resolution of each of the plurality of applications and the execution screen of each of the plurality of applications on the display panel, generate a frame image including the execution screen of each of the plurality of applications and areas corresponding to the determined resolution, and transmit the frame image and coordinate information of each of the areas included in the frame image to the display driving circuit. The display driving circuit may, based on the frame image and the coordinate information of each of the areas, upscale at least a portion of the areas included in the frame image that have a resolution lower than the resolution of the display panel so that the frame image has a resolution corresponding to the resolution of the display panel, and control the display panel to display the execution screen of each of the plurality of applications based on the upscaled frame image.

[0009] Additionally, the display control method of an electronic device disclosed in this document may include: determining the resolution of each of a plurality of applications; generating a frame image including the execution screen of each of the plurality of applications and regions corresponding to the determined resolution, based at least partially on information of a display area corresponding to the execution screen of each of the plurality of applications on the display; up-scale at least some of the regions included in the frame image that have a resolution lower than the resolution of the display, based on the coordinate information of each of the regions included in the frame image and the frame image, so that the frame image has a resolution corresponding to the resolution of the display; and displaying the execution screen of each of the plurality of applications on the display based on the up-scaled frame image. Effects of the invention

[0011] According to the embodiments disclosed in this document, by providing a frame image to a display after at least partially up-scaled, the image quality of the screen output to the display can be supplemented and improved while reducing power consumption.

[0012] According to the embodiments disclosed in this document, when displaying execution screens of a plurality of applications, frame images corresponding to the execution screens can be at least partially upscaled based on the characteristics of the application (e.g., type), the display position or size of the execution screen, user input, or the execution history of the application.

[0013] According to the embodiments disclosed in this document, a processor provides a frame image generated to a DDI, and the DDI can provide the frame image to a display by at least partially up-scaling it.

[0014] In addition, various effects that can be identified directly or indirectly through this document may be provided. Brief explanation of the drawing

[0016] FIG. 1 shows an electronic device in a network environment according to various embodiments. FIG. 2 is a block diagram of an electronic device according to one embodiment. FIG. 3 is a block diagram of an electronic device according to one embodiment. FIGS. 4a to 4e are drawings for explaining the operation of an electronic device according to one embodiment. FIG. 5 is a diagram illustrating the operation of an electronic device according to one embodiment. FIG. 6 is a diagram illustrating the operation of an electronic device according to one embodiment. FIG. 7 is a drawing for explaining the operation of an electronic device according to one embodiment. FIG. 8 is a drawing for explaining the operation of an electronic device according to one embodiment. FIGS. 9a to 9c are drawings for explaining the operation of an electronic device according to one embodiment. FIGS. 10a and 10b are drawings for explaining the operation of an electronic device according to one embodiment. FIG. 11 is a flowchart of a display control method for an electronic device according to one embodiment. FIG. 12 is a flowchart of a display control method for an electronic device according to one embodiment. FIG. 13 is a flowchart of an operation for generating an image corresponding to the execution screen of an electronic device according to one embodiment. FIG. 14 is a flowchart of an operation for generating an image corresponding to the execution screen of an electronic device according to one embodiment. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Specific details for implementing the invention

[0017] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0018] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0019] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0020] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0021] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0022] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0023] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0024] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0025] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0026] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0027] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0028] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0029] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0030] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0031] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0032] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0033] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0034] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0035] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0036] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0037] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0038] According to one embodiment, commands or data may be transmitted or received between an electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0040] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0041] According to one embodiment, an electronic device (200) (e.g., the electronic device (101) of FIG. 1) may include a display panel (210), a display (210) driving circuit (220), and a processor (230) (e.g., the processor (120) of FIG. 1).

[0042] According to one embodiment, the display panel (210) can display visual information. For example, the display panel (210) can display an execution screen of at least one application (e.g., application (146) of FIG. 1) based on a frame image (e.g., at least partially upscaled frame image) under the control of a display (210) driving circuit (220). According to one embodiment, the display panel (210) may include a flexible display panel capable of expanding or contracting the screen display area. For example, the flexible display panel may include a slideable display panel or a foldable display panel.

[0043] According to one embodiment, the display driving circuit (220) can control the display panel (210). For example, the display driving circuit (220) may include a display driving integrated IC (integrated circuit, DDI). According to one embodiment, the display panel (210) and the display driving circuit (220) can form a display (e.g., the display (120) of FIG. 1).

[0044] According to one embodiment, the display driving circuit (220) may include a scaler configured to upscale at least a portion of the frame image. According to one embodiment, the display driving circuit (220) may receive from the processor (230) a frame image including regions corresponding to the execution screens of a plurality of applications, information related to the size of the frame image, and / or coordinate information of each of the regions within the frame image. For example, the information related to the size of the frame image may be information related to the size of the screen display area of ​​the display panel (210). For example, the information related to the size of the frame image may include coordinate information of the frame image. For example, the information related to the size of the frame image may include coordinate information of the entire display panel (210). As another example, if the display panel (210) constitutes a flexible display (e.g., a stretchable display), the information related to the size of the frame image may include information indicating the size of the screen display area that varies according to the state of the flexible display (e.g., when the shape of the flexible display changes and the screen display area changes). For example, each coordinate information may include start coordinate information and end coordinate information. For example, the display driving circuit (220) may determine whether to upscale each of the regions based on information related to the size of the frame image and / or coordinate information of each of the regions within the frame image. For example, the display driving circuit (220) may determine whether to upscale each region corresponding to an adjacent execution screen based on whether the coordinate information between regions corresponding to adjacent execution screens is the same or adjacent within a reference value, or whether the information related to the size of the frame image and the region corresponding to the execution screen is the same or adjacent.An example of an operation determining whether to upscale based on coordinate information is described in more detail below in FIG. 10a and FIG. 10b. For example, the display driving circuit (220) may upscale the frame image at least partially (e.g., at least some of the areas corresponding to the execution screen included in the frame image) based on information related to the size of the frame image and / or coordinate information of each of the areas corresponding to the execution screen of the application within the frame image. For example, the display driving circuit (220) may upscale at least some of the areas included in the frame image that have a resolution lower than the resolution of the display panel (210) so that the frame image has a resolution corresponding to the resolution of the display panel (210).

[0045] According to one embodiment, the display driving circuit (220) can control the display panel (210) to display an application execution screen based on at least a partially upscaled frame image. For example, the display driving circuit (220) can control the display panel (210) to display an application execution screen at the resolution of the display panel (210) (a resolution value corresponding to the resolution of the display panel (210)) based on the upscaled frame image.

[0046] According to one embodiment, the processor (230) may determine the resolution of each of the plurality of applications based on the type of each of the plurality of applications. For example, the resolution of an application may refer to the resolution of an area corresponding to the execution screen of an application included in the frame image when the initial frame image is created, or the resolution of an area corresponding to the execution screen of an application included in the frame image before the frame image is partially upscaled. For example, the resolution of each application may be lower than the resolution of the display panel (210). For example, the processor (230) may determine the resolution of at least one application to be lower than the resolution of the display panel (210). For example, the electronic device (200) may determine the resolution of an application to a specified high resolution or a specified low resolution. For example, a specified high resolution may refer to a resolution that does not require upscaled, and a specified low resolution may refer to a resolution that requires upscaled. For example, a specified high resolution may refer to a resolution greater than or equal to the resolution of the display panel (210), and a specified low resolution may refer to a resolution less than or equal to the resolution of the display panel (210). For example, for the convenience of explanation, the resolution has been described in two cases: high resolution and low resolution, but it is not limited thereto, and the resolution of the application may be set to two or more resolution values. For example, a resolution value greater than or equal to a reference resolution value (e.g., the resolution of the display panel (210)) that determines whether up-scaling is required may be included in high resolution, and a resolution value less than the reference resolution value may be included in low resolution.For example, the processor (230) may determine the resolution of an application that needs to be displayed with relatively high image quality (resolution) on the display panel (210), including an application of a type that requires good readability due to having a lot of text within the execution screen (e.g., a document application) or an application of a type that requires good visibility (e.g., a gallery application, a video application, and an SNS application), to be high resolution. For example, the processor (230) may determine the resolution of an application of a type where the image quality (resolution) displayed on the display panel (210) is relatively less important (e.g., a health application, a financial or banking application, a navigation application, and a music application) to be low resolution. For example, if the resolution of a high-performance application (e.g., a high-performance game application) is determined to be high resolution, the resources of the electronic device (200) may be insufficient when multitasking multiple applications, and therefore multitasking may not be performed smoothly; thus, the processor (230) may determine the resolution of the high-performance application to be low resolution if necessary. For example, the processor (230) may determine the resolution of each application based on at least a portion of the area occupied by the execution screen of each application in the full screen display area of ​​the display panel (210). For example, if the area where the execution screen of an application is displayed in the full screen display area occupies more than a specified ratio (e.g., 50%), the processor (230) may determine the resolution of the application to be high resolution. For example, the specified ratio may be set (or specified) to various values. For example, the processor (230) may provide a user interface for setting the resolution of an application that is running or to be run, and may determine the resolution of the application based on input received through the user interface.For example, the processor (230) may determine the resolution of an application based on resolution information set when the application was previously executed. For example, data related to the application (e.g., the application's manifest) may store resolution information set when the application was previously executed. For example, the processor (230) may determine the resolution of the application based on information stored in the application's manifest. According to one embodiment, the processor (230) may determine the resolution of the application in response to user input for providing a multi-window screen including execution screens of a plurality of applications. For example, the user input may include user input for additionally executing another application while one application is running.

[0047] According to one embodiment, the processor (230) may generate a frame image including areas corresponding to the execution screen of each of a plurality of applications and the determined resolution (resolution of the application) based on information regarding the display area corresponding to the resolution of each of the plurality of applications and / or the execution screen of each of the plurality of applications. For example, the processor (230) may generate a frame image according to the refresh rate (e.g., 60 times per second) of the display panel (210). For example, the frame image may correspond to the entire screen display area to be displayed on the display panel (210). For example, the processor (230) may generate a frame image such that the area corresponding to the execution screen of the application determined to be high resolution corresponds to the size and / or resolution of the execution screen to be displayed on the actual display panel (210). For example, the area corresponding to the execution screen of the application determined to be high resolution in the frame image may have a resolution greater than or equal to the resolution of the display panel (210). For example, the processor (230) may generate a frame image such that an area corresponding to the execution screen of an application determined at high resolution is smaller than the size of the execution screen to be displayed on the actual display panel (210), or has a resolution lower than the resolution of the execution screen to be displayed on the actual display panel (210). For example, an area corresponding to the execution screen of an application determined at low resolution in the frame image may have a resolution lower than the resolution of the display panel (210). For example, the processor (230) may generate (draw) images corresponding to the execution screens of a plurality of applications, and merge or compose the images to generate a frame image containing areas corresponding to the execution screens of a plurality of applications. For example, the processor (230) may store the frame image in a frame buffer at least temporarily.According to one embodiment, the processor (230) can recognize information related to the size of a frame image and coordinate information of an area corresponding to the execution screen of each application included in the frame image. According to one embodiment, the processor (230) can transmit at least some of the frame image stored in the frame buffer, information related to the size of the frame image, and / or coordinate information of each area included in the frame image to the display driving circuit (220).

[0048] According to one embodiment, the electronic device (200) may further include at least some of the components of the electronic device (101) of FIG. 1.

[0049] According to one embodiment, the electronic device (200) can selectively adjust the resolution of an application by not up-scaling the frame images collectively, but by up-scaling the frame images at least partially. Accordingly, the electronic device (200) does not generate images corresponding to the execution screens of all applications at a high resolution (e.g., a resolution greater than or equal to the resolution of the display panel (210), but generates only the images corresponding to the execution screens of applications requiring a high resolution at a high resolution based on the type of application or the area where the execution screens are to be displayed, and generates images corresponding to the execution screens of applications not requiring a high resolution at a low resolution (e.g., a resolution less than the resolution of the display panel (210)), and then uses them by at least partially up-scaling them. This allows the display panel (210) to be controlled with lower power consumption than when all frame images are generated at a high resolution, and improves the quality (resolution) of the screen displayed on the display panel (210) compared to when all frame images are generated at a low resolution.

[0051] FIG. 3 is a block diagram of an electronic device according to one embodiment.

[0052] According to one embodiment, an electronic device (300) (e.g., the electronic device (101) of FIG. 1, or the electronic device (200) of FIG. 2) may include an application layer (310) (e.g., the application (146) of FIG. 1), a framework layer (320) (e.g., the middleware (144) of FIG. 1), a library layer (330) (e.g., the middleware (144) or operating system (142) of FIG. 1), a kernel layer (340) (e.g., the operating system (142) of FIG. 1), and a hardware layer (HW) (350). For example, at least some of each component of the application layer (310), framework layer (320), library layer (330), kernel layer (340), and hardware layer (350) may be implemented by the interaction (e.g., load and execution) between the processor (e.g., processor (120) of FIG. 1, or processor (240) of FIG. 2) and memory (e.g., memory (130) of FIG. 1), and at least some of the operation of each component included in the application layer (310), framework layer (320), library layer (330), kernel layer (340), and hardware layer (350) may be understood as the operation of the processor (or, display driving circuit (e.g., display driving circuit (220) of FIG. 2).

[0053] According to one embodiment, the application layer (310) may include at least one application (311). For example, only one application (311) is shown in FIG. 3, but the number, type, and category of applications (311) are not limited thereto.

[0054] According to one embodiment, the framework layer (320) may provide various functions to the application (311) so that functions or information provided from one or more resources of the electronic device (300) can be used by the application (311). According to one embodiment, the framework layer (320) may include a view system. For example, the view system (321) may generate a view to be displayed on the display (353) according to the activity of the application (311). For example, the application (311) may be implemented as a set of views configured by the view system (321).

[0055] According to one embodiment, the library layer (330) may be a common layer accessed by a plurality of applications included in the application layer. According to one embodiment, the library layer (330) may include a surface manager (331). According to one embodiment, the surface manager (331) may determine the resolution of the application (311) based at least partially on the type of the application (311) when the application (311) is executed, and may generate a frame image including an area corresponding to the execution screen of the application (311) based on information of a display area corresponding to the execution screen of the application (311).

[0056] According to one embodiment, the surface manager (331) may include a window manager (3311), an activity manager (3313), and a surface flinger (3315). For example, each view of the application (311) (e.g., an area (or image) corresponding to the execution screen of the application) may be rendered using a graphics library containing graphics commands. For example, the surface flinger (3315) may combine or composite two or more views. For example, views rendered in the application (311) may be merged or composed into a single frame image for display (353) in the surface flinger (3315). For example, the surface flinger (3315) may store the frame image in a frame buffer.

[0057] According to one embodiment, the activity manager (3313) can perform at least one of execution, activation, and removal of the application (311). For example, the activity manager (3313) can obtain and manage various information related to the execution state (e.g., foreground or background execution), life cycle, and layout of the application (311).

[0058] According to one embodiment, the window manager (3311) can manage (e.g., add, delete, and / or change) the composited view (e.g., frame image). For example, the window manager (3311) can transmit image data stored in the frame buffer and / or coordinate information related to the frame image (e.g., coordinate information of regions included in the frame image and / or information related to the size of the frame image) to the display driving circuit.

[0059] According to one embodiment, the kernel layer (340) may include a display driver (341). For example, the display driver (341) may control a display driving circuit (e.g., the display driving circuit (220) of FIG. 2). For example, the display driver (341) may be included in the display driving circuit.

[0060] According to one embodiment, the hardware layer (350) may include a scaler (351) of the display driving circuit and a display (353) (e.g., the display module (160) of FIG. 1 or the display panel (210) of FIG. 2). According to one embodiment, the scaler (351) may upscale at least a portion of the frame image. For example, the scaler (351) may upscale at least a portion of the regions included in the frame image based on the frame image, information related to the size of the frame image, and / or coordinate information of each region corresponding to the execution screen of the application (311) included in the frame image. For example, the scaler (351) may provide at least partially upscaled frame image to the display (353). According to one embodiment, the display (353) may display a screen (e.g., the execution screen of the application (311)) based on at least partially upscaled frame image.

[0061] According to one embodiment, the components of the framework layer (320), library layer (330), kernel layer (340), and hardware layer (350) are not limited to those shown in FIG. 3, and well-known operations related to the framework layer (320), library layer (330), and kernel layer (340) other than those mentioned above are omitted from description.

[0063] FIGS. 4a to 4e are drawings for explaining the operation of an electronic device according to one embodiment.

[0064] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, or the electronic device (300) of FIG. 3) may generate a frame image comprising areas corresponding to the execution screens of a plurality of applications (e.g., the application (146) of FIG. 1) to be displayed on a display (e.g., the display module (160) of FIG. 1, the display (210) of FIG. 2, or the display (353) of FIG. 3). For example, the electronic device may determine the resolution of each of the plurality of applications based at least partially on the type of each application in order to generate the areas corresponding to the execution screens. For example, the electronic device may determine the resolution of applications that need to be displayed on the display with relatively high quality (resolution), such as applications of a type that require good readability due to a large amount of text within the execution screen (e.g., document applications) or applications of a type that require good visibility (e.g., gallery applications, video applications, and SNS applications), to be high resolution. For example, an electronic device may determine a low resolution for types of applications where image quality (resolution) displayed on the screen is relatively less important (e.g., health applications, financial or banking applications, navigation applications, and music applications). For example, high resolution may refer to a resolution greater than or equal to a reference resolution (e.g., the resolution of the display (display panel)) that determines whether upscaling is performed, and low resolution may refer to a resolution less than or equal to the reference resolution. For example, if a high resolution is determined for a high-performance application (e.g., a high-performance game application), multitasking may not be performed smoothly due to insufficient resources of the electronic device when multiple applications are multitasked; therefore, the electronic device may determine a low resolution for high-performance applications if necessary.For example, an electronic device may determine the resolution of each application based on at least a portion of the area occupied by the execution screen of each application within the entire screen display area of ​​the display. For example, if the area where the execution screen of an application is to be displayed occupies more than a specified percentage (e.g., 50%) of the entire screen display area, the resolution of the application may be determined to be high. For example, the electronic device may provide a user interface for setting the resolution of an application that is currently running or to be executed, and may determine the resolution of the application based on input received through the user interface. For example, the electronic device may determine the resolution of the application based on resolution information set when the application was previously executed. For example, data related to the application may store resolution information set when the application was previously executed. For example, the electronic device may determine the resolution of the application based on information stored in the application's manifest.

[0065] Referring to FIG. 4a, a first frame image (401) is illustrated, comprising a first area (411) corresponding to the execution screen of a first application (e.g., a health application) and a second area (413) corresponding to the execution screen of a second application (e.g., a social media application). For example, in the case of a health application, the image quality (resolution) displayed on the display may be relatively less important (e.g., high readability and visibility are not required). For example, even if the application is of a type that does not require high readability or visibility, the electronic device may determine the resolution of the application to be high if the ratio of the area occupied by the execution screen of the application to the total screen display area of ​​the display is greater than or equal to a specified ratio. For example, in the case of FIG. 4a, the execution screen of the health application may occupy more than a specified ratio (e.g., 50%) of the total screen display area. In this case, the electronic device may determine the resolution of the health application to be high. For example, the social media application may be of a type that requires high readability, and the electronic device may determine the resolution of the social media application to be high. For example, an electronic device may generate a first frame image (401) comprising a first area (411) corresponding to an execution screen of a health application determined at high resolution and a second area (413) corresponding to an execution screen of an SNS application. For example, the first area (411) and the second area (413) may constitute the entire first frame image (401), and the first frame image (401) may not include a blank area that does not substantially contain information corresponding to the execution screen of the application.For example, the locations of the first region (411) and the second region (413) in the first frame image (401) may correspond to display areas corresponding to the execution screen of the first application and the execution screen of the second application on the display panel (e.g., locations where the execution screen of the first application and the execution screen of the second application will be displayed on the display panel). According to one embodiment, the electronic device may determine the resolution of the application differently depending on the content being displayed on the display panel, even if it is the same application. For example, even for the same gallery application, if the image being displayed on the display panel is a landscape image, the electronic device may determine the resolution of the application to be low resolution, and if the image being displayed on the display panel is an image containing text, the resolution of the application may be determined to be high resolution.

[0066] Referring to FIG. 4b, a second frame image (403) is illustrated, comprising a third area (431) corresponding to the execution screen of a third application (e.g., a gallery application) and a fourth area (433) corresponding to the execution screen of a fourth application (e.g., a financial (stock) application). For example, the gallery application may be a type of application requiring high visibility, and the electronic device may determine the resolution of the gallery application to be high resolution. The stock application may be a type of application that does not require high readability or visibility, and the electronic device may determine the resolution of the financial application to be low resolution. For example, the electronic device may generate a second frame image (403) comprising a third area (431) corresponding to the execution screen of the gallery application determined to be high resolution and a fourth area (433) corresponding to the execution screen of the financial application determined to be low resolution. For example, the third area (431) may occupy the entire left divided area of ​​the second frame image (403), and the fourth area (433) may constitute a part of the right divided area of ​​the second frame image (403). For example, the right divided area of ​​the second frame image (403) may include a blank area (435) that does not contain information corresponding to the execution screen of the application. For example, the positions of the third area (431) and the fourth area (433) in the second frame image (403) may correspond to display areas on the display panel that correspond to the execution screen of the third application and the execution screen of the fourth application.

[0067] Referring to FIG. 4c, a third frame image (405) is illustrated, comprising a fifth area (451) corresponding to the execution screen of a fifth application (e.g., a navigation application) and a sixth area (453) corresponding to the execution screen of a sixth application (e.g., a music application). For example, the navigation application and the music application may be types of applications that do not require high visibility, and the electronic device may determine the resolution of the navigation application and the music application to be low resolution. For example, the electronic device may generate a third frame image (405) comprising a fifth area (451) corresponding to the execution screen of the navigation application determined to be low resolution and a sixth area (453) corresponding to the execution screen of the music application. For example, the fifth area (451) may constitute a part of the left divided area in the third frame image (405), and the sixth area (453) may constitute a part of the right divided area in the third frame image (405). For example, the divided areas on the left and right of the third frame image (405) may include blank areas (455, 457) that do not contain information corresponding to the execution screen of the application. For example, the positions of the fifth area (451) and the sixth area (453) in the third frame image (405) may correspond to display areas on the display panel that correspond to the execution screen of the fifth application and the execution screen of the sixth application.

[0068] Referring to FIG. 4d, a fourth frame image (407) is shown, comprising a seventh area (471) corresponding to the execution screen of the seventh application (A), an eighth area (473) corresponding to the execution screen of the eighth application (B), and a ninth area (475) corresponding to the execution screen of the ninth application (C). For example, FIG. 4d illustrates a case where the electronic device determines the resolution of the seventh application to be high resolution and the resolutions of the eighth and ninth applications to be low resolution. For example, the seventh area (471) may occupy the left divided area in the fourth frame image (407), the eighth area (473) may constitute a part of the upper right divided area in the fourth frame image (407), and the ninth area (475) may constitute a part of the lower right divided area in the fourth frame image (407). For example, the seventh area (471) occupies the entire left divided area of ​​the fourth frame image (407), and the upper and lower right divided areas of the fourth frame image (407) may include blank areas (477, 479) that do not contain information corresponding to the execution screen of the application. For example, the locations of the seventh area (471), the eighth area (473), and the ninth area (475) in the fourth frame image (407) may correspond to display areas corresponding to the execution screen of the seventh application, the execution screen of the eighth application, and the execution screen of the ninth application on the display panel.

[0069] Referring to FIG. 4e, a fifth frame image (409) is illustrated, comprising a tenth area (491) corresponding to the execution screen of the tenth application (D), a eleventh area (493) corresponding to the execution screen of the eleventh application (E), and a twelfth area (495) corresponding to the execution screen of the eleventh application (F). For example, FIG. 4e illustrates a case where the electronic device determines the resolution of the tenth application, the eleventh application, and the eleventh application to be low resolution. For example, the tenth area (491) may constitute a part of the upper divided area in the fifth frame image (409), the eleventh area (493) may occupy a lower left divided area in the fifth frame image (409), and the twelfth area (495) may constitute a part of the lower right divided area in the fifth frame image (409). For example, the divided areas at the top and bottom right of the fifth frame image (409) may include blank areas (497, 499) that do not contain information corresponding to the execution screen of the application. For example, the locations of the tenth area (491), the eleventh area (493), and the twelveth area (495) in the fifth frame image (409) may correspond to display areas on the display panel that correspond to the execution screen of the tenth application, the execution screen of the eleventh application, and the execution screen of the twelveth application.

[0070] According to one embodiment, an electronic device (e.g., a display driving circuit) can upscale at least some of the regions included in a frame image and display execution screens of each of a plurality of applications on a display panel based on the frame image that has been at least partially upscaled. For example, the electronic device can partially upscale at least one region in the frame image that corresponds to the execution screen of an application determined at a low resolution. For example, the electronic device can upscale the fourth region (433) of FIG. 4b, the fifth region (451) and the sixth region (453) of FIG. 4c, the seventh region (471) and the eighth region (473) of FIG. 4d, and the tenth region (491) and the twelfth region (495) of FIG. 4e. For example, the electronic device can upscale at least a portion of the frame image based on information related to the size of the frame image and / or coordinate information of each of the regions included in the frame image. An embodiment in which an electronic device partially upscales a frame image using coordinate information is described in more detail in FIGS. 9a to 10b below.

[0072] FIG. 5 is a diagram illustrating the operation of an electronic device according to one embodiment.

[0073] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, or the electronic device (300) of FIG. 3) may include a flexible display (e.g., the display module (160) of FIG. 1 or the display panel (210) of FIG. 2) capable of expanding or contracting the screen display area (510, 520). For example, the electronic device may include a slideable display or a foldable display.

[0074] For example, 501 represents a first frame image in which the screen display area of ​​the display is in a reduced state, and 503 represents a second frame image in which the screen display area of ​​the display is in an expanded state. For example, as a slideable display is slid and expanded, or as a folded part of a foldable display is unfolded, the frame image (503) may be generated to include a part (520) corresponding to the expanded screen display area of ​​the display. For example, the first frame image (501) may include only the part (510) corresponding to the display in the reduced screen display area state, and the second frame image (503) may include the part (510) corresponding to the display in the reduced screen display area state and the part (520) corresponding to the expanded screen display area of ​​the display.

[0075] According to one embodiment, when the screen display area of ​​a display is switched from a reduced state to an expanded state, the electronic device may determine the resolution of an application to be displayed on the expanded screen display area to be low resolution. For example, low resolution may mean a resolution lower than a reference resolution value (e.g., the resolution of the display). For example, when application A is running and application B and / or application C is running on the expanded screen display area, the electronic device may determine the resolution of application B and application C to be low resolution. For example, the electronic device may generate a frame image including area a (531) corresponding to the execution screen of application A, area b (533) corresponding to the execution screen of application B, and area c (535) corresponding to the execution screen of application C. For example, the locations of area a (531), area b (533), and area c (535) in the second frame image (503) may correspond to display areas corresponding to the execution screen of application A, the execution screen of application B, and the execution screen of application C on the display (e.g., locations where the execution screen of application A, the execution screen of application B, and the execution screen of application C will be displayed on the display). For example, area b (533) may constitute a part of the upper divided area of ​​the portion (520) corresponding to the extended screen display area in the second frame image (503), and area c (535) may constitute a part of the lower divided area of ​​the portion (520) corresponding to the extended screen display area in the frame image. For example, the upper and lower divided areas of the region corresponding to the extended screen display area (520) in the second frame image (503) may include blank areas (537, 539) that do not contain information corresponding to the execution screen of the application.

[0076] According to one embodiment, the electronic device may upscale at least one of the regions included in the second frame image (503) (e.g., region a (531) and region b (533)) and display execution screens of each of a plurality of applications (e.g., applications A, B, and C) on a display based on the second frame image (503) that has been at least partially upscaled. For example, the electronic device may partially upscale region b (533) and / or region c (535) in the second frame image (503) and display execution screens of application A, application B, and application C on a display based on the second frame image (503) that has been at least partially upscaled.

[0078] FIG. 6 is a diagram illustrating the operation of an electronic device according to one embodiment.

[0079] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, or the electronic device (300) of FIG. 3) may divide the screen of a display (e.g., the display module (160) of FIG. 1, the display panel (210) of FIG. 2, or the display (353) of FIG. 3) in response to user input. For example, the electronic device may divide the screen of the display in response to user input to provide a multi-window screen. For example, user input may include input for additionally executing application B while application A is running. For example, while the electronic device is displaying the execution screen of application A as a full screen on the display, it may divide the screen of the display in response to user input and display the execution screen of application A in a divided portion area. According to one embodiment, the electronic device may provide a user interface for determining the resolution of application B when application B is running. For example, the electronic device may determine the resolution of application B while maintaining the execution state of application A based on user input received through the user interface.

[0080] According to one embodiment, an electronic device may receive user input selecting at least one of a plurality of applications while executing a plurality of applications, and may provide a user interface for setting the resolution of the selected at least one application. For example, the electronic device may change the resolution of the selected at least one application based on user input received through the user interface. For example, the electronic device may change the resolution while maintaining the execution state of the selected at least one application. For example, while executing Application A and Application B, the electronic device may change the resolution of some applications (e.g., Application B) from high resolution to low resolution based on user selection and / or user input. In this case, the electronic device may change only the settings (e.g., configuration) related to the resolution of Application B without terminating, restarting, or resetting Application B. For example, the electronic device may change the resolution of the selected Application B without affecting other processes running in the foreground by delivering a notification to change the resolution only to the selected Application B.

[0081] For example, the first frame image (601) represents a case where it includes only area a (631) corresponding to the execution screen of application A before generating area b corresponding to the execution screen of application B after screen splitting, and the second frame image (603) represents a case where it includes area a (631) corresponding to the execution screen of application A and area b (633) corresponding to the execution screen of application B. For example, if application A is set to high resolution, the electronic device can generate area a (631) corresponding to the execution screen of application A at high resolution. For example, area a (631) may be included in the area corresponding to the display area corresponding to the execution screen of application A among the divided areas of the display in the frame images (601, 603) (e.g., the area (left area) for displaying the execution screen of application A on the display). For example, when application B is executed, if application B is set to low resolution, or if the resolution of the running application B changes from high resolution to low resolution, the electronic device can generate area b (633) corresponding to the execution screen of application B at low resolution. For example, area b (633) may be included in the area corresponding to the display area corresponding to the execution screen of the B application (e.g., the area to display the execution screen of the B application (right area)) among the divided areas of the display in the second frame image (603).

[0082] According to one embodiment, FIG. 6 illustrates a case where the resolution of application B is determined to a specified low resolution or changed from a high resolution to a low resolution, but is not limited thereto, and the number of applications executed simultaneously is not limited to two.

[0084] FIG. 7 is a diagram illustrating the operation of an electronic device according to one embodiment. For example, FIG. 7 shows a frame image in which the resolution of the applications is inherited when the display positions of the execution screens of the applications are switched with one another.

[0085] For example, assume a case where an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, or electronic device (300) of FIG. 3) displays an execution screen of application A, an execution screen of application B, and an execution screen of application C on a display (e.g., display module (160) of FIG. 1, display panel (210) of FIG. 2, or display (353) of FIG. 3), and switches the display positions of the execution screen of application A and the execution screen of application B based on user input.

[0086] For example, the electronic device may alternately set the resolution set for application A and the resolution set for application B, and exchange coordinate information between area a (711) corresponding to the execution screen of application A and area b (721) corresponding to the execution screen of application B. In this case, the scaling factor between area a (711) and area b (721) can be seen as inherited. For example, if the resolution of application A is set to high resolution and the resolution of application B is set to low resolution before switching the display positions of the execution screens, the resolution of application A may be changed to low resolution and the resolution of application B may be changed to high resolution after switching the display positions of the execution screens. For example, the coordinate information of area a (711) before switching the display positions of the execution screens becomes the coordinate information of area b' (723) after switching the display positions of the execution screens, and the coordinate information of area b (721) before switching the display positions of the execution screens becomes the coordinate information of area a' (713) after switching the display positions of the execution screens. For example, if the starting coordinate information of area a (711) before switching the display positions of the execution screens is (Start_ax, Start_ay) and the ending coordinate information is (End_ax, End ay), and the starting coordinate information of area b' (723) after switching the display positions of the execution screens is (Start_b'x, Start_b'y) and the ending coordinate information is (End_b'x, End_b'y), then (Start_b'x, Start_b'y) may be the same as (Start_ax, Start_ay), and (End_b'x, End_b'y) may be the same as (End_ax, End ay).Conversely, if the starting coordinate information of area b (721) before switching the display positions of the execution screens is (Start_bx, Start_by) and the ending coordinate information is (End_bx, End_by), and the starting coordinate information of area a' (713) after switching the display positions of the execution screens is (Start_a'x, Start_a'y) and the ending coordinate information is (End_a'x, End a'y), then (Start_a'x, Start_a'y) may be the same as (Start_bx, Start_by), and (End_a'x, End_a'y) may be the same as (End_bx, End by). For example, since the display position of the execution screen of the C application has not changed, the resolution of the C application and the coordinate information of area c (731) may remain the same.

[0088] FIG. 8 is a diagram illustrating the operation of an electronic device according to one embodiment. For example, FIG. 8 shows a frame image in which the resolution of the applications is preserved when switching the display positions of the execution screens of the applications.

[0089] For example, assume a case where an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, or electronic device (300) of FIG. 3) displays an execution screen of application A, an execution screen of application B, and an execution screen of application C on a display (e.g., display module (160) of FIG. 1, display panel (210) of FIG. 2, or display (353) of FIG. 3), and switches the display positions of the execution screen of application A and the execution screen of application B based on user input.

[0090] For example, the electronic device may maintain the resolution set for application A and the resolution set for application B as they are, and change (reset) the coordinate information of area a (811) corresponding to the execution screen of application A and area b (821) corresponding to the execution screen of application B. In this case, the scaling factor between area a (811) and area b (821) can be seen as being preserved. For example, if the resolution of application A was set to high resolution and the resolution of application B was set to low resolution before switching the display positions of the execution screens, the resolution of application A may be maintained at high resolution and the resolution of application B may be maintained at low resolution after switching the display positions of the execution screens. For example, after switching the display positions of the execution screens, the coordinate information of area a' (813) may be changed independently of the coordinate information of area b (821) according to the resolution of application A, and the coordinate information of area b' (823) may be changed independently of the coordinate information of area a (811) according to the resolution of application B. For example, if the starting coordinate information of area a (811) before switching the display positions of the execution screens is (Start_ax, Start_ay) and the ending coordinate information is (End_ax, End ay), and the starting coordinate information of area b' (823) after switching the display positions of the execution screens is (Start_b'x, Start_b'y) and the ending coordinate information is (End_b'x, End_b'y), then (Start_b'x, Start_b'y), which is the starting point of area b' (823), may be the same as (Start_ax, Start_ay), but (End_b'x, End_b'y), which is the ending point of area b' (823), may be different from (End_ax, End ay).Conversely, if the starting coordinate information of area b (821) before switching the display positions of the execution screens is (Start_bx, Start_by) and the ending coordinate information is (End_bx, End_by), and the starting coordinate information of area a' (813) after switching the display positions of the execution screens is (Start_a'x, Start_a'y) and the ending coordinate information is (End_a'x, End a'y), then (Start_a'x, Start_a'y), which is the starting point of area a' (813), may be the same as (Start_bx, Start_by), but (End_a'x, End_a'y), which is the ending point of area a' (813), may be different from (End_bx, End by). For example, since the display position of the execution screen of the C application has not changed, the resolution of the C application and the coordinate information of area c (731) may remain the same.

[0091] According to one embodiment, when switching the display positions of the execution screens of applications, the electronic device may inherit the resolution (or scaling factor) of the applications as in FIG. 7 or preserve the resolution (or scaling factor) of the applications as in FIG. 8, depending on the characteristics or type of the application, user input, and / or user settings.

[0093] FIGS. 9a to 9c are drawings for explaining the operation of an electronic device according to one embodiment.

[0094] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, or the electronic device (300) of FIG. 3) can upscale at least a portion of a frame image (e.g., at least one of the regions included in the frame image) based on a frame image and coordinate information and / or coordinate information of a region corresponding to the execution screen of an application included in the frame image. For example, a processor of the electronic device (e.g., the processor (120) of FIG. 1, or the processor (230) of FIG. 2) transmits at least a portion of the frame image stored in a frame buffer, the coordinate information of the frame image, and / or coordinate information of a region corresponding to the execution screen of an application included in the frame image to a display driving circuit (e.g., the display driving circuit (220) of FIG. 2, or the display driver (341) of FIG. 3), and the display driving circuit can at least temporarily store (write) a frame image that has been partially upscaled to a graphic memory (e.g., GRAM (graphic random access memory)) based on the received frame image and coordinate information. For example, the display driving circuit includes a scaler (e.g., scaler (351) of FIG. 3) capable of at least partially up-scaling a frame image, and can use the scaler to at least partially up-scale the frame image. For example, the display driving circuit can display a screen corresponding to at least partially up-scaled frame image on a display panel.

[0095] For example, FIG. 9a illustrates a case where Application A, Application B, and Application C are all set to high resolution, so that upscaling of the frame image is not required. For example, high resolution may mean a resolution greater than or equal to a reference resolution value (e.g., the resolution of a display) that determines whether upscaling is required. For example, a first area (910) corresponding to the execution screen of Application A, a second area (920) corresponding to the execution screen of Application B, and a third area (930) corresponding to the execution screen of Application C may all be generated at high resolution and included in the frame image. For example, the first area (910), the second area (920), and the third area (930) may constitute the entire frame image. In this case, by generating the execution screens of all applications (areas corresponding to the execution screens (910, 920, 930)) at high resolution, the execution screens of Applications A, B, and C can all be provided in high resolution. For example, if applications A, B, and C are all applications requiring high visibility or high image quality, the electronic device can provide a high-quality execution screen without upscaling the frame images by setting the resolutions of applications A, B, and C to high resolution and generating the frame images in high resolution from the beginning.

[0096] For example, FIG. 9b illustrates a case where the entire frame image is upscaled collectively. For example, FIG. 9b assumes that Application A, Application B, and Application C are all set to low resolution. For example, the electronic device can collectively upscale a fourth area (940) corresponding to the execution screen of Application A included in the frame image, a fifth area (950) corresponding to the execution screen of Application B, and a sixth area (960) corresponding to the execution screen of Application C. For example, the electronic device can collectively upscale the fourth area (940) corresponding to the execution screen of Application A included in the frame image, the fifth area (950) corresponding to the execution screen of Application B, and the sixth area (960) corresponding to the execution screen of Application C, thereby minimizing the power or resources consumed to display the execution screen on the display. For example, if the electronic device is an application where high visibility or high image quality is not required for all of the applications A, B, and C, the resolution of all of the applications A, B, and C is set to low resolution, and the frame images (e.g., the fourth region (940), the fifth region (950), and the sixth region (960)) are generated at low resolution from the beginning, thereby minimizing resource consumption by collectively up-scaling the frame images.

[0097] FIG. 9c illustrates a case in which an electronic device according to one embodiment at least partially upscales a frame image. For example, FIG. 9c illustrates a case in which the resolution of application A is set to high resolution, and the resolutions of application B and application C are set to low resolution. For example, the electronic device may generate a frame image including a seventh region (970) corresponding to the execution screen of application A, an eighth region (980) corresponding to the execution screen of application B, and a ninth region (990) corresponding to the execution screen of application C. The electronic device may partially upscale the frame image. For example, the electronic device may not upscale the seventh region (970) generated at high resolution, but may upscale the eighth region (980) and the ninth region (990). For example, the electronic device may determine the part to be upscaled based on the coordinate information of the frame image and the coordinate information of each of the regions (970, 980, 990) included in the frame image, and may at least partially upscale the frame image. For example, by at least partially up-scaling a frame image, an electronic device can reduce the power consumed to display an image on a display while preventing degradation of image quality. In the description of FIGS. 10a and FIGS. 10b below, an embodiment of partially up-scaling a frame image based on coordinate information is specifically described.

[0099] FIGS. 10a and 10b are drawings for explaining the operation of an electronic device according to one embodiment.

[0100] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2, or the electronic device (300) of FIG. 3) can upscale at least a part of a frame image (1001, 1005) (e.g., at least one of the areas (1010, 1020, 1030, 1040, 1050, 1060) corresponding to the execution screen of an application included in the frame image (1001, 1005)) based on at least some of the coordinate information of the frame image (1001, 1005) or the coordinate information of each of the areas (1010, 1020, 1030, 1040, 1050, 1060) corresponding to the execution screen included in the frame image (1001, 1005). For example, the electronic device can determine whether to upscale each of the regions (1010, 1020, 1030, 1040, 1050, 1060) based on the coordinate information of the frame image (1001, 1005) and the coordinate information of each of the regions (1010, 1020, 1030, 1040, 1050, 1060) corresponding to the execution screen of the application included in the frame image (1001, 1005).

[0101] For example, the coordinate information of the frame image (1001, 1005) may correspond to the display of the electronic device (e.g., the entire screen display area of ​​the display). For example, the electronic device may not upscale if the end coordinate information of each area (1010, 1020, 1030, 1040, 1050, 1060) included in the frame image (1001, 1005) is the same as, or adjacent to, the information of the frame image (1001, 1005) (e.g., size of the display-1), and may upscale otherwise.

[0102] For example, in FIG. 10a, it is assumed that the start coordinate information of the first frame image (1001) (e.g., display) is (0,0) and the end coordinate information is (Full_x, Full_y), the start coordinate information of the first area (1010) corresponding to application A is (Start_ax, Start_ay) and the end coordinate information is (End_ax, End_ay), the start coordinate information of the second area (1020) corresponding to application B is (Start_bx, Start_by) and the end coordinate information is (End_bx, End_by), and the start coordinate information of the third area (1030) corresponding to application C is (Start_cx, Start_cy) and the end coordinate information is (End_cx, End_cy). For example, with respect to the first region (1010), End_ax may be identical to Start_bx (e.g., when End_ax = Start_bx) or adjacent to it (e.g., when End_ax = Start_bx - 1), and End_ay = Full_y may hold. In this case, the electronic device may determine that up-scaling of the first region (1010) is not required. For example, the electronic device may not up-scale the first region (1010). For example, with respect to the second image (1020), End_bx may be different from Full_x, End_by may be different from Start_Cy, and End_by may not be adjacent to Start_Cy. In this case, the electronic device may determine that up-scaling of the second region (1020) is required. For example, the electronic device can upscale the second region (1020) to a region corresponding to the (Full_x, Start_Cy) coordinate information. For example, with respect to the third region (1030), End_cx may be different from Full_x, and End_cy may be different from Full_y. In this case, the electronic device may determine that upscaling of the third region (1030) is necessary.For example, the electronic device can upscale the third region (1030) to a region corresponding to the (Full_x, Full_y) coordinate information.

[0103] Similarly, in FIG. 10b, it is assumed that the start coordinate information of the second frame image (1005) (e.g., display) is (0,0) and the end coordinate information is (Full_x, Full_y), the start coordinate information of the fourth area (1040) corresponding to application A is (Start_Ax, Start_Ay) and the end coordinate information is (End_Ax, End_Ay), the start coordinate information of the fifth area (1050) corresponding to application B is (Start_Bx, Start_By) and the end coordinate information is (End_Bx, End_By), and the start coordinate information of the sixth area (1060) corresponding to application C is (Start_Cx, Start_Cy) and the end coordinate information is (End_Cx, End_Cy). For example, with respect to the fourth region (1040), End_Ax may be different from Full_x, and End_Ay may be different from Start_By or Start Cy and may not be adjacent to each other. In this case, the electronic device may determine that up-scaling of the fourth region (1040) is required. For example, the electronic device may up-scale the fourth region (1040) to a region corresponding to the coordinate information (Full_x, Start_By=Start_Cy (or Start_By ? 1 = Start_Cy ? 1)). For example, with respect to the fifth region (1050), End_Bx may be the same as Start_Cx (e.g., when End_Bx = Start_Cx) or adjacent (e.g., when End_Bx = Start_Cx - 1), and End_By may be the same as Full_y. In this case, the electronic device may determine that up-scaling of the fifth region (1050) is not necessary. For example, the electronic device may not up-scale the fifth region (1050). For example, with respect to the sixth region (1060), End_Cx is different from Full_x, and End_Cy is different from Full_y.In this case, the electronic device may determine that up-scaling of the sixth region (1060) is necessary. For example, the electronic device may up-scale the sixth region (1060) to a region corresponding to the (Full_x, Full_y) coordinate information.

[0105] An electronic device according to one embodiment disclosed in this document may include a display panel, a display driving circuit, and at least one processor operatively connected to the display driving circuit. The at least one processor may determine the resolution of each of a plurality of applications and, based on at least a portion of information regarding a display area corresponding to the resolution of each of the plurality of applications and the execution screen of each of the plurality of applications on the display panel, generate a frame image including the execution screen of each of the plurality of applications and areas corresponding to the determined resolution, and transmit the frame image and coordinate information of each of the areas included in the frame image to the display driving circuit. The display driving circuit may, based on the frame image and the coordinate information of each of the areas, upscale at least a portion of the areas included in the frame image that have a resolution lower than the resolution of the display panel so that the frame image has a resolution corresponding to the resolution of the display panel, and control the display panel to display the execution screen of each of the plurality of applications based on the upscaled frame image.

[0106] According to one embodiment, the display driving circuit may include a scaler configured to hardware-upscale at least a portion of the frame image.

[0107] According to one embodiment, the at least one processor can determine the resolution of each of the plurality of applications based at least partially on the type of each of the plurality of applications.

[0108] According to one embodiment, the at least one processor can determine the resolution of each of the plurality of applications based on at least a portion of the area occupied by the execution screen of each of the plurality of applications in the entire screen display area of ​​the display panel.

[0109] According to one embodiment, the at least one processor controls the display panel through the display driving circuit to provide a user interface for setting the resolution of at least one of the plurality of applications, and can determine the resolution of the at least one application based on an input received through the user interface.

[0110] According to one embodiment, the at least one processor can determine the resolution of each of the plurality of applications based on resolution information set when each of the plurality of applications was previously executed.

[0111] According to one embodiment, the at least one processor may perform an operation to determine the resolution in response to user input for providing a multi-window screen including execution screens of the plurality of applications.

[0112] According to one embodiment, the user input may include a user input for additionally executing a second application while displaying the execution screen of a first application through the display panel.

[0113] According to one embodiment, the at least one processor controls the display panel through the display driving circuit to provide a user interface for setting the resolution of the second application, and can determine the resolution of the second application while maintaining the execution state of the first application based on user input received through the user interface.

[0114] According to one embodiment, the display panel includes a flexible display panel capable of expanding or contracting the screen display area, and the at least one processor can determine the resolution of an application displayed in the expanded screen display area to be lower than the resolution of the display panel when the screen display area of ​​the display panel is switched from a contracted state to an expanded state.

[0115] According to one embodiment, the at least one processor receives a user input selecting at least one application among the plurality of applications while executing the plurality of applications, controls the display driving circuit to provide a user interface for the display panel to set the resolution of the selected at least one application, and can change the resolution set for the selected at least one application based on the user input received through the user interface.

[0116] According to one embodiment, the plurality of applications includes a first application and a second application, and the at least one processor determines the resolution of the first application to a first resolution corresponding to the resolution of the display panel and determines the resolution of the second application to a second resolution lower than the first resolution, generates the frame image including a first area corresponding to a first execution screen of the first application and a second area corresponding to a second execution screen of the second application, and can transmit at least some of the frame image, information related to the size of the frame image, coordinate information of the first area, or coordinate information of the second area to the display driving circuit. The display driving circuit can upscale the second area within the frame image based on at least some of the frame image, information related to the size of the frame image, coordinate information of the first area, or coordinate information of the second area, and control the display panel to display the execution screen of each of the plurality of applications based on the frame image in which the second area is upscaled.

[0117] According to one embodiment, the at least one processor can generate the frame image based on information of a first display area in which the first execution screen of the first application is displayed on the display panel and information of a second display area in which the second execution screen of the second application is displayed, such that a first area corresponding to the first execution screen is included at a position corresponding to the first display area in the frame image, and a second area corresponding to the second execution screen is included at a position corresponding to the second display area in the frame image.

[0118] According to one embodiment, each of the plurality of applications includes a first execution screen of a first application and a second execution screen of a second application, and the at least one processor receives a user input for switching the display positions of the first execution screen and the second execution screen with each other, and in response to the user input for switching the display positions with each other, sets a first resolution set in the first application and a second resolution set in the second application by swapping them with each other, and sets the coordinate information of a first area corresponding to the first execution screen included in the frame image and the coordinate information of a second area corresponding to the second execution screen by swapping them with each other.

[0119] According to one embodiment, each of the plurality of applications includes a first execution screen of a first application and a second execution screen of a second application, and the at least one processor receives a user input for switching the display positions of the first execution screen and the second execution screen with each other, and in response to the user input for switching the display positions with each other, can change the coordinate information of a first area corresponding to the first execution screen and the coordinate information of a second area corresponding to the second execution screen included in the frame image while maintaining a first resolution set in the first application and a second resolution set in the second application.

[0120] According to one embodiment, the at least one processor can transmit information related to the size of the frame image to the display driving circuit.

[0121] According to one embodiment, the at least one processor can determine whether to upscale each of the regions based on information related to the size of the frame image or at least some of the coordinate information of each of the regions.

[0123] FIG. 11 is a flowchart of a display control method for an electronic device according to one embodiment. For example, the operations of FIG. 11 may be performed by a processor (e.g., processor (120) of FIG. 1 or processor (230) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, or electronic device (300) of FIG. 3) and / or a display driving circuit (e.g., display driving circuit (220) of FIG. 2).

[0124] According to one embodiment, in operation 1110, the electronic device may determine the resolution of each of a plurality of applications. For example, the electronic device may determine the resolution of each of a plurality of applications based on the type of each of the plurality of applications. For example, the electronic device may determine the resolution of an application as high resolution or low resolution. For example, high resolution may mean a resolution greater than or equal to a reference resolution value (e.g., the resolution of a display) that determines whether up-scaling is required, and low resolution may mean a resolution less than or equal to the reference resolution value. For example, the electronic device may determine the resolution of an application that needs to be displayed with relatively high quality (resolution) on a display, such as an application of a type that requires good readability due to a large amount of text within the execution screen (e.g., a document application) or an application of a type that requires good visibility (e.g., a gallery application, a video application, and a social media application), as high resolution. For example, the electronic device may determine the resolution of an application of a type where the quality (resolution) displayed on the display is relatively less important (e.g., a health application, a financial or banking application, a navigation application, and a music application) as low resolution. For example, if the resolution of a high-performance application (e.g., a high-performance game application) is determined to be high, multitasking may not be performed smoothly due to insufficient resources of the electronic device when multitasking multiple applications; therefore, the electronic device may determine the resolution of the high-performance application to be low if necessary. For example, the electronic device may determine the resolution of each application based on at least a portion of the area occupied by the execution screen of each application within the entire screen display area of ​​the display.For example, if the execution screen of an application occupies more than a specified percentage (e.g., 50%) of the total screen display area, the electronic device may determine the resolution of the application to be high. For example, the electronic device may provide a user interface for setting the resolution of an application that is currently running or to be executed, and may determine the resolution of the application based on input received through the user interface. For example, the electronic device may determine the resolution of the application based on resolution information set when the application was previously executed. For example, the application's manifest may store resolution information set when the application was previously executed. For example, the electronic device may determine the resolution of the application based on information stored in the application's manifest.

[0125] According to one embodiment, an electronic device may perform an operation 1110 in response to user input for providing a multi-window screen including execution screens of a plurality of applications. For example, the user input may include user input for additionally executing another application while one application is running.

[0126] According to one embodiment, in operation 1120, the electronic device may generate a frame image comprising regions corresponding to the execution screen of each of the plurality of applications and the resolution of each of the plurality of applications (e.g., the resolution determined in operation 1110), based at least partially on information of a display area corresponding to the resolution of each of the plurality of applications and / or the execution screen of each of the plurality of applications. For example, the frame image may correspond to the entire screen display area to be displayed on the display. For example, the electronic device may generate (or render) a region corresponding to the execution screen of each application. For example, the electronic device may generate a region corresponding to the execution screen of an application determined to be high resolution so as to correspond to the size of the execution screen to be displayed on the display and / or the resolution of the display. For example, the electronic device may generate a region corresponding to the execution screen of an application determined to be high resolution so as to be smaller than the size of the execution screen to be displayed on the display, or at a resolution lower than the resolution of the display.

[0127] For example, an electronic device can generate a frame image by merging or composing regions corresponding to the execution screens of multiple applications. For example, the electronic device can store the frame image in a frame buffer.

[0128] According to one embodiment, in operation 1130, the electronic device may upscale at least some of the regions included in the frame image so that the frame image has a resolution corresponding to the resolution of the display, based on at least some of the frame image, information related to the size of the frame image, and / or coordinate information of each of the regions included in the frame image. For example, the information related to the size of the frame image may include start coordinate information and end coordinate information of the frame image. For example, the coordinate information of each of the regions may include start coordinate information and end coordinate information of each of the regions. For example, the electronic device may upscale at least one of the regions included in the frame image through a scaler included in the display driving circuit. For example, the electronic device may not upscale the entire frame image collectively, but may selectively upscale a part of the frame image (e.g., at least one of the regions included in the frame image).

[0129] According to one embodiment, in operation 1140, the electronic device can display the execution screen of each of a plurality of applications on a display based on at least a partially upscaled frame image.

[0131] FIG. 12 is a flowchart of a display control method for an electronic device according to one embodiment. Descriptions that overlap with FIG. 11 below are omitted or briefly described. For example, the operations of FIG. 12 may be performed by a processor (e.g., processor (120) of FIG. 1 or processor (230) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, or electronic device (300) of FIG. 3) and / or a display driving circuit (e.g., display driving circuit (220) of FIG. 2).

[0132] According to one embodiment, in the operation of 1205, an electronic device (e.g., a processor) may enter a split screen (e.g., a multi-window screen). For example, the electronic device may enter a split screen in response to user input to execute a second application while displaying the execution screen of a first application as a full screen on a display. For example, the electronic device may split the screen of the display to simultaneously display the execution screen of the first application and the execution screen of the second application. For example, if the electronic device includes a flexible display that can expand or contract the screen display area, the electronic device may provide at least a portion of the expanded screen display area as a split screen as the screen display area of ​​the flexible display is expanded.

[0133] According to one embodiment, in operation 1210, an electronic device (e.g., a processor) may determine the resolution of an application based at least partially on a display area corresponding to the execution screen of the application on a display and the type of the application. For example, the electronic device may determine the resolution of a specified type of application requiring high readability or visibility to be high resolution, and the resolution of an application other than the specified type to be low resolution. For example, the electronic device may determine the resolution of the application to be high resolution if the area occupied by each execution screen of the application in the entire screen display area of ​​the display is greater than or equal to a specified value (e.g., 50%). For example, the electronic device may provide a user interface for setting the resolution of an application that is currently running or to be run, and may determine the resolution of the application based on input received through the user interface. For example, the electronic device may determine the resolution of the application based on resolution information set when the application was previously executed.

[0134] According to one embodiment, in the operation of 1215, an electronic device (e.g., a processor) may generate regions corresponding to the execution screen of an application. For example, the electronic device may generate or draw regions corresponding to the execution screen of each application (e.g., an image or view corresponding to the execution screen) based on a determined resolution.

[0135] According to one embodiment, in operation 1220, an electronic device (e.g., a processor) can generate a frame image by merging regions and recognize coordinate information of regions included in the frame image. For example, the electronic device can store the frame image generated by merging or composing regions in a frame buffer. For example, the electronic device can recognize the start coordinate information and end coordinate information of the frame image, and the start coordinate information and end coordinate information of each region within the frame image.

[0136] According to one embodiment, in operation 1225, an electronic device (e.g., a processor) may transmit a frame image and coordinate information to a display driving circuit (e.g., a DDI). For example, the electronic device (e.g., a processor) may transmit at least some of the frame image, information related to the size of the frame image, or coordinate information of each region within the frame image to the display driving circuit.

[0137] According to one embodiment, operations 1205 to 1225 can be performed by a processor of an electronic device.

[0138] According to one embodiment, in operation 1230, an electronic device (e.g., a display driving circuit) can update a frame image in the graphics memory (e.g., GRAM) of the display driving circuit. For example, in operation 1225, the display driving circuit of the electronic device can update a frame image received from the processor in the graphics memory.

[0139] According to one embodiment, in operation 1235, an electronic device (e.g., a display driving circuit) can at least partially upscale a frame image based on coordinate information. For example, the electronic device can upscale at least one of the low-resolution images included in the frame image. For example, the operation of partially upscaled a frame image using coordinate information is described in FIGS. 9a to 10b, so a redundant description is omitted.

[0140] According to one embodiment, in operation 1240, an electronic device (e.g., a display driving circuit) can display a screen on a display based on a frame image that has been at least partially upscaled. For example, the electronic device can display an execution screen of an application on each of the split screens of the display based on a frame image that has been at least partially upscaled.

[0141] According to one embodiment, 1230 operations to 1250 operations can be performed by a display driving circuit of an electronic device.

[0142] According to one embodiment, the electronic device can selectively adjust the resolution of the required application by partially up-scaling the frame image instead of collectively up-scaling the frame image. Accordingly, the electronic device does not generate high-resolution areas corresponding to the execution screens of all applications within the frame image, but generates high-resolution areas corresponding to the execution screens of applications requiring high resolution based on the application type or display area corresponding to the execution screen, and generates low-resolution areas corresponding to the execution screens of applications not requiring high resolution, and then uses the frame image by at least partially up-scaling it. This allows the device to control the display with lower power consumption than when the entire frame image (e.g., all areas included in the frame image) is generated in high resolution, while improving the quality (resolution) of the screen displayed on the display compared to when the entire frame image is generated in low resolution.

[0144] FIG. 13 is a flowchart of an operation for generating an image corresponding to an execution screen of an electronic device according to one embodiment. Descriptions that overlap with FIG. 11 and FIG. 12 are omitted or briefly described below. For example, the operations of FIG. 13 may be performed by a processor (e.g., processor (120) of FIG. 1 or processor (230) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, or electronic device (300) of FIG. 3).

[0145] According to one embodiment, in operation 1305, the electronic device can determine whether the area occupied by the execution screen of an application in the full screen display area is greater than or equal to a specified ratio. For example, the specified ratio may be pre-set or set by user input. For example, the electronic device may perform operation 1325 if the area occupied by the execution screen of an application in the full screen display area is greater than or equal to the specified ratio (operation 1305 - YES), and perform operation 1310 if it is less than the specified ratio (operation 1305 - NO).

[0146] According to one embodiment, in operation 1310, the electronic device may determine whether to determine the resolution of the application to be high resolution based on user input. For example, the electronic device may provide a user interface for determining the resolution of an application that is running or to be run, and may receive user input for determining the resolution of the application through the user interface. For example, the electronic device may perform operation 1325 if it determines the resolution of the application to be high resolution based on user input (operation 1310 - YES), and perform operation 1315 if it determines the resolution of the application to be low resolution (operation 1310 - NO).

[0147] According to one embodiment, in operation 1315, the electronic device can determine whether the type of application requires high-resolution operation. For example, an application requiring high visibility or readability may be a designated type requiring high-resolution operation, and an application not requiring high visibility or readability may be a designated type not requiring high-resolution operation. For example, the electronic device may pre-set the application requiring high-resolution operation to a designated type or set it by the user. For example, the electronic device may perform operation 1325 if the type of application is a designated type requiring high-resolution operation (operation 1315 - YES), and perform operation 1320 if it is not a designated type requiring high-resolution operation (operation 1310 - NO).

[0148] According to one embodiment, in operation 1320, the electronic device can determine whether the resolution information set when the application was previously executed is high resolution. For example, the resolution information set during the previous execution may be stored in the application's manifest. For example, the electronic device can determine whether the resolution information set when the application was previously executed is high resolution based on the information stored in the application's manifest. For example, if the resolution information set when the application was previously executed is high resolution (operation 1320 - YES), operation 1325 may be performed, and if the previously set resolution information is low resolution (operation 1320 - NO), operation 1330 may be performed.

[0149] According to one embodiment, the order of operations 1305 to 1320 may be changed, or some operations may be omitted.

[0150] According to one embodiment, in the operation of 1325, the electronic device may determine the resolution of the application to be high resolution. For example, high resolution may mean a resolution corresponding to the resolution of the execution screen of the application to be displayed on the display (e.g., the resolution of the display). For example, high resolution may mean a resolution greater than or equal to a reference resolution value (e.g., the resolution of the display) that determines whether to upscale the area corresponding to the execution screen of the application included in the frame image.

[0151] According to one embodiment, in operation 1330, the electronic device may set the resolution of the application to a low resolution. For example, the specified low resolution may mean a resolution lower than the resolution of the execution screen of the application to be displayed on the display (e.g., the resolution of the display). For example, the low resolution may mean a resolution lower than a reference resolution value (e.g., the resolution of the display) that determines whether to upscale the area corresponding to the execution screen of the application included in the frame image.

[0152] According to one embodiment, in the operation of 1335, the electronic device may generate an area corresponding to the execution screen of an application (e.g., image data or view corresponding to the execution screen) based on a determined (set) resolution. For example, the electronic device may generate a frame image including a plurality of areas corresponding to the execution screens of each of a plurality of applications.

[0154] FIG. 14 is a flowchart of an operation for generating an image corresponding to an execution screen of an electronic device according to one embodiment. Descriptions that overlap with FIGS. 11 to 13 are omitted or briefly described below. For example, the operations of FIG. 14 may be performed by a processor (e.g., processor (120) of FIG. 1 or processor (230) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIG. 2, or electronic device (300) of FIG. 3).

[0155] According to one embodiment, in operation 1410, the electronic device may determine whether there is changed resolution information within the application's manifest in a split-screen state. For example, a split-screen state may refer to a state in which the screen of a display is divided to simultaneously display the execution screens of multiple applications. For example, the application's manifest may store resolution information set when the application was previously executed. For example, if there is changed resolution information within the application's manifest, it may mean that there is resolution information set by the user or the electronic device during a previous execution of the application. For example, the electronic device may perform operation 1420 if there is changed resolution information within the manifest (operation 1410 - YES). For example, the electronic device may perform operation 1430 if there is no changed resolution information within the manifest (operation 1410 - NO).

[0156] According to one embodiment, in operation 1420, the electronic device can set the resolution of the application to a resolution stored in the manifest. For example, the electronic device can set the resolution of the application to a resolution that was set when the application was previously executed, based on the resolution information stored in the manifest.

[0157] According to one embodiment, in operation 1430, the electronic device may determine whether the execution screen of the application occupies more than a specified percentage of the full screen display area, or whether the application requires high-definition operation. For example, the electronic device may perform operation 1440 if the execution screen of the application occupies more than a specified percentage of the full screen display area, or if the application requires high-definition operation (operation 1430 - YES), and perform operation 1450 if not (operation 1410 - NO).

[0158] According to one embodiment, in operation 1440, the electronic device may set the resolution of the application to a high resolution. For example, the high resolution may mean a resolution greater than or equal to a reference resolution value (e.g., the resolution of the display) for determining whether up-scaling of an area corresponding to the execution screen of the application is required.

[0159] According to one embodiment, in operation 1450, the electronic device may set the resolution of the application to a low resolution. For example, the low resolution may mean a resolution lower than a reference resolution value (e.g., the resolution of the display) for determining whether up-scaling of an area corresponding to the execution screen of the application is required.

[0160] According to one embodiment, in operation 1460, the electronic device can determine whether there is a change in resolution by the user. For example, the electronic device may provide a user interface for receiving user input for changing the resolution and may receive user input through the user interface. For example, the electronic device may determine whether there is a change in the resolution set in operation 1420, operation 1440, or operation 1450 depending on the user input. For example, the electronic device may perform operation 1470 if there is a change in resolution by the user (operation 1460 - YES), and perform operation 1480 if there is no change in resolution by the user (operation 1460 - NO).

[0161] According to one embodiment, in operation 1470, the electronic device stores resolution information changed by the user in a manifest and can set the resolution of the application to the resolution changed by the user.

[0162] According to one embodiment, in operation 1480, the electronic device can generate a frame image including an area corresponding to the execution screen of an application based on a set resolution.

[0164] The display control method of an electronic device disclosed in this document may include: determining the resolution of each of a plurality of applications; generating a frame image including the execution screen of each of the plurality of applications and regions corresponding to the determined resolution, based at least partially on information of a display area corresponding to the execution screen of each of the plurality of applications on the display; up-scale at least some of the regions included in the frame image that have a resolution lower than the resolution of the display, based on the coordinate information of each of the regions included in the frame image and the frame image, so that the frame image has a resolution corresponding to the resolution of the display; and displaying the execution screen of each of the plurality of applications on the display based on the up-scaled frame image.

[0165] According to one embodiment, the plurality of applications includes a first application and a second application, and the operation of determining the resolution may include the operation of determining the resolution of the first application to a first resolution corresponding to the resolution of the display, and the operation of determining the resolution of the second application to a second resolution lower than the first resolution.

[0166] According to one embodiment, the operation of generating the frame image may include the operation of generating the frame image including a first area corresponding to a first execution screen of the first application and a second area corresponding to a second execution screen of the second application.

[0167] According to one embodiment, the operation of generating the frame image may include, based on information of a first display area in which the first execution screen of the first application is displayed on the display and information of a second display area in which the second execution screen of the second application is displayed, an operation of generating the frame image such that a first area corresponding to the first execution screen is included at a position corresponding to the first display area in the frame image, and a second area corresponding to the second execution screen is included at a position corresponding to the second display area in the frame image.

[0168] According to one embodiment, the operation of determining the resolution may include the operation of determining the resolution of each of the plurality of applications based on at least a portion of the area occupied by the execution screen of each of the plurality of applications in the entire screen display area of ​​the display.

[0169] According to one embodiment, the operation of determining the resolution may include an operation of providing a user interface for setting the resolution of at least one of the plurality of applications, and an operation of determining the resolution of the at least one application based on an input received through the user interface.

[0170] According to one embodiment, the operation of determining the resolution may include the operation of determining the resolution of each of the plurality of applications based on resolution information set when each of the plurality of applications was previously executed.

[0171] According to one embodiment, each of the plurality of applications includes a first execution screen of a first application and a second execution screen of a second application, and the method may further include an operation of receiving a user input for switching the display positions of the first execution screen and the second execution screen with each other, and in response to the user input for switching the display positions with each other, an operation of swapping the first resolution set in the first application and the second resolution set in the second application with each other, and swapping the coordinate information of an area corresponding to the first execution screen included in the frame image with the coordinate information of an area corresponding to the second execution screen.

[0172] According to one embodiment, each execution screen of the plurality of applications includes a first execution screen of a first application and a second execution screen of a second application, and the method may further include an operation of receiving a user input for switching the display positions of the first execution screen and the second execution screen with each other, and an operation of changing the coordinate information of a first area corresponding to the first execution screen and the coordinate information of a second area corresponding to the second execution screen included in the frame image while maintaining a first resolution set in the first application and a second resolution set in the second application in response to the user input for switching the display positions with each other.

[0173] According to one embodiment, the up-scaling operation may include an operation to determine whether to up-scale each of the regions based on at least some of the information related to the size of the frame image or the coordinate information of each of the regions.

[0175] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0176] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0177] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0178] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0179] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0180] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

Claim 1 An electronic device comprising: a display panel; a display driving circuit; and at least one processor operatively connected to the display driving circuit, wherein the at least one processor determines the resolution of each of a plurality of applications and, based on at least a portion of information regarding a display area corresponding to the resolution of each of the plurality of applications and the execution screen of each of the plurality of applications on the display panel, generates a frame image including the execution screen of each of the plurality of applications and areas corresponding to the determined resolution, transmits the frame image and coordinate information of each of the areas included in the frame image to the display driving circuit, wherein the display driving circuit determines whether to upscale each of the areas based on at least a portion of information related to the size of the frame image or the coordinate information of each of the areas, upscales at least a portion of the areas included in the frame image that have a resolution lower than the resolution of the display panel so that the frame image has a resolution corresponding to the resolution of the display panel, and controls the display panel to display the execution screen of each of the plurality of applications based on the upscaled frame image. Claim 2 An electronic device according to claim 1, wherein the display driving circuit comprises a scaler configured to hardware-upscale at least a portion of the frame image. Claim 3 The electronic device of claim 1, wherein the at least one processor determines the resolution of each of the plurality of applications based at least partially on the type of each of the plurality of applications. Claim 4 An electronic device according to claim 1, wherein the at least one processor determines the resolution of each of the plurality of applications based on at least a portion of the area occupied by the execution screen of each of the plurality of applications in the entire screen display area of ​​the display panel. Claim 5 An electronic device according to claim 1, wherein the at least one processor controls the display panel through the display driving circuit to provide a user interface for setting the resolution of at least one of the plurality of applications, and determines the resolution of the at least one application based on an input received through the user interface. Claim 6 The electronic device of claim 1, wherein the at least one processor determines the resolution of each of the plurality of applications based on resolution information set when each of the plurality of applications was previously executed. Claim 7 An electronic device according to claim 1, wherein the at least one processor performs an operation to determine the resolution in response to user input for providing a multi-window screen including execution screens of the plurality of applications. Claim 8 An electronic device according to claim 7, wherein the user input comprises a user input for additionally executing a second application while displaying an execution screen of a first application through the display panel. Claim 9 An electronic device according to claim 8, wherein the at least one processor controls the display panel to provide a user interface for setting the resolution of the second application through the display driving circuit, and determines the resolution of the second application while maintaining the execution state of the first application based on user input received through the user interface. Claim 10 An electronic device according to claim 7, wherein the display panel comprises a flexible display panel capable of expanding or contracting a screen display area, and the at least one processor determines the resolution of an application displayed in the expanded screen display area to a resolution lower than the resolution of the display panel when the screen display area of ​​the display panel is switched from a contracted state to an expanded state. Claim 11 An electronic device according to claim 1, wherein the at least one processor receives a user input selecting at least one application among the plurality of applications while executing the plurality of applications, controls the display driving circuit so that the display panel provides a user interface for setting the resolution of the selected at least one application, and changes the resolution set for the selected at least one application based on the user input received through the user interface. Claim 12 An electronic device according to claim 1, wherein the plurality of applications includes a first application and a second application, and the at least one processor determines the resolution of the first application to a first resolution corresponding to the resolution of the display panel and determines the resolution of the second application to a second resolution lower than the first resolution, generates the frame image including a first area corresponding to a first execution screen of the first application and a second area corresponding to a second execution screen of the second application, transmits at least some of the frame image, information related to the size of the frame image, coordinate information of the first area, or coordinate information of the second area to the display driving circuit, and the display driving circuit upscales the second area in the frame image based on at least some of the frame image, information related to the size of the frame image, coordinate information of the first area, or coordinate information of the second area, and controls the display panel to display the execution screen of each of the plurality of applications based on the frame image in which the second area is upscaled. Claim 13 An electronic device according to claim 12, wherein the at least one processor generates a frame image based on information of a first display area in which a first execution screen of the first application is displayed on the display panel and information of a second display area in which a second execution screen of the second application is displayed, such that a first area corresponding to the first execution screen is included at a position corresponding to the first display area in the frame image, and a second area corresponding to the second execution screen is included at a position corresponding to the second display area in the frame image. Claim 14 An electronic device according to claim 1, wherein each execution screen of a plurality of applications includes a first execution screen of a first application and a second execution screen of a second application, and the at least one processor receives a user input for switching the display positions of the first execution screen and the second execution screen with each other, and in response to the user input for switching the display positions with each other, sets a first resolution set in the first application and a second resolution set in the second application by swapping them with each other, and sets coordinate information of a first area corresponding to the first execution screen included in the frame image and coordinate information of a second area corresponding to the second execution screen by swapping them with each other. Claim 15 An electronic device according to claim 1, wherein each execution screen of a plurality of applications includes a first execution screen of a first application and a second execution screen of a second application, and the at least one processor receives a user input for switching the display positions of the first execution screen and the second execution screen with each other, and in response to the user input for switching the display positions with each other, changes the coordinate information of a first area corresponding to the first execution screen and the coordinate information of a second area corresponding to the second execution screen included in the frame image while maintaining a first resolution set in the first application and a second resolution set in the second application. Claim 16 In claim 1, the at least one processor is an electronic device that transmits information related to the size of the frame image to the display driving circuit, Claim 17 delete Claim 18 A method for controlling a display of an electronic device, comprising: determining the resolution of each of a plurality of applications; generating a frame image including the execution screen of each of the plurality of applications and regions corresponding to the determined resolution, based at least partially on information regarding a display area corresponding to the resolution of each of the plurality of applications and the execution screen of each of the plurality of applications on the display; determining whether to upscale each of the regions based on at least partially on information regarding the size of the frame image or coordinate information of each of the regions included in the frame image; upscale at least a portion of the regions included in the frame image that have a resolution lower than the resolution of the display so that the frame image has a resolution corresponding to the resolution of the display; and displaying the execution screen of each of the plurality of applications on the display based on the upscaled frame image. Claim 19 delete Claim 20 delete Claim 21 delete Claim 22 delete Claim 23 delete Claim 24 delete Claim 25 In claim 18, each execution screen of the plurality of applications includes a first execution screen of the first application and a second execution screen of the second application, and the method further comprises: receiving a user input for switching the display positions of the first execution screen and the second execution screen; and in response to the user input for switching the display positions, setting a first resolution set in the first application and a second resolution set in the second application by swapping them with each other, and setting coordinate information of an area corresponding to the first execution screen included in the frame image and coordinate information of an area corresponding to the second execution screen by swapping them with each other. Claim 26 In claim 18, each execution screen of the plurality of applications includes a first execution screen of the first application and a second execution screen of the second application, and the method further comprises: receiving a user input for switching the display positions of the first execution screen and the second execution screen with each other; and in response to the user input for switching the display positions with each other, changing the coordinate information of a first area corresponding to the first execution screen and the coordinate information of a second area corresponding to the second execution screen included in the frame image while maintaining a first resolution set in the first application and a second resolution set in the second application. Claim 27 delete

Images