Electronic device with hole area and method for controlling hole area thereof

Abstract

Disclosed herein is an electronic device having an aperture area and a method for controlling the aperture area thereof. The electronic device includes a housing, a touch screen, and at least one processor electrically coupled to a display. The processor implements a method comprising the following steps: defining a primary area and an extended area of the display of the electronic device, detecting a selection of displayed content, detecting, by the processor, whether a characteristic of a portion of the content disposed along an edge of the content is equal to or less than a threshold, and, based on whether the characteristic of the portion is equal to or less than the threshold, enlarging the selected displayed content so that it is displayed in the primary area and extended to the extended area.

Description

[0001] This application is a divisional application of the invention patent application with the application date of October 30, 2017, application number "201711039001.7", and title "Electronic device with a hole area and method for controlling its hole area". Technical Field

[0002] The following example embodiments relate to an electronic device having an aperture area and a method of controlling the aperture area thereof. Background Art

[0003] With the development of technology, electronic devices have been developed to provide various services and functions through multi-tasking or execution of various applications (for example, applications other than basic functions such as communication and data transmission).

[0004] Electronic devices with front-facing display screens may have increasingly larger screen sizes to provide better user experience through a larger viewing area. The screen size is limited by the placement of other components, such as a camera, an earpiece, and sensors located at the upper portion of the device's front surface, or a main button located further down the device's front surface. Summary of the Invention

[0005] The present disclosure is made in view of the above problems and provides an electronic device having a hole area that can magnify content through a display having a main area and an extension area, and a method of controlling the hole area thereof.

[0006] According to an aspect of the present disclosure, a method of an electronic device includes: defining a main area and an extended area of a display of the electronic device; detecting a selection of displayed content; detecting, by a processor, whether a feature of a portion of content set along an edge of the content is equal to or less than a threshold; and based on whether the feature of the portion is equal to or less than the threshold, enlarging the selected displayed content to be displayed on the main area and extended to the extended area.

[0007] According to another aspect of the present disclosure, an electronic device includes: a housing including a first surface facing a first direction, and a second surface facing a second direction opposite to the first direction; a touch screen display arranged between the first surface and the second surface so that a portion of the touch screen is exposed through the first surface, the touch screen display including a main area and an extended area, the extended area including at least one opening; and at least one processor electrically coupled to the display, configured to detect a selection of content displayed on the touch screen, and detect whether a feature of a portion of the content set along an edge of the content is equal to or less than a threshold, when the feature is equal to or less than the threshold, displaying the selected content on the main area and extending to the extended area, and when the feature is greater than the threshold, excluding the selected content from display in the extended area. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The objects and features of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0009] Figure 1 is a diagram illustrating a network environment including electronic devices according to various embodiments of the present disclosure;

[0010] Figure 2 is a block diagram illustrating a configuration of an electronic device according to an example embodiment;

[0011] Figure 3 is a block diagram illustrating a configuration of program modules according to various exemplary embodiments;

[0012] Figure 4 is a front view illustrating an electronic device according to various example embodiments;

[0013] Figure 5 is a rear view illustrating an electronic device according to various example embodiments;

[0014] Figure 6 1 and 2 are perspective views and views illustrating an electronic device according to an example embodiment;

[0015] Figure 7 is a front view illustrating an electronic device according to an example embodiment;

[0016] Figure 8 is a flowchart illustrating a method of controlling an electronic device according to an example embodiment;

[0017] Figure 9A 、 Figure 9B 、 Figure 9C 、 Figure 9D 、 Figure 9E 、 Figure 9F 、 Figure 9G 、 Figure 9H 、 Figure 9I 、 Figure 9J and Figure 9K is a diagram illustrating a method of controlling an electronic device according to an example embodiment;

[0018] Figure 10 is a flowchart illustrating a method of controlling an electronic device according to another example embodiment;

[0019] Figure 11A 、 11B , 11C, 11D, 11E and Figure 11F is a diagram illustrating a method of controlling an electronic device according to another example embodiment. DETAILED DESCRIPTION

[0020] The following description, with reference to the accompanying drawings, is provided to facilitate a more comprehensive understanding of the various embodiments of the present disclosure as defined by the claims and their equivalents. The following description includes various specific details to facilitate understanding, but these specific details should be construed as merely illustrative. Therefore, those skilled in the art will recognize that various changes and modifications may be made to the various embodiments described herein without departing from the present disclosure. In addition, descriptions of known functions and structures may be omitted for clarity and brevity.

[0021] The terms and words used in the following description and claims are not limited to their bibliographical meanings, but are merely used by the discloser to enable a clear and consistent understanding of the present disclosure. Therefore, it should be apparent to those skilled in the art that the following description of various embodiments of the present disclosure is provided for illustration purposes only and is not intended to limit the present disclosure as defined by the appended claims and their equivalents.

[0022] It should be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a component surface" includes reference to one or more of such surfaces.

[0023] In the present disclosure, the expression "A or B" or "at least one of A and / or B" may include A, may include B, or may include both A and B. Expressions including ordinal numbers, such as "first" and "second", etc., may modify various elements. However, the above expressions do not limit the order and / or importance of the elements, and are only used to distinguish the elements from other elements. Where a certain (e.g., first) element is referred to as being "connected" or "accessed" (functionally or communicatively) to other (e.g., second) elements, it should be understood that the element is directly connected or accessed to the other elements, or is connected or accessed through another (e.g., third) element. In the present disclosure, the expression "(being) configured to" may be used interchangeably with "adapted to", "having", "modified to", "manufactured to", "capable of" or "designed to", depending on the circumstances. In some cases, the expression "a device (being) configured to..." may mean that the device can operate with other devices or other components. For example, the expression "a processor configured to perform A, B, and C" may mean a dedicated processor for performing the above operations (e.g., an embedded processor), or a general-purpose processor (e.g., a central processing unit (CPU) or an application processor (AP)) capable of performing the above operations by executing one or more software programs stored in a storage device. The electronic device according to various embodiments of the present disclosure may include at least one of the following: a smart phone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP), a Moving Picture Experts Group Phase 1 or Phase 2 (MPEG-1 or MPEG-2) Audio Layer-III (MP3) player, a medical device, a camera, and a wearable device. For example, the wearable device may include at least one of the following: an ornamental type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, an electronic accessory, glasses, contact lenses, or a head-mounted device (HMD)), a clothing or apparel integrated type (e.g., electronic apparel), a body-attached type (e.g., a skin patch or tattoo), and a body-implanted circuit. In some embodiments, the electronic device may include at least one of the following: a television (TV), a digital versatile disc (DVD) player, an audio device, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a media box (e.g., Samsung HomeSync™, Apple TV™, or Google TV™), a game console (e.g., Xbox™, PlayStation™), an electronic dictionary, an electronic key, a video recorder, and an electronic photo frame.

[0024] In various embodiments of the present disclosure, the electronic device may include at least one of the following: various medical devices (e.g., magnetic resonance imaging (MRA) machines, magnetic resonance imaging (MRI) machines, computed tomography (CT) scanners, scanners, ultrasound equipment, etc.), navigation equipment, global navigation satellite systems (GNSS), event data recorders (EDRs), flight data recorders (FDRs), in-vehicle entertainment equipment, marine navigation equipment gyroscopes, etc., aviation equipment, security equipment, host units or vehicle equipment, industrial or household robots, drones, automatic teller machines (ATMs), retail points (POS), and various Internet of Things (IoT) devices (e.g., light bulbs, various sensors, electricity or gas meters, sprinkler equipment, fire alarms, thermostats, street lights, toasters, exercise equipment, kettles, heaters, boilers, etc.). According to a certain embodiment, the electronic device may include at least one of the following: a piece of furniture, a part of a building or a car, an electronic bulletin board, an electronic signature receiving device, a projector, and various measuring instruments (e.g., a water meter, an electricity meter, a gas meter, an electric wave meter, etc.). In various embodiments, the electronic device may be flexible or a combination of two or more of the above devices. In addition, the electronic devices according to various embodiments of the present disclosure are not limited to the above-mentioned devices. In the present disclosure, the term "user" may refer to a person using an electronic device or a machine (eg, an artificial intelligence device) using an electronic device.

[0025] Figure 1 is a block diagram illustrating a network environment 100 including an electronic device 101 according to various embodiments of the present disclosure.

[0026] refer to Figure 1 , electronic device 101 may include but is not limited to bus 110, processor 120, memory 130, input / output interface 150, display 160 and communication interface 170. Bus 110 may be a circuit designed to connect the above elements and transmit data (e.g., control messages) between these elements. Processor 120 may receive commands from other elements (e.g., memory 130, input / output interface 150, display 160 or communication interface 170, etc.) via bus 110, interpret the received commands, and perform arithmetic or data processing based on the interpreted commands. Memory 130 may store therein commands or data received from processor 120 or other elements (e.g., input / output interface 150, display 160 or communication interface 170, etc.) or generated at processor 120 or other elements. Memory 130 may include programming modules 140 such as kernel 141, middleware 143, application programming interface (API) 145 and application 147. Each programming module may be implemented by software, firmware, hardware and any combination thereof.

[0027] like Figure 1As shown, the kernel 141 may control or manage system resources (e.g., bus 110, processor 120, memory 130, etc.) used to perform operations or functions implemented by other programming modules (e.g., middleware 143, API 145, and application 147). In addition, the kernel 141 may provide an interface that enables access and control or management of various elements of the electronic device 101 by using the middleware 143, API 145, or application 147.

[0028] Middleware 143 can be configured to operate between API 145 or application 147 and kernel 141, with API 145 or application 147 communicating with kernel 141 and exchanging data therewith. Furthermore, for example, with respect to work requests received from one or more applications 147 and / or middleware 143, load balancing of work requests can be performed by assigning a priority to at least one of the one or more applications 147, whereby system resources of electronic device 101 (e.g., bus 110, processor 120, memory 130, etc.) can be used. API 145 is an interface through which application 147 can control functions provided by kernel 141 or middleware 143, and may include, for example, at least one interface or function for file control, window control, image processing, character control, etc. Input / output interface 150 can transmit commands or data entered by a user through an input / output unit or device (e.g., a sensor, keyboard, or touchscreen) to processor 120, memory 130, or communication interface 170 via bus 110.

[0029] The display module 160 may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic LED (OLED) display, a microelectromechanical system (MEMS) display, or an electronic paper display. The display 160 may display various types of content (e.g., text, images, videos, icons, or symbols) to the user. The display module 160 may include a touch screen and may receive, for example, touch, gesture, proximity, or hovering input using an electronic device or a part of the user's body.

[0030] The communication interface 170 can establish communication between the electronic device 101 and any external device (e.g., the first external electronic device 102, the second external electronic device 104, or the server 106). For example, the communication interface 170 can be connected to the network 162 via wired or wireless communication 164, and thereby communicate with any external device (e.g., the second external electronic device 104 or the server 106).

[0031] Wireless communication may use at least one of the following as a cellular communication protocol: for example, Long Term Evolution (LTE), LTE-Advanced (LTE-A), Code Division Multiple Access (CDMA), Wideband CDMA (WCDMA), Universal Mobile Telecommunications System (UMTS), Wireless Broadband (WiBro), and Global System for Mobile Communications (GSM). Short-range communication may include, for example, at least one of Wi-Fi, Bluetooth (BT), Near Field Communication (NFC), Magnetic Secure Transmission or Near-field Magnetic Data Strip Transmission (MST), GNSS, and the like. GNSS may include, for example, at least one of the following: Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), BeiDou Navigation Satellite System (hereinafter referred to as “BeiDou”), and Galileo (European global satellite-based navigation system). Hereinafter, in the present disclosure, “GPS” may be used interchangeably with “GNSS”.

[0032] Wired communication may include, but is not limited to, at least one of the following: Universal Serial Bus (USB), High-Definition Multimedia Interface (HDMI), Recommended Standard 232 (RS-232), and Plain Old Telephone Service (POTS). Network 162 may include at least one of a computer network (e.g., a local area network (LAN) or a wide area network (WAN)) as a telecommunications network, the Internet, and a telephone network. The types of the first external electronic device 102 and the second external electronic device 104 may be the same as or different from those of the electronic device 101. Server 106 may include a group of one or more servers. Some or all of the operations performed in electronic device 101 may be performed in one or more other electronic devices 102, 104, or server 106. When electronic device 1001 performs a specific function or service automatically or in response to a request, instead of or in addition to performing the function or service itself, electronic device 101 may request at least a portion of the functions related to the function or service from another electronic device 102, 104, or server 106. Other electronic devices 102, 104 or server 106 can execute the requested function or additional function and transmit the result of the execution to electronic device 101. In addition, electronic device 101 can process the received result to provide the requested function or service. For this purpose, cloud computing technology, distributed computing technology or client-server computing technology can be used, for example.

[0033] Figure 2 2 is a block diagram showing an electronic device 201 according to various embodiments of the present disclosure. The electronic device 201 may be formed, for example, Figure 1 The whole or part of the electronic device 101 is shown.

[0034] refer to Figure 2, the electronic device 201 may include at least one processor or AP 210, a communication module 220, a subscriber identity module (SIM) card 224, a memory 230, a sensor module 240, an input unit or input device 250, a display or display module 260, an interface 270, an audio module 280, a camera module 291, a power management module 295, a battery 296, an indicator 297, and a motor 298. The processor 210 is capable of driving, for example, an operating system or an application program to control a plurality of hardware or software components connected to the processor 210, processing various data, and performing operations. For example, the processor 210 may be implemented as a system on a chip (SoC). According to an embodiment, the processor 210 may further include a graphics processing unit (GPU) and / or an image signal processor.

[0035] The processor 210 may also include Figure 2 At least a portion of the components shown (e.g., cellular module 221). The processor 210 is capable of loading commands or data received from at least one of the other components (e.g., non-volatile memory) onto the volatile memory and processing the loaded commands or data. The processor 210 is capable of storing various data in the non-volatile memory. The communication module 220 (e.g., communication interface 170) can perform data communication with any other electronic device (e.g., electronic device 104 or server 106) connected to the electronic device 201 (e.g., electronic device 101) via a network. According to an embodiment, the communication module 220 may include a cellular module 221, a WiFi module 223, a BT module 225, a GNSS or GPS module 227, an NFC module 228, and a radio frequency (RF) module 229. For example, the cellular module 221 is capable of providing voice calls, video calls, short message services (SMS), Internet services, etc. via the communication network. According to one embodiment, the cellular module 221 is capable of performing identification and authentication of the electronic device 201 in the communication network by using a SIM card 224 (e.g., a SIM card). According to one embodiment, the cellular module 221 can perform at least a portion of the functions provided by the processor 210. According to one embodiment, the cellular module 221 can also include a communication processor (CP).

[0036] like Figure 2 As shown, the Wi-Fi module 223 , the BT module 225 , the GNSS module 226 , and the NFC module 228 can each include a processor for processing data transmitted or received through the corresponding module.

[0037] The NFC module 228 can include a processor for processing data sent or received by the corresponding module. According to various embodiments, the cellular module 221, WiFi module 223, BT module 225, GNSS module 227, NFC module 228, and other modules, such as an MST module (e.g., two or more modules), can be included in a single integrated circuit (IC) or a single IC package. The RF module 229 can transmit and receive data, such as communication signals (e.g., RF signals). The RF module 229 can include a transceiver, a power amplifier module (PAM), a frequency filter, a low-noise amplifier (LNA), an antenna, and the like. Depending on the embodiment, at least one of the cellular module 221, Wi-Fi module 223, BT module 225, GNSS module 227, and NFC module 228 can transmit and receive RF signals via a separate RF module. The SIM module 224 can include a card, including a SIM card and / or an embedded SIM card. The SIM card 224 can include unique identification information (e.g., an integrated circuit card identifier (ICCID)) or subscriber information (e.g., an international mobile subscriber identity (IMSI)).

[0038] like Figure 2 As shown, the memory 230 (eg, Figure 1 The memory 103 shown) can include a built-in or internal memory 232 and / or an external memory 234. The built-in or internal memory 232 can include at least one of a volatile memory (e.g., dynamic random access memory (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.) and a non-volatile memory (e.g., one-time programmable read-only memory (OTPROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash, NOR flash, etc.), hard disk drive, solid-state drive (SSD), etc.).

[0039] The sensor module 240 can measure / detect physical quantities or the operating state of the electronic device 201 and convert the measured or detected information into electrical signals. The sensor module 240 can include at least one of the following: a gesture sensor 240A, a gyroscope sensor 240B, an air pressure or barometer sensor 240C, a magnetic sensor 240D, an acceleration sensor 240E, a grip sensor 240F, a proximity sensor 240G, a color or RGB sensor 240H (e.g., a red, green, blue (RGB) sensor), a biometric sensor 240I, a temperature / humidity sensor 240J, an illumination sensor 240K, and an ultraviolet (UV) sensor 240M.

[0040] Additionally or alternatively, the sensor module 240 can further include one or more of the following sensors or operations (not shown): an electronic nose (E-nose) sensor, an electromyography (EMG) sensor, an electroencephalography (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, an iris sensor, and / or a fingerprint sensor. The sensor module 240 can also include a control circuit for controlling the one or more sensors included therein.

[0041] In various embodiments of the present disclosure, the electronic device 201 may include a processor configured as part of the processor 210 or as a separate component for controlling the sensor module 240. In this case, when the processor 210 is operating in sleep mode, the processor may control the sensor module 240. The input device 250 may include a touch panel 252, a (digital) pen sensor (digital pen or stylus) 254, a key 256, or an ultrasonic input unit or device 258. The touch panel 252 may be implemented using at least one of the following: a capacitive touch system, a resistive touch system, an infrared touch system, and an ultrasonic touch system. The touch panel 252 may also include a control circuit. The touch panel 252 may also include a tactile layer to provide a tactile response to the user. The (digital) pen sensor 254 may be implemented using a portion of the touch panel or a separate recognition sheet. The key 256 may include a physical button, an optical key, or a keypad. The ultrasonic input unit 258 may detect ultrasonic waves created in the input tool through the microphone 288 and recognize data corresponding to the detected ultrasonic waves.

[0042] Display 260 (e.g., Figure 1 The display 160 shown in FIG. 1 can include a panel 262, a hologram unit or device 264, or a projector 266. The panel 262 can include Figure 1 The display 160 shown in FIG. 262 may be configured the same as or similar to the display 160 shown in FIG.

[0043] The panel 262 may also be combined with the touch panel 252 into a single module. The hologram unit 264 can display a stereoscopic image in the air by using light interference. The projector 266 can display an image by projecting light onto a screen. The screen may be placed inside or outside the electronic device 201. Depending on the embodiment, the display 260 may further include a control circuit for controlling the panel 262, the hologram unit 264, or the projector 266.

[0044] The interface 270 can include an HDMI 272, a USB 274, an optical interface 276, or a D-subminiature (D-sub) 278. The interface 270 may be included in Figure 1The communication interface 107 is shown. Additionally or alternatively, the interface 270 can include a Mobile High-Definition Link (MHL) interface, an SD card / MMC interface, or an Infrared Data Association (IrDA) standard interface.

[0045] like Figure 2 As shown, the audio module 280 can provide bidirectional conversion between audio signals and electrical signals. At least part of the components of the audio module 280 may be included in Figure 1 The audio module 280 can also process sound information input or output through the speaker 282, the earphone 284, the headphone 286, the microphone 288, etc.

[0046] The camera module 291 refers to a device capable of capturing both still and moving images. According to one embodiment, the camera module 291 may include one or more image sensors (e.g., a front image sensor or a rear image sensor), a lens, an image signal processor (ISP), a flash (e.g., an LED or a xenon lamp), and the like.

[0047] The power management module 295 can manage the power of the electronic device 201. According to one embodiment, the power management module 295 can include a power management IC (PMIC), a charger IC, or a battery fuel gauge. The PMIC can enable wired charging and / or wireless charging methods. Examples of wireless charging methods are magnetic resonance charging, magnetic induction charging, and electromagnetic charging. To this end, the PMIC can also include additional circuits for wireless charging, such as a coil loop, a resonant circuit, a rectifier, etc. The battery gauge can measure the remaining capacity, charging voltage, current, or temperature of the battery 296. The battery 296 can take the form of a rechargeable battery or a solar cell.

[0048] The indicator 297 can display a specific state of the electronic device 201 or a portion thereof (e.g., the processor 210), such as a startup state, a message state, a charging state, etc. The motor 298 can convert an electrical signal into a mechanical vibration, such as a vibration, a haptic effect, etc. Although not shown, the electronic device 201 can further include a processing unit (e.g., a GPU) for supporting mobile TV. The processing unit for supporting mobile TV can, for example, process media data according to some standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or mediaFlo™.

[0049] Each of the elements described in this disclosure can be formed into one or more components, and the name of the corresponding element can be changed according to the type of electronic device. In various embodiments, the electronic device may include at least one of the above-mentioned elements described in this disclosure, and may exclude some elements, or may also include other additional elements. In addition, some elements of the electronic device according to various embodiments may be coupled to form a single entity while performing the same function as the functions of these corresponding elements before coupling.

[0050] Figure 3 is a block diagram illustrating a configuration of the program module 310 according to various embodiments of the present disclosure.

[0051] The programming module 310 may include (or be stored in) Figure 1 The electronic device 101 (eg, memory 130) shown in FIG. 1 may include (or store) Figure 2 At least a portion of the programming module 310 may be implemented as software, firmware, hardware, or a combination of two or more thereof. The programming module 310 may be implemented as hardware (e.g., Figure 2 The hardware 200 of the electronic device (e.g., electronic device 101) may include an operating system (OS) for controlling resources related to the electronic device (e.g., electronic device 101) and / or various applications (e.g., application 370) executed in the OS. For example, the OS may be Android, iOS, Windows, Symbian, Tizen, Bada, etc.

[0052] Reference Figure 3 , the programming module 310 may include a kernel 320 , middleware 330 , an API 360 and / or an application 370 .

[0053] Kernel 320 (e.g., Figure 1 The kernel 141 in the system may include a system resource manager 321 and / or a device driver 323. The system resource manager 321 may include, for example, a process manager (not shown), a memory manager (not shown), and a file system manager (not shown). The system resource manager 321 may perform control, allocation, recovery, etc. of system resources. The device driver 323 may include, for example, a display driver (not shown), a camera driver (not shown), a BT driver (not shown), a shared memory driver (not shown), a USB driver (not shown), a keyboard driver (not shown), a WiFi driver (not shown), and / or an audio driver (not shown). In addition, according to an embodiment of the present disclosure, the device driver 312 may include an inter-process communication (IPC) driver (not shown).

[0054] The middleware 330 may include a plurality of pre-implemented modules to provide functions commonly used by the applications 370. In addition, the middleware 330 may provide functions to the applications 370 through the API 360 so that the applications 370 can efficiently use the limited system resources within the electronic device. Figure 3 As shown in , middleware 330 (e.g., middleware 132) may include at least one of the following: a runtime library 335, an application manager 341, a window manager 342, a multimedia manager 343, a resource manager 344, a power manager 345, a database manager 346, a package manager 347, a connection or connectivity manager 348, a notification manager 349, a location manager 350, a graphics manager 351, a security manager 352, and any other suitable and / or similar managers.

[0055] The runtime library 335 may include, for example, a library module used by a compiler to add new functions by using a programming language during execution of the application 370. According to an embodiment of the present disclosure, the runtime library 335 may perform functions related to input and output, memory management and / or arithmetic functions, etc.

[0056] The application manager 341 can manage, for example, the life cycle of at least one application 370. The window manager 342 can manage graphical user interface (GUI) resources used on the screen. The multimedia manager 343 can detect the formats used to reproduce various media files and can encode or decode the media files by using codecs suitable for the relevant formats. The resource manager 344 can manage the resources of at least one application 370, such as source code, memory, and / or storage space.

[0057] like Figure 3 As shown, the power manager 345 can operate together with the basic input / output system (BIOS), can manage the battery or power, and can provide power information for operation, etc. The database manager 346 can manage the database so that the database to be used by at least one application 370 can be generated, searched, and / or changed. The package manager 347 can manage the installation and / or update of applications distributed in the form of package files.

[0058] The connection or connectivity manager 348 can manage wireless connections such as Wi-Fi and BT. The notification manager 349 can display or report events such as incoming messages, appointments, proximity alerts, etc. to the user in a manner that does not disturb the user. The location manager 350 can manage the location information of the electronic device. The graphics manager 351 can manage the graphic effects to be provided to the user and / or the user interface related to the graphic effects. The security manager 352 can provide various security functions for system security, user authentication, etc. According to an embodiment of the present disclosure, when the electronic device (e.g., the electronic device 101) has a telephone function, the middleware 330 may also include a telephone manager (not shown) for managing the voice phone call function and / or the video phone call function of the electronic device.

[0059] The middleware 330 can generate and use new middleware modules by combining various functions of the above-mentioned internal component modules. The middleware 330 can provide modules specialized according to the type of OS to provide different functions. In addition, the middleware 330 can dynamically delete some of the existing components or add new components. Therefore, the middleware 330 can omit some of the components described in the various embodiments of the present disclosure, can also include other components, or can replace some of these components with components that perform similar functions and have different names.

[0060] API 360 (e.g., API 133) is a set of API programming functions and may have different configurations depending on the OS. For example, in the case of Android or iOS, one API set may be provided for each platform. For example, in the case of Tizen, two or more API sets may be provided for each platform.

[0061] Applications 370 (e.g., applications 134) may include, for example, preloaded applications and / or third-party applications. Applications 370 (e.g., applications 134) may include, for example, a homepage application 371, a dialer application 372, a short message service (SMS) / multimedia message service (MMS) application 373, an instant messaging (IM) application 374, a browser application 375, a camera application 376, an alarm application 377, a contacts application 378, a voice dialing application 379, an email application 380, a calendar application 381, a media player application 382, an album application 383, a clock application 384, and any other suitable and / or similar applications.

[0062] At least a portion of the programming module 310 may be implemented by instructions stored in a non-transitory computer-readable storage medium. When the instructions are executed by one or more processors (e.g., one or more processors 210), the one or more processors may perform the functions corresponding to the instructions. The non-transitory computer-readable storage medium may be, for example, the memory 230. At least a portion of the programming module 310 may be implemented (e.g., executed) by, for example, one or more processors 210. At least a portion of the programming module 310 may include, for example, modules, programs, routines, instruction sets, and / or processes for performing one or more functions.

[0063] Figure 4 is a front view illustrating an electronic device according to various exemplary embodiments.

[0064] Figure 5 The front surface of an electronic device 401 according to various example embodiments is shown. The electronic device 401 may include a display device 410, a housing 420, an optical sensor 430, an earpiece 440, a camera 450, and a fingerprint sensor 460. According to example embodiments, the display 410 may be formed on the entire front surface of the display device 401. Therefore, the housing 420 may not be formed on the front surface of the electronic device 401.

[0065] The display 410 may extend to, for example, a side surface of the electronic device 401. In addition, according to an example embodiment, the processor 410 may be formed in a portion of the front surface of the display device 401. Therefore, the housing 420 may be formed in the remaining portion of the front surface of the electronic device 401.

[0066] The display 410 may be covered by a glass cover 620 (see Figure 6 ) protection. According to an example embodiment, the glass cover 620 may have a plurality of holes (or openings). For example, the glass cover 620 may include an optical sensor hole 430a, an earpiece hole 440a, a camera hole 450a, and a fingerprint sensor hole (or main button hole) 460a. The glass cover 620 may also include a light emitting diode (LED) hole 735 (see Figure 7 ). In addition, the glass cover 620 may further include an opening, a hole, or a cutout portion (eg, a cutout portion 631 (see Figure 6 ).

[0067] According to various exemplary embodiments of the present disclosure, the optical sensor 430, the earpiece 440, the camera 450, and the fingerprint sensor 460 may be located, for example, at the lower end of the housing 420 or the display 410. According to various exemplary embodiments of the present disclosure, the optical sensor 430, the earpiece 440, the camera 450, and the fingerprint sensor 460 may be included, for example, in the display 410. The optical sensor 430 may include, for example, a proximity sensor, an illumination sensor, an iris sensor, or a UV sensor.

[0068] According to an example embodiment, the positions of the optical sensor 430, the earpiece 440, the camera 450, and the fingerprint sensor 460 are not limited to Figure 4 For example, the optical sensor 430 may be located at the lower end of the electronic device 401 .

[0069] Figure 5 is a rear view illustrating an electronic device according to various exemplary embodiments.

[0070] Figure 5 The rear surface and side surfaces of an electronic device 501 according to various exemplary embodiments are shown. The electronic device 501 may include a housing 510 , a biosensor 520 , a camera 530 , an interface 540 , and a speaker 550 .

[0071] According to an example embodiment, the housing 510 may be formed on the rear surface and the side surface of the electronic device 501. According to an example embodiment, the biosensor 520 and the camera 530 may be located on the rear surface of the electronic device 501. According to an example embodiment, the interface 540 and the speaker 550 may be located on the side surface of the electronic device 501. According to an example embodiment, the positions of the biosensor 520, the camera 530, the interface 540 and the speaker 550 are not limited to Figure 5 location.

[0072] Figure 6 2 are perspective views and 3D views illustrating an electronic device according to example embodiments.

[0073] refer to Figure 6 , an electronic device 600 according to an example embodiment may include a housing 610 , a glass cover 620 , a display panel 630 , a camera module 640 , an earpiece hole 650 , and a home button 660 .

[0074] The shell 610 may include a first surface 611 facing a first direction (front surface), a second surface 612 facing a second direction (rear surface) opposite to the first direction, and a side surface 613 (or "rear" surface) surrounding a gap between the first direction surface 611 (or "front" surface) and the second surface 612.

[0075] The glass cover 620 can protect a configuration such as a display panel 630 of the electronic device 600. The glass cover 620 can correspond to at least the front surface of the electronic device 600. For example, the glass cover 620 can occupy the entire front surface. The glass cover 620 can occupy a portion of the front surface and the side surface. The glass cover 620 can be formed in a plane, or in a curved surface with the upper end, lower end, left end and / or right end curved. The glass cover 620 can be made of a transparent material. The glass cover 620 can be made of a material such as reinforced glass, plastic (e.g., polyethylene terephthalate (PET)) or aluminum oxide.

[0076] The display panel 630 may be disposed under the glass cover 620 . The display panel 630 may be curved such that a left side end, a right side end, an upper end, and / or a lower end form a curved surface, and may be disposed within the housing 610 .

[0077] The display panel 630 may be a full front display that occupies most of the front surface of the electronic device. Enlarging the display panel 630 may change the settings of other configurations. For example, configurations such as a camera module 640 and an earpiece (not shown) may be provided at the outermost edge of the electronic device 600.

[0078] The display panel 630 may include an active area 632 and an inactive area 633. The active area 632 may be exposed through a transparent area of the glass cover 620. The active area 632 may output light in response to electrical signals provided via scan lines and data lines. The aspect ratio of the active area 632 may be, for example, 18.5:9. Alternatively, the aspect ratio of the active area 632 may include 4:3, 3:2, 8:5, 16:10, 5:3, or 21:9.

[0079] According to an example embodiment, the active area 632 may occupy at least a portion of the front surface and the side surface. For example, the active area 632 may be arranged to surround the front surface and the side surface. The active area 632 of the electronic device 600 according to an example embodiment may also be closer to the side surface than a typical active area.

[0080] The side portions of active area 632 can function as soft keys that adjust the volume. The position of the soft keys can be changed based on the user's grip or usage history. Active area 632 can occupy a substantial portion of the front surface (e.g., approximately 90% or more of the front area).

[0081] The inactive area 633 may be an area surrounding the active area 632. The inactive area 633 of the electronic device 600 according to example embodiments may be smaller than that of a typical electronic device 600. At least a portion of the inactive area 633 may be exposed through the glass cover 620.

[0082] The inactive area 633 may be, for example, a peripheral portion of the display panel 630 and may be an area covered by an opaque cover layer. The opaque cover layer may be formed by printing a layer in the glass cover plate 620. The thickness ratio between the horizontal inactive area 633 and the vertical inactive area 633 may be, for example, 1:1, 2:1, or 3:1. In another example, the thickness ratio between the top inactive area 633, the side inactive area 633, and the bottom inactive area 633 may be, for example, 2:1:4.

[0083] The display panel 630 may include at least one opening portion (or opening) or at least one cutout portion. For example, the display panel 630 may include at least one opening portion 631 formed at the upper end portion of the active area 632. The display panel 630 may be curved so that the opening portion 631 is located at a corner and may be disposed within the housing 610.

[0084] like Figure 6 As shown, the opening portion 631 may form a U-shaped space when viewed from the front surface of the electronic device 600. Various modules of the electronic device 600 may be exposed through the space formed by the opening portion 631.

[0085] In this specification, the touch screen display may mean a module including a configuration such as a touch screen, a glass cover, and / or a polarizing plate, as well as the display panel 630 .

[0086] The camera module 640 can be positioned at a location corresponding to at least one opening or at least one cutout. For example, the camera module 640 can be positioned in a space formed by at least one opening or at least one cutout. For example, the camera module 640 can be positioned in a space formed by the opening 631 formed at the upper end of the active area 632. The camera module 640 can be exposed to the outside through the glass cover 620. For example, when positioned below the glass cover 620, the camera module 640 can be viewed from the outside through the glass cover 620. The camera module 640 can detect light applied from the outside through the glass cover 620 to acquire an image.

[0087] According to example embodiments, the camera module 640 may be provided to be exposed through the center of the upper end of the glass cover plate 620 .

[0088] According to example embodiments, the camera module 640 may be disposed adjacent to the outermost edge of the front surface.

[0089] The earpiece hole 650 may transmit sound generated by an earpiece provided in the housing 610 to the outside of the housing. The earpiece hole 650 may be formed at the front surface 611 of the housing 610. For example, the earpiece hole 650 may be formed in a metal frame of the side surface 613.

[0090] The front surface 611 of the housing 610 may be formed into a metal frame including or incorporating a side surface 613 having a predetermined curvature. Figure 6 As shown, the electronic device 600 may include a plurality of earpiece holes 650. By forming the earpiece holes 650 on the side surface 613, the sound generated by the earpiece can be transmitted to the outside without affecting the configuration of the display panel 630 occupying the front surface 611 of the electronic device 101. Figure 6 In the embodiment, the earpiece hole 650 is formed at the front surface 611 of the housing 610 , but the present disclosure is not limited thereto, and the earpiece hole 650 may be formed at the side surface 613 of the housing 610 .

[0091] The main button 660 may be provided at the lower end of the front surface of the electronic device 600. The main button 660 may be a physical key or a soft key. When the main button 660 is a physical key, the display panel 630 may include an opening portion (e.g., the same as the opening portion at the upper end) or a cutout portion formed at the lower end of the active area 632 in order to provide the main button. The main button 660 may be provided within the space formed by the opening portion 631 (e.g., or the cutout portion).

[0092] The main button 660 may be implemented as a soft key (e.g., implemented by software) located at the lower end of the front surface 611 of the electronic device 600. When the main button 660 is a soft key, a fingerprint sensor may be provided below the main button 660 region of the display panel 630. The glass cover 620 may include a recessed portion formed at a location where the fingerprint sensor is provided.

[0093] As described above, the electronic device 600 according to example embodiments may include the display panel 630 exposed through the front surface 611 of the electronic device 600 and the camera module 640 located within the display panel 630 .

[0094] Figure 7 is a front view illustrating an electronic device according to an example embodiment.

[0095] Figure 7The front surface of the electronic device 701 according to an example embodiment is shown. Content (e.g., image) 750a is displayed in the display (e.g., full front display) 750 of the electronic device 701. The display 750 may include an edge display that is enlarged to one side surface (or two side surfaces). For example, the housing 610 may be exposed on the front surface of the electronic device 701, at the upper end and / or lower end of the display 750. The housing 610 may be exposed on the front surface of the electronic device 701, at the left side and / or right side of the display 750. According to various example embodiments of the present disclosure, the housing 610 may not be exposed on the front surface of the electronic device 701, at the left side and / or right side of the display 750.

[0096] The display 750 includes a main area 751 and an extension area 752. The extension area 752 may include a first extension area 752a extending at an upper end portion of the main area 751 and a second extension area 752b extending at a lower end of the main area 751.

[0097] One or more holes or "hole regions" (at least one of 720, 725, 730, and 735) may be located in the first extension region 752a. According to various example embodiments of the present disclosure, one or more hole regions 740 may be located in the second extension region 752b.

[0098] The size of the main area 751 can be larger than the size of the extension area 752. The size of the first extension area 752a can be the same as or different from the size of the second extension area 752b. For example, the size of the second extension area 752b can be larger than the size of the first extension area 752a.

[0099] The display 750 may include a main area 751 and a first extended area 752a. The display 750 may include the main area 751 and the second extended area 752b. In addition, the display 750 may include the entirety of the main area 751, the first extended area 752a, and the second extended area 752b.

[0100] The main region 751 may include a first region 751a1 located at an upper end portion of the main region 751 and connected to the first extension region 752a. In addition, the main region 751 may include a second region 751a2 located at a lower end of the main region 751 and connected to the second extension region 752b at the lower end. The size of the first region 751a1 may be the same as or different from the size of the second region 751a2.

[0101] According to various exemplary embodiments of the present disclosure, the first region 751a1 and / or the second region 751a2 may be edge regions of the main region 751. The first region 751a1 and / or the second region 751a2 may correspond to an edge region of one side of an image (or content).

[0102] According to various exemplary embodiments of the present disclosure, in the display 750, the size of the main area 751 may be, for example, 1440×2560 pixels. The size of the first extended area 752a may be 1440×216 pixels. The size of the second extended area 752b may be 1440×216 pixels. The size of the first area 751a1 may be 1440×10 pixels. Furthermore, the size of the second area 751a2 may be 1440×10 pixels.

[0103] The size of the main area 751, the size of the first extended area 752a, the size of the second extended area 752b, the size of the first area 751a1 and / or the size of the second area 751a2 are examples, and it is easily understood by a person of ordinary skill in the art that the size of each can be changed to correspond to the aspect ratio of the display 750.

[0104] The analysis of the first area 751a1 or the analysis of the second area 751a2 may mean the analysis of an edge area located on one side of the image (or content).

[0105] The processor 210 may analyze the first region 751a1 to enlarge and display the content 750a displayed in the main region 751 in the first extended region 752a. The processor 210 may analyze the second region 751a2 to enlarge and display the content 750a displayed in the main region 751 in the second extended region 752b.

[0106] The processor 210 may analyze the first area 751 a 1 and / or the second area 751 a 2 to enlarge and display the content 750 a displayed in the main area 751 to the first extended area 752 a and / or the second extended area 752 b .

[0107] The first extended region 752a can be divided into an extended region 752a1 and an extended region 752a2. The size of the extended region 752a1 can be different from the size of the extended region 752a2. The size of the extended region 752a1 can be determined by the position of the camera (or camera aperture) 730. When the center (or optical axis) of the camera (or camera aperture) 730 is located at a position lower than the center point of the first extended region 752a (e.g., the position of the middle pixel corresponding to the length of the first extended region 752a) (e.g., adjacent to the main region), the size of the extended region 752a1 can be different from the size of the extended region 752a2.

[0108] The second extended area 752b can be divided into an extended area 752b1 and an extended area 752b2. The size of the twenty-first extended area 752b1 can be different from the size of the twenty-second extended area 752b2. The size of the extended area 752b1 can be determined by the position of the fingerprint sensor (or main button) 740. When the fingerprint sensor 740 is located at a position higher than the center point of the second extended area 752b (e.g., the position of the middle pixel corresponding to the length of the second extended area) (e.g., adjacent to the main area), the size of the extended area 752b1 can be different from the size of the extended area 752b2.

[0109] The processor 210 may analyze the first region 751a1 to enlarge and display the content 750a displayed in the main region 751 in the extended region 752a2. In addition, the processor 210 may analyze the second region 751a2 to enlarge and display the content 750a displayed in the main region 751 in the extended region 752b2.

[0110] The content 750a may be displayed by the processor 210 in the main area 751 of the display 750. The content 750a displayed in the main area 751 may be enlarged by the processor 210 to the main area 751 and the first extended area 752a of the display 750. The content 750a displayed in the main area 751 may be enlarged by the processor 210 to the main area 751 and the second extended area 752b of the display 750. The content 750a displayed in the main area 751 may be enlarged by the processor 210 to the main area 751, the first extended area 752a, and the second extended area 752b of the display 750.

[0111] The content 750a displayed in the main area 751 can be enlarged by the processor 210 to the main area 751, the first extended area 752a, and the extended area 752b2 of the display 750. In addition, the content 750a displayed in the main area 751 can be enlarged by the processor 210 to the main area 751, the extended area 752a2, and the extended area 752b2 of the display 750.

[0112] In example embodiments, a hole, opening, or cutout portion of a front surface may be referred to as a hole region. In example embodiments, a hole, opening, or cutout portion of a side surface (e.g., a volume button or a power button) may be referred to as a hole region. In example embodiments, a hole, opening, or cutout portion of a rear surface (e.g., a camera, a flash) may be referred to as a hole region.

[0113] An electronic device according to an example embodiment of the present disclosure includes: a housing including a first surface facing a first direction and a second surface facing a second direction opposite to the first direction; a touch screen display arranged between the first surface and the second surface, exposed through the first surface, and having a main area and an extension area; a hole area located in the extension area; at least one processor electrically connected to the display; and a memory electrically connected to the processor, such that the memory stores at least one instruction executed by the processor when performing a function, and the processor controls to analyze an edge area of selected content to magnify the content by one of interference magnification and / or no interference based on the analysis result, and display the content in a display area.

[0114] In an example embodiment, when the analysis result is interference magnification, the processor may control to display the content in the main area and the extended area, and the magnification of the content may be limited by the hole area.

[0115] In an exemplary embodiment, when the analysis result is interference-free magnification, the processor may control to display the content in partial areas of the main area and the extended area.

[0116] In example embodiments, the hole region may include one of a hole, an opening, and a cutout portion.

[0117] Figure 8 is a flowchart illustrating a method of controlling an electronic device according to an example embodiment, Figures 9A to 9K is a diagram illustrating a method of controlling an electronic device according to example embodiments.

[0118] exist Figure 8 In step 810, the electronic device may select a displayed image by user input.

[0119] refer to Figure 9A , an image (or a thumbnail corresponding to the image) 951 is displayed on the display 950 of the electronic device 901.

[0120] On the display 950 of the electronic device 901, an image (or a shortcut corresponding to the image) is displayed (not shown). Figure 9A According to various exemplary embodiments of the present disclosure, in the display 950 of the electronic device 901, one or more images (or thumbnails corresponding to the images) 951-1 to 951-19 may be displayed by an application (eg, via execution of an album photo application).

[0121] An application (e.g., a photo application) is an example and would be an application that can display images (e.g., a web browser). An application may include, for example, a video player that displays images or videos.

[0122] The display 950 of the electronic device 901 according to an example embodiment may display an application screen including an image (or video), a home screen, or a lock screen.

[0123] refer to Figure 9B , in one image 951 - 10 , a first user input (eg, touch or hover) 990 is received.

[0124] The processor 210 may detect the first user input 990 using the panel 262. The processor 210 may calculate a first user input position (eg, X1 coordinate and Y1 coordinate) 990a corresponding to the first user input 990 using the electrical signal received from the panel 262.

[0125] According to various example embodiments, the processor 210 may store the first user input position 990 a , a touch detection time (eg, 11:15 AM) of the detected touch, and touch information corresponding to the touch in the memory 230 .

[0126] According to an example embodiment, in another image 951 - 7 , a second user input (eg, touch or hover) 991 may be received.

[0127] The processor 210 may detect the second user input 991 using the panel 262. The processor 210 may calculate a second user input position (eg, X1 coordinate and Y1 coordinate) 991a corresponding to the second user input 991 using an electrical signal received from the panel 262.

[0128] The processor 210 may store the second user input position 991a, a touch detection time (eg, 11:15 AM) of the detected touch, and touch information corresponding to the touch in the memory.

[0129] The first user input 990 and / or the second user input 991 contacting the display 950 may be generated by one of a finger including a thumb or a touch input pen (or stylus (not shown)).

[0130] refer to Figure 8 In step 820, the processor 210 may control to analyze the image 951-7 corresponding to the second user input 990 and display the image 951-7 on the display 950. In an example embodiment, the image may include images 951-10 and 951-7. In an example embodiment, the image may include images 951-1 to 951-20. In addition, in an example embodiment, the image may have a meaning including an image (already stored in the electronic device or capable of being downloaded to the electronic device).

[0131] refer to Figure 9B, the processor 210 analyzes the image 951-10 or 951-7 corresponding to the selected thumbnail. The processor 210 may analyze the first area 751a1 corresponding to the image of the selected thumbnail. The processor 210 may analyze the number of pixels included in the first area 751a1 (e.g., 1440×10 pixels). In addition, the processor 210 may analyze one or more pixels (e.g., 1, 3, 5, 7, 9 pixels, 2, 5, 8 pixels, or random pixels) indicated by the number of pixels included in the first area 751a1 (e.g., 1440×10 pixels).

[0132] Processor 210 may analyze the color of each adjacent pixel. Processor 210 may also analyze the chromaticity of each adjacent pixel. According to various exemplary embodiments of the present disclosure, processor 210 may also analyze the texture of each adjacent pixel. In other words, processor 210 may analyze the color, chromaticity, or texture value of each pixel. The specific algorithms corresponding to such pixel analysis are well-known technologies; therefore, a detailed description thereof may be omitted.

[0133] When the difference between the color, chroma, or texture of each pixel matches a specific threshold (e.g., 30%, which may vary) or less, the processor 210 may select to perform zooming in on the image to surround the first extended area 752a. In addition, when the difference between the color, chroma, or texture of each pixel exceeds a predetermined threshold (e.g., 30%, which may vary), the processor 210 may determine that the image cannot be zoomed in on the first extended area 752a.

[0134] The processor 210 may determine to enlarge the image to the first extended area 752a (eg, enlargement of the background color) by analyzing the first area 751a1.

[0135] The processor 210 may analyze the second area 751a2 of the image corresponding to the selected thumbnail.The processor 210 may analyze the pixels included in the second area 751a2 (eg, 1440×10 pixels).

[0136] Analysis of the second region 751a2 by the processor 210 is substantially similar to analysis of the first region 751a1 by the processor 210; therefore, a detailed description thereof may be omitted.

[0137] The processor 210 may analyze the color, chromaticity, or texture value of each pixel included in the second area 751a2. When the difference between the color, chromaticity, or texture of each pixel is a threshold value (e.g., 30) or less, the processor 210 may determine to enlarge the image to the second extended area 752b. In addition, when the difference between the color, chromaticity, or texture of each pixel exceeds a threshold value (e.g., 30%, which may be changed), the processor 210 may determine that the image cannot be enlarged to the second extended area 752b.

[0138] The processor 210 may determine that the image cannot be enlarged to the second extended area 752b by analyzing the second area 751a2 (e.g., comparing it to a predetermined threshold variable). In this case, the processor 210 may also determine to enlarge the image to the twenty-second area 752b2. For example, when the difference between the color, chroma, or texture of each pixel in the second area 751a2 is (in one embodiment) 50% or less, the processor 210 may determine to enlarge the image to the twenty-second area 752b2.

[0139] The processor 210 may sequentially perform analysis on the first region 751a1 and analysis on the second region 751a2, or may perform analysis on the first region 751a1 and analysis on the second region 751a2 in reverse order.

[0140] exist Figure 8 At step 830 , the processor may determine whether to use an interference upscaling process to upscale the image.

[0141] That is, the processor 210 may determine whether to magnify the interference of the image. The processor 210 may determine whether to magnify the image to at least one of the first extension area 752a and the second extension area 752b according to the analysis result (eg, a threshold value or less).

[0142] In an exemplary embodiment, the image magnification may include image interference magnification and image non-interference magnification. Image interference magnification may mean that the image is magnified to at least one of the first extension area 752a and the second extension area 752b by analyzing the first area 751a1 (e.g., a threshold value or less) or analyzing the second area 751a2 (e.g., a threshold value or less). The image magnification may include image extension.

[0143] "Interference magnification" of an image may mean interference with image magnification caused by a hole, opening, or cutout portion of the front surface (e.g., image magnification restriction in a partial area (or hole area)) (or image display restriction in a partial area (or hole area)). In addition, interference magnification of an image may mean interference with image magnification caused by a component element corresponding to a hole, opening, or cutout portion of the front surface of the device (e.g., a sensor, earpiece, camera, main button, or fingerprint sensor) (e.g., image magnification restriction (or image display restriction) in a partial area).

[0144] "Non-interference magnification" of an image may mean that a hole, opening, or cutout portion of the front surface does not interfere with image magnification (for example, magnification to the periphery of the hole, opening, or cutout portion of the front surface) so that the hole does not interfere with the display of the image. In addition, image-interference magnification may mean that a component corresponding to the hole, opening, or cutout portion of the front surface (for example, a sensor, earpiece, camera, home button, or fingerprint sensor) does not interfere with image magnification.

[0145] Image non-interference magnification may mean magnifying the image to at least one of the area 752a2 and the extended area 752b2 by analyzing the first area 751a1 (e.g., more than a threshold) or analyzing the second area 751a2 (e.g., more than a threshold).

[0146] According to the analysis result, when both the first area 751a1 and the second area 751a2 are below the threshold, the processor 210 may determine that the image interference is amplified. According to the analysis result, when one of the first area 751a1 and the second area 751a2 is the threshold or less, the processor 210 may determine that the image interference is amplified.

[0147] In addition, according to the analysis result, when both the first area 751a1 and the second area 751a2 exceed the threshold value, the processor 210 may determine that the image is not enlarged.

[0148] According to the determination of image interference magnification, the processor 210 may magnify the image to one of magnification of the main area 751 and the first extended area 752a, magnification of the main area 751 and the second extended area 752b, and magnification of the main area 751 and the first extended area 752a and the second extended area 752b.

[0149] return Figure 8 At step 830 , if the processor determines that “image interference” is to be used for magnification, processing continues at step 840 . At step 830 , if image interference is not to be magnified (eg, image interference-free magnification), processing continues at step 870 .

[0150] In step 840 , the processor 210 may determine whether to use “entire image zoom-in” or “partial image zoom-in” to zoom in on the entire image.

[0151] That is, when “image interference” is selected to enlarge the image, the processor 210 may determine to use one of image overall enlargement and image partial enlargement according to the analysis result.

[0152] "Entire image magnification" may mean magnifying the image to the entire area of the display (including the main area 751, the first extension area 752a, and the second extension area 752b). In addition, the entire area of the display may be referred to as the interference area of the display.

[0153] “Image partial enlargement” may mean enlarging the image to a partial area of the display (main area 751 and first extension area 752a, or first extension area 752a and second extension area 752b). In addition, the partial area of the display may be referred to as a non-interference area of the display.

[0154] exist Figure 8 At step 840 , if the entire image is enlarged, processing continues at step 850 . At step 840 , if the entire image is not enlarged (eg, a portion of the image is enlarged), processing continues at step 860 .

[0155] In step 850, the enlarged image is displayed on the entire screen.

[0156] refer to Figure 9C , the processor 210 may control to enlarge and display the image (e.g., 951-7) on the entire screen. Based on the analysis results, the processor 210 may control to enlarge and display the image 951-7 on the entire screen. The entire screen is an area including the main area 751, the first extended area 752a, and the second extended area 752b. The size of the entire screen may be 1440 x 2992 pixels.

[0157] The size of the entire screen may be changed according to the screen size and / or aspect ratio of the electronic device 901 .

[0158] In an exemplary embodiment, the screen of the application as well as the image may be displayed on the entire screen.

[0159] refer to Figure 9F , an application screen (eg, a communication application screen 953 ) may be displayed on the entire screens 751 , 752 a , and 752 b .

[0160] Before analyzing the first and second regions, the processor 210 may control the communication application screen 953 to be displayed in the main region 751. When the setting (e.g., one of interference amplification and non-interference amplification) does not exist, the processor 210 may control the communication application screen 953 to be displayed in the main region 751.

[0161] Processor 210 may analyze the first and second areas of communication application screen 953 to determine one of interference amplification and non-interference amplification in communication application screen 953. Processor 210 may amplify interference of communication application screen 953 according to the analysis result (e.g., a threshold value or less).

[0162] The processor 210 may control to enlarge and display the communication application screen 953 to the entire screen according to the analysis result (eg, a threshold value or less).

[0163] The application (eg, a communication application) is an example, and the present disclosure is not limited thereto, and may be an application already installed in the electronic device 901 (eg, a music application, a moving image application) or an application that can be downloaded and installed in the electronic device 901 .

[0164] Figure 9J and 9K An example of an image enlarged on the entire screen is shown.

[0165] Figure 9I For example, a lock screen is shown. In the lock screen, image 957a can be enlarged and displayed on the entire screen 951, 952a, and 952b. The processor 210 can control to enlarge and display image 957a on the entire screen 951, 952a, and 952b according to the analysis result (e.g., a threshold value or less).

[0166] 9K shows, for example, a home screen. In the home screen, image 957b can be magnified and displayed on the entire screens 951, 952a, and 952b. The processor 210 can control the magnification and display of image 957b on the entire screens 951, 952a, and 952b based on the analysis result (e.g., a threshold value or less). The processor 210 can position the shortcuts and the tray 957t displayed behind the shortcuts on the home screen without being disturbed by the holes, openings, or cutouts of the front surface.

[0167] The tray 957t may have a transparency (eg, 60-80%, which may be changed through settings). In addition, the tray 957t may be displayed in a color different from the shortcut and the magnified image 957b.

[0168] exist Figure 8In step 850, when the enlarged image is displayed on the entire screen, the processing of the method of controlling the hole area of the electronic device is terminated.

[0169] At step 840 , if the entire image is not magnified (eg, a portion of the image is magnified), processing continues at step 860 .

[0170] In step 860, the partially enlarged image is displayed on the entire screen.

[0171] refer to Figure 9D , the processor 210 may control to enlarge and display an image (e.g., 951-10) in a partial area of the entire screen. Based on the analysis result, the processor 210 may control to enlarge and display image 951-10 in a partial area of the entire screen. The partial area of the entire screen may refer to the main area 751 and the first extended area 752a, or the main area 751 and the second extended area 752b. The size of the partial area of the entire screen may be 1440×2776 pixels.

[0172] In an exemplary embodiment, the increased partial area of the entire screen may further include one of the extended area 752a2 and the extended area 725b2. The processor 210 may control to enlarge and display an image (eg, 951-10) in the increased partial area of the entire screen.

[0173] The increased partial area of the entire screen may include a main area 751, a first extended area 752a, and an extended area 752b2. In addition, the increased partial area of the entire screen may include a main area 751, a second extended area 752b, and an extended area 752a2. The size of the partial area of the entire screen according to an example embodiment may be 1440×2856 pixels.

[0174] The size of the partial area of the entire screen may be changed according to the screen size and / or aspect ratio of the electronic device 901. In addition, the size of the increased partial area of the entire screen may be changed according to the screen size and / or aspect ratio of the electronic device 901.

[0175] exist Figure 8 In step 860 , when the enlarged image is displayed in the partial area of the entire screen (or the increased partial area of the entire screen), the processing of the method of controlling the hole area of the electronic device is terminated.

[0176] At step 830 , if “image interference” upscaling is not being utilized (eg, image interference-free upscaling), processing continues at step 870 .

[0177] At step 870, the image is determined to be magnified using "non-intrusive" magnification.

[0178] The processor 210 may determine whether the image is enlarged without interference. Enlarging the image with "no interference" may mean that the image (e.g., 951-13) is enlarged to the area 752a2 and the extended area 752b2 by analyzing the first area 751a1 (e.g., greater than a threshold) or the second area 751a2 (e.g., greater than a threshold).

[0179] According to the analysis result, when the first area 751a1 and the second area 751a2 (eg, 951-13) of the image are both larger than the threshold value, the processor 210 may determine whether the enlarged image has no interference.

[0180] Upon determining that the image is not obstructed by the enlargement, the processor 210 may enlarge the image (eg, 951 - 13 ) to the main region 751 , the region 752 a 2 , and the extended region 752 b 2 .

[0181] exist Figure 8 At step 870, if it is determined that the image should be zoomed in “without interference”, the process continues at step 880. At step 870, if the image should not be zoomed in “without interference”, the process continues at step 890.

[0182] At step 880, the image with "distraction-free" magnification applied is displayed on the entire screen.

[0183] refer to Figure 9E , the processor 210 can control to enlarge and display the image (e.g., 951-13) in a partial area of the entire screen (e.g., the non-interference areas 951, 952a2, 952b2). According to the analysis results, the processor 210 can enlarge and display the image 951-13 in the non-interference areas 951, 952a2, and 952b2 of the entire screen. The non-interference area of the entire screen can mean the main area 751 and the first extension area 752a, or the main area 751 and the second extension area 752b. The size of the non-interference area of the entire screen can be 1440×2710 pixels. The size of the non-interference area can be 90.6% of the size of the entire screen.

[0184] The size of the interference-free area of the entire screen can be changed according to the screen size and / or aspect ratio of the electronic device 901. In addition, the size of the interference-free area of the entire screen can be changed according to the position and / or size of the hole, opening or cutout portion of the screen of the electronic device 901.

[0185] exist Figure 8 In step 880 , when the enlarged image is displayed in the non-interference area of the entire screen, the processing of the method of controlling the hole area of the electronic device is terminated.

[0186] At step 870 , if non-intrusive upscaling of the image is not utilized, processing continues at step 890 .

[0187] At step 890, the image is displayed in the main area.

[0188] When interference magnification and non-interference magnification are not applied to the image (or when interference magnification and non-interference magnification are not set), the processor 210 may control the image (e.g., 951-17) to be displayed in the main area 751. The size of the main area of the entire screen may be 1440×2560 pixels. The size of the main area may be 85.6% of the size of the entire screen.

[0189] In an exemplary embodiment, when a moving image application is executed, subtitles 954 may be displayed in the extended areas 752a and 752b. In addition, text (or subtitles) may be displayed on one side of the application screen displayed in the main area 751 (eg, the extended areas 752a and 752b).

[0190] refer to Figure 9G , a moving image application screen 954 may be displayed on the entire screens 951 , 952 a , and 952 b . In addition, a moving image application screen 954 may be displayed in the main area 751 .

[0191] Before analyzing the first and second regions, the processor 210 may control the moving image application screen 954 to be displayed in the main region 751. When a setting (e.g., one of interference amplification and interference-free amplification) does not exist, the processor 210 may control the moving image application screen 954 to be displayed in the main region 751.

[0192] The processor 210 may analyze the first and second areas of the moving image application screen 954 and determine whether to use interference amplification or interference-free amplification of the moving image application screen 954. The processor 210 may amplify the interference of the moving image application screen 954 according to the analysis result (e.g., a threshold value or less). The processor 210 may amplify and display the moving image application screen 954 on the entire screen according to the analysis result (e.g., a threshold value or less).

[0193] The processor 210 may control the display of the moving image application screen 954 in the main area 751 according to the analysis result (e.g., greater than a threshold value). In addition, the processor 210 may control the display of the moving image application screen 954 in the main area 751 and the extended area 752b2 according to the analysis result (e.g., greater than a threshold value).

[0194] The moving image application screen 954 may include a moving image display area 954a and a text providing area (or subtitle area) 954b. The moving image display area 954a may be the main area 751. The moving image display area 954a may include a portion of the main area 751 and a first extended area 752a. The moving image display area 954a may include a portion of the main area 751 and a second extended area 752b. In addition, the moving image display area 954a may include the main area 751, a portion of the first extended area 752a, and a portion of the second extended area 752b.

[0195] The text providing area 954b may be one or more. The text providing area 954b may include a portion or all of the first extended area 752a. The text providing area 954b may include a portion or all of the second extended area 752b. In addition, the text providing area 954b may include a portion of the first extended area 752a and a portion or all of the second extended area 752b.

[0196] In an exemplary embodiment, the processor 210 may control to display a moving image in a moving image display area (or main area) 954a and to display subtitles 954 in a text providing area (or a portion of the extended area) 954b.

[0197] In the text providing area 954b, the background of the subtitles 954 can be black, white, or gray. In addition, in the text providing area 954b, the background of the subtitles 954 can be a single color background or a multi-color background. In the text providing area 954b, the color of the subtitles 954 should be distinguished from the background.

[0198] The direction (or flow) of the subtitles 954 can be determined to correspond to the orientation of the electronic device 901. For example, when the orientation of the electronic device 901 is landscape, the direction of the subtitles 954 can be portrait. Additionally, when the orientation of the electronic device 901 is portrait, the direction of the subtitles 954 can be landscape.

[0199] In the text providing area 954b, the subtitles 954 may be displayed in a partial area (e.g., the extension area 752b2) that is not disturbed by the hole, opening, or cutout portion. In the text providing area 954b, the subtitles 954 may be displayed in a partial area (e.g., the extension area 752a2 or the twenty-second extension area 752b2).

[0200] In an exemplary embodiment, text (eg, alarm (or notification)) 955t may be displayed on one side (eg, extended areas 752a and 752b) of the application screen displayed in the main area 751.

[0201] refer to Figure 9H, the main area 751 may be displayed on an executed application screen (eg, a web browser) 955 .

[0202] Processor 210 may analyze the first and second areas of application screen 955 to determine one of interference magnification and interference-free magnification of application screen 955 .

[0203] The processor 210 may control to display the application screen 955 in the main area 751 according to the analysis result (eg, greater than a threshold value).

[0204] Separately from the application screen, a text 955t corresponding to the alarm (or notification) may be displayed in the extended area 752a or 752b. The processor 210 may control to display the text 955t corresponding to the alarm (or notification) in the extended area 752a or 752b.

[0205] When the text 955t is displayed in the extended area 752a or 752b, the processor 210 may gradually move (e.g., in the direction of arrow 955a) the text 955t corresponding to the alarm (or notification). When the text 955t is displayed in the extended area 752a or 752b, the processor 210 may control the display of the text 955t corresponding to the alarm (or notification) to avoid the position of the hole, opening, or cutout portion (e.g., without interference). In addition, when the text 955t is displayed in the extended area 752a or 752b, the processor 210 may gradually move (e.g., in the direction of arrow 955a) the text 955t corresponding to the alarm (or notification) to avoid the position of the hole, opening, or cutout portion (e.g., without interference).

[0206] In an exemplary embodiment, on one side (eg, extended areas 752a and 752b) of the application screen displayed in the main area 751, an image (or symbol, icon) 956i may be displayed.

[0207] refer to Figure 9I , an executed application screen (e.g., a web browser) 955 may be displayed in the main area 751. The processor 210 may analyze the first and second areas of the application screen 956 and determine one of interference amplification and non-interference amplification of the application screen 956. The processor 210 may control the application screen 956 to be displayed in the main area 751 according to the analysis result (e.g., greater than a threshold value).

[0208] Separately from the application screen, an image 956i corresponding to an obstruction may be displayed at the location of the hole, opening, or cutout portion of the extended area 752a or 752b. The processor 210 may control the display of the image 956i corresponding to the obstruction in at least one of the first extended area 752a and the second extended area 752b at the location of the opening or cutout portion. Image 956i is an example of an image corresponding to the camera (or camera hole) 730. The size of image 956i may be larger than the size of the camera (or camera hole) 730. Furthermore, image 956i should be large enough to cover the camera (or camera hole) 730.

[0209] Those skilled in the art can easily understand that there are Figure 7 The positions 720 to 740 or 631 of the holes, openings or cutout portions correspond to the various images as well as the above-mentioned images.

[0210] exist Figure 8 In step 890, when the image is displayed in the main area of the entire screen, the processing of the method of controlling the hole area of the electronic device is terminated.

[0211] Figure 10 is a flowchart illustrating a method of controlling an electronic device according to an example embodiment, Figures 11A to 11F is a diagram illustrating a method of controlling an electronic device according to example embodiments.

[0212] exist Figure 10 In step 1010 , a touch input on the screen is detected.

[0213] refer to Figure 11A and 11E , an eleventh user input (e.g., touch or hover) 992 is received in the display 950 of the electronic device 901. The user input 992 can be detected in the first extended area 952a of the display 950 of the electronic device 901. In addition, the user input 9922 can be detected in the first extended area 952a extending from the main area 751 where an application (e.g., a photo application) is displayed.

[0214] refer to Figure 11E , user input 992 may be received in an outer edge region 726 of a first hole (camera or camera hole) 725. The first hole 725 may correspond to an opening portion or a cutout portion 720 to 740 or 631. For example, when the first hole is a camera (or camera hole), the second hole may correspond to an optical sensor.

[0215] exist Figure 11EIn the embodiment, the gap d1 between the outer edge region 726 and the first hole (camera or camera hole) 725 may be 2.5 mm. In addition, the gap d1 between the outer edge region 726 and the first hole (camera or camera hole) 725 may be 1 mm ≤ d1 ≤ 18 mm. The gap d1 is an example and may vary.

[0216] exist Figure 11E In the embodiment, the gap d2 between the first outer edge area 726 and the first hole (camera or camera hole) 725 may be 2.5 mm. The gap d3 between the first outer edge area 726 and the second outer edge area 727 may be 2.0 mm. The gap d2 between the first outer edge area 726 and the first hole (camera or camera hole) 725 may be 1 mm ≤ d1 ≤ 10 mm. In addition, the gap d3 between the first outer edge area 726 and the second outer edge area 727 may be 1 mm ≤ d1 ≤ 8 mm. The input used for precise detection can be detected by the first outer edge area 726 and the second outer edge area 727. The gaps d2 and d3 are examples and may be changed.

[0217] An application (eg, a photo application) is an example and should be an application (eg, a web browser) that can be executed or installed in the electronic device 901 .

[0218] The processor 210 may detect the user input 992 using the panel 262. The processor 210 may calculate an eleventh user input position (eg, X11 coordinate and Y11 coordinate) 992a corresponding to the user input 992 using the electrical signal received from the panel 262.

[0219] The processor 210 may store the eleventh user input position 990a, a touch detection time of the detected touch (eg, 11:16 AM), and touch information corresponding to the touch in a memory.

[0220] exist Figure 10 In step 1020 , the direction of the continuous movement of the touch input is detected.

[0221] refer to Figure 11B , continuous movement of user input (e.g., touch or hover) 992 is received in the display 950 of the electronic device 901.

[0222] The processor 210 may detect continuous movement of the user input 992 (e.g., multiple X coordinates and multiple Y coordinates corresponding to the continuous touch) using the panel 262. The processor 210 may calculate continuous movement positions (e.g., multiple X coordinates and multiple Y coordinates) 992a and 992b of the eleventh user input corresponding to the user input 992 using the electrical signal received from the panel 262.

[0223] In the first outer edge area 726, continuous movement of the user input 992 (e.g., movement from the initial position 992a to the final position 992b) may indicate a touch gesture input to the display 750. In the first outer edge area 726, continuous movement of the user input 992 (e.g., movement from the initial position 992a to the camera (or camera hole) 725) may mean a touch gesture input to the display 750. In the first outer edge area 726, continuous movement of the user input 992 (e.g., movement from the initial position 992a to the outer edge area 726 via the camera (or camera hole) 725) may mean a touch gesture input to the display 750. In addition, in the first outer edge area 726, continuous movement of the user input 992 (e.g., movement from the initial position 992a to the first outer edge area 726 via the camera (or camera hole) 725) may mean a touch gesture input to the display 750.

[0224] The touch gesture of the display 750 may include a slide, a drag, or a swipe using the location 992a of the user input 992 as an initial location.

[0225] The processor 210 can use the stored continuous movement positions of the user input to determine the direction of the continuous movement of the user input. Figure 11B , the processor 210 may determine the continuous movement direction of the direction of the user input to the first hole 725 .

[0226] exist Figure 10 In step 1030 , the processor may detect that the touch input moves to a position corresponding to the first hole 725 .

[0227] refer to Figure 11B , the continuous movement of the user input reaches the first hole 725. In addition, the continuous movement of the user input may pass through the first hole 725. The processor 210 may determine that the continuous movement of the user input reaches the first hole 725 using the stored continuous movement positions of the user input.

[0228] exist Figure 10 In step 1040, a function corresponding to reaching the first hole may be executed (eg, reaching a corresponding position in response to the touch input).

[0229] refer to Figure 11CWhen the continuous movement of the user input is detected to arrive at the first hole 725, the processor 210 may execute the shortcut panel. However, please note that the processor 210 may be configured to execute any function (e.g., calling the shortcut panel 960) in response to the continuous movement of the user input arriving at the first hole 725. The processor 210 may execute a function (e.g., executing a preset panel, not shown) in response to the continuous movement of the user input arriving at the first hole 725. The execution of the shortcut panel 960 may include the execution of a preset panel (not shown).

[0230] The processor 210 can also execute a function in response to the continuous movement of the user input reaching any hole (for example, the nth hole). The processor 210 can execute a preset function at the nth hole in response to the continuous movement of the user input reaching the nth hole.

[0231] For example, when the second hole 730 is a camera or a camera hole, the processor 210 can execute a screenshot function or a camera function in response to the continuous movement of the user input reaching the second hole 730. When the third hole 725 is an earpiece or an earpiece hole, the processor 210 can execute voice recording or S voice accessibility (e.g., data acquisition or execution based on voice recognition) in response to the continuous movement of the user input reaching the third hole 725. In addition, when the fourth hole 740 is a fingerprint sensor (or home button) hole, the processor 210 can execute one of the fingerprint recognition and Samsung Pay functions corresponding to the continuous movement of the user input reaching the fourth hole 740.

[0232] In an example embodiment, a function corresponding to the nth hole may be implemented by receiving a user input at the nth hole and continuous movement of the user input reaching the nth hole.

[0233] In the outer edge region 726, the first outer edge region 726 and the second outer edge region 727 of the n-th hole are as follows: Figure 11E (a) or Figure 11E In the implementation shown in (b), when a user input is detected, the processor 210 can execute the function corresponding to the nth hole.

[0234] In an exemplary embodiment, an application screen (eg, a web browser) is displayed on the entire screens 751 , 752 a , and 752 b .

[0235] refer to Figure 11D , at the upper end of the screen (for example, including a portion of the first extended area 752a), a head-up notification 961 may be displayed. In addition, in the main area of the screen, a head-up notification 961 may be displayed.

[0236] The processor 210 can execute a function corresponding to the hole in response to the continuous movement of the user input. The hole can be, for example, the earpiece hole 725, the camera hole 730, and the fingerprint sensor hole 740. The hole can also include the optical sensor hole 720. In addition, the eleventh hole can include a front hole or a rear hole of the electronic device 901 (e.g., a rear camera hole, an LED hole).

[0237] User input 993 of the user generated at the heads-up notification 961. The user may input a continuous movement from an initial position 993a to a final position (e.g., 993b, 993c, or 993d).

[0238] The processor 210 may execute a function in response to the arrival of the continuous movement of the detected user input 993 (eg, from the initial position 993a to the final position (eg, 993b, 993c, or 993d)).

[0239] When the user input 993 reaches the hole, the operation is substantially similar to (eg, the difference between the user inputs) the continuous movement of the user input reaching the first hole; therefore, a detailed description thereof will be omitted.

[0240] The functions corresponding to the user's continuous movement to the hole in the heads-up notification 961 may include: keeping the heads-up notification (from initial position 993a to final position 993b), deleting the heads-up notification (from initial position 993a to final position 993c), or storing the heads-up notification (from initial position 993a to final position 993d). This function is understood to be merely an example, and the description is of an example function provided by the electronic device 901.

[0241] In an example embodiment, visual feedback 995a to 995f corresponding to continuous movement of the user input (or user input) is provided.

[0242] refer to Figure 11F (a) to Figure 11F As shown in (c), the processor 210 may provide visual feedback 995a to 995c corresponding to the continuous movement of the received user input.

[0243] Visual feedback 995a to 995c may be displayed corresponding to the direction or trajectory of the continuous movement of the user input. Visual feedback 995a to 995c may be displayed using the shape of the hole (e.g., circle, oval) corresponding to the initial position of the received user input. In addition, by using, for example, the color and brightness added to the shape of the hole (e.g., circle, oval) corresponding to the initial position of the received user input, visual feedback 995a to 995c may be displayed corresponding to the direction or trajectory of the continuous movement of the user input.

[0244] refer to Figure 11F(d) to Figure 11F (f), the processor 210 may provide visual feedback 995e to 995f corresponding to the received user input.

[0245] Visual feedback 995e to 995f may be displayed corresponding to the location of the received user input. Visual feedback 995e to 995f may be displayed using a hole shape (e.g., a circle, an oval) corresponding to the location of the received user input. In addition, visual feedback 995e to 995f may be displayed to gradually enlarge using the color and brightness added to the hole shape (e.g., a circle, an oval) corresponding to the initial location of the received user input.

[0246] exist Figure 10 In step 1040 , when the function is executed in response to detecting that the user input arrives at the first hole, the processing of the method of controlling the hole area of the electronic device is terminated.

[0247] According to an example embodiment of the present disclosure, a method for controlling a hole area of an electronic device having at least one hole area in a display includes the following operations: selecting displayed content; determining one of interference magnification and non-interference magnification by edge analysis of the content; and magnifying the content according to the one of interference magnification and non-interference magnification, so that the hole area is formed by one of a camera, an earpiece, an optical sensor, and a main button.

[0248] In example embodiments, the display may include a main area and an extension area, and the hole area may be located in the extension area.

[0249] In example embodiments, the extension region may be distinguished into a first extension region located at an upper end portion of the main region and a second extension region located at a lower end portion of the main region.

[0250] In example embodiments, the first extension region may be distinguished into an extension region in which one of the hole regions is located and a twelfth extension region located at a lower end portion of the extension region.

[0251] In example embodiments, the second extension region may be distinguished into an extension region in which another hole region of the hole region is located and an extension region located at an upper end portion of the extension region.

[0252] In an example embodiment, the main area may be distinguished into a first area connected to the first extended area and a second area connected to the second extended area, and edge analysis of the content may include edge analysis of content corresponding to the first area and edge analysis of content corresponding to the second area.

[0253] In example embodiments, the interference amplification may be an amplification in which the amplification of the content is limited by the hole area, and the non-interference amplification may be an amplification in which the amplification of the content is not limited by the hole area.

[0254] In example embodiments, interference magnification may be magnifying and displaying content in an interference area of a display, and the interference area of the display may include a main area and an extended area.

[0255] In example embodiments, interference magnification may limit display of a partial area of the content magnified by the hole area.

[0256] In example embodiments, the distraction-free magnification may be to magnify and display the content in a distraction-free area of the display, and the distraction-free area of the display may include partial areas of the main area and the extended area.

[0257] In example embodiments, an area of the first extension region and an area of the second extension region may be different.

[0258] In example embodiments, the area of the extended region and the area of the extended region may be different.

[0259] In example embodiments, an area of the first extension region and an area of the extension region may be different.

[0260] In example embodiments, an area of the extended region may be greater than an area of one of the first region and the second region.

[0261] In example embodiments, one hole area may be located in the first extension area to correspond to the camera.

[0262] In example embodiments, the hole region may include one of a hole, an opening, and a cutout portion.

[0263] The term "module" used in this disclosure may mean, for example, a unit including one or more combinations of hardware, software, and firmware. "Module" can be interchangeable with terms such as "unit", "logic", "logic block", "component", "circuit", etc. A "module" can be the smallest unit of a component forming a main body, or a part thereof. A "module" can be the smallest unit for performing one or more functions, or a part thereof. A "module" can be implemented mechanically or electronically. For example, a "module" according to an embodiment of the present disclosure may include at least one of a dedicated IC (ASIC) chip, a field programmable gate array (FPGA), and a programmable logic device for performing specific operations, all of which are known or will be developed in the future.

[0264] Examples of computer-readable media include: magnetic media, such as hard disks, floppy disks, and magnetic tapes; optical media, such as compact disk read-only memory (CD-ROM) and digital versatile disks (DVD); magneto-optical media, such as magneto-optical floppy disks; and hardware devices specifically configured to store and execute program instructions (e.g., programming modules), such as ROM, RAM, and flash memory. Examples of program instructions include: machine code instructions generated by an assembly language such as a compiler, and code instructions generated by a high-level programming language executable by a computer using an interpreter. The described hardware devices can be configured to function as one or more software modules to perform the above-described operations and methods, and vice versa.

[0265] The modules or programming modules according to the embodiments of the present disclosure may include one or more components, remove some of the above components, or include new components. The operations performed by the modules, programming modules or other components according to the present disclosure may be performed sequentially, in parallel, repeatedly or in a heuristic manner. Some operations may be performed in a different order, skipped, or performed together with additional operations.

[0266] The method for adjusting camera exposure in an electronic device according to various embodiments of the present disclosure may identify the exposure status of a partial area selected by a user from the entire area of a preview image, and provide a screen for correctly adjusting the exposure based on the identification result of the exposure status.

[0267] While the present disclosure has been shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made without departing from the present disclosure as defined by the appended claims and their equivalents.

[0268] According to various exemplary embodiments of the present disclosure, by providing an electronic device having a hole area that can magnify content through a display having a main area and an extension area and a method of controlling the hole area thereof, natural screen usability can be provided to a user.

Claims

1. An electronic device comprising: A display comprising a first area and a second area, wherein the second area corresponds to an upper area of the display where the camera hole is formed, and the first area corresponds to a remaining area of the display below the second area; a camera, disposed at a position corresponding to the camera hole portion; and The processor is configured to: Based on an analysis result of a portion of the content to be displayed corresponding to an edge area of the first area, setting a display mode of an execution screen of an application for displaying the content to a first display mode or a second display mode, If a display mode for displaying the execution screen of the application with respect to the camera hole portion is set to a first display mode, controlling the display to display the execution screen of the application on both the first area and the second area of the display, and If the display mode for displaying the execution screen of the application with respect to the camera hole portion is set to the second display mode, controlling the display to display the execution screen of the application only on the first area of the display, The operation of setting the display mode of the execution screen of the application for displaying the content to the first display mode or the second display mode based on the analysis result of the portion of the content corresponding to the edge area of the first area in the content to be displayed includes: When the characteristic of the partial content is greater than a threshold, setting the display mode of the execution screen of the application to a second display mode; and When the characteristic of the partial content is equal to or less than the threshold, setting the display mode of the execution screen of the application to the first display mode, The feature of the portion of content is a difference in color, chroma or texture between pixels of the portion of content.

2. The electronic device according to claim 1, wherein The width of the second area is the width of the display, and the height of the second area is greater than or equal to the height of the camera hole portion.

3. The electronic device according to claim 1, wherein When the execution screen of the application is displayed only on the first area of the display, an alarm and / or a notification is displayed on the second area of the display.

4. The electronic device according to claim 3, wherein: The alarm and / or notification is displayed at a position of the second area avoiding the camera hole portion.

5. The electronic device according to claim 1, wherein Content covering the camera hole portion is displayed on the second area of the display.

6. The electronic device according to claim 1, wherein When the execution screen of the application is displayed on both the first area and the second area of the display, the displayed execution screen of the application is restricted by the camera hole portion.

7. The electronic device according to claim 1, wherein The camera aperture portion includes a hole, an opening, or a cutout.

8. The electronic device according to claim 1, further comprising: A memory stores information related to the position of the camera hole portion, wherein the information related to the position of the camera hole portion is used to determine the position of the camera hole portion.

9. An electronic device comprising: A display comprising a hole region formed near an upper side of an electronic device, wherein a display area of the display is divided into an upper display region at least partially surrounding the hole region and a remaining display region below the upper display region; and The processor is configured to: setting a display mode of an execution screen of an application for displaying the content to a first display mode or a second display mode based on an analysis result of a portion of the content to be displayed corresponding to an edge area of the remaining display area; If the display mode for displaying the execution screen of the application for the hole area is set to the first display mode, controlling the display to display the execution screen of the application on both the upper display area and the remaining display areas, and If the display mode for displaying the execution screen of the application for the hole area is set to the second display mode, controlling the display to display the execution screen of the application only on the remaining display area, The operation of setting the display mode of the execution screen of the application for displaying the content to the first display mode or the second display mode based on the analysis result of the portion of the content to be displayed corresponding to the edge area of the remaining display area includes: When the characteristic of the partial content is greater than a threshold, setting the display mode of the execution screen of the application to a second display mode; and When the characteristic of the partial content is equal to or less than the threshold, setting the display mode of the execution screen of the application to the first display mode, The feature of the partial content is the difference between the colors, chromaticity or textures of the pixels of the partial content.

10. The electronic device according to claim 9, further comprising: A memory stores position information of the hole area, wherein the position information is used to determine the position of the hole area.

11. The electronic device according to claim 9, wherein When the display mode for displaying the execution screen of the application in the hole area is set to the first display mode, the processor is further configured to display part of the execution screen in the upper display area and display the rest of the execution screen in the remaining display area.

12. The electronic device according to claim 11, wherein The portion of the execution screen displayed in the upper display area is displayed based on a color of content displayed in an edge area of the remaining display area.

13. The electronic device according to claim 9, wherein The width of the upper display area is the width of the display, and the height of the upper display area is greater than or equal to the height of the hole area.

14. The electronic device according to claim 9, wherein When the display mode for displaying the execution screen of the application with respect to the hole area is set to the second display mode, an alarm and / or a notification is displayed in the upper display area.

15. The electronic device according to claim 14, wherein The alarm and / or notification is displayed at a position of the upper display area avoiding the hole area.

16. The electronic device according to claim 9, wherein Content covering the hole area is displayed on the upper display area.

17. The electronic device according to claim 9, wherein: When the display mode for displaying the execution screen of the application with respect to the hole area is set to the first display mode, the displayed execution screen of the application is limited by the hole area.

Images