Electronic device for changing display in designated area of display and operating method thereof

Abstract

An electronic device is provided. The electronic device includes a display, a camera module configured to be positioned below the display, a memory configured to store instructions, and a processor configured to be functionally connected to the display, the camera module, and the memory, wherein the processor is configured to identify a change in an operating state of the camera module when the electronic device displays a predetermined image in an area of the display surrounding the camera module by executing the instructions to cause the electronic device to display the predetermined image in the area of the display surrounding the camera module, change a size of the area surrounding the camera module in response to identifying the change in the operating state of the camera module, and display the predetermined image in the changed area.

Description

Technical Field

[0001] This disclosure relates to an electronic device for changing the display in a designated area of ​​a display and a method for operating said electronic device. Background Technology

[0002] Electronic devices have evolved to minimize the bezels of the surface on which the display is placed. Changes have been made to minimize the bezels of electronic devices so that various components (e.g., camera modules and sensor modules) positioned on the surface of the display according to relevant technologies are now located below the display.

[0003] The above information is presented as background technology to aid in understanding this disclosure. It is neither determined nor asserted whether any of the above can be considered prior art application of this disclosure. Summary of the Invention

[0004] Technical issues

[0005] If the camera module is positioned below the display, light from the display can be reflected inside the electronics and detected by the camera module. If light from the display is detected by the camera module in this way, the quality of the image acquired by the camera module may be degraded.

[0006] Therefore, there is a need to investigate a method to prevent the quality of images acquired by the camera module from degrading even when the camera module is positioned below the display.

[0007] The technical objectives to be achieved herein are not limited to those described above, and other technical objectives not mentioned herein may be clearly understood by those skilled in the art from the following description.

[0008] Solution to the problem

[0009] The purpose of this disclosure is to at least address the aforementioned problems and / or disadvantages, and to at least provide the advantages described below. Therefore, one aspect of this disclosure is to provide…

[0010] Additional aspects will be set forth in part in the description which follows, and in part will be obvious from the description or may be learned by practice of the presented embodiments.

[0011] According to an aspect of this disclosure, an electronic device is provided. The electronic device includes: a display; a camera module configured to be positioned below the display; a memory configured to store instructions; and a processor configured to be functionally connected to the display, the camera module, and the memory. The processor can be configured to, by executing the instructions, cause the electronic device to recognize changes in the operating state of the camera module when displaying a predetermined image in an area of ​​the display surrounding the camera module, change the size of the area surrounding the camera module in response to recognizing the changes in the operating state of the camera module, and display the predetermined image in the changed area.

[0012] According to another aspect of this disclosure, a method of operating an electronic device is provided. The method includes: recognizing a change in the operating state of the camera module while displaying a predetermined image in an area of ​​a display surrounding a camera module positioned below the display; changing the size of the area surrounding the camera module in response to recognizing the change in the operating state of the camera module; and displaying the predetermined image in the changed area.

[0013] The electronic devices and methods according to various embodiments are advantageous in that the image quality acquired by the camera module can be maintained even when the camera module is positioned below the display.

[0014] Other aspects, advantages, and distinctive features of this disclosure will become apparent to those skilled in the art from the following detailed description of various embodiments disclosed in conjunction with the accompanying drawings. Attached Figure Description

[0015] The above and other aspects, features, and advantages of certain embodiments of this disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, wherein:

[0016] Figure 1 This is a block diagram illustrating an electronic device in a network environment according to an embodiment of the present disclosure;

[0017] Figure 2 This is a block diagram illustrating a procedure according to an embodiment of the present disclosure;

[0018] Figure 3 This is a block diagram illustrating a camera module according to an embodiment of the present disclosure;

[0019] Figure 4A This is a diagram illustrating an electronic device according to an embodiment of the present disclosure;

[0020] Figure 4B This is a diagram showing at least a portion of a cross-section of an electronic device according to an embodiment of the present disclosure;

[0021] Figure 4CThis is a diagram showing at least a portion of a cross-section of an electronic device according to an embodiment of the present disclosure;

[0022] Figure 5A This is a diagram illustrating the variation of circular cutting strokes in an electronic device according to an embodiment of the present disclosure;

[0023] Figure 5B This is a diagram illustrating the variation of the "U"-shaped cutting strokes in an electronic device according to an embodiment of the present disclosure;

[0024] Figure 5C This is a diagram illustrating the variation of the "V" shaped cutting stroke in an electronic device according to an embodiment of the present disclosure;

[0025] Figure 5D This is a diagram illustrating the variation of planar cutting strokes in an electronic device according to an embodiment of the present disclosure;

[0026] Figure 5E This is a diagram illustrating the variation of rectangular cutting strokes in an electronic device according to an embodiment of the present disclosure;

[0027] Figure 6 This is a flowchart illustrating the operation of changing the cutting strokes in an electronic device according to an embodiment of the present disclosure;

[0028] Figure 7 This is a flowchart illustrating the operation of changing the display of a display in an electronic device according to an embodiment of the present disclosure;

[0029] Figure 8 This is a flowchart illustrating the operation of increasing the thickness of a cut stroke in an electronic device according to an embodiment of the present disclosure;

[0030] Figure 9 This is a flowchart illustrating the operation of reducing the thickness of cut strokes in an electronic device according to an embodiment of the present disclosure;

[0031] Figure 10A This is a flowchart illustrating the operation of changing cutting strokes when acquiring an image in an electronic device according to an embodiment of the present disclosure;

[0032] Figure 10B This is a diagram illustrating an image acquired by an electronic device according to an embodiment of the present disclosure;

[0033] Figure 11 This is a flowchart illustrating the operation of increasing the thickness of cutting strokes when acquiring an image in an electronic device according to an embodiment of the present disclosure;

[0034] Figure 12 This is a flowchart illustrating the operation of reducing the thickness of cutting strokes when acquiring an image in an electronic device according to an embodiment of the present disclosure; and

[0035] Figure 13This is a flowchart illustrating the operation of changing the indication of a display in an electronic device according to an embodiment of the present disclosure.

[0036] In all the accompanying drawings, similar reference numerals will be understood to refer to similar parts, components, and structures. Detailed Implementation

[0037] The following description, provided with reference to the accompanying drawings, is intended to aid in a comprehensive understanding of the various embodiments of this disclosure as defined by the claims and their equivalents. The following description includes various specific details to aid understanding, but these should be considered exemplary only. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of this disclosure. Furthermore, for clarity and brevity, descriptions of well-known functions and constructions may be omitted.

[0038] The terms and words used in the following description and claims are not limited to their literal meaning, but are used by the inventors only to enable a clear and consistent understanding of this disclosure. Therefore, it will be apparent to those skilled in the art that the following description of various embodiments of this disclosure is provided for illustrative purposes only and not for the purpose of limiting the disclosure as defined by the appended claims and their equivalents.

[0039] It should be understood that the singular forms “a,” “an,” and “the” include plural referents unless the context clearly specifies otherwise. Thus, for example, a reference to “component surface” includes a reference to one or more such surfaces.

[0040] Figure 1 This is a block diagram illustrating an electronic device in a network environment according to an embodiment of the present disclosure.

[0041] Reference Figure 1In network environment 100, electronic device 101 can communicate with electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or with electronic device 104 or server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, electronic device 101 can communicate with electronic device 104 via server 108. According to an embodiment, electronic device 101 may include a processor 120, memory 130, input device 150, sound output device 155, display device 160, audio module 170, sensor module 176, interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module (SIM) 196, or antenna module 197. In some embodiments of this disclosure, at least one of these components (e.g., display device 160 or camera module 180) may be omitted from electronic device 101, or one or more other components may be added to electronic device 101. In some embodiments, some components may be implemented as a single integrated circuit. For example, sensor module 176 (e.g., a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented as embedded in display device 160 (e.g., a display).

[0042] Processor 120 may run software (e.g., program 140) to control at least one other component (e.g., hardware or software component) of electronic device 101 connected to processor 120, and may perform various data processing or calculations. According to one embodiment of this disclosure, as at least part of the data processing or calculation, processor 120 may load commands or data received from another component (e.g., sensor module 176 or communication module 190) into volatile memory 132, process the commands or data stored in volatile memory 132, and store the resulting data in non-volatile memory 134. According to embodiments of this disclosure, processor 120 may include a main processor 121 (e.g., central processing unit (CPU) or application processor (AP)) and auxiliary processors 123 (e.g., graphics processing unit (GPU), image signal processor (ISP), sensor hub processor, or communication processor (CP)) that are operationally independent of or combined with the main processor 121. Alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or it may be adapted to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or it may be implemented as part of the main processor 121.

[0043] When the main processor 121 is inactive (e.g., in sleep mode), the auxiliary processor 123 (rather than the main processor 121) can control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display device 160, sensor module 176, or communication module 190), or when the main processor 121 is active (e.g., running an application), the auxiliary processor 123 can work with the main processor 121 to control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display device 160, sensor module 176, or communication module 190). According to embodiments, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) functionally associated with the auxiliary processor 123. The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., processor 120 or sensor module 176). The various data may include, for example, software (e.g., program 140) and input or output data for commands associated with it. Memory 130 may include volatile memory 132 or non-volatile memory 134.

[0044] The program 140 may be stored as software in the memory 130, and the program 140 may include, for example, an operating system (OS) 142, middleware 144, or application 146.

[0045] Input device 150 can receive commands or data from outside electronic device 101 (e.g., a user) that will be used by other components of electronic device 101 (e.g., processor 120). Input device 150 may include, for example, a microphone, mouse, keyboard, or digital pen (e.g., stylus).

[0046] The sound output device 155 can output sound signals to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. According to embodiments of this disclosure, the receiver may be implemented separately from the speaker or as part of the speaker.

[0047] Display device 160 can visually provide information to the outside of electronic device 101 (e.g., to a user). Display device 160 may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling a respective one of the display, holographic device, and projector. According to embodiments of this disclosure, display device 160 may include touch circuitry adapted to detect touch or sensor circuitry (e.g., a pressure sensor) adapted to measure the intensity of the force caused by touch.

[0048] The audio module 170 can convert sound into electrical signals and vice versa. According to embodiments of this disclosure, the audio module 170 can obtain sound via the input device 150, or output sound via the sound output device 155 or headphones of an external electronic device (e.g., electronic device 102) that is directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0049] Sensor module 176 can detect the operating state of electronic device 101 (e.g., power or temperature) or the environmental state outside electronic device 101 (e.g., user state), and then generate an electrical signal or data value corresponding to the detected state. According to embodiments of this disclosure, sensor module 176 may include, for example, a gesture sensor, a gyroscope sensor, an atmospheric pressure sensor, a magnetic sensor, an accelerometer, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0050] Interface 177 may support one or more specific protocols used to enable electronic device 101 to connect directly (e.g., wired) or wirelessly to external electronic device (e.g., electronic device 102). According to embodiments of this disclosure, interface 177 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital Card (SD) interface, or an audio interface.

[0051] Connection end 178 may include a connector, via which electronic device 101 may be physically connected to an external electronic device (e.g., electronic device 102). According to embodiments of this disclosure, connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0052] The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or motion) or electrical stimulation that can be recognized by a user through his touch or kinesthesia. According to embodiments of this disclosure, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0053] Camera module 180 can capture still or moving images. According to embodiments of this disclosure, camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0054] The power management module 188 manages the power supply to the electronic device 101. According to embodiments of this disclosure, the power management module 188 may be implemented as at least a portion of, for example, a power management integrated circuit (PMIC).

[0055] Battery 189 may power at least one component of electronic device 101. According to embodiments of this disclosure, battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable rechargeable battery, or a fuel cell.

[0056] Communication module 190 can support the establishment of a direct (e.g., wired) or wireless communication channel between electronic device 101 and external electronic devices (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. Communication module 190 may include one or more communication processors capable of operating independently of processor 120 (e.g., application processor (AP)) and support direct (e.g., wired) or wireless communication. According to embodiments of this disclosure, communication module 190 may include wireless communication module 192 (e.g., cellular communication module, short-range wireless communication module, or Global Navigation Satellite System (GNSS) communication module) or wired communication module 194 (e.g., local area network (LAN) communication module or power line communication (PLC) module). One of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip) or as multiple components (e.g., multiple chips) that are separate from each other. The wireless communication module 192 can identify and verify the electronic device 101 in the communication network (such as the first network 198 or the second network 199) using user information (e.g., the International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0057] Antenna module 197 can transmit or receive signals or power to or from the exterior of electronic device 101 (e.g., external electronic device). According to embodiments of this disclosure, antenna module 197 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to embodiments of this disclosure, antenna module 197 may include multiple antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as a first network 198 or a second network 199) can be selected from the multiple antennas by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and the external electronic device via the selected at least one antenna. According to embodiments of this disclosure, additional components besides the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may be additionally incorporated into antenna module 197.

[0058] At least some of the aforementioned components can be interconnected and communicate signals (e.g., commands or data) between them via an inter-peripheral communication scheme (e.g., bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industrial processor interface (MIPI)).

[0059] According to embodiments of this disclosure, commands or data can be sent or received between electronic device 101 and external electronic device 104 via server 108 connected to a second network 199. Each of electronic device 102 or electronic device 104 can be a device of the same type as electronic device 101, or a device of a different type. According to embodiments of this disclosure, all or some operations that would be performed on electronic device 101 can be performed on one or more of external electronic devices 102, external electronic devices 104, or server 108. For example, if electronic device 101 is required to automatically perform a function or service, or is required to perform a function or service in response to a request from a user or another device, electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service, instead of running the function or service, or electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service in addition to running the function or service. Upon receiving the request, the one or more external electronic devices may perform at least a portion of the requested function or service, or perform additional functions or services related to the request, and transmit the result of the execution to electronic device 101. Electronic device 101 may provide the result as at least a partial response to the request, either with further processing or without further processing. For this purpose, technologies such as cloud computing, distributed computing, or client-server computing may be used.

[0060] Figure 2 This is a block diagram 200 illustrating a procedure according to an embodiment of the present disclosure.

[0061] refer to Figure 2 The program 140 may include an operating system (OS) 142, middleware 144, or an application 146 that can run on the OS 142 for controlling one or more resources of the electronic device 101. The OS 142 may include, for example, Android. TM iOS TM Windows TM Symbian TM Tizen TM Or Bada TM For example, at least a portion of program 140 may be preloaded onto electronic device 101 during manufacturing, or at least a portion of program 140 may be downloaded from or updated by an external electronic device (e.g., electronic device 102 or electronic device 104, or server 108) during user use.

[0062] OS 142 can control the management (e.g., allocation or deallocation) of one or more system resources (e.g., processes, memory, or power) of electronic device 101. Alternatively or additionally, OS 142 may include one or more drivers for driving other hardware devices of electronic device 101 (e.g., input device 150, sound output device 155, display device 160, audio module 170, sensor module 176, interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, user identification module 196, or antenna module 197).

[0063] Middleware 144 may provide various functions to application 146, enabling application 146 to use functions or information provided from one or more resources of electronic device 101. Middleware 144 may include, for example, application manager 201, window manager 203, multimedia manager 205, resource manager 207, power manager 209, database manager 211, package manager 213, connection manager 215, notification manager 217, location manager 219, graphics manager 221, security manager 223, telephone manager 225, or voice recognition manager 227.

[0064] Application manager 201, for example, manages the lifecycle of application 146. Window manager 203, for example, manages one or more graphical user interface (GUI) resources used on the screen. Multimedia manager 205, for example, identifies one or more formats that will be used to play media files and can encode or decode corresponding media files within the media files using a codec suitable for the corresponding format selected from said one or more formats. Resource manager 207, for example, manages the source code of application 146 or the storage space of memory 130. Power manager 209, for example, manages the capacity, temperature, or power of battery 189 and can determine or provide relevant information for the operation of electronic device 101 based at least in part on the corresponding information of battery 189's capacity, temperature, or power. According to embodiments of this disclosure, power manager 209 can work in conjunction with the basic input / output system (BIOS) (not shown) of electronic device 101.

[0065] Database manager 211, for example, can create, search, or modify databases that will be used by application 146. Package manager 213, for example, can manage the installation or updates of applications distributed in the form of package files. Connection manager 215, for example, can manage wireless or direct connections between electronic device 101 and external electronic devices. Notification manager 217, for example, can provide functionality for notifying the user of specific events (e.g., incoming calls, messages, or alarms). Location manager 219, for example, can manage location information about electronic device 101. Graphics manager 221, for example, can manage one or more graphical effects to be provided to the user or user interfaces related to said one or more graphical effects.

[0066] Security manager 223 may provide system security or user authentication, for example. Telephone manager 225 may manage voice or video calling functions provided by electronic device 101, for example. Voice recognition manager 227 may send user voice data to server 108 and receive commands from server 108 corresponding to functions that operate on electronic device 101 based at least partially on voice data or text data converted from at least partially on voice data. According to embodiments of this disclosure, middleware 144 may dynamically remove some existing components or add new components. According to embodiments of this disclosure, at least a portion of middleware 144 may be included as part of OS 142, or at least a portion of middleware 144 may be implemented as separate software independent of OS 142.

[0067] Application 146 may include, for example, a homepage 251, a dialer 253, a Short Message Service (SMS) / Multimedia Messaging Service (MMS) 255, an Instant Messaging (IM) 257, a browser 259, a camera 261, an alarm clock 263, a contact 265, a voice recognition 267, an email 269, a calendar 271, a media player 273, a photo album 275, a watch 277, a health 279 (e.g., for measuring exercise intensity or biometric information such as blood sugar) or an environmental information 281 (e.g., for measuring barometric pressure, humidity, or temperature information). According to embodiments of this disclosure, application 146 may also include an information exchange application (not shown) capable of supporting information exchange between electronic device 101 and external electronic devices. The information exchange application may, for example, include a notification forwarding application suitable for transmitting specified information (e.g., a call, message, or alarm) to external electronic devices or a device management application suitable for managing external electronic devices. The notification forwarding application can send notification information to an external electronic device corresponding to a specific event (e.g., receiving an email) that has occurred in another application (e.g., email application 269) on electronic device 101. Alternatively or additionally, the notification forwarding application can receive notification information from an external electronic device and provide the notification information to the user of electronic device 101.

[0068] Device management applications can control the power (e.g., turning on or off) or functions (e.g., adjusting brightness, resolution, or focus) of external electronic devices or some components of external electronic devices (e.g., the display device or camera module of the external electronic device). Additionally or optionally, device management applications can support the installation, removal, or updating of applications running on external electronic devices.

[0069] Figure 3 This is a block diagram 300 illustrating a camera module according to an embodiment of the present disclosure.

[0070] Reference Figure 3 The camera module 180 may include a lens assembly 310, a flash 320, an image sensor 330, an image stabilizer 340, a memory 350 (e.g., a buffer memory), or an image signal processor 360. The lens assembly 310 may capture light emitted or reflected from an object whose image is to be captured. The lens assembly 310 may include one or more lenses. According to embodiments of this disclosure, the camera module 180 may include multiple lens assemblies 310. In this case, the camera module 180 may form, for example, a dual-camera system, a 360-degree camera, or a spherical camera. Some of the multiple lens assemblies 310 may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties that differ from the lens properties of the other lens assemblies. The lens assembly 310 may include, for example, a wide-angle lens or a telephoto lens.

[0071] The flash 320 is capable of emitting light, wherein the emitted light is used to enhance light reflected from an object. According to embodiments of this disclosure, the flash 320 may include one or more light-emitting diodes (LEDs) (e.g., red-green-blue (RGB) LEDs, white LEDs, infrared (IR) LEDs, or ultraviolet (UV) LEDs) or xenon lamps. The image sensor 330 acquires an image corresponding to an object by converting light emitted or reflected from an object and transmitted through the lens assembly 310 into an electrical signal. According to embodiments of this disclosure, the image sensor 330 may include one image sensor selected from a plurality of image sensors having different properties (e.g., an RGB sensor, a black-and-white (BW) sensor, an IR sensor, or a UV sensor), a plurality of image sensors having the same properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor 330 may be implemented using, for example, a charge-coupled device (CCD) sensor or a complementary metal-oxide-semiconductor (CMOS) sensor.

[0072] Image stabilizer 340 may move image sensor 330 or at least one lens included in lens assembly 310 in a specific direction, or control the operability properties of image sensor 330 (e.g., adjust readout timing) in response to movement of camera module 180 or electronics 101 including camera module 180. This allows compensation for at least a portion of the negative effects (e.g., image blur) caused by movement of the image being captured. According to embodiments of this disclosure, image stabilizer 340 may use a gyroscope sensor (not shown) or an accelerometer sensor (not shown) disposed within or outside camera module 180 to sense such movement of camera module 180 or electronics 101. According to embodiments of this disclosure, image stabilizer 340 may be implemented as, for example, an optical image stabilizer.

[0073] Memory 350 may at least temporarily store at least a portion of the images acquired via image sensor 330 for subsequent image processing tasks. For example, if multiple images are captured rapidly or if image capture is delayed due to shutter lag, the acquired raw images (e.g., Bayer pattern images, high-resolution images) may be stored in memory 350, and their corresponding copy images (e.g., low-resolution images) may be previewed via display device 160. Then, if specified conditions are met (e.g., by user input or system command), at least a portion of the raw images stored in memory 350 may be acquired and processed by, for example, image signal processor 360. According to embodiments of this disclosure, memory 350 may be configured as at least a portion of memory 130, or memory 350 may be configured as a separate memory operating independently of memory 130.

[0074] Image signal processor 360 may perform one or more image processing operations on images acquired via image sensor 330 or stored in memory 350. The one or more image processing operations may include, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image compositing, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Alternatively or additionally, image signal processor 360 may perform control (e.g., exposure time control or readout timing control) on at least one component included in camera module 180 (e.g., image sensor 330). Images processed by image signal processor 360 may be stored back in memory 350 for further processing, or the image may be provided to external components outside camera module 180 (e.g., memory 130, display device 160, electronic device 102, electronic device 104, or server 108). According to embodiments of this disclosure, image signal processor 360 may be configured as at least a portion of processor 120, or image signal processor 360 may be configured as a separate processor operating independently of processor 120. If the image signal processor 360 is configured as a processor separate from the processor 120, the processor 120 can display at least one image processed by the image signal processor 360 as is via the display device 160, or the at least one image can be displayed after further processing.

[0075] According to embodiments of this disclosure, the electronic device 101 may include a plurality of camera modules 180 with different attributes or functions. In this case, at least one of the plurality of camera modules 180 may form, for example, a wide-angle camera, and at least another of the plurality of camera modules 180 may form a telephoto camera. Similarly, at least one of the plurality of camera modules 180 may form, for example, a front-facing camera, and at least another of the plurality of camera modules 180 may form a rear-facing camera.

[0076] The electronic device according to various embodiments can be one of a variety of types of electronic devices. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. According to embodiments of this disclosure, the electronic device is not limited to those described above.

[0077] It should be understood that the various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features set forth herein to the specific embodiments, but rather to include various changes, equivalents, or substitutions to the respective embodiments. In the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that nouns in the singular form corresponding to terms may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” may include any one or all possible combinations of the items enumerated together with the corresponding phrase among the plurality of phrases. As used herein, terms such as “first” and “second” or “first” and “second” may be used to simply distinguish the respective component from another component and do not limit the component in other respects (e.g., importance or order). It will be understood that, whether the terms “operably” or “communically” are used or not, if an element (e.g., a first element) is referred to as “combined with another element (e.g., a second element),” “combined to another element (e.g., a second element),” “connected to another element (e.g., a second element),” or “attached to another element (e.g., a second element)”, it means that the first element can be directly (e.g., wiredly) connected to the second element, wirelessly connected to the second element, or connected to the second element via a third element.

[0078] As used in connection with various embodiments of this disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "part," or "circuit"). A module may be a single integrated component adapted to perform one or more functions, or the smallest unit or part of such a single integrated component. For example, according to embodiments of this disclosure, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0079] The various embodiments set forth herein can be implemented as software (e.g., program 140) containing one or more instructions readable by a machine (e.g., electronic device 101) stored in a storage medium (e.g., internal memory 136 or external memory 138). For example, under the control of a processor, the processor (e.g., processor 120) of the machine (e.g., electronic device 101) can invoke and execute at least one of the one or more instructions stored in the storage medium, with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. Machine-readable storage media may be provided in the form of non-transitory storage media. The term "non-transitory" means only that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between data being stored semi-permanently in the storage medium and data being temporarily stored in the storage medium.

[0080] According to embodiments of this disclosure, methods according to various embodiments of this disclosure can be included and provided in a computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)) or via an app store (e.g., the Play Store). TM The computer program product may be published online (e.g., downloaded or uploaded), or may be distributed directly between two user devices (e.g., smartphones) (e.g., downloaded or uploaded). If published online, at least a portion of the computer program product may be temporarily generated, or at least a portion of the computer program product may be temporarily stored in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a forwarding server).

[0081] According to various embodiments of this disclosure, each of the above-described components (e.g., a module or program) may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to various embodiments of this disclosure, one or more of the above-described components may be omitted, or one or more other components may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments of this disclosure, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding component of the multiple components performed one or more functions before integration. According to various embodiments of this disclosure, the operations performed by a module, program, or other component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.

[0082] Figure 4A This is a diagram illustrating an electronic device 401 according to an embodiment of the present disclosure. In embodiments of the present disclosure, Figure 4A The description can be found here. Figures 1 to 3 In embodiments of this disclosure, Figure 4A The electronic device 401 can correspond to Figure 1 Electronic device 101. In embodiments of this disclosure, Figure 4A The display panel 402 may be included in Figure 1 In the display device 160.

[0083] refer to Figure 4A In the display panel 402 of the electronic device 401, the camera module (e.g., Figure 1 The camera module 180 can be disposed in the region 403 for acquiring images. In embodiments of this disclosure, the region 403 for acquiring images can be a region corresponding to the viewpoint of the camera module 180. In embodiments of this disclosure, the region 403 for acquiring images can also be referred to as the region surrounding the camera module 180.

[0084] refer to Figure 4A The cutting stroke 404 may exist around the area 403 used to acquire the image. In embodiments of this disclosure, the cutting stroke 404 may be an area on the display panel 402 configured to express a predetermined color (e.g., black lines).

[0085] In embodiments of this disclosure, electronic device 401 may display a predetermined color and / or a predetermined image in an area of ​​display panel 402 corresponding to cutting stroke 404, thereby expressing the predetermined color in cutting stroke 404.

[0086] In embodiments of this disclosure, electronic device 401 may turn off the area of ​​display panel 402 corresponding to cutting stroke 404, thereby expressing a predetermined color in cutting stroke 404.

[0087] In embodiments of this disclosure, the area surrounding the camera module 180 may include a region 403 for acquiring images and / or cutting strokes 404.

[0088] Figure 4B This is a diagram showing at least a portion of a cross-section of an electronic device according to an embodiment of the present disclosure.

[0089] refer to Figure 4B It shows Figure 4A The cross-section between S1 and S2 of the electronic device 401. In embodiments of this disclosure, Figure 4B The display panel 420 may be included in Figure 1 In the display device 160. In embodiments of this disclosure, Figure 4B The camera module 180 can correspond to Figure 1 The camera module 180. In embodiments of this disclosure, Figure 4B The description can be found here. Figures 1 to 3 .

[0090] In embodiments of this disclosure, window 410 may form a surface of electronic device 101.

[0091] In embodiments of this disclosure, the display panel 420 may be disposed below the window 410 and may include a hole 425. In embodiments of this disclosure, the hole 425 may also be referred to as an opening. In embodiments of this disclosure, when viewed from above (in... Figure 4A When viewing the electronic device 101 from top to bottom, the aperture 425 can be implemented in the form of surrounding the camera module 180. In embodiments of this disclosure, the aperture 425 can be implemented in the form of a circle, an ellipse, a polygon, or a combination thereof. In embodiments of this disclosure, the display panel 420 can also be referred to as a display.

[0092] In embodiments of this disclosure, the hole 425 may be an area from which the display panel 420 is removed. In embodiments of this disclosure, the hole 425 may be an area in which the display panel 420 is made transparent. In embodiments of this disclosure, the hole 425 created by removing the display panel 420 may be referred to as a through hole or a via. In embodiments of this disclosure, the hole 425 created by making the display panel 420 transparent may also be referred to as a glass hole or a transparent hole.

[0093] In embodiments of this disclosure, the camera module 180 may be disposed below the display panel 420 and can be viewed through the window 410. In embodiments of this disclosure, the camera module 180 can acquire images by sensing light passing through the window 410 and the aperture 425 of the display panel 420. In embodiments of this disclosure, the area of ​​the window 410 from which the camera module 180 is directly viewed may be referred to as the camera area 421. In embodiments of this disclosure, the camera area 421 may also be referred to as the area covering the camera module 180.

[0094] In embodiments of this disclosure, when a user views the aperture area 411, the camera module 180 can be identified through the transparent window 410 and the aperture 425. In embodiments of this disclosure, the aperture area 411, excluding the camera area 421, can be displayed to the user in a predetermined color (e.g., black). In embodiments of this disclosure, a black matrix can be disposed between the pixels of the display panel 420, such that the aperture area 411, excluding the camera area 421, can be displayed to the user in a predetermined color (e.g., black). In embodiments of this disclosure, the black matrix may not be disposed within the camera area 421.

[0095] In embodiments of this disclosure, the processor 120 of the electronic device 101 can control the display panel 420 to display a predetermined color and / or a predetermined image in an area of ​​the display panel 420 corresponding to the cutting stroke 430. In embodiments of this disclosure, the predetermined color may be black. In embodiments of this disclosure, the predetermined image may be an image with black.

[0096] In embodiments of this disclosure, the processor 120 of the electronic device 101 can control the display panel 420 to turn off the area of ​​the display panel 420 corresponding to the cutting stroke 430. In embodiments of this disclosure, when the area of ​​the display panel 420 corresponding to the cutting stroke 430 is turned off, the area of ​​the display panel 420 corresponding to the cutting stroke 430 can be viewed as black through a black matrix.

[0097] In embodiments of this disclosure, the processor 120 can change the size and / or shape of the cutting strokes 430 according to the operating state of the electronic device 101. In embodiments of this disclosure, when the camera module 180 is in image capture mode, the processor 120 can increase the thickness of the cutting strokes 430. In embodiments of this disclosure, when the camera module 180 is in off mode or illumination measurement mode, the processor 120 can decrease the thickness of the cutting strokes 430.

[0098] In embodiments of this disclosure, the hole region 411 may correspond to Figure 4A The region 403 used to acquire the image.

[0099] refer to Figure 4BThe illustration shows the division of the area corresponding to cutting stroke 430 and the hole area 411, but this is merely an example. In embodiments of this disclosure, the area of ​​hole area 411 other than camera area 421 may be included in the area corresponding to cutting stroke 430. In embodiments of this disclosure, when the area of ​​hole area 411 other than camera area 421 is included in the area corresponding to cutting stroke 430, the area surrounding camera module 180 may be divided into the area corresponding to cutting stroke 430 and camera area 421.

[0100] Figure 4C This is a cross-sectional view showing an electronic device 401 according to an embodiment of the present disclosure.

[0101] refer to Figure 4C It can show Figure 4A The cross-section between S1 and S2 of the electronic device 401. In embodiments of this disclosure, Figure 4C The display panel 420 may be included in Figure 1 In the display device 160. In embodiments of this disclosure, Figure 4C The camera module 180 can correspond to Figure 1 The camera module 180. In embodiments of this disclosure, Figure 4C The description can be found here. Figures 1 to 3 .exist Figure 4C In the description, with Figure 4B Overlapping descriptions can be omitted.

[0102] In embodiments of this disclosure, window 410 may form a surface of electronic device 101.

[0103] In embodiments of this disclosure, the display panel 420 may be disposed below the window 410. In embodiments of this disclosure, light may pass through the display panel 420. In embodiments of this disclosure, light may pass through the space between the pixels of the display panel 420. In embodiments of this disclosure, light may pass through the space between the pixels of the display panel 420 and / or the space between the black matrices.

[0104] In embodiments of this disclosure, the camera module 180 may be disposed below the display panel 420. In embodiments of this disclosure, the camera module 180 can acquire images by sensing light passing through the window 410 and the display panel 420. In embodiments of this disclosure, the area within the window 410 where the camera module 180 is located may be referred to as camera area 421.

[0105] In embodiments of this disclosure, when the display panel 420 is off, the camera coverage area 412 can be displayed to the user in a predetermined color (e.g., black). In embodiments of this disclosure, a black matrix can be disposed between the display panel 420 and the camera module 180, such that the camera coverage area 412 can be displayed to the user in a predetermined color (e.g., black). In embodiments of this disclosure, the black matrix may not be disposed within the camera area 421. In embodiments of this disclosure, the camera coverage area 412 can be the area surrounding the camera module 180.

[0106] In embodiments of this disclosure, the processor 120 of the electronic device 101 can control the display panel 420 to display predetermined colors and / or predetermined images in the area of ​​the display panel 420 corresponding to the cutting strokes 430.

[0107] In embodiments of this disclosure, the processor 120 can control the display panel 420 to turn off the area of ​​the display panel 420 corresponding to the cutting stroke 430. In embodiments of this disclosure, when the area of ​​the display panel 420 corresponding to the cutting stroke 430 is turned off, the area of ​​the display panel 420 corresponding to the cutting stroke 430 can be regarded as black by a black matrix.

[0108] In embodiments of this disclosure, the processor 120 can control the display panel 420 to display a predetermined color and / or a predetermined image in the area of ​​the display panel 420 corresponding to the cutting stroke 430, and also to display the predetermined color and / or the predetermined image in the area of ​​the display panel 420 corresponding to the camera coverage area 412. In embodiments of this disclosure, the processor 120 can also control the display panel 420 to turn off the area of ​​the display panel 420 corresponding to the camera coverage area 412 when displaying the predetermined color and / or the predetermined image in the area of ​​the display panel 420 corresponding to the cutting stroke 430.

[0109] In embodiments of this disclosure, the processor 120 can control the display panel 420 to display a predetermined color and / or a predetermined image in the area of ​​the display panel 420 corresponding to the camera coverage area 412 when the area of ​​the display panel 420 corresponding to the cutting stroke 430 is closed. In embodiments of this disclosure, the processor 120 can control the display panel 420 to close the area of ​​the display panel 420 corresponding to the cutting stroke 430, and simultaneously close the area of ​​the display panel 420 corresponding to the camera coverage area 412.

[0110] In embodiments of this disclosure, the processor 120 can change the size and / or shape of the cutting strokes 430 according to the operating state of the electronic device 101. In embodiments of this disclosure, when the camera module 180 is in image capture mode, the processor 120 can increase the thickness of the cutting strokes 430. In embodiments of this disclosure, when the camera module 180 is in off mode or illumination measurement mode, the processor 120 can decrease the thickness of the cutting strokes 430.

[0111] In embodiments of this disclosure, the camera coverage area 412 may correspond to Figure 4A The region 403 used to acquire the image.

[0112] Figure 4C The diagram illustrates the division of the area corresponding to cutting stroke 430 and the area of ​​camera coverage area 412, but this is merely an example. In embodiments of this disclosure, the area of ​​camera coverage area 412 other than camera area 421 may be included in the area corresponding to cutting stroke 430. In embodiments of this disclosure, when the area of ​​camera coverage area 412 other than camera area 421 is included in the area corresponding to cutting stroke 430, the area surrounding camera module 180 may be divided into the area corresponding to cutting stroke 430 and camera area 421.

[0113] Figure 5A This is a diagram illustrating the variation of circular cutting strokes in an electronic device 501 according to an embodiment of the present disclosure.

[0114] refer to Figure 5A Camera area 510 can be a camera module (e.g., Figure 1 The camera module 180) is located in the area therein. In embodiments of this disclosure, electronic device 501 (e.g., Figure 1 The electronic device 101 may be Figure 4A The structure is shown in the diagram. In embodiments of this disclosure, the electronic device 501 may have... Figure 4B The structure is shown in the diagram. In embodiments of this disclosure, Figure 5A The camera area 510 can correspond to Figure 4A The camera region 421 and / or the aperture region 411. In embodiments of this disclosure, Figure 5A The camera area 510 can correspond to Figure 4B The camera area 421 and / or the camera coverage area 412.

[0115] refer to Figure 5A The cutting strokes 521 and 531 surrounding the camera area 510 can have a circular shape.

[0116] In embodiments of this disclosure, the electronic device 501 can display cutting lines corresponding to the operating state of the camera module 180 on the display panel 502. In embodiments of this disclosure, when the camera module 180 is in an off state or an illuminance measurement state, the electronic device 501 can display cutting lines 521 on the display panel 502. In embodiments of this disclosure, when the camera module 180 is in an image capture state, the electronic device 501 can display cutting lines 531 on the display panel 502.

[0117] In embodiments of this disclosure, when the operating state of the camera module 180 changes, the electronic device 501 can change the size and / or shape of the cutting strokes. In embodiments of this disclosure, when the camera module 180 changes from an image capture state to an off state or an illuminance measurement state, the size of the cutting stroke 531 can be changed to correspond to the cutting stroke 521. In embodiments of this disclosure, when the camera module 180 changes from an off state or an illuminance measurement state to an image capture state, the size of the cutting stroke 521 can be changed to correspond to the cutting stroke 531.

[0118] In embodiments of this disclosure, when the electronic device 501 has Figure 4B When the structure shown is configured, electronic device 501 can display predetermined colors and / or predetermined images in areas of display panel 502 corresponding to each of the cutting strokes 521 and 531. In embodiments of this disclosure, when electronic device 501 has Figure 4B In the structure shown, because the display panel 502 is not present in the camera area 510, the predetermined color and / or predetermined image may not be displayed. In embodiments of this disclosure, when the electronic device 501 has Figure 4B With the structure shown, the camera module 180 can always be viewed through the camera area 510.

[0119] In embodiments of this disclosure, when the electronic device 501 has Figure 4B When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to each of the cutting strokes 521 and 531.

[0120] In embodiments of this disclosure, when the electronic device 501 has Figure 4C When the structure shown is configured, electronic device 501 can display predetermined colors and / or predetermined images in areas of display panel 502 corresponding to each of the cutting strokes 521 and 531. In embodiments of this disclosure, when electronic device 501 has Figure 4C When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to each of the cutting strokes 521 and 531.

[0121] In embodiments of this disclosure, when the electronic device 501 has Figure 4C In the structure shown, when a predetermined color and / or predetermined image is displayed on the area of ​​display panel 502 corresponding to each of the cutting strokes 521 and 531, electronic device 501 can also display a predetermined color and / or predetermined image in the area of ​​display panel 502 corresponding to camera area 510. In embodiments of this disclosure, when the electronic device has Figure 4C When the structure shown is configured such that a predetermined color and / or a predetermined image is displayed on the area of ​​the display panel 502 corresponding to each of the cutting strokes 521 and 531, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to the camera area 510.

[0122] In embodiments of this disclosure, when the electronic device has Figure 4C When the structure shown is closed, the electronic device 501 can also display a predetermined color and / or a predetermined image in the area of ​​the display panel 502 corresponding to each of the cutting strokes 521 and 531. In embodiments of this disclosure, when the electronic device has Figure 4C When the structure shown is closed, the electronic device 501 can close the area of ​​the display panel 502 corresponding to the camera area 510 when the area of ​​the display panel 502 corresponding to each of the cutting strokes 521 and 531 is closed.

[0123] In embodiments of this disclosure, the closed area in the display panel 502 may represent a predetermined color indicated by the black matrix.

[0124] Figure 5B This is a diagram illustrating the variation of the "U"-shaped cutting strokes in an electronic device 501 according to an embodiment of the present disclosure. Figure 5B In the description, with Figure 5A Overlapping descriptions can be omitted.

[0125] refer to Figure 5B The cutting strokes 523 and 533 surrounding the camera area 510 can have a "U" shape.

[0126] In embodiments of this disclosure, when the camera module 180 is in an off state or an illuminance measurement state, the electronic device 501 can display the cutting strokes 523 on the display panel 502. In embodiments of this disclosure, when the camera module 180 is in an image capture state, the electronic device 501 can display the cutting strokes 533 on the display panel 502.

[0127] In embodiments of this disclosure, when the operating state of the camera module 180 changes, the electronic device 501 can change the size and / or shape of the cutting strokes.

[0128] In embodiments of this disclosure, when the electronic device 501 has Figure 4B When the structure shown is configured, the electronic device 501 can display a predetermined color and / or a predetermined image on the display panel 502 in areas corresponding to each of the cutting strokes 523 and 533. In embodiments of this disclosure, when the electronic device 501 has Figure 4B When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to each of the cutting strokes 523 and 533.

[0129] In embodiments of this disclosure, when the electronic device 501 has Figure 4C When the structure shown is configured, the electronic device 501 can display a predetermined color and / or a predetermined image on the display panel 502 in areas corresponding to each of the cutting strokes 523 and 533. In embodiments of this disclosure, when the electronic device 501 has Figure 4C When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to each of the cutting strokes 523 and 533.

[0130] In embodiments of this disclosure, when the electronic device 501 has Figure 4C In the illustrated configuration, the electronic device 501 can also display a predetermined color and / or a predetermined color on the display panel 502 in the area corresponding to the camera area 510. In embodiments of this disclosure, when the electronic device 501 has... Figure 4C When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to the camera area 510.

[0131] In embodiments of this disclosure, the closed area in the display panel 502 may represent a predetermined color indicated by the black matrix.

[0132] Figure 5C This is a diagram illustrating the variation of the "V"-shaped cutting strokes in an electronic device 501 according to an embodiment of the present disclosure. Figure 5C In the description, with Figure 5A Overlapping descriptions can be omitted.

[0133] refer to Figure 5C The cutting strokes 525 and 535 surrounding the camera area 510 can have a “V” shape.

[0134] In embodiments of this disclosure, when the camera module 180 is in an off state or an illuminance measurement state, the electronic device 501 can display the cutting strokes 525 on the display panel 502. In embodiments of this disclosure, when the camera module 180 is in an image capture state, the electronic device 501 can display the cutting strokes 535 on the display panel 502.

[0135] In embodiments of this disclosure, when the operating state of the camera module 180 changes, the electronic device 501 can change the size and / or shape of the cutting strokes.

[0136] In embodiments of this disclosure, when the electronic device 501 has Figure 4B With the structure shown, electronic device 501 can display predetermined colors and predetermined images on the display panel 502 in areas corresponding to each of the cutting strokes 525 and 535. In embodiments of this disclosure, when electronic device 501 has Figure 4B When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to each of the cutting strokes 525 and 535.

[0137] In embodiments of this disclosure, when the electronic device 501 has Figure 4C With the structure shown, electronic device 501 can display predetermined colors and / or predetermined images on the display panel 502 in areas corresponding to each of the cutting strokes 525 and 535. In embodiments of this disclosure, when electronic device 501 has Figure 4C When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to each of the cutting strokes 525 and 535.

[0138] In embodiments of this disclosure, when the electronic device 501 has Figure 4C In the illustrated configuration, the electronic device 501 can also display a predetermined color and / or a predetermined image on the display panel 502 in the area corresponding to the camera area 510. In embodiments of this disclosure, when the electronic device 501 has... Figure 4C When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to the camera area 510.

[0139] In embodiments of this disclosure, the closed area in the display panel 502 may represent a predetermined color indicated by the black matrix.

[0140] Figure 5D This is a diagram illustrating the variation of planar cutting strokes in an electronic device 501 according to an embodiment of the present disclosure. Figure 5D In the description, with Figure 5A Overlapping descriptions can be omitted.

[0141] refer to Figure 5D The cutting strokes 527 and 537 surrounding the camera region 510 may have a planar shape. In embodiments of this disclosure, the cutting strokes 527 and 537 may correspond to the region including the camera region 510 in one of two regions surrounded by lines parallel to the tangents of the camera region 510 and the display panel 502.

[0142] In embodiments of this disclosure, when the camera module 180 is in an off state or an illuminance measurement state, the electronic device 501 can display the cutting strokes 527 on the display panel 502. In embodiments of this disclosure, when the camera module 180 is in an image capture state, the electronic device 501 can display the cutting strokes 537 on the display panel 502.

[0143] In embodiments of this disclosure, when the operating state of the camera module 180 changes, the electronic device 501 can change the size and / or shape of the cutting strokes.

[0144] In embodiments of this disclosure, when the electronic device 501 has Figure 4B With the structure shown, electronic device 501 can display predetermined colors and / or predetermined images on the display panel 502 in areas corresponding to each of the cutting strokes 527 and 537. In embodiments of this disclosure, when electronic device 501 has Figure 4B When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to each of the cutting strokes 527 and 537.

[0145] In embodiments of this disclosure, when the electronic device 501 has Figure 4C With the structure shown, electronic device 501 can display predetermined colors and / or predetermined images on the display panel 502 in areas corresponding to each of the cutting strokes 527 and 537. In embodiments of this disclosure, when electronic device 501 has Figure 4C When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to each of the cutting strokes 527 and 537.

[0146] In embodiments of this disclosure, when the electronic device 501 has Figure 4C In the illustrated configuration, the electronic device 501 can also display a predetermined color and / or a predetermined image on the display panel 502 in the area corresponding to the camera area 510. In embodiments of this disclosure, when the electronic device 501 has... Figure 4C When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to the camera area 510.

[0147] In embodiments of this disclosure, the closed area in the display panel 502 may represent a predetermined color indicated by the black matrix.

[0148] Figure 5E This is a diagram illustrating the variation of rectangular cutting strokes in an electronic device 501 according to an embodiment of the present disclosure. Figure 5E In the description, with Figure 5A Overlapping descriptions can be omitted.

[0149] refer to Figure 5E The cutting strokes 529 and 539 surrounding the camera area 510 can have a rectangular shape.

[0150] In embodiments of this disclosure, when the camera module 180 is in an off state or an illuminance measurement state, the electronic device 501 can display the cutting strokes 529 on the display panel 502. In embodiments of this disclosure, when the camera module 180 is in an image capture state, the electronic device 501 can display the cutting strokes 539 on the display panel 502.

[0151] In embodiments of this disclosure, when the operating state of the camera module 180 changes, the electronic device 501 can change the size and / or shape of the cutting strokes.

[0152] In embodiments of this disclosure, when the electronic device 501 has Figure 4B With the structure shown, electronic device 501 can display predetermined colors and / or predetermined images on the display panel 502 in areas corresponding to each of the cutting strokes 529 and 539. In embodiments of this disclosure, when electronic device 501 has Figure 4B When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to each of the cutting strokes 529 and 539.

[0153] In embodiments of this disclosure, when the electronic device 501 has Figure 4C With the structure shown, electronic device 501 can display predetermined colors and / or predetermined images on the display panel 502 in areas corresponding to each of the cutting strokes 529 and 539. In embodiments of this disclosure, when electronic device 501 has Figure 4C When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to each of the cutting strokes 529 and 539.

[0154] In embodiments of this disclosure, when the electronic device 501 has Figure 4C In the illustrated configuration, the electronic device 501 can also display a predetermined color and / or a predetermined image on the display panel 502 in the area corresponding to the camera area 510. In embodiments of this disclosure, when the electronic device 501 has... Figure 4C When the structure shown is configured, the electronic device 501 can turn off the area of ​​the display panel 502 corresponding to the camera area 510.

[0155] In embodiments of this disclosure, the off area in the display panel 502 may represent a predetermined color indicated by the black matrix.

[0156] Figure 5A , Figure 5B , Figure 5C , Figure 5D and Figure 5E The illustration shows variations in cutting strokes between identical patterns according to embodiments of the present disclosure; however, the electronic device 501 according to embodiments of the present disclosure can change the cutting strokes into different patterns. In embodiments of the present disclosure, the electronic device 501 can change a circular cutting stroke 521 into a rectangular cutting stroke 539 based on the operating state of the camera module 180.

[0157] Figure 5A , Figure 5B , Figure 5C , Figure 5D and Figure 5E A camera area 510 is shown, with a camera module 180 located at the upper center of the display panel 502. However, according to embodiments of the present disclosure, the electronic device 501 may include a camera area 510 located at another location on the display panel 502. In embodiments of the present disclosure, the electronic device 501 may include two or more camera areas 510, with two or more camera modules 180 respectively positioned on the display panel 502. In embodiments of the present disclosure, the electronic device 501 may include camera areas 510, with at least one camera module 180 positioned at the upper right, upper left, lower right, lower center, lower left, or a combination thereof on the display panel 502.

[0158] Figure 6 This is a flowchart illustrating the operation of changing the cutting strokes in the electronic device 101 according to an embodiment of the present disclosure. Figure 6 The description can be found here. Figures 1 to 3 .

[0159] refer to Figure 6 In operation 611, window manager 203 can request status information of camera module 180 from camera manager. In embodiments of this disclosure, status information may be information indicating the status of camera module 180 (e.g., image capture status, off status, or illuminance measurement status).

[0160] During operation 613, camera manager 229 can transmit the status information of camera module 180 to window manager 203.

[0161] In operation 615, window manager 203 can request cutting stroke information from memory 130. In embodiments of this disclosure, the cutting stroke information may be information indicating the shape and / or size of the cutting stroke.

[0162] In operation 617, memory 130 can transmit the cutting stroke information to window manager 203. In embodiments of this disclosure, memory 130 can search for cutting stroke information stored as configuration information and can transmit the searched cutting stroke information to window manager 203.

[0163] In embodiments of this disclosure, operations 611 to 617 can be performed when the electronic device 101 is started.

[0164] In operation 620, application 146 may request a driver for camera module 180 from camera manager 229. In embodiments of this disclosure, application 146 may request a driver for camera module 180 from camera manager 229 based on input. In embodiments of this disclosure, application 146 may be an application for providing a user with functions related to camera module 180 (e.g., image capture or augmented reality) by controlling camera module 180. In embodiments of this disclosure, application 146 may be an application for controlling camera module 180 based on information acquired through camera module 180 (e.g., illuminance) (e.g., changes in display panel brightness).

[0165] In operation 630, camera manager 229 can drive camera module 180 based on a drive request to camera module 180.

[0166] In operation 640, camera manager 229 can transmit driver notifications for camera module 180 to window manager 203. In embodiments of this disclosure, the driver notification for camera module 180 may include information about application 146 using camera module 180. In embodiments of this disclosure, the driver notification for camera module 180 may include status information for camera module 180.

[0167] In operation 650, window manager 203 can update the cutting strokes. In embodiments of this disclosure, window manager 203 can update the cutting strokes based on driver notifications from camera module 180.

[0168] In embodiments of this disclosure, based on the driver of the camera module in the camera module of the electronic device 101 that is capable of capturing images through the display panel (or a hole in the display panel), the window manager 203 can update the cutting strokes corresponding to the driven camera module.

[0169] In embodiments of this disclosure, based on the driver of at least one camera module among those capable of capturing images through a display panel (or a hole in the display panel), the window manager 203 can update the cutting strokes corresponding to the driven camera module.

[0170] In embodiments of this disclosure, the window manager 203 can identify the driving state of the camera module 180 based on driving notifications from the camera module 180. In embodiments of this disclosure, the window manager 203 can update the cutting strokes based on the identified driving state of the camera module 180. In embodiments of this disclosure, when the camera module 180 is driven in an image capture state, the window manager 203 can update the cutting strokes to correspond to the image capture state. In embodiments of this disclosure, when the camera module 180 is driven in an off state or an illuminance measurement state, the window manager 203 can update the cutting strokes to correspond to the off state or the illuminance measurement state.

[0171] In operation 660, application 146 can request driver termination of camera module 180 from camera manager 229. In embodiments of this disclosure, application 146 can request driver termination of camera module 180 from camera manager 229 based on input. In embodiments of this disclosure, application 146 can request driver termination of camera module 180 from camera manager 229 when a user application uses input to terminate application 146.

[0172] In operation 670, camera manager 229 can terminate the driver of camera module 180 based on a driver termination request for camera module 180.

[0173] In operation 680, camera manager 229 can transmit a driver termination notification for camera module 180 to window manager 203. In embodiments of this disclosure, the driver termination notification for camera module 180 may include status information of camera module 180.

[0174] In operation 690, window manager 203 can update the cutting strokes. In embodiments of this disclosure, window manager 203 can update the cutting strokes based on a driver termination notification from camera module 180.

[0175] In embodiments of this disclosure, the window manager 203 can identify the driving state of the camera module 180 based on the driver termination notification of the camera module 180. In embodiments of this disclosure, the cutting strokes can be updated based on the identified driving state of the camera module 180. In embodiments of this disclosure, when the driver of the camera module 180 terminates, the window manager 203 can update the cutting strokes to correspond to the closed cutting strokes.

[0176] In embodiments of this disclosure, upon termination of the drive of a camera module in the camera module of electronic device 101 that is capable of capturing images through a display panel (or a hole in the display panel), the window manager 203 may update the cutting strokes corresponding to the terminated drive of the camera module.

[0177] In embodiments of this disclosure, based on the termination of the drive of all camera modules capable of capturing images through the display panel (or holes in the display panel), the window manager 203 can update the cutting strokes corresponding to the terminated drive of the camera module.

[0178] Figure 7 This is a flowchart illustrating the operation of changing the display of the display in the electronic device 101 according to an embodiment of the present disclosure. Figure 7 The description can be found here. Figures 1 to 3 .

[0179] refer to Figure 7 During operation 710, the processor 120 of the electronic device can recognize input. In embodiments of this disclosure, the processor 120 can recognize input via the touch circuitry of the input device 150 and / or the display device 160.

[0180] In embodiments of this disclosure, processor 120 may execute functions based on identified input. For example, processor 120 may execute application 146 based on identified input. For example, processor 120 may execute the function of application 146 (e.g., image capture) based on identified input. For example, processor 120 may configure conditions for executing the function of application 146 based on identified input (e.g., timer configuration or flash configuration for image capture).

[0181] In operation 720, processor 120 can identify whether the operating state of camera module 180 has changed. In embodiments of this disclosure, processor 120 can identify whether the operating state of camera module 180 has changed due to the execution of a function based on the identified input.

[0182] In embodiments of this disclosure, the processor 120 may execute operation 730 when the operating state of the camera module 180 changes (“Yes”). For example, the processor 120 may execute operation 730 when the operating state of the camera module 180 changes from an image capture state to an off state or an illuminance measurement state.

[0183] In embodiments of this disclosure, when the operating state of the camera module 180 does not change (“No”), the processor 120 may terminate according to... Figure 7 The operation. For example, when the operating state of the camera module 180 is not changed in the image capture state, the processor 120 can terminate the operation according to... Figure 7 The operation.

[0184] During operation 730, the processor 120 can identify whether the display of the display panel 420 needs to be changed. In embodiments of this disclosure, when the cutting strokes need to be changed, the processor 120 can identify that the display of the display panel 420 needs to be changed.

[0185] In embodiments of this disclosure, when the operating state changes from an image capture state to an off state or an illuminance measurement state, the processor 120 can recognize that the display of the display panel 420 needs to be changed.

[0186] In embodiments of this disclosure, when the operating state changes from an off state to an illuminance measurement state, the processor 120 can recognize that the display of the display panel 420 does not need to be changed.

[0187] In embodiments of this disclosure, when the display of the display panel 420 needs to be changed (“Yes”), the processor 120 may perform operation 740. In embodiments of this disclosure, when the display of the display panel 420 does not need to be changed (“No”), the processor 120 may terminate according to... Figure 7 The operation.

[0188] During operation 740, processor 120 can change the display of display panel 420 around camera module 180.

[0189] In embodiments of this disclosure, the processor 120 can change the display of the display panel 420 around the camera module 180 by changing the size and / or shape of the cutting strokes. In embodiments of this disclosure, the processor 120 can change the shape of the cutting strokes to one of a circular shape, a "U" shape, a "V" shape, a planar shape, a rectangular shape, or a combination thereof, thereby changing the display of the display panel 420 around the camera module 180.

[0190] Figure 8 This is a flowchart illustrating the operation of increasing the thickness of cut strokes in electronic device 101 according to an embodiment of the present disclosure. Figure 8 The operation can be included in Figure 7 In operations 730 and 740.

[0191] refer to Figure 8 During operation 810, the processor 120 can identify whether the operating state of the camera module 180 has changed to an image capture state. In embodiments of this disclosure, it is possible to... Figure 7 After operation 720, operation 810 is executed.

[0192] In embodiments of this disclosure, when the operating state of the camera module 180 changes to an image capture state (“Yes”), the processor 120 may execute operation 820. In embodiments of this disclosure, when the operating state of the camera module 180 does not change to an image capture state (“No”), the processor 120 may terminate according to... Figure 8 The operation.

[0193] In operation 820, processor 120 can change the thickness of the cutting strokes by increasing it. In embodiments of this disclosure, the increased thickness of the cutting strokes can be approximately 30 pixels.

[0194] Figure 9 This is a flowchart illustrating the operation of reducing the thickness of cut strokes in an electronic device according to an embodiment of the present disclosure. Figure 9 The operation can be included in Figure 7 In operations 730 and 740.

[0195] refer to Figure 9 In operation 910, the processor 120 can recognize that the operating state of the camera module 180 has changed from the image capture state. In embodiments of this disclosure, it is possible to... Figure 7 After operation 720, operation 910 is executed.

[0196] In embodiments of this disclosure, when the operating state of the camera module 180 changes from the image capture state (“Yes”), the processor 120 may execute operation 920. In embodiments of this disclosure, when the operating state of the camera module 180 does not change from the image capture state (“No”), the processor 120 may terminate according to... Figure 9 The operation.

[0197] In operation 920, processor 120 can change the thickness of the cutting strokes to a reduction. In embodiments of this disclosure, the reduced thickness of the cutting strokes can be approximately 30 pixels.

[0198] Figure 10A This is a flowchart illustrating the operation of changing cutting strokes when acquiring an image in an electronic device according to an embodiment of the present disclosure. Figure 10B This is a diagram illustrating an image acquired by an electronic device according to an embodiment of the present disclosure. Figure 10A and Figure 10B The description can be found here. Figures 1 to 3 .

[0199] refer to Figure 10AIn operation 1010, the processor 120 can acquire image 1001 via camera module 180. In embodiments of this disclosure, when the processor 120 acquires image 1001, camera module 180 may be in a first state. In embodiments of this disclosure, image 1001 may be the original image acquired by camera module 180. In embodiments of this disclosure, the image displayed via display panel 420 may be a copy of image 1001. In embodiments of this disclosure, the image displayed via display panel 420 may be an image with a lower resolution than image 1001.

[0200] refer to Figure 10B The image shown is square, but this is merely an example. In embodiments of this disclosure, the image may have a shape corresponding to the aspect ratio of the image sensor 330 of the camera module 180.

[0201] refer to Figure 10A In operation 1020, processor 120 can identify whether the features of predetermined regions 1011, 1013, 1015, and 1017 of image 1001 have changed. In embodiments of this disclosure, the predetermined regions 1011, 1013, 1015, and 1017 of image 1001 may be located at the edges of image 1001.

[0202] In embodiments of this disclosure, the features of the predetermined regions 1011, 1013, 1015, and 1017 may include noise, resolution, brightness, or a combination thereof.

[0203] In embodiments of this disclosure, when the presence of noise changes in predetermined regions 1011, 1013, 1015, and 1017 of image 1001, processor 120 can identify that the features of predetermined regions 1011, 1013, 1015, and 1017 have changed.

[0204] In embodiments of this disclosure, when the resolution changes in predetermined regions 1011, 1013, 1015 and 1017 of image 1001, processor 120 can identify that the features of predetermined regions 1011, 1013, 1015 and 1017 have changed.

[0205] In embodiments of this disclosure, when the brightness changes in predetermined regions 1011, 1013, 1015 and 1017 of image 1001, processor 120 can identify that the features of predetermined regions 1011, 1013, 1015 and 1017 have changed.

[0206] During operation 1030, the processor 120 can change the display of the display panel 420 around the camera module 180.

[0207] In embodiments of this disclosure, when a change occurs in the direction of feature degradation in predetermined regions 1011, 1013, 1015, and 1017, the processor 120 may increase the thickness of the cutting strokes around the camera module 180. In embodiments of this disclosure, an increase in noise, a decrease in resolution, or an increase in brightness can be understood as a change in the direction of feature degradation in predetermined regions 1011, 1013, 1015, and 1017.

[0208] In embodiments of this disclosure, when a change occurs in the direction of feature improvement in predetermined regions 1011, 1013, 1015, and 1017, the processor 120 may reduce the thickness of the cutting strokes around the camera module 180. In embodiments of this disclosure, a reduction in noise, an increase in resolution, or a decrease in brightness can be understood as a change in the direction of feature improvement in predetermined regions 1011, 1013, 1015, and 1017.

[0209] In embodiments of this disclosure, the processor 120 can change the display of the display panel 420 around the camera module 180 by changing the thickness of the cutting strokes in a partial direction.

[0210] For example, when the features of image 1001 change in the region on the left relative to the center of image 1001, processor 120 can change the thickness of the cutting strokes on the left relative to the center of camera module 180.

[0211] In embodiments of this disclosure, the processor 120 can change the display of the display panel 420 around the camera module 180 by changing the shape of the cutting strokes. In embodiments of this disclosure, the processor 120 can change the display of the display panel 420 around the camera module 180 by changing the shape of the cutting strokes to one of a circular shape, a "U" shape, a "V" shape, a planar shape, a rectangular shape, or a combination thereof.

[0212] Figure 11 This is a flowchart illustrating the operation of increasing the thickness of cutting strokes when acquiring an image in an electronic device according to an embodiment of the present disclosure. Figure 11 The operations can be included in operations 1020 and 1030 in Figure 10.

[0213] refer to Figure 11 In operation 1110, processor 120 can identify whether the brightness of predetermined regions 1011, 1013, 1015, and 1017 of image 1001 has increased. In embodiments of this disclosure, operation 1110 can be performed after operation 1010 of FIG. 10.

[0214] In embodiments of this disclosure, when the brightness of predetermined regions 1011, 1013, 1015, and 1017 of image 1001 increases (“Yes”), processor 120 may execute operation 1120. In embodiments of this disclosure, when the brightness of predetermined regions 1011, 1013, 1015, and 1017 of image 1001 does not increase (“No”), processor 120 may terminate operation according to… Figure 11 The operation.

[0215] In operation 1120, the processor 120 can change the thickness of the cutting strokes to an increase. In embodiments of this disclosure, the increased thickness of the cutting strokes can be approximately 30 pixels.

[0216] Figure 12 This is a flowchart illustrating the operation of reducing the thickness of cutting strokes when acquiring an image in an electronic device according to an embodiment of the present disclosure. Figure 12 The operations can be included in operations 1020 and 1030 in Figure 10.

[0217] refer to Figure 12 In operation 1210, processor 120 can identify whether the brightness of predetermined regions 1011, 1013, 1015, and 1017 of image 1001 has decreased. In embodiments of this disclosure, operation 1210 can be performed after operation 1010 of FIG. 10.

[0218] In embodiments of this disclosure, when the brightness of predetermined regions 1011, 1013, 1015, and 1017 of image 1001 decreases (“Yes”), processor 120 may perform operation 1220. In embodiments of this disclosure, when the brightness of predetermined regions 1011, 1013, 1015, and 1017 of image 1001 does not decrease (“No”), processor 120 may terminate the operation according to FIG. I.

[0219] In operation 1220, the processor 120 can change the thickness of the cutting strokes to a reduction. In embodiments of this disclosure, the reduced thickness of the cutting strokes can be approximately 30 pixels.

[0220] Figure 13 This is a flowchart illustrating the operation of changing the indication of a display in an electronic device according to an embodiment of the present disclosure. Figure 13 The description can be found here. Figures 1 to 3 .

[0221] refer to Figure 13 In operation 1310, the processor 120 of the electronic device 101 can be displayed on a screen (e.g., Figure 1 The display device 160 or Figure 4A The area of ​​the display panel 402 surrounding the camera module 180 (e.g., Figure 4AThe changes in the operating state of the camera module 180 are recognized when a predetermined image is displayed in the area (including the area of ​​cut stroke 404).

[0222] In embodiments of this disclosure, the predetermined image may be an image used to display a predetermined color (e.g., black).

[0223] In operation 1320, in response to recognizing a change in the operating state of camera module 180, processor 120 may determine the size of the region surrounding camera module 180. In embodiments of this disclosure, processor 120 may determine the size of the region surrounding camera module 180 to correspond to the operating state of camera module 180.

[0224] In operation 1330, processor 120 can be displayed on a monitor (e.g., Figure 1 The display device 160 or Figure 4A The predetermined image is displayed in the area of ​​the display panel 402.

[0225] As described above, the electronic device 101 and its method according to embodiments of the present disclosure do not degrade the quality of images acquired by the camera module 180 even when the camera module 180 is positioned below the display panel 420.

[0226] With the camera module 180 positioned below the display panel 420, when the display panel 420 operates in flash mode, the electronic device 101 and its method according to embodiments of this disclosure can prevent the quality of the image acquired by the camera module 180 from deteriorating by increasing the thickness of the cutting strokes. In embodiments of this disclosure, the flash mode of the display panel 420 can represent a mode in which a predetermined color (e.g., white) is displayed at a predetermined brightness in at least a portion of the display panel 420.

[0227] When the camera module 180 is positioned below the display panel 420, and the display panel 420 displays a predetermined object, the electronic device 101 and its method according to embodiments of this disclosure can prevent the quality of the image acquired by the camera module 180 from deteriorating by increasing the thickness of the cutting strokes. In embodiments of this disclosure, the predetermined object may be a character representing a timer.

[0228] When the camera module 180 is positioned below the display panel 420, when the display panel 420 displays a preview image, the electronic device 101 and its method according to embodiments of the present disclosure can prevent the quality of the image acquired by the camera module 180 from deteriorating by increasing the thickness of the cutting strokes based on the brightness of the preview image.

[0229] As described above, the electronic device 101 according to embodiments of this disclosure may include: a display (e.g., Figure 1The system includes a display device 160; a camera module 180 configured to be positioned below the display; a memory 130 configured to store instructions; and a processor 120 configured to be functionally connected to the display, camera module 180, and memory 130. By executing instructions, the processor 120 can be configured to cause the electronic device 101 to recognize changes in the operating state of the camera module 180 when the display shows a predetermined image in an area surrounding the camera module 180. By executing instructions, the processor 120 can be configured to cause the electronic device 101 to change the size of the area surrounding the camera module 180 in response to recognizing changes in the operating state of the camera module 180. By executing instructions, the processor 120 can be configured to cause the electronic device 101 to display a predetermined image in the changed area.

[0230] In embodiments of this disclosure, by executing instructions, processor 120 may be configured to cause electronic device 101 to change the size of the area surrounding camera module 180 to increase in response to recognizing that the operating state of camera module 180 has changed to an image capture state.

[0231] In embodiments of this disclosure, by executing instructions, processor 120 can be configured to cause electronic device 101 to reduce the size of the area surrounding camera module 180 in response to recognizing that the operating state of camera module 180 has changed from an image capture state to a state other than an image capture state.

[0232] In embodiments of this disclosure, the predetermined image may include an image configured in black and white.

[0233] In embodiments of this disclosure, by executing instructions, processor 120 may be configured to cause electronic device 101 to identify a change in features in a predetermined region of an image acquired by camera module 180 when the operating state of camera module 180 is an image capture state, and to change the size of the region surrounding camera module 180 in response to identifying the change in features in the predetermined region.

[0234] In embodiments of this disclosure, by executing instructions, processor 120 can be configured to cause electronic device 101 to change the size of the area surrounding camera module 180 to increase in response to identifying feature degradation in a predetermined area. By executing instructions, processor 120 can be configured to cause electronic device 101 to change the size of the area surrounding camera module 180 to decrease in response to identifying feature improvement in a predetermined area.

[0235] In embodiments of this disclosure, features may include noise, resolution, brightness, or a combination thereof. By executing instructions, processor 120 may be configured to cause electronic device 101 to identify feature degradation in a predetermined area when at least one of increased noise, decreased resolution, or increased brightness occurs in the predetermined area. By executing instructions, processor 120 may be configured to cause electronic device 101 to identify feature improvement in a predetermined area when at least one of decreased noise, increased resolution, or decreased brightness occurs in the predetermined area.

[0236] In embodiments of this disclosure, the display may be configured to have a hole (e.g., Figure 4B (Hole 425 in the image). The camera module 180 can be configured to be seen from the outside through the hole. The area of ​​the display surrounding the camera module 180 can be configured to surround the hole.

[0237] In embodiments of this disclosure, the area of ​​the display surrounding the camera module 180 can be divided into a first region overlapping the camera module 180 (e.g., Figure 4C The camera area 421) and the second area surrounding the first area (e.g., Figure 4C (Camera coverage area 412). By executing instructions, processor 120 can be configured to cause electronic device 101 to change the size of the second area in response to recognizing a change in the operating state of camera module 180.

[0238] In embodiments of this disclosure, by executing instructions, processor 120 can be configured to cause electronic device 101 to close the first region in response to recognizing that the operating state of camera module 180 is an image capture state.

[0239] In embodiments of this disclosure, by executing instructions, processor 120 can be configured to cause electronic device 101 to display a predetermined image in a first area in response to recognizing that the operating state of camera module 180 is other than an image capture state.

[0240] In embodiments of this disclosure, the area surrounding the camera module 180 may be configured to have a circular shape, an elliptical shape, a polygonal shape, a planar shape, a "U" shape, a "V" shape, or a combination thereof.

[0241] As described above, the method of the electronic device 101 according to embodiments of the present disclosure may include: displaying (e.g., Figure 1 When a predetermined image is displayed in the area surrounding the camera module 180 positioned below the display, the device (160) identifies changes in the operating state of the camera module 180; in response to identifying changes in the operating state of the camera module 180, the device changes the size of the area surrounding the camera module 180; and displays the predetermined image in the changed area.

[0242] In embodiments of this disclosure, changing the size of the area surrounding the camera module 180 may include increasing the size of the area surrounding the camera module 180 in response to recognizing that the operating state of the camera module 180 has changed to an image capture state.

[0243] In embodiments of this disclosure, changing the size of the area surrounding the camera module 180 may include reducing the size of the area surrounding the camera module 180 in response to recognizing that the operating state of the camera module 180 has changed from an image capture state to a state other than an image capture state.

[0244] In embodiments of this disclosure, the method may further include: identifying a change in features in a predetermined region of an image acquired by the camera module 180 when the camera module 180 is in an image capture state; and changing the size of the region surrounding the camera module 180 in response to identifying the change in features in the predetermined region.

[0245] In embodiments of this disclosure, changing the size of the region surrounding the camera module 180 in response to identifying a change in features within a predetermined region may include: increasing the size of the region surrounding the camera module 180 in response to identifying feature degradation within the predetermined region; and decreasing the size of the region surrounding the camera module 180 in response to identifying feature improvement within the predetermined region.

[0246] In embodiments of this disclosure, features may include noise, resolution, brightness, and combinations thereof.

[0247] In embodiments of this disclosure, changing the size of the area surrounding the camera module 180 in response to identifying a change in features within a predetermined area may include: identifying feature degradation in the predetermined area when at least one of increased noise, decreased resolution, or increased brightness occurs in the predetermined area; and identifying feature improvement in the predetermined area when at least one of decreased noise, increased resolution, or decreased brightness occurs in the predetermined area.

[0248] In embodiments of this disclosure, the area of ​​the display surrounding the camera module 180 can be divided into a first region overlapping the camera module 180 and a second region surrounding the first region. Changing the size of the area surrounding the camera module 180 can include changing the size of the second region in response to recognizing a change in the operating state of the camera module 180.

[0249] In embodiments of this disclosure, the method may further include displaying a predetermined image in a first region in response to identifying that the operating state of the camera module 180 is other than an image capture state.

[0250] The methods disclosed in these claims and / or the methods according to the various embodiments described in this disclosure may be implemented in hardware, software, or a combination of hardware and software.

[0251] When the method is implemented in software, a computer-readable storage medium may be provided for storing one or more programs (software modules). One or more programs stored in the computer-readable storage medium may be configured to be executed by one or more processors within an electronic device. At least one program may include instructions that cause the electronic device to perform the method as defined by the appended claims and / or as disclosed herein, according to various embodiments of this disclosure.

[0252] The program (software module or software) can be stored in non-volatile memory, including random access memory and flash memory, read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic disk storage devices, compressed optical disc ROM (CD-ROM), digital versatile disc (DVD), or other types of optical storage devices or magnetic tape. Alternatively, any combination of some or all of these can form the memory in which the program is stored. Furthermore, an electronic device may include multiple such memories.

[0253] Furthermore, these programs can be stored in attachable storage devices that can be accessed by the electronic device via communication networks such as the Internet, intranets, local area networks (LANs), wide area networks (WLANs), and storage area networks (SANs), or combinations thereof. Such storage devices can access the electronic device via external ports. Additionally, separate storage devices on communication networks can access portable electronic devices.

[0254] In the detailed embodiments described above, elements included in this disclosure are expressed in a singular or plural form according to the presented embodiments. However, for ease of description, the singular or plural form is suitably chosen for the presented situation, and this disclosure is not limited to elements expressed in a singular or plural form. Thus, an element expressed in a plural form may also include a single element, or an element expressed in a singular form may include multiple elements.

[0255] Although this disclosure has been shown and described with reference to various embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made in this disclosure without departing from the spirit and scope of this disclosure as defined by the appended claims and their equivalents.

Claims

1. An electronic device comprising: monitor; A camera module configured to be positioned below the display and to capture external images through a hole in the display; Memory, configured to store instructions; as well as A processor configured to be functionally connected to the display, the camera module, and the memory. When the processor executes the instruction, it causes the electronic device to: The changes in the operating state of the camera module are identified when a cut stroke image of a first size is displayed in the area surrounding the hole on the display, wherein the cut stroke image of the first size includes an image configured in black. In response to recognizing that the camera module's operating state has changed to image capture state, the display is controlled to change the size of the cut stroke image to display a cut stroke image of a second size that is larger than the first size, surrounding the hole.

2. The electronic device of claim 1, wherein when the instructions are executed by the processor, the electronic device causes: In response to recognizing that the operating state of the camera module has changed to image capture state, the second size is set to be larger than the first size.

3. The electronic device of claim 1, wherein when the instructions are executed by the processor, the electronic device causes: In response to recognizing that the operating state of the camera module has changed from the image capture state to a state other than the image capture state, the display is controlled to change the size of the cut stroke image to display a cut stroke image of a first size that is smaller than the second size.

4. The electronic device of claim 1, wherein the cut stroke image having a second size comprises an image configured in black.

5. The electronic device of claim 1, wherein when the instructions are executed by the processor, the electronic device causes: When the camera module is in the image capture state, feature changes in a predetermined region of the image acquired by the camera module are identified; and The size of the cut stroke image displayed in the area surrounding the hole on the display is changed in response to the detection of a change in features in the predetermined area.

6. The electronic device of claim 5, wherein when the instructions are executed by the processor, the electronic device causes: In response to recognizing feature degradation in the predetermined region, the size of the cut stroke image is increased; and The size of the cut stroke image is reduced in response to feature improvements identified in the predetermined region.

7. The electronic device as claimed in claim 6, The features mentioned include noise, resolution, brightness, or a combination thereof, and When the processor executes the instruction, it causes the electronic device to: When at least one of the following occurs in the predetermined region: increased noise, decreased resolution, or increased brightness, feature degradation in the predetermined region is identified, and When at least one of the noise reduction, resolution increase, or brightness reduction occurs in the predetermined region, feature improvement in the predetermined region is identified.

8. The electronic device as claimed in claim 1, The area of ​​the display surrounding the camera module is divided into a first area overlapping the camera module and a second area surrounding the first area. When the processor executes the instruction, it causes the electronic device to: The display is controlled to change the size of the second region displaying the cut stroke image of the second size in response to recognizing a change in the operating state of the camera module.

9. The electronic device of claim 1, wherein the cut stroke image having a first size is configured to have a circular shape, an elliptical shape, a polygonal shape, a "U" shape, a "V" shape, or a combination thereof.

10. A method of operating an electronic device, the method comprising: When a cut-stroke image of a first size is displayed in the area surrounding a camera module positioned below the display, changes in the operating state of the camera module are identified. The display is configured to have an aperture, and the camera module is configured to capture an external image through the aperture of the display, wherein the cut-stroke image of the first size includes an image configured in black. In response to recognizing that the camera module's operating state has changed to image capture state, the display is controlled to change the size of the cut stroke image to display a cut stroke image of a second size that is larger than the first size, surrounding the hole.

11. The method of claim 10, wherein displaying the cut stroke image having a second size comprises: In response to recognizing that the operating state of the camera module has changed to image capture state, the second size is set to be larger than the first size.

12. The method of claim 10, wherein displaying the cut stroke image having a second size comprises: In response to recognizing that the operating state of the camera module has changed from the image capture state to a state other than the image capture state, the display is controlled to change the size of the cut stroke image to display a cut stroke image of a first size that is smaller than the second size.

13. The method of claim 10, further comprising: When the camera module is in the image capture state, feature changes in a predetermined region of the image acquired by the camera module are identified. as well as The display is controlled to change the size of the cut stroke image displayed in the area surrounding the hole in response to recognizing a change in features in the predetermined area.

14. The method as described in claim 10, The area of ​​the display surrounding the camera module is divided into a first area overlapping the camera module and a second area surrounding the first area. The image showing cut strokes with a second size includes: In response to recognizing a change in the operating state of the camera module, the display is controlled to change the size of the second region displaying the cut stroke image of the second size.

Images