Electronic device having front camera alignment function and operating method thereof

Abstract

An electronic device according to an embodiment may comprise: a plate; a display that is stacked on a first surface of the plate, includes an opening, and is separable from the plate; a camera module that is arranged on a second surface opposite to the first surface of the plate so as to face the opening and includes a lens housing; at least one processor; and a memory storing instructions. The instructions according to an embodiment may be executed by the at least one processor to cause the electronic device to: after detecting separation of the display, identify a unique ID of a new display coupled to the plate; and if the identified unique ID is different from a pre-stored unique ID, output a diagnostic screen based on a repair filter attached to an opening in the new display.

Description

Electronic device having a front camera alignment function and its operating method

[0001] The present disclosure relates to an electronic device having a front camera alignment function and an operating method thereof.

[0002] Smartphones may adopt UDC (Under Display Camera) technology, which forms a hole in the display and mounts a camera behind the hole to maximize the use of the display screen.

[0003] Replacing consumables on a smartphone typically requires a visit to a service center. For some consumables, various kits may be provided so users can replace them themselves. For example, smartphone manufacturers may provide a separate display replacement kit so users can replace the display themselves.

[0004] Meanwhile, when a user replaces a smartphone with a new display using UDC, problems such as vignetting may occur if the center of the front camera lens and the center of the hole formed in the display are not aligned.

[0005] An electronic device according to one embodiment may include a plate (310 of FIG. 2), a display (330 of FIG. 2) laminated on a first surface of the plate and including an opening (331 of FIG. 2), the display being detachable from the plate, a camera module (180 of FIG. 2) disposed to face the opening on a second surface of the plate opposite the first surface and including a lens housing, at least one processor (120 of FIG. 1), and a memory storing instructions. The instructions according to one embodiment may be executed by the at least one processor to cause the electronic device to, after detecting separation of the display, check a unique ID of a new display (a replacement display, 330 of FIG. 5) coupled to the plate, and if the checked unique ID is different from a pre-stored unique ID, execute an alignment mode supported by an application stored in the memory, and output a diagnostic screen based on a repair filter attached to the opening of the new display in the alignment mode.

[0006] According to one embodiment, a recording medium is a non-transitory computer-readable recording medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform set operations, the operations including: checking a unique ID of a new display coupled to a plate after detecting separation of the displays, executing an alignment mode supported by an application stored in a memory if the checked unique ID is different from a pre-stored unique ID, and outputting a diagnostic screen based on a repair filter attached to the opening of the new display in the alignment mode.

[0007] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0008] FIG. 2 is an exploded perspective view of an electronic device according to one embodiment.

[0009] FIG. 3 illustrates the alignment between a camera module and an opening according to one embodiment.

[0010] FIG. 4 is a drawing for explaining alignment misalignment between a lens and an opening of a camera module according to one embodiment.

[0011] FIG. 5 is a drawing for explaining a repair filter according to one embodiment.

[0012] FIG. 6 illustrates a diagnostic screen in an electronic device according to one embodiment.

[0013] Figure 7 is a flowchart of a method of operating an electronic device according to one embodiment.

[0014] Figure 8 illustrates a case where vignetting does not occur in a diagnostic screen according to one embodiment.

[0015] FIG. 9 illustrates a case where vignetting occurs in a diagnostic screen according to one embodiment.

[0016] FIG. 10 is a flowchart of an operation method for performing AF scanning in an electronic device according to one embodiment.

[0017] Figure 11 is a drawing to explain a section in which vignetting does not occur during AF scanning.

[0018] FIG. 12 is a flowchart of an operational method for performing AI filtering in an electronic device according to one embodiment.

[0019] Figures 13 and 14 illustrate AI filtering areas.

[0020] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings. The advantages and features of the present invention, and methods for achieving them, will become clear with reference to the embodiments described in detail below together with the attached drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms. These embodiments are provided only to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention, and the present invention is defined only by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

[0021] Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used in their common sense to those of ordinary skill in the art to which the present invention pertains. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise. The terminology used herein is for the purpose of describing embodiments and is not intended to limit the present invention. In this specification, singular forms also include plural forms, unless specifically stated otherwise.

[0022] The terms "comprises" and / or "comprising" as used in the specification do not exclude the presence or addition of one or more other components, steps, operations and / or elements.

[0023] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0024] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0025] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0026] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0027] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0028] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0029] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0030] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0031] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0032] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0033] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0034] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0035] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0036] The camera module (180) can capture still and moving images. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0037] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0038] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0039] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0040] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0041] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0042] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0043] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0044] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0045] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0046] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0047] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0048] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0049] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0050] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0051] FIG. 2 is an exploded perspective view of an electronic device according to one embodiment.

[0052] Referring to FIG. 2, an electronic device (300) (e.g., the electronic device (101) of FIG. 1) may include a plate (310) (e.g., a side bezel structure), a first support member (311) (e.g., a bracket or a support structure), a front plate (320) (e.g., a front cover), a display (330) (e.g., the display (201) of FIG. 1), a substrate (340) (e.g., a printed circuit board (PCB), a flexible PCB (FPCB), or a rigid-flexible PCB (RFPCB)), a battery (350), a second support member (360) (e.g., a rear case), an antenna (370), and a rear plate (380) (e.g., a rear cover). In some embodiments, the electronic device (300) may omit at least one of the components (e.g., the first support member (311) or the second support member (360)) or may additionally include other components.

[0053] The first support member (311) may be disposed inside the electronic device (300) and connected to the plate (310), or may be formed integrally with the plate (310). The first support member (311) may be formed of, for example, a metallic material and / or a non-metallic (e.g., polymer) material. The first support member (311) may have a display (330) coupled to one surface and a substrate (340) coupled to the other surface. A processor, a memory, and / or an interface may be mounted on the substrate (340). The processor may include, for example, one or more of a central processing unit, an application processor, a graphic processing unit, an image signal processor, a sensor hub processor, or a communication processor.

[0054] The memory may include, for example, volatile memory or non-volatile memory.

[0055] The interface may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, and / or an audio interface. The interface may electrically or physically connect the electronic device (300) to an external electronic device, for example, and may include a USB connector, an SD card / MMC connector, or an audio connector.

[0056] The battery (350) is a device for supplying power to at least one component of the electronic device (300), and may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell. At least a portion of the battery (350) may be disposed substantially on the same plane as the substrate (340), for example. The battery (350) may be integrally disposed within the electronic device (300). In another embodiment, the battery (350) may be disposed so as to be detachable from the electronic device (300).

[0057] The antenna (370) may be positioned between the rear plate (380) and the battery (350). The antenna (370) may include, for example, a near field communication (NFC) antenna, a wireless charging antenna, and / or a magnetic secure transmission (MST) antenna. The antenna (370) may, for example, perform short-range communication with an external device or wirelessly transmit and receive power required for charging. In another embodiment, the antenna structure may be formed by a part or a combination of the side bezel structure (310) and / or the first support member (311).

[0058] The display (330) may be visually exposed, for example, through a significant portion of the front plate (320). The display (330) may be coupled to or adjacent to a touch sensing circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a digitizer capable of detecting a magnetic stylus pen.

[0059] The camera module (180) may be arranged to be visually exposed through the display (330). Here, the camera module (180) may be a front camera. For example, the camera module (180), the sensor module (176), or the indicator may be arranged to be in contact with the external environment through an opening or a transparent area perforated from the internal space of the electronic device (300) to the front plate (320) of the display (320). According to one embodiment, the area where the display (330) and the camera module (180) face each other may be formed as a transparent area having a certain transmittance as part of an area for displaying content. According to one embodiment, the transparent area may be formed to have a transmittance in the range of about 513 to about 2013. This transparent area may include an area overlapping with an effective area (e.g., a field of view area) of the camera module (180) through which light passes to be imaged by the image sensor to generate an image. For example, the transparent area of ​​the display (330) may include an area with a lower pixel density than the surrounding area. For example, the transparent area may replace the opening. For example, the camera module (180) may include an under-display camera (UDC). In another embodiment, some sensor modules may be arranged to perform their functions without being visually exposed through the front plate (320) in the internal space of the electronic device. For example, in this case, the area of ​​the display (330) facing the sensor module may not require a perforated opening.

[0060] According to one embodiment, the electronic device (300) has a bar type or plate type appearance, but the present invention is not limited thereto. For example, the illustrated electronic device (200) may be a part of a foldable electronic device, a slidable electronic device, a stretchable electronic device, and / or a rollable electronic device. The terms “foldable electronic device,” “slidable electronic device,” “stretchable electronic device,” and / or “rollable electronic device” may refer to an electronic device in which a display (e.g., the display (330) of FIG. 3) is capable of bending deformation, such that at least a portion thereof is folded, wound or rolled, at least a portion thereof is expanded, and / or the display can be housed inside a housing. Foldable electronic devices, slideable electronic devices, stretchable electronic devices and / or rollable electronic devices can be used to expand the screen display area by unfolding the display or exposing a wider area of ​​the display to the outside, depending on the user's needs.

[0061] In one embodiment, the display (330) may be laminated on a first surface of the plate (310) and may include an opening (331). The display (330) according to one embodiment is detachable from the plate (310). In one embodiment, the camera module (180) may be positioned to face the opening (331) on a second surface opposite the first surface. The camera module (180) may include a movable lens housing to perform an optical image stabilization (OIS) function or an autofocus (AF) function.

[0062] FIG. 3 illustrates alignment between a camera module and an opening according to one embodiment. FIG. 4 is a drawing illustrating alignment misalignment between a lens and an opening of a camera module according to one embodiment.

[0063] Referring to FIG. 3, the display (330) may form a first opening (331), and the front plate (320) may form a second opening (321).

[0064] The camera module (180) can be positioned so as to be in contact with the external environment through the first opening (331) of the display (320) and the second opening (321) of the front plate (320) in the internal space of the electronic device (300).

[0065] The camera module (180) may include a camera housing (not shown), a lens housing (not shown) disposed in an internal space of the camera housing and protruding at least partially toward the display (330), a plurality of lenses (not shown) disposed at regular intervals in the internal space of the lens housing, and an image sensor (not shown) disposed to be aligned with the plurality of lenses.

[0066] The center of the first opening (331) and the center of the second opening (321) can be aligned through an alignment process to match the center of the lens housing of the camera module (180).

[0067] Meanwhile, as shown in (A) of Fig. 4, when the center of the lens housing, the center of the first opening (331), and the center of the second opening (321) are aligned, the lens (L) is completely exposed from the outside, and when the camera module (180) acquires an image with all centers aligned, vignetting does not occur. Vignetting is a phenomenon in which the corners or outer parts of an image appear dark or black due to a decrease in the amount of light in the peripheral area when taking a picture.

[0068] On the other hand, as in (B) of FIG. 4, if the center of the lens housing, the center of the first opening (331), and the center of the second opening (321) do not all coincide, a portion of the lens (L) may be obscured from the outside by the display (330) and / or the front plate (320), in which case a vignetting phenomenon may occur.

[0069] When a user replaces an existing display with a new one, a center misalignment, such as that shown in (B) of FIG. 4, may occur. The electronic device (300 of FIG. 2) has a front-repair structure, allowing the display to be replaced without disassembling the rear portion. The electronic device (300) is manufactured with the front camera fixed to the opening area of ​​the existing display (and the front plate opening area). When replacing the display (or replacement front plate), printing deviation may occur, resulting in the aforementioned vignetting.

[0070] The invention according to the disclosure can check vignetting by checking a preview image in a state where a repair film is attached to a first opening (331) or a second opening (321) to confirm that the front camera angle is covered by a display (330) and / or a front plate (320). Furthermore, when the electronic device (300) outputs a preview image in a state where the repair film is attached, the degree of vignetting and the area where vignetting occurs can be checked with the naked eye. The repair filter and the preview image according to the attachment of the repair filter will be described with reference to FIGS. 5 and 6.

[0071] Fig. 5 is a diagram illustrating a repair filter according to one embodiment. Fig. 6 illustrates a diagnostic screen in an electronic device according to one embodiment.

[0072] In one embodiment, a user may utilize an application to diagnose vignetting by attaching a repair film (500) to the opening area of ​​the display (330) and / or the front plate (320) after replacing the display (330).

[0073] According to one embodiment, the repair film (500) may be a translucent member, such as a thin film or filter with uniform transparency. The repair film (500) may be used by a user by directly attaching it to the first opening area of ​​the display (330) or the second opening area of ​​the front plate (320), or may be provided in a state already attached to a replacement display kit.

[0074] According to one embodiment, when the electronic device (300) executes the shooting mode while the repair film (500) is attached, the electronic device (300) can generate an image by light transmitted from the repair film (500). Referring to FIG. 6, since the image blocks light reflected by an object by the repair film (500), the image can be provided as a preview image with the same color but different brightness for each region. In FIG. 6, the center of the lens housing, the center of the first opening (331), and the center of the second opening (321) are aligned, so the brightness of the preview image is uniform for each region. If the center of the lens housing, the center of the first opening (331), and the center of the second opening (321) are not aligned, the brightness of one region of the preview image may be output differently from the brightness of the remaining regions.

[0075] The invention according to the disclosure can detect the occurrence of vignetting by checking the brightness of each area in an image output through a repair film (500). In addition, the electronic device (300) according to one embodiment can improve vignetting without changing the embedded position of the camera module (180) by changing the settings of the camera module (180) including an optical image stabilization (OIS) function or an auto focus (AF) function when vignetting occurs. This will be described with reference to FIGS. 7 to 14.

[0076] Figure 7 is a flowchart illustrating a method of operating an electronic device according to one embodiment. Figure 8 illustrates a case in which vignetting does not occur on a diagnostic screen according to one embodiment. Figure 9 illustrates a case in which vignetting occurs on a diagnostic screen according to one embodiment.

[0077] In this embodiment, vignetting can be improved by checking the vignetting value for each area occurring in the image (preview image) and changing the initial setting value of OIS based on the vignetting value for each area.

[0078] According to one embodiment, a processor (120) can detect a display replacement (701). When a user removes an existing display from an electronic device (101) and attaches a replacement display to a connector provided in the electronic device (101), the electronic device (101) can recognize a unique ID stored in the attached display. The unique ID may correspond to a serial number that allows the electronic device (101) to manage the display.

[0079] According to one embodiment, the processor (120) verifies whether the unique ID of the display is identical to the specified unique ID (703). If the unique ID of the display is identical to the specified unique ID, the combined display is not a new display, and thus, no vignetting diagnosis is required. Therefore, the alignment mode according to the present embodiment is not executed.

[0080] According to one embodiment, the processor (120) may execute an alignment mode if the unique ID of the display is not identical to the specified unique ID. In addition, according to one embodiment, the processor (120) may adjust the AF position simultaneously with executing the alignment mode (705).

[0081] According to one embodiment, the processor (120) can detect the separation of the display and then check the unique ID of the new display coupled to the plate, and if the checked unique ID is different from the pre-stored unique ID, it can execute an alignment mode supported by an application stored in the memory.

[0082] A processor (120) according to one embodiment can control the display to output a diagnostic screen based on a repair filter attached to the opening of the display in an alignment mode.

[0083] Align mode is a vignetting diagnostic function supported by an application stored in memory (130), which can provide a preview image with the repair film attached. According to one embodiment, the processor (120) can automatically execute the alignment mode of the application in response to detecting the attachment of a new display, or can execute it according to the user's application execution after the new display is attached.

[0084] According to one embodiment, the processor (120) may execute an alignment mode and adjust the AF position. According to one embodiment, the electronic device (101) may move the lens housing of the front camera to a position closer to the display (330) or to a position farther from the display (330) by driving the AF actuator for auto-focus adjustment. That is, the processor (120) according to one embodiment may move the lens housing in the direction of the optical axis to adjust the AF position. In one embodiment, the processor (120) may move the position of the lens housing to the farthest position from the display (330) along the optical axis by driving the AF actuator. In order to perform a diagnosis in a state where vignetting (obstruction of the field of view) is the worst, the position of the lens housing may be moved as far as possible to the rear of the electronic device (101).

[0085] According to one embodiment, when the align mode is executed, the processor (120) can adjust the AF (auto focus) position so that the lens housing is away from the display.

[0086] According to one embodiment, the processor (120) may output a diagnostic screen output (707). The diagnostic screen is a preview image with the repair film attached, and allows vignetting caused by the display or the front plate to be confirmed. If the camera module (180) is not covered by an area other than the opening of the display or an area other than the opening of the front plate, a diagnostic screen with uniform brightness for each area may be output as in FIG. 8, and if the camera module (180) is covered by an area other than the opening of the display or an area other than the opening of the front plate, a diagnostic screen with uneven brightness for each area may be output as in FIG. 9. In FIG. 9, it can be confirmed that vignetting occurs in areas ①②③ of the diagnostic screen when the upper part of the camera module (180) is covered.

[0087] In one embodiment, the diagnostic screen may output a vignetting area if the center of the camera module and the center of the opening of the display do not align.

[0088] According to one embodiment, the processor (120) may store the unique ID of the replaced display and terminate the alignment mode (719) if vignetting does not occur as a result of checking the diagnostic screen (709).

[0089] According to one embodiment, the processor (120) can store vignetting values ​​for each region (711) if vignetting occurs as a result of checking the diagnostic screen (709). The vignetting values ​​for each region correspond to data that quantifies the degree of darkness in each coordinate within the preview image. According to one embodiment, the processor (120) can output the vignetting region on the diagnostic screen and store the vignetting values ​​for each region of the diagnostic screen.

[0090] According to one embodiment, the processor (120) can change the OIS position setting based on the vignetting value for each region (713). As shown in FIG. 9, if there is a vignetting value in the regions ①②③ at the top of the preview image, the default OIS position when OIS is not performed can be changed. In FIG. 9, since the camera module (180) is located at the top based on the opening region, if the existing OIS position is (x=0, y=0), the OIS position can be changed to (x=0, y=-1) considering the vignetting value for each region. According to one embodiment, the processor (120) can change the OIS position based on the vignetting value for each region.

[0091] According to one embodiment, the processor (120) can change the OIS position and re-output the diagnostic screen to determine whether vignetting has occurred. According to one embodiment, the processor (120) can re-output the diagnostic screen after the OIS position has been changed.

[0092] According to one embodiment, the processor (120) may recheck the diagnostic screen and, if no vignetting has occurred (715), store the unique ID of the replaced display and terminate the alignment mode (719).

[0093] According to one embodiment, the processor (120) may output a pop-up (717) if vignetting occurs as a result of checking the diagnostic screen (715). If vignetting continues to be detected even after adjusting the OIS position, this indicates a fundamental problem, and the electronic device (101) according to one embodiment may provide the user with a message recommending a visit to a service center.

[0094] Fig. 10 is a flowchart of an operation method for performing an AF scan in an electronic device according to one embodiment. Fig. 11 is a diagram for explaining a section in which vignetting does not occur during an AF scan.

[0095] According to one embodiment, a processor (120) can detect a display replacement (1001). When a user removes an existing display from an electronic device (101) and attaches a replacement display to a connector provided in the electronic device (101), the electronic device (101) can recognize a unique ID stored in the attached display. The unique ID may correspond to a serial number that allows the electronic device (101) to manage the display.

[0096] According to one embodiment, the processor (120) verifies whether the unique ID of the display is identical to the specified unique ID (1003). If the unique ID of the display is identical to the specified unique ID, the combined display is not a new display, and thus, no vignetting diagnosis is required. Therefore, the alignment mode according to the present embodiment is not executed.

[0097] Additionally, according to one embodiment, the processor (120) can automatically execute the alignment mode even if the unique IDs of the displays are different from each other. This is the case when the replacement display is simply reattached after detaching the existing display, or when the existing display is reattached after being repaired. That is, according to one embodiment, the processor (120) can execute the alignment mode when it detects that the display is connected to the connector.

[0098] According to one embodiment, the processor (120) may execute an alignment mode if the unique ID of the display is not identical to the specified unique ID. In addition, according to one embodiment, the processor (120) may adjust the AF position simultaneously with executing the alignment mode (1005).

[0099] According to one embodiment, the processor (120) can detect the separation of the display and then check the unique ID of the new display coupled to the plate, and if the checked unique ID is different from the pre-stored unique ID, it can execute an alignment mode supported by an application stored in the memory.

[0100] A processor (120) according to one embodiment can control the display to output a diagnostic screen based on a repair filter attached to the opening of the display in an alignment mode.

[0101] Align mode is a vignetting diagnostic function supported by an application stored in memory (130), which can provide a preview image with the repair film attached. According to one embodiment, the processor (120) can automatically execute the alignment mode of the application in response to detecting the attachment of a new display, or can execute it according to the user's application execution after the new display is attached.

[0102] According to one embodiment, the processor (120) may execute an alignment mode and adjust the AF position. According to one embodiment, the electronic device (101) may move the lens housing of the front camera to a position closer to the display (330) or to a position farther from the display (330) by driving the AF actuator for auto-focus adjustment. That is, the processor (120) according to one embodiment may move the lens housing in the direction of the optical axis to adjust the AF position. In one embodiment, the processor (120) may move the position of the lens housing to the farthest position from the display (330) along the optical axis by driving the AF actuator. In order to perform a diagnosis in a state where vignetting (obstruction of the field of view) is the worst, the position of the lens housing may be moved as far as possible to the rear of the electronic device (101).

[0103] According to one embodiment, when the align mode is executed, the processor (120) can adjust the AF (auto focus) position so that the lens housing is away from the display.

[0104] According to one embodiment, the processor (120) may output a diagnostic screen output (1007).

[0105] According to one embodiment, the processor (120) can move the AF position from the first position to the second position (1009). Referring to FIG. 11, the first position corresponds to a position where the lens housing of the camera module (180) is furthest from the display (330) based on the optical axis, and the second position corresponds to a position where the lens housing of the camera module (180) is closest to the display (330) based on the optical axis. When the lens housing is in the first position, the field of view obstruction by the display (330) and / or the front panel (320) is the most severe, and when it is in the second position, the effect of the field of view obstruction is small. According to one embodiment, the processor (120) can set the starting position of the AF position to the second position, and move it from the second position to the first position. Here, the process of moving the AF position is an AF scan.

[0106] Meanwhile, vignetting may appear and then disappear on the diagnostic screen as the AF position moves from the first to the second position. This is because the closer the lens housing is to the first position, the greater the effect of field obstruction. Conversely, vignetting may appear and then disappear on the diagnostic screen as the AF position moves from the second to the first position.

[0107] According to one embodiment, the processor (120) can identify a third position, which is an AF position where vignetting does not occur (1011).

[0108] In one embodiment, the processor (120) can adjust the AF position to a first position so that the lens housing has a maximum distance from the display in the align mode. In one embodiment, the processor (120) can move the AF position to a second position so that the lens housing has a minimum distance from the display while the lens housing is in the first position. In one embodiment, the processor (120) can identify a third position where no vignetting occurs while the AF position is moving from the first position to the second position. In one embodiment, the processor (120) can store the third position.

[0109] In one embodiment, the processor (120) may store the third position and terminate the alignment mode (1013). In addition, the processor (120) according to one embodiment may store the unique ID of the replaced display.

[0110] According to one embodiment, the electronic device (101) may perform an autofocus (AF) function based on the third position when the shooting mode is performed after storing the third position. For example, since vignetting occurs when the AF position is in the first position-third position section, the camera module (180) may be controlled to perform the autofocus (AF) function only in the second position-third position section.

[0111] Meanwhile, since vignetting still occurs in the first-third position interval, action is required in that area. At this time, if the degree of vignetting in each area can be determined based on the diagnostic screen, vignetting can be removed from the actual output image through brightness correction only for the areas where vignetting occurs. This will be described with reference to FIGS. 12 to 14.

[0112] Fig. 12 is a flowchart of an operational method for performing AI filtering in an electronic device according to one embodiment. Figs. 13 and 14 illustrate an AI filtering area.

[0113] According to one embodiment, a processor (120) can detect a display replacement (1201). When a user removes an existing display from an electronic device (101) and attaches a replacement display to a connector provided in the electronic device (101), the electronic device (101) can recognize a unique ID stored in the attached display. The unique ID may correspond to a serial number that allows the electronic device (101) to manage the display.

[0114] According to one embodiment, the processor (120) verifies whether the unique ID of the display is identical to the specified unique ID (1203). If the unique ID of the display is identical to the specified unique ID, the combined display is not a new display, and thus, no vignetting diagnosis is required. Therefore, the alignment mode according to the present embodiment is not executed.

[0115] According to one embodiment, the processor (120) may execute an alignment mode if the unique ID of the display is not identical to the specified unique ID. In addition, according to one embodiment, the processor (120) may adjust the AF position simultaneously with executing the alignment mode (1205).

[0116] According to one embodiment, the processor (120) can detect the separation of the display and then check the unique ID of the new display coupled to the plate, and if the checked unique ID is different from the pre-stored unique ID, it can execute an alignment mode supported by an application stored in the memory.

[0117] A processor (120) according to one embodiment can control the display to output a diagnostic screen based on a repair filter attached to the opening of the display in an alignment mode.

[0118] Align mode is a vignetting diagnostic function supported by an application stored in memory (130), which can provide a preview image with the repair film attached. According to one embodiment, the processor (120) can automatically execute the alignment mode of the application in response to detecting the attachment of a new display, or can execute it according to the user's application execution after the new display is attached.

[0119] According to one embodiment, the processor (120) may execute an alignment mode and adjust the AF position. According to one embodiment, the electronic device (101) may move the lens housing of the front camera to a position closer to the display (330) or to a position farther from the display (330) by driving the AF actuator for auto-focus adjustment. That is, the processor (120) according to one embodiment may move the lens housing in the direction of the optical axis to adjust the AF position. In one embodiment, the processor (120) may move the position of the lens housing to the farthest position from the display (330) along the optical axis by driving the AF actuator. In order to perform a diagnosis in a state where vignetting (obstruction of the field of view) is the worst, the position of the lens housing may be moved as far as possible to the rear of the electronic device (101).

[0120] According to one embodiment, when the align mode is executed, the processor (120) can adjust the AF (auto focus) position so that the lens housing is away from the display.

[0121] Meanwhile, the execution of the alignment mode and the adjustment of the AF position may start from the third position according to Fig. 10 or may start from the first position.

[0122] According to one embodiment, the processor (120) may output a diagnostic screen output (1207).

[0123] According to one embodiment, the processor (120) can store a vignetting value for each area for each AF position while changing the AF position while the diagnostic screen is output (1209).

[0124] According to one embodiment, the processor (120) may store filtering values ​​by region (1211). Here, the filtering values ​​by region correspond to values ​​for AI-based removal of dark areas that occur in an image when an image is acquired with vignetting. When the filtering values ​​by region are stored, the processor (120) according to one embodiment may apply the filtering values ​​to the AI ​​filtering region where vignetting occurs to generate an image without vignetting.

[0125] Referring to Fig. 13, the vignetting value can be confirmed for each area at a specific AF location. For example, if the vignetting values ​​are 17 in area ①, 19 in area ②, 16 in area ③, and 1 in area ⑤, respectively, then each vignetting value is stored, and when an image is acquired through the camera module, the vignetting can be removed by applying a filtering value for each area corresponding to the vignetting value.

[0126] Referring to Fig. 14, the vignetting values ​​for each area can be confirmed in a state where the AF position has been moved from a specific AF position in Fig. 13. For example, if the vignetting values ​​are 12 in area ⑤, 8 in area ⑦, and 19 in area ⑧, respectively, each vignetting value is stored, and when an image is acquired through the camera module, the filtering value for each area corresponding to the vignetting value can be applied to remove vignetting from the image.

[0127] According to one embodiment, the processor (120) may store region-specific filtering values ​​corresponding to region-specific vignetting values. At this time, an AF position may be assigned to the region-specific filtering values.

[0128] In one embodiment, the processor (120) may execute a shooting mode in which the camera module operates while storing region-specific vignetting values. In one embodiment, the processor (120) may acquire an image through the camera module and remove vignetting from the image based on region-specific filtering values.

[0129] According to one embodiment, the processor (120) may adjust the AF position to the first position so that the lens housing has the maximum distance from the display in the align mode. Then, the processor (120) may move the AF position to the second position so that the lens housing has the minimum distance from the display in the first position. According to one embodiment, the processor (120) may identify a third position where vignetting does not occur while the AF position is moving from the first position to the second position, and may store the third position. According to one embodiment, when the third position is stored in the electronic device (101), the processor (120) may store an image acquired through the camera module when the AF position is between the first position and the third position in the shooting mode, and may process a filtering value for each region in the image acquired through the camera module when the AF position is between the second position and the third position.

[0130] An electronic device according to one embodiment may include a plate (310 of FIG. 2), a display (330 of FIG. 2) laminated on a first surface of the plate and including an opening (331 of FIG. 2), the display being detachable from the plate, a camera module (180 of FIG. 2) disposed to face the opening on a second surface of the plate opposite the first surface and including a lens housing, at least one processor (120 of FIG. 1), and a memory storing instructions. The instructions according to one embodiment may be executed by the at least one processor to cause the electronic device to, after detecting separation of the display, check a unique ID of a new display (a replacement display, 330 of FIG. 5) coupled to the plate, and if the checked unique ID is different from a pre-stored unique ID, execute an alignment mode supported by an application stored in the memory, and output a diagnostic screen based on a repair filter attached to the opening of the new display in the alignment mode.

[0131] According to one embodiment, a diagnostic screen may output a vignetting area if the center of the camera module and the center of the opening of the new display do not align.

[0132] Instructions according to one embodiment, executed by the at least one processor, cause the electronic device to: adjust the AF (auto focus) position so that the lens housing is away from the display when the align mode is executed.

[0133] Instructions according to one embodiment, executed by the at least one processor, may cause the electronic device to: output a vignetting area on a diagnostic screen, and store a vignetting value for each area of ​​the diagnostic screen.

[0134] Instructions according to one embodiment, executed by the at least one processor, may cause the electronic device to: change the OIS position based on a region-specific vignetting value.

[0135] Instructions according to one embodiment, executed by the at least one processor, may cause the electronic device to: re-output the diagnostic screen after the OIS position has changed.

[0136] Instructions according to one embodiment, executed by the at least one processor, may cause the electronic device to: output a pop-up message recommending a visit to a service center when vignetting occurs on a re-output diagnostic screen.

[0137] Instructions according to one embodiment, executed by the at least one processor, may cause the electronic device to: store at least one of a unique ID of a new display or a setting value of a changed OIS position if no vignetting occurs in the re-output diagnostic screen.

[0138] Instructions according to one embodiment may be executed by the at least one processor to cause the electronic device to: in an align mode, adjust the position of the AF to a first position so that the lens housing has a distance from the display, move the position of the AF from the first position to a second position so that the lens housing has a minimum distance from the display, determine a third position where no vignetting occurs while the position of the AF is moved from the first position to the second position, and store the third position.

[0139] Instructions according to one embodiment, executed by the at least one processor, may cause the electronic device to: store a region-specific filtering value corresponding to a region-specific vignetting value.

[0140] Instructions according to one embodiment, executed by the at least one processor, may cause the electronic device to: execute a shooting mode in which the camera module operates, acquire an image through the camera module in the shooting mode, and remove vignetting of the image based on a region-specific filtering value.

[0141] Instructions according to one embodiment may be executed by the at least one processor to cause the electronic device to: in an align mode, adjust the position of the AF to a first position so that the lens housing has a maximum distance from the display, move the position of the AF from the first position to a second position so that the lens housing has a minimum distance from the display, determine a third position where vignetting does not occur while the position of the AF moves from the first position to the second position, and store the third position. Instructions according to one embodiment may be executed by the at least one processor to cause the electronic device to: in a shooting mode, store an image acquired through a camera module when the AF position is between the first position and the third position, and process a region-specific filtering value on an image acquired through the camera module when the AF position is between the second position and the third position.

[0142] According to one embodiment, a recording medium is a non-transitory computer-readable recording medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform set operations, the operations including: checking a unique ID of a new display coupled to a plate after detecting separation of the displays, executing an alignment mode supported by an application stored in a memory if the checked unique ID is different from a pre-stored unique ID, and outputting a diagnostic screen based on a repair filter attached to the opening of the new display in the alignment mode.

[0143] The operations of the recording medium according to one embodiment may further include an operation of outputting a vignetting area on a diagnostic screen and an operation of storing a vignetting value for each area of ​​the diagnostic screen.

[0144] The operations of the recording medium according to one embodiment may further include an operation of changing the OIS position based on a vignetting value per area.

Claims

1. In electronic devices, plate; A display laminated on the first surface of the plate, including an opening, and separable from the plate; A camera module including a lens housing, the camera module being positioned so as to face the opening on a second side opposite to the first side of the plate; at least one processor; and Contains memory that stores instructions, The instructions, executed by the at least one processor, cause the electronic device to: After detecting the separation of the above display, the unique ID of the new display combined with the above plate is verified, An electronic device that outputs a diagnostic screen based on a repair filter attached to the opening of the new display if the above-mentioned unique ID is different from the pre-stored unique ID.

2. In paragraph 1, The above diagnostic screen is, An electronic device in which a vignetting area is output when the center of the camera module and the center of the opening of the new display do not coincide.

3. In paragraph 1, The instructions, executed by the at least one processor, cause the electronic device to: An electronic device that adjusts the AF (auto focus) position so that the lens housing moves away from the display when the above alignment mode is executed.

4. In paragraph 3, The instructions, executed by the at least one processor, cause the electronic device to: Output the vignetting area on the above diagnostic screen, An electronic device that stores vignetting values ​​for each area of ​​the above diagnostic screen.

5. In paragraph 4, The instructions, executed by the at least one processor, cause the electronic device to: An electronic device that changes the OIS position based on the vignetting value for each area.

6. In paragraph 5, The instructions, executed by the at least one processor, cause the electronic device to: An electronic device that re-outputs the diagnostic screen after the OIS position is changed.

7. In paragraph 5, The instructions, executed by the at least one processor, cause the electronic device to: An electronic device that outputs a pop-up message recommending a visit to a service center when vignetting occurs on the above-mentioned reprinted diagnostic screen.

8. In paragraph 5, The instructions, executed by the at least one processor, cause the electronic device to: An electronic device that stores at least one of the unique ID of the new display or the setting value of the changed OIS position, if no vignetting occurs on the re-printed diagnostic screen.

9. In paragraph 3, The instructions, executed by the at least one processor, cause the electronic device to: In the above alignment mode, the position of the AF is adjusted to the first position so that the lens housing has the maximum distance from the display, Move the position of the AF to a second position so that the lens housing has a minimum distance from the display at the first position, Confirm the third position where no vignetting occurs while the position of the above AF moves from the first position to the second position, An electronic device storing the third location.

10. In paragraph 4, The instructions, executed by the at least one processor, cause the electronic device to: An electronic device storing filtering values ​​for each region corresponding to the vignetting values ​​for each region.

11. In paragraph 10, The instructions, executed by the at least one processor, cause the electronic device to: Execute the shooting mode in which the above camera module operates, Acquire an image through the camera module in the above shooting mode, An electronic device for removing vignetting from an image based on a filtering value for each region.

12. In paragraph 11, The instructions, executed by the at least one processor, cause the electronic device to: In the above alignment mode, the position of the AF is adjusted to the first position so that the lens housing has the maximum distance from the display, Move the position of the AF to a second position so that the lens housing has a minimum distance from the display at the first position, Confirm the third position where no vignetting occurs while the position of the above AF moves from the first position to the second position, Save the above third location, In the above shooting mode: When the above AF position is between the first position and the third position, the image acquired through the camera module is stored, An electronic device that processes the filtering value for each region in an image acquired through the camera module when the AF position is between the second position and the third position.

13. In paragraph 1, If the above-mentioned unique ID is different from the pre-stored unique ID, the alignment mode supported by the application stored in the memory is executed, An electronic device that outputs a diagnostic screen based on a repair filter attached to the opening of the new display in the above alignment mode.

14. A non-transitory computer-readable recording medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform set operations, the operations comprising: An action to verify the unique ID of a new display bonded to the plate after detecting the separation of the display; and A recording medium including an action of outputting a diagnostic screen based on a repair filter attached to the opening of the new display if the above-mentioned confirmed unique ID and the pre-stored unique ID are different.

15. In paragraph 13, The above actions are: An action of outputting a vignetting area on the above diagnostic screen; and A recording medium further comprising an operation of storing a vignetting value for each area of ​​the above diagnostic screen.

Images