Method for detecting foreign substance, and electronic device for supporting same

Abstract

An electronic device according to one embodiment may comprise: a housing including a first housing and a second housing; a hinge unit for enabling the first housing and the second housing to rotate; a display arranged in the first housing and the second housing; a camera; a sensor; at least one processor including a processing circuit; and a memory for storing instructions. When executed individually or collectively by the at least one processor (250), the instructions can cause the electronic device to: detect, through the sensor, that a folding angle formed by the first housing and the second housing is reduced to a designated angle or less; display a designated screen through the display on the basis that the folding angle is reduced to the designated angle or less; acquire an image related to the designated screen through the camera; and identify, on the basis of the uniformity of the acquired image, whether a foreign substance is present on the display.

Description

Method for detecting foreign substances and electronic device supporting the same

[0001] The present disclosure relates to a method for detecting a foreign substance and an electronic device supporting the same.

[0002] Advances in electronic technology are driving the development of electronic devices featuring various types of flexible displays. For example, electronic devices featuring flexible displays may include foldable, bendable, or rollable displays.

[0003] An electronic device including a foldable display can provide various functions not only in a fully folded state or a fully unfolded state, but also in an intermediate state between the fully folded state and the fully unfolded state (hereinafter referred to as an “intermediate state”).

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0005] A user can use an electronic device including a foldable display (hereinafter referred to as the "electronic device") in a fully unfolded state (or an intermediate state, or a fully folded state). After using the electronic device, the user can close the electronic device so that the electronic device switches from the fully unfolded state (or the intermediate state) to the fully folded state in order to stop using the electronic device. If the user closes the electronic device without noticing a foreign object (e.g., a pen, a key, a USB (universal serial bus) memory, etc.) on the display of the electronic device, the display may be damaged by the foreign object. Foldable displays are relatively more fragile than flat displays (e.g., LCDs, rigid OLEDs) due to their low durability, and are expensive, so damage may cause greater damage to the user.

[0006] Methods for detecting whether a foreign substance exists on the display of an electronic device may include a method of analyzing an image of the display acquired through a camera placed on the electronic device when the electronic device is closed (e.g., while the electronic device is folded) (hereinafter referred to as the “first method”) and a method using a touch screen panel (hereinafter referred to as the “second method”).

[0007] In the first method, due to the limited field of view (e.g., approximately 85 degrees) of the camera positioned at the top of the electronic device, it may be difficult to acquire an image of the entire display area. Furthermore, in the first method, it may be difficult to distinguish between an image acquired when a foreign substance is present on the display (e.g., an image acquired by photographing an actual foreign substance with a camera) and an image acquired when an image containing the foreign substance is displayed on the display (e.g., an image acquired by photographing an image containing the foreign substance with a camera).

[0008] In the second method, when a resistive touch screen panel is used, only foreign substances having a weight that can exert pressure exceeding a certain pressure on the touch screen panel can be detected, which may result in a low touch recognition rate. Furthermore, in the second method, when a capacitive touch screen panel is used, touches by non-conductive foreign substances (e.g., plastic) may not be recognized.

[0009] The present disclosure relates to a method for detecting a foreign substance, and an electronic device supporting the same, which can detect whether a foreign substance exists on a display based on an image of the specified screen acquired through a camera (e.g., an under display camera (UDC)) when the electronic device is reduced below a specified angle, by displaying a specified screen through the display.

[0010] The technical problems to be solved by the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0011] An electronic device according to one embodiment may include a housing including a first housing and a second housing, a hinge portion that allows the first housing and the second housing to rotate, a display disposed in the first housing and the second housing, a camera, a sensor, at least one processor including a processing circuit, and a memory that stores instructions. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device to detect, through the sensor, that a folding angle formed by the first housing and the second housing is reduced to a specified angle or less. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device to display a specified screen through the display based on that the folding angle is reduced to a specified angle or less. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device to acquire an image related to the specified screen or less through the camera. The above commands, when executed individually or collectively by the at least one processor (250), may cause the electronic device to determine whether a foreign substance is present on the display based on the uniformity of the acquired image.

[0012] A method for detecting a foreign substance in an electronic device according to one embodiment may include an operation of detecting, through a sensor of the electronic device, that a folding angle formed by a first housing and a second housing of the electronic device has decreased below a specified angle. The method may include an operation of displaying a specified screen through a display of the electronic device based on the decrease in the folding angle below the specified angle. The method may include an operation of acquiring an image related to the specified screen through a camera of the electronic device. The method may include an operation of determining, based on uniformity of the acquired image, whether a foreign substance exists on the display.

[0013] In one embodiment, a non-transitory computer-readable storage medium having computer-executable instructions recorded thereon may cause the computer-executable instructions, when individually or collectively executed by at least one processor of an electronic device, to cause the electronic device to detect, through a sensor of the electronic device, that a folding angle formed by a first housing and a second housing of the electronic device has decreased below a specified angle. The computer-executable instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a specified screen through a display of the electronic device based on the folding angle having decreased below the specified angle. The computer-executable instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire an image related to the specified screen through a camera of the electronic device. The computer-executable instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine whether a foreign substance is present on the display based on a uniformity of the acquired image.

[0014] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0015] FIG. 2A is a diagram illustrating an unfolded state of an electronic device according to one embodiment.

[0016] FIG. 2b is a diagram illustrating a folded state of an electronic device according to one embodiment.

[0017] FIG. 3 is a block diagram of an electronic device according to one embodiment.

[0018] FIG. 4 is a drawing for explaining an electronic device according to one embodiment.

[0019] FIG. 5 is a drawing for explaining an electronic device according to one embodiment.

[0020] FIG. 6 is a drawing for explaining an electronic device according to one embodiment.

[0021] FIG. 7 is a drawing for explaining an electronic device according to one embodiment.

[0022] FIG. 8 is a drawing for explaining an electronic device according to one embodiment.

[0023] FIG. 9 is a flowchart illustrating a method for detecting foreign matter according to one embodiment.

[0024] FIG. 10 is a drawing illustrating a method for detecting a foreign substance according to one embodiment.

[0025] FIG. 11 is a drawing illustrating a method for detecting a foreign substance according to one embodiment.

[0026] FIG. 12 is a flowchart illustrating a method for detecting foreign matter according to one embodiment.

[0027] FIG. 13 is a drawing illustrating a method for detecting a foreign substance according to one embodiment.

[0028] FIG. 14 is a flowchart illustrating a method for detecting foreign matter according to one embodiment.

[0029] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment.

[0030] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0031] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0032] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0033] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0034] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0035] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0036] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0037] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0038] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0039] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0040] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0041] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0042] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0043] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0044] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0045] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0046] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0047] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0048] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0049] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0050] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0051] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0052] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0053] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0054] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0055] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0056] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0057] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0058] FIG. 2A is a diagram illustrating an unfolded state of an electronic device according to one embodiment.

[0059] FIG. 2b is a diagram illustrating a folded state of an electronic device according to one embodiment.

[0060] Referring to FIGS. 2A and 2B, the electronic device (201) may include a housing (202) and a flexible display (e.g., a front display (230)) positioned within a space formed by the housing (202). In one embodiment, the housing (202) may be referred to as a foldable housing. In one embodiment, the front display (230) may be referred to as a foldable display.

[0061] According to one embodiment, the housing (202) may include a first housing (210) and a second housing (220) configured to rotate relative to the first housing (210).

[0062] According to one embodiment, the first housing (210) and / or the second housing (220) may form at least a portion of the exterior of the electronic device (201). According to one embodiment, the surface on which the front display (230) is visually exposed is defined as a front surface (e.g., a first front surface (210a) and a second front surface (220a)) of the electronic device (201) and / or the housing (202). The surface opposite the front surface is defined as a back surface (e.g., a first back surface (210b) and a second back surface (220b)) of the electronic device (201). The surface surrounding at least a portion of the space between the front surface and the back surface is defined as a side surface (e.g., a first side surface (210c) and a second side surface (220c)) of the electronic device (201).

[0063] According to one embodiment, the first housing (210) may be rotatably connected to the second housing (220) using a hinge structure (also referred to as a “hinge” or a “hinge portion”). For example, the first housing (210) and the second housing (220) may each be rotatably connected to the hinge structure. Accordingly, the electronic device (201) may be variable between a fully folded state (e.g., FIG. 2b) and a fully unfolded state (e.g., FIG. 2a). In the fully folded state, the first front surface (210a) may face the second front surface (220a), and in the fully unfolded state, the direction in which the first front surface (210a) faces may be substantially the same as the direction in which the second front surface (220a) faces. For example, in a fully unfolded state, the first front surface (210a) may be positioned substantially on the same plane as the second front surface (220a). In one embodiment, the second housing (220) may provide relative motion with respect to the first housing (210).

[0064] According to one embodiment, the first housing (210) and the second housing (220) may be arranged on both sides with respect to the folding axis (A) as the center, and may have an overall symmetrical shape with respect to the folding axis (A). The angle (hereinafter also referred to as the “folding angle”) between the first housing (210) and the second housing (220) may be changed depending on whether the state of the electronic device (201) is a fully unfolded state, a fully folded state, or an intermediate state between the fully unfolded state and the fully folded state (hereinafter referred to as the “intermediate state”).

[0065] According to one embodiment, the electronic device (201) may include a hinge cover (240). At least a portion of the hinge cover (240) may be disposed between the first housing (210) and the second housing (220). According to one embodiment, the hinge cover (240) may be covered by a portion of the first housing (210) and the second housing (220) or may be exposed to the outside of the electronic device (201) depending on the state of the electronic device (201). According to one embodiment, the hinge cover (240) may protect a hinge structure (not shown) from an external impact of the electronic device (201). According to one embodiment, the hinge cover (240) may be interpreted as a hinge housing for protecting the hinge structure.

[0066] According to one embodiment, as illustrated in FIG. 2A, when the electronic device (201) is in a fully unfolded state, the hinge cover (240) may be covered by the first housing (210) and the second housing (220) and may not be exposed. As another example, as illustrated in FIG. 2B, when the electronic device (201) is in a folded state (e.g., a fully folded state), the hinge cover (240) may be exposed to the outside between the first housing (210) and the second housing (220). As another example, when the first housing (210) and the second housing (220) are in an intermediate state where they are folded at a certain angle, the hinge cover (240) may be partially exposed to the outside between the first housing (210) and the second housing (220). However, in this case, the exposed area may be less than in the fully folded state. In one embodiment, the hinge cover (240) may include a curved surface.

[0067] In one embodiment, the front display (230) may be disposed in the first housing (210) (e.g., the first front (210a)) and the second housing (220) (e.g., the second front (220a)). For example, the front display (230) may be disposed in the first housing (210) and the second housing (220) across the hinge portion.

[0068] In one embodiment, the front display (230) can visually provide information to an external party (e.g., a user) of the electronic device (201). The front display (230) can include, for example, a holographic device or a projector and a control circuit for controlling the device. In one embodiment, the front display (230) can include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the strength of a force generated by the touch.

[0069] According to one embodiment, the front display (230) may be a display in which at least a portion of the display can be transformed into a flat or curved surface. For example, the front display (230) may be formed to vary in response to the relative movement of the second housing (220) with respect to the first housing (210). According to one embodiment, the front display (230) may include a folding area (233), a first display area (231) positioned on one side (e.g., above (+Y direction)) of the folding area (233), and a second display area (232) positioned on the other side (e.g., below (-Y direction)). According to one embodiment, the folding area (233) may be positioned above the hinge structure. For example, at least a portion of the folding area (233) may face the hinge structure. According to one embodiment, the first display area (231) may be disposed on the first housing (210), and the second display area (232) may be disposed on the second housing (220). According to one embodiment, the front display (230) may be accommodated in the first housing (210) and the second housing (220).

[0070] However, the division of the areas of the front display (230) illustrated in the above-described FIG. 2a is exemplary, and the front display (230) may be divided into multiple areas (for example, four or more or two) depending on the structure or function.

[0071] Also, in the embodiment illustrated in FIG. 2A, the front display (230) may be divided into regions by a folding region (233) extending parallel to the X-axis or a folding axis (A-axis), but in other embodiments, the front display (230) may be divided into regions based on another folding region (e.g., a folding region parallel to the Y-axis) or another folding axis (e.g., a folding axis parallel to the Y-axis). According to one embodiment, the front display (230) may be coupled to or disposed adjacent to a touch detection circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a digitizer configured to detect a magnetic field-type stylus pen.

[0072] According to one embodiment, the electronic device (201) may include a rear display (234). The rear display (234) may be arranged to face a different direction than the front display (230). For example, the front display (230) may be visually exposed through the front side of the electronic device (201) (e.g., the first front side (210a) and / or the second front side (220a)), and the rear display (234) may be visually exposed through the rear side of the electronic device (201) (e.g., the first rear side (210b)).

[0073] According to one embodiment, the electronic device (201) may include at least one camera module (204, 206) and a flash (208). According to one embodiment, the electronic device (201) may include a front camera module (204) exposed through a front side (e.g., a first front side (210a)) and / or a rear camera module (206) exposed through a rear side (e.g., a first rear side (210b)). The camera modules (204, 206) may include one or more lenses, an image sensor, a flash, and / or an image signal processor. The flash (208) may include a light emitting diode or a xenon lamp. According to one embodiment, two or more lenses (an infrared camera, a wide-angle lens, and a telephoto lens) and image sensors may be arranged on one side of the electronic device (201). The configuration of the front camera module (204) and / or the rear camera module (206) may be partially or entirely identical to the configuration of the camera module (180) of FIGS. 1 and 2.

[0074] FIG. 3 is a block diagram of an electronic device (301) according to one embodiment.

[0075] FIG. 4 is a drawing for explaining an electronic device (301) according to one embodiment.

[0076] Referring to FIGS. 3 and 4, in one embodiment, the electronic device (301) may be the electronic device (101) of FIG. 1, or the electronic device (201) of FIGS. 2A and 2B. For example, the electronic device (301) may be a foldable electronic device including a housing (202) (e.g., the first housing (210) and the second housing (220)) and a hinge portion (hinge structure) as described through FIGS. 2A and 2B.

[0077] In one embodiment, the electronic device (301) may include a display (310), a camera (320), a sensor (330), a plurality of magnets (340), memory (350), and / or a processor (360).

[0078] In one embodiment, the display (310) may be the display module (160) of FIG. 1.

[0079] In one embodiment, the display (310) may be a display disposed in a first housing (410) (e.g., the first housing (210)) and a second housing (420) (e.g., the second housing (220)). For example, the display (310) may be a display (e.g., a front display (230)) disposed in a front surface of the first housing (410) (e.g., a first front surface (210a) of the first housing (210)) and a second housing (420) (e.g., a first front surface (220a) of the second housing (220)). For example, the display (310) may be disposed in the first housing (410) (e.g., the first housing (210)) and the second housing (420) (e.g., the second housing (220)) across a hinge portion (430).

[0080] In one embodiment, the display (310) (e.g., the front display (230)) may be a foldable display. For example, the display (310) may be a display in which at least a portion of the display can be transformed into a flat or curved surface.

[0081] In one embodiment, the display (310) may include a first region (311) (hereinafter referred to as “the first region of the display” or “the first region”) and a second region (312) (hereinafter referred to as “the second region of the display” or “the second region”).

[0082] In one embodiment, the first region (311) and the second region (312) of the display (310) may be distinguished based on an axis along which the display (310) is folded (hereinafter referred to as a “folding axis”) (e.g., axis A of FIG. 2A). For example, the first region (311) of the display (310) may be an area (or portion) disposed in the first housing (410) (e.g., the first front surface (210a) of the first housing (210)). For example, the second region (312) of the display (310) may be an area (or portion) disposed in the second housing (420) (e.g., the first front surface (220a) of the second housing (220)).

[0083] In one embodiment, the display (310) may include a front display (e.g., front display (230)) and a rear display (e.g., rear display (234)).

[0084] In one embodiment, the camera (320) may be the camera module (180) of FIG. 1.

[0085] In one embodiment, the camera (320) may include a camera (321) positioned under the display (e.g., an under display camera (UDC)) (also referred to as an “under panel camera (UPC)”).

[0086] In one embodiment, the camera (320) may be a camera (e.g., a UDC) (e.g., camera (321)) positioned below a region close to the hinge (430) within the first region of the display (310). For example, when the first region (311) of the display (310) is divided into an upper region and a lower region (e.g., a region close to the hinge relative to the upper region based on the folding axis), the camera (320) may be a camera (e.g., camera (321)) positioned below a lower region of the first region (311) of the display (310).

[0087] In one embodiment, the camera (320) (e.g., UDC) (e.g., camera (321)) may be an RGB camera, but is not limited thereto. For example, the camera (320) (e.g., UDC) (e.g., camera (321)) may be a black and white camera (e.g., a camera that does not include a color filter and does not require an interpolation operation to be performed on the acquired image).

[0088] In one embodiment, the camera (320) (e.g., UDC) (e.g., camera (321)) may be replaced by an infrared sensor capable of obtaining a depth map (e.g., an image containing depth information) using infrared.

[0089] In one embodiment, the camera (320) may include multiple cameras. For example, the camera (320) may include a camera (UDC) (e.g., camera (321)) positioned below the lower area of ​​the first area (311) of the display (310) described above, and at least one camera (e.g., at least one camera module (204), camera (322) of FIG. 5) (and / or an infrared sensor) positioned on the top of the first housing (410) (e.g., the first front surface (210a) of the first housing (210)).

[0090] In one embodiment, the sensor (330) may be the sensor module (176) of FIG. 1.

[0091] In one embodiment, the sensor (330) may be a sensor for detecting (or acquiring, or sensing) an angle (θ) (hereinafter referred to as a “folding angle”) between the first housing (410) (e.g., the first housing (210)) and the second housing (420) (e.g., the second housing (220)). For example, the sensor (330) may be a sensor for detecting that the folding angle (θ) is 90 degrees in FIG. 4.

[0092] In one embodiment, the sensor (330) may include a Hall sensor disposed in one of the first housing (410) and the second housing (420), and a magnet disposed in one of the first housing and the other housing. The Hall sensor may acquire sensor data for detecting a folding angle by detecting a change in an electromagnetic field (or magnetic flux density) generated by the magnet while at least one of the first housing (410) and the second housing (420) rotates about the hinge portion (430).

[0093] In one embodiment, the sensor (330) may include at least one of a proximity sensor, an angle sensor, a load cell, an infrared sensor, a pressure sensor, an acceleration sensor, a gyro sensor, or an electromagnetic sensor as a sensor for detecting a folding angle.

[0094] In one embodiment, the sensor (330) may be a sensor for detecting the folding state of the electronic device (301) (e.g., a state in which the electronic device (301) is fully folded, a state in which the electronic device (301) is fully unfolded, and an intermediate state).

[0095] However, the sensor (330) for detecting the folding angle (and / or folding state) of the electronic device (301) is not limited to the examples described above.

[0096] In one embodiment, the plurality of magnets (340) may include at least one magnet (hereinafter referred to as “at least one first magnet”) (e.g., magnet (341)) disposed in the first housing (410) and at least one magnet (hereinafter referred to as “at least one second magnet”) (e.g., magnet (342)) disposed in the second housing.

[0097] In one embodiment, a plurality of magnets (340) (e.g., a plurality of electromagnets) can generate a repulsive force between the plurality of magnets (340) under the control of the processor (360) (e.g., by applying a current to at least some of the plurality of magnets (340) under the control of the processor (360). For example, when at least one first magnet (e.g., at least one first electromagnet) and / or at least one second magnet (e.g., at least one second electromagnet) is turned on under the control of the processor (360), a repulsive force can be generated between the at least one first magnet and the at least one second magnet. For example, a repulsive or attractive force can be generated between the at least one first magnet and the at least one second magnet by changing the direction (and strength) of a magnetic field generated by the at least one first magnet and / or the direction (and strength) of a magnetic field generated by the at least one second magnet under the control of the processor (360).

[0098] In one embodiment, the electronic device (301) may be prevented from closing due to a repulsive force generated between the plurality of magnets (340). For example, if a specified condition is satisfied (e.g., a rate at which the folding angle is reduced is greater than a specified rate) while the electronic device (301) is closing (e.g., while the folding angle is reduced), the electronic device (301) may not be completely folded due to a repulsive force generated between the plurality of magnets (340).

[0099] In one embodiment, the speed at which the electronic device (301) closes (e.g., the speed at which the folding angle decreases) can be reduced by the repulsive force generated between the plurality of magnets (340). For example, when a user continuously applies the same force (e.g., torque) to the electronic device (301) to close the electronic device (301), the repulsive force can be generated between the plurality of magnets (340) so that the speed at which the folding angle decreases after the folding angle becomes lower than or equal to a specified angle is lower than before the folding angle becomes lower than or equal to a specified angle. For example, when a user continuously applies the same force (e.g., torque) to the electronic device (301) to close the electronic device (301), the repulsive force can be generated between the plurality of magnets (340) so that the electronic device (301) closes more slowly after the folding angle becomes lower than or equal to a specified angle than before the folding angle becomes lower than or equal to a specified angle. However, the method for reducing the closing speed of the electronic device (301) is not limited to the above-described examples. For example, the closing speed of the electronic device (301) can be reduced by controlling the hydraulic pressure of the hinge portion or the motor of the hinge portion.

[0100] In one embodiment, some of the plurality of magnets (340) may be rotated under the control of the processor (360) to generate a repulsive force between the plurality of magnets (340). For example, when an attractive force is generated between at least one first magnet (e.g., magnet (341)) and at least one second magnet (e.g., magnet (342)) and a specified condition is satisfied (e.g., a condition in which the folding angle is reduced to a specified angle or less or a condition in which the speed at which the folding angle is reduced is less than a specified speed), the at least one first magnet (or the at least one second magnet) may be rotated under the control of the processor (360). The rotation of the at least one first magnet (or the at least one second magnet) may generate a repulsive force between the at least one first magnet and the at least one second magnet.

[0101] In one embodiment, the memory (350) may be the memory (130) of FIG. 1.

[0102] In one embodiment, the memory (350) may store information for performing an operation to detect a foreign substance. For example, the memory (350) may store commands that, when executed by the processor (360) of the electronic device (301), cause the operation to detect a foreign substance to be performed. However, the information stored by the memory (350) is not limited to the examples described above, and the information stored by the memory (350) will be described in detail later.

[0103] In one embodiment, the processor (360) may be the processor (120) of FIG. 1.

[0104] In one embodiment, the processor (360) may perform overall operations for detecting foreign substances. In one embodiment, the processor (360) may include one or more processors for performing operations for detecting foreign substances. The operations for detecting foreign substances performed by the processor (360) will be described in detail with reference to FIG. 9 and below.

[0105] In FIG. 3, the electronic device (301) is illustrated as including, but not limited to, a display (310), a camera (320), a sensor (330), a plurality of magnets (340), a memory (350), and / or a processor (360). For example, the electronic device (301) may further include at least one component illustrated in FIGS. 1, 2A, and 2B. The electronic device (301) may not include at least one component illustrated in FIG. 3 (e.g., the plurality of magnets (340)).

[0106] In the examples described above, the electronic device (301) is described as a foldable electronic device (301) including a first housing (410) and a second housing (420) that are rotatable around one hinge portion (430), but is not limited thereto. For example, the electronic device (301) may be a foldable electronic device (301) including three or more housings that are rotatable around two or more hinge portions.

[0107] FIG. 5 is a drawing for explaining an electronic device (301) according to one embodiment.

[0108] Referring to FIG. 5, in one embodiment, the electronic device (301) may acquire an image of the second area (312) of the display (310) through the camera (320) based on the folding angle being a specified angle (e.g., about 60 degrees). The specified angle at which the camera (320) is set to acquire an image will be described in detail below.

[0109] In one embodiment, in order to more accurately detect whether a foreign substance is present on the display (310) (e.g., the second area (312)), it may be necessary to secure the field of view range of the camera (320) so that the display (310) is positioned within the field of view range of the camera (320) in a state of the electronic device (301) having a specified folding angle.

[0110] In one embodiment, the electronic device (301) may further include a camera (322) (e.g., at least one camera disposed on the top of the first housing (410)) in addition to the camera (321) (e.g., a UDC disposed in the first housing (410)) so that the display (310) is positioned within the field of view of the camera (320) when the electronic device (301) is in a state where the folding angle is a specified angle. For example, in FIG. 5, the electronic device (301) may include a camera (321) and a camera (322) arranged in the electronic device (301) such that the second area (312) of the display (310) exists within the field of view range of the camera (321) (e.g., the field of view range formed by lines (511, 512)) and the field of view range of the camera (322) (e.g., the field of view range formed by lines (521, 522)) in a state of the electronic device (301) where the folding angle (θ) is a specified angle (e.g., about 60 degrees). However, the present invention is not limited thereto. For example, in a state of the electronic device (301) where the folding angle is a specified angle, a part of the display (310) may be positioned outside the field of view range of the camera (320).

[0111] In one embodiment, when the electronic device (301) includes a camera (321) and a camera (322), in a state where the folding angle of the electronic device (301) is a specified angle, the camera (321) and the camera (322) can simultaneously acquire images.

[0112] FIG. 6 is a drawing for explaining an electronic device (301) according to one embodiment.

[0113] Referring to FIG. 6, in one embodiment, the orientation (and position) of the camera (320) or a component included in the camera (320) may be implemented such that the display (310) is positioned within the field of view range of the camera (320) in a state of the electronic device (301) where the folding angle is a specified angle.

[0114] In one embodiment, as illustrated in FIG. 6, the camera (321) (e.g., a UDC disposed in the first housing (410)) may include a lens (321-1) that is inclined at a predetermined angle (e.g., about 10 degrees) with respect to the first housing (410). For example, the camera (321) including the lens (321-1) may be disposed within the first housing (410) such that a predetermined angle is formed between a surface of the first housing (410) and a surface of the lens (321-1) included in the camera (321). Through this, the display (310) may be positioned within the field of view range of the camera (321) (e.g., the field of view range formed by lines (611, 612)) in a state where the folding angle of the electronic device (301) is a designated angle.

[0115] In one embodiment, in FIG. 6, only the lens (321-1) of the camera (321) is illustrated as forming a certain angle with the first housing (410), but this is not limited thereto. For example, the first camera (321) may be placed in the first housing (410) such that the camera (321) (e.g., the entire components of the camera (321) including the lens) is inclined at a certain angle (e.g., about 10 degrees) with respect to the first housing (410).

[0116] FIG. 7 is a drawing for explaining an electronic device (301) according to one embodiment.

[0117] Referring to FIG. 7, in one embodiment, FIG. 7 may represent a state in which the electronic device (301) is fully unfolded.

[0118] In one embodiment, as illustrated in FIG. 7, the electronic device (301) may include a camera (321) and a camera (322) disposed in the first housing (410). For example, the camera (321) may be a camera disposed below the first area (311) of the display (310), and the camera (322) may be at least one camera disposed on the top of the first housing (410). However, depending on the embodiment, the electronic device (301) may not include the camera (322) (or the camera (321).

[0119] In one embodiment, the electronic device (301) may include at least one first magnet (341, 343) disposed in a first housing (410) and at least one second magnet (342, 344) disposed in a second housing (420).

[0120] FIG. 8 is a drawing for explaining an electronic device (301) according to one embodiment.

[0121] Referring to FIG. 8, in one embodiment, in the examples described above, the camera (321) (and camera (322)) is arranged in the first housing (410), but is not limited thereto.

[0122] In one embodiment, the electronic device (301) may further include a camera (323) disposed in a second housing (420) in addition to the camera (321) disposed in the first housing (410). For example, the electronic device (301) may further include a camera (323) disposed in a second area (312) of the display (310) in addition to the camera (321) disposed in the first housing (410).

[0123] In one embodiment, when the electronic device (301) further includes a camera (323) in addition to the camera (321), the electronic device (301) may perform an operation of acquiring an image (e.g., an image captured of a designated screen displayed through a first area of ​​the display (310)) through the camera (321) in addition to or instead of the operation of acquiring an image through the camera (321) in a state where the electronic device (301) has a designated folding angle.

[0124] FIG. 9 is a flowchart (900) illustrating a method for detecting a foreign substance according to one embodiment.

[0125] FIG. 10 is a drawing illustrating a method for detecting a foreign substance according to one embodiment.

[0126] FIG. 11 is a drawing illustrating a method for detecting a foreign substance according to one embodiment.

[0127] Referring to FIGS. 9 to 11, in operation 901, in one embodiment, the processor (360) may detect, through the sensor (330), that the folding angle formed by the first housing and the second housing is reduced to a specified angle or less.

[0128] In one embodiment, the sensor (330) may include a Hall sensor disposed in one of the first housing (410) and the second housing (420), and a magnet disposed in one of the first housing and the other housing. The Hall sensor may acquire sensor data for detecting a folding angle by detecting a change in an electromagnetic field (or magnetic flux density) generated by the magnet while at least one of the first housing (410) and the second housing (420) rotates about the hinge portion (430).

[0129] In one embodiment, the sensor (330) may include at least one of a proximity sensor, an angle sensor, a load cell, an infrared sensor, a pressure sensor, an acceleration sensor, a gyro sensor, or an electromagnetic sensor as a sensor for detecting a folding angle.

[0130] In one embodiment, the processor (360) can detect (or obtain, or confirm) a folding angle based on sensor data obtained from the sensor (330).

[0131] In one embodiment, the processor (360) may detect that the folding angle has decreased and become equal to a specified angle. For example, in FIG. 10, the first housing (410) may be rotated in the direction indicated by the arrow (1020), thereby performing an operation of closing (e.g., folding) the electronic device (301). The processor (360) may detect that the folding angle (θ) has decreased and become equal to a specified angle (e.g., about 60 degrees) (or an angle less than or equal to the specified angle).

[0132] In one embodiment, the specified angle may be a folding angle (hereinafter referred to as a “specified angle”) that is set to perform an operation of displaying a specified screen through the display (310) of operation 903 and / or an operation of acquiring an image related to the specified screen through the camera (320) of operation 905. For example, the processor (360) may start an operation of displaying a specified screen through the display (310) of operation 903 and / or an operation of acquiring an image related to the specified screen through the camera (320) of operation 905 at a point in time when the folding angle is reduced below the specified angle (e.g., at a point in time when the folding angle becomes equal to the specified angle after being reduced). However, the present invention is not limited thereto.

[0133] In one embodiment, the specified angle may be set based on the field of view of the camera (320) and the size of the display (310). For example, in FIG. 10, the processor (360) may set the folding angle (θ) to the specified angle so that the entire second area (312) of the display (310) is positioned within the field of view range (e.g., the field of view range formed by the lines (1011, 1012)) of the camera (321) (e.g., the camera positioned below the first area (311) of the display (310). For example, the processor (360) may set the folding angle to the specified angle so that a scene including the entire second area (312) of the display (310) can be captured by the camera (321) (e.g., the camera positioned below the first area (311) of the display (310). For example, when the electronic device (301) includes a camera (321) (e.g., a camera positioned below the first area (311) of the display (310)) and a camera (322) (e.g., at least one camera positioned on the top of the first housing (410), the processor (360) may set the folding angle to a specified angle so that the entire second area (312) of the display (310) is positioned within the field of view range of the camera (321) and the field of view range of the camera (322) (e.g., the union of the field of view range of the camera (321) and the field of view range of the camera (322). However, the present invention is not limited thereto. For example, in a state of the electronic device (301) where the folding angle is the specified angle, a part of the display (310) may be positioned outside the field of view range of the camera (320).

[0134] In one embodiment, the processor (360) may set a largest folding angle among the plurality of folding angles to a specified angle when there are multiple folding angles that allow the entire second region (312) of the display (310) to be positioned within the field of view of the camera (320) (e.g., camera (321) and / or camera (322)). For example, while the electronic device (301) is closed (e.g., while the folding angle is reduced), the larger the field of view of the camera (320) relative to the size of the second region (312) of the display (310). For example, depending on the field of view of the camera (320) and the size of the display (310), there may be multiple folding angles that allow the entire second region (312) of the display (310) to be positioned within the field of view of the camera (320). In this case, the processor (360) may set the largest folding angle among the plurality of folding angles to a designated angle, thereby allowing more time to pass until the electronic device (301) transitions from a state where the folding angle is the designated angle to a fully folded state. This may reduce the possibility that the user closes the electronic device (301) without recognizing that a foreign substance is placed on the display (310).

[0135] In operation 903, in one embodiment, the processor (360) may display a designated screen through the display (310) based on the folding angle being reduced below a designated angle.

[0136] In one embodiment, the processor (360) may display a designated screen (hereinafter referred to as a “designated screen”) through the display (310) based on the folding angle being reduced to a designated angle.

[0137] In one embodiment, the designated screen may include a screen having a single color (a single color). For example, the designated screen may be a screen having a single color, such as red, blue, or green. For example, the designated screen may be a screen having an achromatic color, such as white or gray. However, the designated screen is not limited to a screen having a single color. For example, the designated screen may include a screen having a certain pattern (e.g., a checkered pattern).

[0138] In one embodiment, the designated screen may be a screen containing a monochrome image.

[0139] In one embodiment, the processor (360) may adjust the brightness of the display (310) (e.g., the luminance of the display (310)) when displaying a specified screen through the display (310). For example, when the current luminance of the display (310) is less than or equal to about 30% of the maximum luminance, the processor (360) may increase the luminance of the display (310) to about 50% or more of the maximum luminance.

[0140] In operation 905, in one embodiment, the processor (360) may acquire an image related to the specified screen through the camera (320).

[0141] In one embodiment, the processor (360) can obtain an image including the specified screen through the camera (320). For example, the processor (360) can obtain the image by taking a picture of a monochrome screen displayed through the display (310) in operation 903 through the camera (321) (and the camera (322)). For example, the processor (360) can obtain an image including a monochrome screen displayed through the display (310) through the camera (321) (and the camera (322)) in a state where the electronic device (301) has a folding angle at a specified angle.

[0142] In operation 907, in one embodiment, the processor (360) can determine whether a foreign substance is present on the display (310) based on the degree of uniformity of the acquired image.

[0143] In one embodiment, the processor (360) may determine (or detect) whether there is a foreign substance on the second area (312) of the display (310) based on the uniformity of the image (hereinafter referred to as “first image”) acquired through operation 905.

[0144] In one embodiment, when a foreign substance is located in the second area (312) of the display (310), a shadow may occur in a portion corresponding to the foreign substance within the first image. When a foreign substance is not located in the second area (312) of the display (310), a shadow may not occur in a portion corresponding to the foreign substance within the first image. For example, as illustrated in FIG. 11, while the second area (312) of the display (310) displays a designated screen (1110) (e.g., a monochrome screen), the second area (312) of the display (310) may emit (or output) light (1131) for displaying the designated screen (1110). When a foreign substance (1120) exists on the second area (312) of the display (310), light emitted from a position corresponding to the position of the foreign substance (1120) in the second area (312) of the display (310) may be blocked (or reflected) by the foreign substance (1120). In the first image acquired through the camera (321), a portion corresponding to the portion where light (1131) is blocked by the foreign substance (1120) in the second area (312) of the display (310) may be darker than other portions. In one embodiment, in FIG. 11, lines (1011, 1012) may represent the field of view range of the camera (321).

[0145] In one embodiment, the operation of determining whether a foreign substance is present on the display (310) based on the uniformity of the first image may include determining whether a foreign substance is present on the display (310) based on whether a shadow is present within the first image.

[0146] In one embodiment, the processor (360) may determine that there is a foreign object on the display (310) based on the presence of a shadow within the first image. In one embodiment, the processor (360) may determine that there is no foreign object on the display (310) based on the absence of a shadow within the first image.

[0147] Hereinafter, with reference to FIGS. 12 and 13, an operation for checking whether a foreign substance exists on the display (310) based on the uniformity of the first image will be described in detail.

[0148] FIG. 12 is a flowchart (1200) illustrating a method for detecting a foreign substance according to one embodiment.

[0149] FIG. 13 is a drawing illustrating a method for detecting a foreign substance according to one embodiment.

[0150] Referring to FIGS. 12 and 13, in operation 1201, in one embodiment, the processor (360) may divide the acquired image (the first image) into a plurality of regions. For example, the processor (360) may divide (or distinguish, or classify) the first image (e.g., an image related to a designated screen acquired through operation 905) into a plurality of regions. For example, the processor (360) may divide the first image (e.g., an image related to a designated screen acquired through operation 905) into a plurality of regions. For example, the processor (360) may divide the first image (e.g., an image related to a designated screen acquired through operation 905) into 20 regions (e.g., 20 regions distinguished by 10 columns and 2 vertical rows), such as image 1 (1311) of reference numeral 1301 and image 2 (1312) of reference numeral 1302 of FIG. 13).

[0151] In one embodiment, the processor (360) may set the number of the plurality of regions differently depending on the size of the display (310) (e.g., the size of the second region (312) of the display (310)) and / or the accuracy set for foreign substance detection. For example, the processor (360) may set the number of the plurality of regions so that the number of the plurality of regions increases as the size of the display (310) increases. For example, the processor (360) may set the number of the plurality of regions so that the number of the plurality of regions increases as the accuracy of the operation of detecting whether a foreign substance is present on the display (310) is set higher.

[0152] In operation 1303, in one embodiment, the processor (360) may obtain a plurality of average RGB values ​​of each of the plurality of regions.

[0153] In one embodiment, the processor (360) may obtain an average RGB value from each of a plurality of regions (e.g., a plurality of regions segmented from the first image). For example, the processor (360) may obtain an average of RGB values ​​of region (1321) and obtain (e.g., calculate) an average of RGB values ​​of region (1322) in reference numeral 1301. In addition, the processor (360) may obtain an average of RGB values ​​from each of the remaining regions (e.g., 18 regions excluding region (1321) and region (1322).

[0154] In operation 1305, in one embodiment, the processor (360) may determine whether a foreign substance is present on the display (310) based on whether, among the plurality of regions (e.g., the plurality of regions of the first image), there is a region having an average RGB value lower than the average RGB value of other regions.

[0155] In one embodiment, at reference numeral 1301, image 1 (1311) may represent a first image acquired through the camera (320) when no foreign substance is present on the display (310) (e.g., the second area (312) of the display (310)). At reference numeral 1302, image 2 (1311) may represent a first image acquired through the camera (320) when a foreign substance is present on the display (310) (e.g., the second area (312) of the display (310)).

[0156] In one embodiment, when there is no foreign matter on the display (310) (e.g., the second region (312) of the display (310), there may not be a region among the plurality of regions that has an average RGB value lower than the average RGB value of other regions. For example, when a given screen includes a red image with RGB values ​​of (255, 0, 0), the average RGB values ​​of each of the plurality of regions (e.g., region (1321), region (1322)) of image 1 (1311) may all be about 80 to about 85.

[0157] In one embodiment, when a foreign substance exists on the display (310) (e.g., the second region (312) of the display (310), among the plurality of regions, there may exist a region having a lower average RGB value than the average RGB value of other regions. For example, when a given screen includes a red image with an RGB value of (255, 0, 0), among the plurality of regions of image 2 (1312), the average RGB values ​​of the regions (1311, 1322) that do not include a portion (1340) corresponding to the foreign substance may be about 80 to about 85, whereas the average RGB values ​​of each of the regions (1333, 1334, 1335, 1336, 1337) that include a portion (1340) corresponding to the foreign substance may be lower than the RGB value of about 80 to about 85, such as about 16.

[0158] In one embodiment, the processor (360) may determine that a foreign substance is present on the display (310) based on the presence of a region among the plurality of regions of the first image having a lower average RGB value than the average RGB value of other regions. The processor (360) may determine that a foreign substance is not present on the display (310) based on the absence of a region among the plurality of regions of the first image having a lower average RGB value than the average RGB value of other regions.

[0159] In one embodiment, the processor (360) may determine whether a foreign substance is present on the display (310) based on whether the average RGB values ​​of each of the plurality of regions of the first image are uniform (or substantially the same). For example, the processor (360) may determine that no foreign substance is present on the display (310) if the average RGB values ​​of each of the plurality of regions of the first image are substantially the same. The processor (360) may determine that a foreign substance is present on the display (310) if at least some of the average RGB values ​​of each of the plurality of regions of the first image are not substantially the same.

[0160] In one embodiment, the processor (360) can determine the number of regions among a plurality of regions of the first image that have an average RGB value lower than the average RGB values ​​of other regions. The processor (360) can determine whether a foreign substance exists on the display (310) based on whether the determined number is equal to or greater than a specified number (e.g., 1). For example, the processor (360) can determine that a foreign substance exists on the display (310) based on whether the determined number is equal to or greater than a specified number (e.g., 1). The processor (360) can determine that no foreign substance exists on the display (310) based on whether the determined number is less than a specified number (e.g., 1).

[0161] In one embodiment, although FIG. 12 illustrates a method of determining whether a foreign substance exists on the display (310) by using a plurality of regions segmented from the first image, the present invention is not limited thereto. For example, the processor (360) may obtain RGB values ​​(or averages of RGB values) of each of a plurality of pixels included in the first image without segmenting the first image into a plurality of regions. The processor (360) may determine whether a foreign substance exists on the display (310) based on whether there is a pixel among the acquired RGB values ​​that has a lower RGB value than other RGB values ​​(or whether the number of pixels among the acquired RGB values ​​that have a lower RGB value than other RGB values ​​is equal to or greater than a specified number).

[0162] In one embodiment, although FIG. 12 illustrates, but is not limited to, determining whether a foreign substance exists on the display (310) based on a plurality of average RGB values ​​of each of a plurality of regions of the first image. For example, the processor (360) may determine whether a foreign substance exists on the display (310) based on at least one of average brightness values, average saturation values, or average color values ​​of each of a plurality of regions of the first image, instead of or in addition to the average RGB values. The operation of determining whether a foreign substance exists on the display (310) based on at least one of average brightness values, average saturation values, or average color values ​​of each of a plurality of regions of the first image is at least partially the same as or similar to the operation of determining whether a foreign substance exists on the display (310) based on a plurality of average RGB values ​​of each of a plurality of regions of the first image, and therefore, a detailed description thereof will be omitted.

[0163] In one embodiment, although the examples described above illustrate that the first image is an image having at least one of an R value, a G value, or a B value, the present invention is not limited thereto. For example, the first image may be a black and white image having achromatic colors. For example, the first image may be an image acquired through a black and white camera as the camera (320), when the camera (320) is a black and white camera (e.g., a camera that does not include a color filter).

[0164] Referring back to FIG. 9, in one embodiment, the processor (360) may output information indicating the presence of a foreign substance on the display (310) based on determining that a foreign substance is present on the display (310). For example, the processor (360) may output information indicating the presence of a foreign substance on the display (310) through a speaker (e.g., an audio output module (155)) based on determining that a foreign substance is present on the display (310). For example, the processor (360) may output a vibration corresponding to the information indicating the presence of a foreign substance on the display (310) through a haptic module (e.g., a haptic module (179)) based on determining that a foreign substance is present on the display (310). For example, based on determining that a foreign substance exists on the display (310), the processor (360) may output information indicating that a foreign substance exists on the display (310) or a screen indicating that a foreign substance exists on the display (310) (e.g., a red screen blinking on the display (310)) through the display (310).

[0165] In one embodiment, the processor (360) may output information indicating the presence of a foreign substance on the display (310), and then terminate at least some of the operations of FIG. 9 based on a user input. For example, the processor (360) may display a screen (e.g., a window) through the display (310) that includes information indicating the presence of a foreign substance on the display (310) and an object (e.g., an icon, a button) for confirming whether the user recognizes the presence of the foreign substance on the display (310). The processor (360) may terminate the operation of displaying a designated screen through the display (310) in operation 903 and / or the operation of controlling the plurality of magnets (340) (e.g., the operation of turning the plurality of electromagnets on) based on the user input for the object.

[0166] In one embodiment, although not illustrated in FIG. 9, the processor (360) may control the plurality of magnets (340) (e.g., one or more electromagnets) to generate a repulsive force between the plurality of magnets (340) based on the folding angle being reduced below a specified angle. For example, the processor (360) may generate a repulsive force between the plurality of magnets (340) such that, when a user continuously applies the same force (e.g., torque) to the electronic device (301) to close the electronic device (301), the speed at which the folding angle is reduced after the folding angle is below a specified angle is lower than before the folding angle is reduced below a specified angle. For example, when a user continuously applies the same force (e.g., torque) to the electronic device (301) to close the electronic device (301), the processor (360) may generate a repulsive force between the plurality of magnets (340) so that the electronic device (301) closes more slowly after the folding angle becomes less than or equal to a specified angle than before the folding angle becomes less than or equal to a specified angle. However, the present invention is not limited thereto. For example, the processor (360) may control the hydraulic pressure of the hinge portion or the motor of the hinge portion to slowly close the electronic device (301) after the folding angle becomes less than or equal to a specified angle.

[0167] In one embodiment, the processor (360) may terminate at least some of the operations of FIG. 9 based on determining that no foreign matter exists on the display (310). For example, the processor (360) may terminate the operation of displaying a designated screen through the display (310) in operation 903 based on determining that no foreign matter exists on the display (310). For example, the processor (360) may terminate the operation of controlling the plurality of magnets (340) (e.g., performing an operation of turning off the plurality of electromagnets) based on determining that no foreign matter exists on the display (310).

[0168] In one embodiment, the electronic device (301) can obtain an image of the entire second area (312) of the display (310) by using a camera (321) positioned below the first area (311) of the display (310).

[0169] In one embodiment, the electronic device (301) displays a screen through the display (310) in a state where the folding angle of the electronic device (301) is a specified angle, and acquires an image of the displayed screen using the camera (320), thereby enabling the electronic device (301) to determine whether a foreign substance exists on the display (310) without being affected by ambient illumination.

[0170] FIG. 14 is a flowchart (1400) illustrating a method for detecting a foreign substance according to one embodiment.

[0171] Referring to FIG. 14, in operation 1401, in one embodiment, the processor (360) may detect, through the sensor (330), that the folding angle formed by the first housing and the second housing is reduced below a designated angle (hereinafter referred to as “designated first angle”).

[0172] Since operation 1401 is at least partially identical or similar to operation 901 of FIG. 9, a detailed description thereof will be omitted.

[0173] In operation 1403, in one embodiment, the processor (360) may determine whether the rate at which the folding angle decreases is greater than or equal to a specified rate (hereinafter referred to as “specified rate”) based on the folding angle decreasing to a specified angle (specified first angle) or less in operation 1401.

[0174] In one embodiment, the processor (360) may determine whether the folding angle has been reduced by a specified second angle (hereinafter referred to as the “specified second angle”) or more before the folding angle is reduced to the specified first angle, if the folding angle has been reduced to a specified first angle of about 60 degrees after the folding angle has been reduced. For example, the processor (360) may determine whether the folding angle has been reduced by a specified second angle of about 30 degrees or more before the folding angle is reduced to about 60 degrees, if the folding angle has been reduced to a specified first angle of about 60 degrees.

[0175] In one embodiment, the processor (360) may determine a rate at which the folding angle decreases (e.g., a rate at which the folding angle decreases) while the folding angle decreases by a specified second angle (e.g., about 30 degrees). For example, the processor (360) may determine an average angular velocity of the folding angle while the folding angle decreases by a specified second angle of about 30 degrees or more. However, the present invention is not limited thereto. For example, the processor (360) may determine an instantaneous angular velocity of the folding angle at a point in time when the folding angle becomes a specified first angle of about 60 degrees after the folding angle decreases by a specified second angle of about 30 degrees or more.

[0176] In one embodiment, the processor (360) may compare a rate at which the folding angle decreases by a specified second angle or more (e.g., the average angular velocity or the instantaneous angular velocity of the folding angle) with a specified rate (e.g., the specified angular velocity).

[0177] In operation 1405, in one embodiment, the processor (360) may control one or more of the plurality of magnets (340) to generate a repulsive force between the plurality of magnets (340) based on the rate at which the folding angle decreases in operation 1403 being greater than or equal to a specified rate.

[0178] In one embodiment, the processor (360) may control one or more of the plurality of magnets (340) to prevent the electronic device (301) from being completely folded (or to prevent the electronic device (301) from being completely folded) by a repulsive force generated between the plurality of magnets (340) based on the speed at which the folding angle is reduced being greater than a specified speed.

[0179] In operation 1407, in one embodiment, the processor (360) may output a notification that prompts (or requests) the user to check whether a foreign substance exists on the display (310) based on the speed at which the folding angle decreases being greater than or equal to a specified speed. For example, the processor (360) may output a notification prompting the user to check whether a foreign substance exists on the display (310) through a speaker (e.g., an audio output module (155)) based on the speed at which the folding angle decreases being greater than or equal to a specified speed. For example, the processor (360) may output a vibration corresponding to the notification prompting the user to check whether a foreign substance exists on the display (310) through a haptic module (e.g., a haptic module (179)) based on the speed at which the folding angle decreases being greater than or equal to a specified speed. For example, the processor (360) may display a notification through the display (310) to prompt the user to check whether a foreign substance is present on the display (310) based on the speed at which the folding angle decreases being greater than a specified speed.

[0180] In one embodiment, the processor (360) may output a notification prompting the user to check whether a foreign substance is present on the display (310), and then terminate operation 1405 based on a user input. For example, the processor (360) may display a screen (e.g., a window) including an object (e.g., an icon, a button) for confirming whether the user recognizes the presence of a foreign substance on the display (310) along with a notification prompting the user to check whether a foreign substance is present on the display (310), through the display (310). The processor (360) may terminate an operation of controlling one or more magnets (e.g., an operation of turning on one or more of the plurality of electromagnets) of operation 1405 (e.g., an operation of turning off one or more of the plurality of electromagnets) based on the user input for the object.

[0181] In one embodiment, if the speed at which the folding angle is reduced is greater than or equal to a specified speed before the folding angle is reduced to a specified first angle, the electronic device (301) may be closed more quickly. In this case, the processor (360) may prevent the electronic device (301) from closing without the user checking whether a foreign substance is present on the display (310) by generating a repulsive force between the plurality of magnets (340) using one or more of the plurality of magnets (340).

[0182] In operation 1409, in one embodiment, the processor (360) may display a designated screen through the display (310) based on the speed at which the folding angle decreases being less than a designated speed.

[0183] Since operation 1409 is at least partially identical or similar to operation 903 of FIG. 9, a detailed description thereof will be omitted.

[0184] In operation 1411, in one embodiment, the processor (360) may acquire an image related to the specified screen through the camera (320).

[0185] Since operation 1411 is at least partially identical or similar to operation 905 of FIG. 9, a detailed description thereof will be omitted.

[0186] In operation 1413, in one embodiment, the processor (360) can determine whether a foreign substance is present on the display (310) based on the degree of uniformity of the acquired image.

[0187] Since operation 1413 is at least partially identical or similar to operation 907 of FIG. 9, a detailed description thereof will be omitted.

[0188] If it is confirmed that a foreign substance exists on the display (310) in operation 1413, in one embodiment, in operation 1415, the processor (360) may output a notification indicating that a foreign substance exists on the display (310) based on the confirmation that a foreign substance exists on the display (310). For example, the processor (360) may output information indicating that a foreign substance exists on the display (310) through a speaker (e.g., an audio output module (155)) based on the confirmation that a foreign substance exists on the display (310). For example, the processor (360) may output a vibration corresponding to information indicating that a foreign substance exists on the display (310) through a haptic module (e.g., a haptic module (179)) based on the confirmation that a foreign substance exists on the display (310). For example, based on determining that a foreign substance exists on the display (310), the processor (360) may output information indicating that a foreign substance exists on the display (310) or a screen indicating that a foreign substance exists on the display (310) (e.g., a red screen blinking on the display (310)) through the display (310).

[0189] In one embodiment, the processor (360) may output information indicating the presence of a foreign substance on the display (310), and then terminate at least some of the operations of FIG. 14 based on a user input. For example, the processor (360) may display a screen (e.g., a window) through the display (310) that includes information indicating the presence of a foreign substance on the display (310) and an object (e.g., an icon, a button) for confirming whether the user recognizes the presence of the foreign substance on the display (310). The processor (360) may terminate the operation of displaying a designated screen through the display (310) in operation 1409 and / or the operation of controlling the plurality of magnets (340) (e.g., the operation of turning the plurality of electromagnets on) based on the user input for the object.

[0190] In one embodiment, although not shown in FIG. 14, the processor (360) may control the plurality of magnets (340) (e.g., one or more electromagnets) to generate a repulsive force between the plurality of magnets (340) based on the folding angle being reduced below a specified angle.

[0191] If it is not confirmed that a foreign substance exists on the display (310) in operation 1413, the processor (360) may terminate at least some of the operations of FIG. 14. For example, the processor (360) may terminate the operation of displaying a designated screen through the display (310) in operation 1409 based on confirming that no foreign substance exists on the display (310). For example, the processor (360) may terminate the operation of controlling the plurality of magnets (340) (e.g., may perform an operation of turning off the plurality of electromagnets) based on confirming that no foreign substance exists on the display (310).

[0192] An electronic device (301) according to one embodiment may include a housing including a first housing (410) and a second housing (420), a hinge part (430) that allows the first housing (410) and the second housing (420) to rotate, a display (310), a camera (320), a sensor (330) disposed in the first housing (410) and the second housing (420), at least one processor (360) including a processing circuit, and a memory (240) that stores instructions. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to detect, through the sensor (330), that a folding angle formed by the first housing (410) and the second housing (420) is reduced to a specified angle or less. The above commands, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to display a designated screen through the display (310) based on the folding angle being reduced below a designated angle. The above commands, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to acquire an image related to the designated screen through the camera (320). The above commands, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to determine whether a foreign substance is present on the display (310) based on a uniformity of the acquired image.

[0193] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to display the designated screen through an area disposed in the second housing (420) within the display (310) based on the folding angle being reduced below a designated angle. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to acquire an image related to the designated screen through the camera (320) disposed in the first housing (410).

[0194] In one embodiment, the camera (320) may include an under display camera (UDC) positioned below an area disposed in the first housing (410) within the display (310) and / or at least one camera positioned in the first housing (410).

[0195] In one embodiment, the camera (320) may be a camera including a lens tilted at a certain angle with respect to the first housing (410).

[0196] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to divide the acquired image into a plurality of regions. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to obtain a plurality of average RGB values ​​of each of the plurality of regions. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to determine whether a foreign substance is present on the display (310) based on whether, among the plurality of regions, there is a region having a lower average RGB value than the average RGB value of another region.

[0197] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to determine the number of regions among the plurality of regions having an average RGB value lower than an average RGB value of other regions. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to determine whether a foreign substance is present on the display (310) based on whether the determined number is greater than or equal to a specified number.

[0198] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to output information indicating the presence of a foreign substance on the display (310) based on determining the presence of a foreign substance on the display (310).

[0199] In one embodiment, the electronic device (301) may further include a plurality of magnets (340). The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to determine whether a rate at which the folding angle is reduced is greater than or equal to a specified rate, based on the folding angle being reduced below a specified angle. The instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to control one or more of the plurality of magnets (340) so as to prevent the electronic device (301) from being completely folded, based on the rate at which the folding angle is reduced is greater than or equal to the specified rate.

[0200] In one embodiment, the instructions, when individually or collectively executed by the at least one processor (250), may cause the electronic device (201) to display the specified screen through the display (310) based on a rate at which the folding angle decreases being less than the specified rate.

[0201] In one embodiment, the specified angle may be an angle set based on the angle of view of the camera (320) and the size of the display (310). The specified screen may include a monochrome screen.

[0202] A method for detecting a foreign substance in an electronic device (301) according to one embodiment may include an operation of detecting, through a sensor (330) of the electronic device (301), that a folding angle formed by a first housing (410) and a second housing (420) of the electronic device (301) is reduced to a specified angle or less. The method may include an operation of displaying a specified screen through a display (310) of the electronic device (301) based on the reduction of the folding angle to a specified angle or less. The method may include an operation of acquiring an image related to the specified screen through a camera (320) of the electronic device (301). The method may include an operation of determining, based on uniformity of the acquired image, whether a foreign substance exists on the display (310).

[0203] In one embodiment, the operation of displaying a designated screen through the display (310) of the electronic device (301) may include an operation of displaying the designated screen through an area disposed in the second housing (420) within the display (310) based on the folding angle being reduced below a designated angle. The operation of obtaining an image related to the designated screen through the camera (320) of the electronic device (301) may include an operation of obtaining an image related to the designated screen through the camera (320) disposed in the first housing (410).

[0204] In one embodiment, the camera (320) may include an under display camera (UDC) positioned below an area disposed in the first housing (410) within the display (310) and / or at least one camera positioned in the first housing (410).

[0205] In one embodiment, the camera (320) may be a camera including a lens tilted at a certain angle with respect to the first housing (410).

[0206] In one embodiment, the operation of determining whether a foreign substance exists on the display (310) may include an operation of dividing the acquired image into a plurality of regions. The operation of determining whether a foreign substance exists on the display (310) may include an operation of obtaining a plurality of average RGB values ​​of each of the plurality of regions. The operation of determining whether a foreign substance exists on the display (310) may include an operation of determining whether a foreign substance exists on the display (310) based on whether, among the plurality of regions, a region exists that has a lower average RGB value than the average RGB value of other regions.

[0207] In one embodiment, the operation of determining whether a foreign substance exists on the display (310) may include determining the number of regions among the plurality of regions that have an average RGB value lower than the average RGB value of other regions. The operation of determining whether a foreign substance exists on the display (310) may include determining whether a foreign substance exists on the display (310) based on whether the determined number is equal to or greater than a specified number.

[0208] In one embodiment, the method may further include an operation of outputting information indicating the presence of a foreign substance on the display (310) based on determining that a foreign substance is present on the display (310).

[0209] In one embodiment, the method may further include an operation of determining whether the rate at which the folding angle is reduced is greater than or equal to a specified rate, based on the folding angle being reduced below a specified rate. The method may further include an operation of controlling one or more of the plurality of magnets (340) of the electronic device (301) so as to prevent the electronic device (301) from being completely folded, based on the rate at which the folding angle is reduced being greater than or equal to the specified rate.

[0210] In one embodiment, the method may further include an operation of displaying the designated screen through the display (310) based on the speed at which the folding angle decreases being less than the designated speed.

[0211] In one embodiment, the specified angle may be an angle set based on the angle of view of the camera (320) and the size of the display (310). The specified screen may include a monochrome screen.

[0212] In one embodiment, a non-transitory computer-readable storage medium having computer-executable instructions recorded thereon may cause the computer-executable instructions, when individually or collectively executed by at least one processor (250) of an electronic device (201), to cause the electronic device (201) to detect, through a sensor (330) of the electronic device (301), that a folding angle formed by a first housing (410) and a second housing (420) of the electronic device (301) is reduced to or below a specified angle. When individually or collectively executed by at least one processor (250) of the electronic device (201), to cause the electronic device (201) to display a specified screen through a display (310) of the electronic device (301) based on that the folding angle is reduced to or below the specified angle. When executed individually or collectively by at least one processor (250) of the electronic device (201), the electronic device (201) may cause the electronic device (201) to acquire an image related to the designated screen through the camera (320) of the electronic device (301). When executed individually or collectively by at least one processor (250) of the electronic device (201), the electronic device (201) may cause the electronic device (201) to determine whether a foreign substance is present on the display (310) based on the uniformity of the acquired image.

[0213] Additionally, the structure of the data used in the embodiments of the present disclosure described above can be recorded on a computer-readable recording medium through various means. The computer-readable recording medium includes storage media such as magnetic storage media (e.g., ROM, floppy disk, hard disk, etc.) and optical reading media (e.g., CD-ROM, DVD, etc.).

Claims

1. In an electronic device (301), A housing comprising a first housing (410) and a second housing (420); A hinge part (430) that allows the first housing (410) and the second housing (420) to rotate; A display (310) placed in the first housing (410) and the second housing (420); Camera (320); Sensor (330); At least one processor (360) comprising a processing circuit; and Contains a memory (240) for storing commands, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: Through the above sensor (330), it is detected that the folding angle formed by the first housing (410) and the second housing (420) is reduced below a specified angle, Based on the folding angle being reduced below a specified angle, a specified screen is displayed through the display (310), Obtaining an image related to the designated screen through the above camera (320), and An electronic device (301) configured to determine whether a foreign substance exists on the display (310) based on the degree of uniformity of the acquired image.

2. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: Based on the folding angle being reduced below a specified angle, the specified screen is displayed through an area disposed in the second housing (420) within the display (310), and An electronic device (301) configured to obtain an image related to the designated screen through the camera (320) disposed in the first housing (410).

3. In paragraph 1 or 2, The above camera (320) is an electronic device (301) including an under display camera (UDC) positioned below an area positioned in the first housing (410) within the display (310) and / or at least one camera positioned in the first housing (410).

4. In any one of paragraphs 1 to 3, The above camera (320) is an electronic device (301) that is a camera including a lens tilted at a certain angle with respect to the first housing (410).

5. In any one of paragraphs 1 to 4, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: Divide the above acquired image into multiple regions, Obtaining multiple average RGB values ​​of each of the multiple regions, and An electronic device (301) configured to determine whether a foreign substance exists on the display (310) based on whether, among the plurality of regions, there exists a region having a lower average RGB value than the average RGB values ​​of other regions.

6. In any one of paragraphs 1 to 5, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: Among the above multiple regions, the number of regions having an average RGB value lower than the average RGB value of other regions is determined, and An electronic device (301) configured to determine whether a foreign substance exists on the display (310) based on whether the above-determined number is greater than or equal to a specified number.

7. In any one of paragraphs 1 to 6, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: An electronic device (301) configured to output information indicating the presence of a foreign substance on the display (310) based on confirmation that a foreign substance exists on the display (310).

8. In any one of paragraphs 1 to 7, Including a plurality of magnets (340), The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: Based on the folding angle being reduced below a specified angle, it is determined whether the speed at which the folding angle is reduced is greater than a specified speed, and An electronic device (301) configured to control one or more of the plurality of magnets (340) so that the electronic device (301) is not completely folded based on a speed at which the folding angle decreases being greater than or equal to the specified speed.

9. In any one of paragraphs 1 to 8, The above instructions, when individually or collectively executed by the at least one processor (250), cause the electronic device (201) to: An electronic device (301) configured to display the designated screen through the display (310) based on the speed at which the folding angle decreases being less than the designated speed.

10. In any one of paragraphs 1 to 9, The above specified angle is an angle set based on the angle of view of the camera (320) and the size of the display (310), and The above-mentioned screen is an electronic device (301) including a monochrome screen.

11. A method for detecting a foreign substance in an electronic device (301), An operation of detecting, through the sensor (330) of the electronic device (301), that the folding angle formed by the first housing (410) and the second housing (420) of the electronic device (301) is reduced to a specified angle or less; An operation of displaying a designated screen through the display (310) of the electronic device (301) based on the folding angle being reduced below a designated angle; An operation of acquiring an image related to the specified screen through the camera (320) of the electronic device (301); and A method including an operation of determining whether a foreign substance exists on the display (310) based on the uniformity of the acquired image.

12. In paragraph 11, The operation of displaying a designated screen through the display (310) of the above electronic device (301) is as follows: An operation of displaying the designated screen through an area disposed in the second housing (420) within the display (310) based on the folding angle being reduced below a designated angle, and The operation of obtaining an image related to the specified screen through the camera (320) of the electronic device (301) is as follows: A method including an operation of obtaining an image related to the designated screen through the camera (320) disposed in the first housing (410).

13. In clause 11 or 12, A method in which the above camera (320) includes an under display camera (UDC) positioned below an area positioned in the first housing (410) within the display (310) and / or at least one camera positioned in the first housing (410).

14. In any one of paragraphs 11 to 13, A method in which the above camera (320) is a camera including a lens tilted at a certain angle with respect to the first housing (410).

15. A non-transitory computer-readable storage medium having computer-executable instructions recorded thereon, wherein the computer-executable instructions, when individually or collectively executed by at least one processor (250) of an electronic device (201), cause the electronic device (201) to: Through the sensor (330) of the electronic device (301), it is detected that the folding angle formed by the first housing (410) and the second housing (420) of the electronic device (301) is reduced to a specified angle or less, Based on the folding angle being reduced below a specified angle, a specified screen is displayed through the display (310) of the electronic device (301), Obtaining an image related to the designated screen through the camera (320) of the electronic device (301), and A non-transitory computer-readable storage medium that causes a determination of whether a foreign substance exists on the display (310) based on the uniformity of the acquired image.

Images