Method and device for displaying conversion image generated from target image

Abstract

This electronic device may comprise: a display; at least one processor; and a memory for storing instructions, wherein the instructions, when executed by the at least one processor, cause the electronic device to: detect a plurality of candidate objects from a plurality of images; determine a first classification result of the plurality of candidate objects on the basis of a user input for a first display condition; determine a second classification result of the plurality of candidate objects on the basis of a user input for a second display condition; generate a first conversion image corresponding to the first display condition by applying the first classification result to a target image; generate a second conversion image corresponding to the second display condition by applying the second classification result to the target image; display the first conversion image while the electronic device satisfies the first display condition; and display the second conversion image while the electronic device satisfies the second display condition.

Description

Method and device for displaying a transformed image generated from a target image

[0001] Example embodiments may relate to techniques for displaying a transformed image generated from a transformed image.

[0002] Electronic devices automatically provide features like stories and collages, which are bundles of media based on a user's personal library, to enhance the user experience. For example, when a user takes a large number of photos with a camera, the data can be kept secure by storing copies of the photos on a server (e.g., cloud storage). To enhance the service's usability, the server can provide the user with a photo set containing at least one photo based on criteria such as date, location, or person related to the stored photos. While users may sign up for a service with the intention of safely storing their data (e.g., photos), the server may provide benefits that exceed their expectations. This can lead to a positive impression of the service and encourage continued use.

[0003] The above information may be provided as background information to aid in understanding this document. None of the above is claimed to be prior art related to this document or can be used to determine prior art.

[0004] According to various exemplary embodiments, an electronic device includes: a display; a processor including processing circuitry; And a memory storing instructions, wherein when the instructions are executed by the at least one processor, the electronic device detects a plurality of candidate objects from a plurality of images, and determines a first classification result by classifying at least one of the plurality of candidate objects as an object of interest or an object of non-interest based on a user input for a first display condition regarding at least one of a device displaying an image, an area of ​​a display of the device in which the image is displayed, or a time at which the image is displayed, and determines a second classification result by classifying at least one of the plurality of candidate objects as an object of interest or an object of non-interest based on a user input for a second display condition, and generates a first conversion image corresponding to the first display condition by retaining the object of interest of the first classification result and excluding the object of non-interest of the first classification result in the target image, and corresponding to the second display condition by retaining the object of interest of the second classification result and excluding the object of non-interest of the second classification result in the target image. A second converted image can be generated, and while the electronic device satisfies the first display condition, the first converted image can be displayed, and while the electronic device satisfies the second display condition, the second converted image can be displayed.

[0005] According to various exemplary embodiments, a method performed by an electronic device comprises: detecting a plurality of candidate objects from a plurality of images; determining a first classification result by classifying at least one of the plurality of candidate objects as an object of interest or an object of non-interest based on a user input for a first display condition regarding at least one of a device for displaying an image, an area of ​​a display of the device in which the image is displayed, or a time at which the image is displayed; determining a second classification result by classifying at least one of the plurality of candidate objects as an object of interest or an object of non-interest based on a user input for a second display condition; generating a first conversion image corresponding to the first display condition by retaining the object of interest of the first classification result and excluding the object of non-interest of the first classification result in a target image; generating a second conversion image corresponding to the second display condition by retaining the object of interest of the second classification result and excluding the object of non-interest of the second classification result in the target image; The method may include: displaying the first converted image while the electronic device satisfies the first display condition; and displaying the second converted image while the electronic device satisfies the second display condition.

[0006] FIG. 1 is a block diagram illustrating an exemplary configuration of an electronic device according to various exemplary embodiments.

[0007] FIG. 2A is a diagram illustrating an unfolded state of an electronic device according to various exemplary embodiments of the present disclosure.

[0008] FIG. 2b is a diagram illustrating a folded state of an electronic device according to various exemplary embodiments of the present disclosure.

[0009] FIG. 2C is a perspective view illustrating an example of a fully unfolded state of an electronic device according to various exemplary embodiments of the present disclosure.

[0010] FIG. 2D is a perspective view illustrating an example of a partially unfolded intermediate state (also referred to herein as an “intermediate state”) of an electronic device according to various exemplary embodiments of the present disclosure.

[0011] FIGS. 3A, 3B, 3C, and 3D are drawings illustrating a fully unfolded state, a partially unfolded intermediate state, and a fully folded state of an electronic device according to various exemplary embodiments.

[0012] FIG. 4 illustrates a block diagram of an electronic device according to various exemplary embodiments.

[0013] FIG. 5 is a flowchart illustrating an example of a method for an electronic device to generate and display a converted image according to display conditions according to various exemplary embodiments.

[0014] FIG. 6 is a diagram illustrating an example of a classification setting interface for an electronic device to determine a classification result according to various exemplary embodiments.

[0015] FIG. 7 is a diagram illustrating an example of an operation of an electronic device highlighting a specific graphical representation in a classification setting interface according to various exemplary embodiments.

[0016] FIG. 8 is a diagram illustrating an example of an operation of an electronic device selecting a transformation image from a target image based on a classification result according to various exemplary embodiments.

[0017] FIG. 9 is a diagram illustrating an example of an operation of an electronic device selecting a transformation image from a target image based on a classification result according to various exemplary embodiments.

[0018] FIG. 10 is a diagram illustrating an example of an operation of an electronic device according to various exemplary embodiments to display converted images according to display conditions regarding an area in which an image is displayed during a display.

[0019] FIG. 11 is a diagram illustrating an example of an operation of an electronic device according to various exemplary embodiments to display converted images according to display conditions regarding the time at which the images are displayed.

[0020] FIG. 12 is a diagram illustrating an example of an operation of an electronic device displaying converted images according to display conditions for a device displaying images according to various exemplary embodiments.

[0021] FIG. 13 is a block diagram illustrating an example configuration of an electronic device according to various exemplary embodiments.

[0022] FIG. 14 is a block diagram illustrating an example configuration of an electronic device according to various exemplary embodiments.

[0023] Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the attached drawings, identical components are assigned the same reference numerals regardless of the drawing numbers, and redundant descriptions thereof will be omitted.

[0024] FIG. 1 is a block diagram illustrating an exemplary configuration of an electronic device according to various embodiments.

[0025] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108).

[0026] According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display (160), an audio module (170), a sensor (176), an interface (177), a connection terminal (178), a haptic module (179), a camera (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor (176), the camera (180), or the antenna module (197)) may be integrated into one component (e.g., the display (160)).

[0027] The processor (120) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing. The processor (120) may include at least one electrical circuit and may individually or collectively perform distributed processing of instructions (or programs (140), data, etc.) stored in the memory (130). The processor (120) may include a processor assembly including one or more processing circuits. The processor (120) may include any processing circuit operative to control the performance and operations of one or more components of the electronic device (100) (e.g., the memory (130), the display (160), the camera (180), the communication circuit (190), and / or the sensor (176)). Here, each “processor” may include a processing circuit and / or multiple processors. For example, as used herein, including in the claims, the term "processor" may include various processing circuits, including at least one processor, one or more of which may be configured to perform the various functions described herein, collectively and / or individually, in a distributed manner. As used herein, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform numerous functions, these terms may cover situations, such as, but not limited to, situations where one processor performs some of the listed functions, other processor(s) perform other of the listed functions, and situations where a single processor performs all of the listed functions.Additionally, at least one processor may comprise a combination of processors that perform various listed / described functions, for example, in a distributed manner. At least one processor may execute program instructions to perform or achieve various functions.

[0028] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) directly or indirectly connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor (176) or a communication module (190)) in the volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in the non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0029] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display (160), a sensor (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0030] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0031] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0032] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0033] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0034] A display (160) (e.g., a display) can visually provide information to an external device (e.g., a user) of the electronic device (101). The display (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0035] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0036] The sensor (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor (176) may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor. For example, the sensor (176) may include an inertial measurement unit (IMU).

[0037] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0038] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0039] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0040] The camera (180) can capture still images and moving images. In one embodiment, the camera (180) may include one or more lenses, one or more image sensors, one or more image signal processors, or one or more flashes.

[0041] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0042] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0043] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication circuits. The communication module (190) may include one or more communication processors (CPs) that operate independently from the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data relation association)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as a plurality of separate components (e.g., multiple chips).The wireless communication module (192) can verify or authenticate an electronic device (101) within a communication network, such as a first network (198) or a second network (199), using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0044] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0045] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0046] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0047] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0048] According to one embodiment, commands or data may be transmitted or received between an electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199).

[0049] Each of the external electronic devices (102, 104) and the server (108) may be the same type of device as or different from the electronic device (101). According to one embodiment, all or part of the operations executed by the electronic device (101) may be executed by one or more of the external electronic devices (102, 104) or the server (108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of executing the function or service itself or in addition, request one or more external electronic devices to execute at least a part of the function or service. The one or more external electronic devices that receive the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a part of a response to the request.

[0050] FIG. 2A is a diagram illustrating an unfolded state of an electronic device (200) according to various embodiments of the present disclosure. FIG. 2B is a diagram illustrating a folded state of an electronic device (200) according to various embodiments of the present disclosure. FIG. 2C is a perspective view illustrating an example of a fully unfolded state of an electronic device (200) according to various embodiments of the present disclosure. FIG. 2D is a perspective view illustrating an example of a partially unfolded intermediate state (also referred to as an 'intermediate state' herein) of an electronic device (200) according to various embodiments of the present disclosure.

[0051] The electronic device (200) of FIGS. 2A, 2B, 2C, and 2D may be a foldable or bendable electronic device, as an example of the electronic device (101) illustrated in FIG. 1.

[0052] The drawings of FIGS. 2c and 2d illustrate a spatial coordinate system defined by an X-axis, a Y-axis, and a Z-axis that are orthogonal to each other. Here, the X-axis may represent the width direction of the electronic device, the Y-axis may represent the length direction of the electronic device, and the Z-axis may represent the height (or thickness) direction of the electronic device. In the following description, the term "first direction" may mean a direction parallel to the Z-axis.

[0053] Referring to FIGS. 2A and 2B , in an exemplary embodiment, an electronic device (200) may include a foldable housing (201), and a flexible or foldable display (250) (hereinafter, simply referred to as “display” 250) (e.g., the display (160) of FIG. 1 ) disposed within a space formed by the foldable housing (201). According to an exemplary embodiment, a surface on which the display (250) is disposed (or a surface on which the display (250) is visible from the outside of the electronic device (200)) may be defined as a front surface of the electronic device (200). A surface opposite to the front surface may be defined as a rear surface of the electronic device (200). In addition, a surface surrounding the space between the front surface and the rear surface may be defined as a side surface of the electronic device (200). “Disposed” herein may cover something that is disposed directly or indirectly.

[0054] According to various embodiments, the foldable housing (201) may include a first housing structure (210), a second housing structure (220) including a sensor area (222), a first rear cover (215), a second rear cover (225), and a hinge structure (230). Here, the hinge structure (230) may include a hinge cover that covers a foldable portion of the foldable housing (201). The foldable housing (201) of the electronic device (200) is not limited to the shape and combination shown in FIGS. 2A and 2B, and may be implemented by a combination and / or combination of other shapes or parts. For example, in another embodiment, the first housing structure (210) and the first rear cover (215) may be formed integrally, and the second housing structure (220) and the second rear cover (225) may be formed integrally.

[0055] According to various embodiments, the first housing structure (210) may be directly or indirectly connected to the hinge structure (230) and may include a first side facing a first direction and a second side facing a second direction opposite to the first direction. The second housing structure (220) may be directly or indirectly connected to the hinge structure (230) and may include a third side facing a third direction and a fourth side facing a fourth direction opposite to the third direction. The second housing structure (220) may rotate about the hinge structure (230) with respect to the first housing structure (210). The electronic device (200) may be variable between a folded state and an unfolded state.

[0056] According to one embodiment, the electronic device (200) may have the first side facing the third side in a fully folded state, and the third direction may be the same as the first direction in a fully unfolded state.

[0057] According to various embodiments, the first housing structure (210) and the second housing structure (220) may be arranged on both sides with respect to the folding axis (A) as the center, and may have an overall symmetrical shape with respect to the folding axis A. As described below, the angle or distance between the first housing structure (210) and the second housing structure (220) may vary depending on whether the state of the electronic device (200) is an unfolded state, a folded state, or a partially unfolded (or partially folded) intermediate state. According to one embodiment, unlike the first housing structure (210), the second housing structure (220) additionally includes a sensor area (222) in which various sensors are arranged, but may have a mutually symmetrical shape in other areas.

[0058] According to various embodiments, as illustrated in FIG. 2A, the first housing structure (210) and the second housing structure (220) may together form a recess for accommodating the display (250). In one embodiment, due to the sensor area (222), the recess may have two or more different widths in a direction perpendicular to the folding axis (A). According to one embodiment, the recess may have a first width (w1) between a first portion (210a) of the first housing structure (210) that is parallel to the folding axis (A) and a first portion (220a) formed at the edge of the sensor area (222) of the second housing structure (220), and the recess may have a second width (w2) formed by a second portion (210b) of the first housing structure (210) and a second portion (220b) of the second housing structure (220) that is parallel to the folding axis (A) and does not correspond to the sensor area (222). In this case, the second width (w2) may be formed longer than the first width (w1). According to one embodiment, the first portion (220a) and the second portion (220b) of the second housing structure (220) may have different distances from the folding axis (A). The width of the recess is not limited to the illustrated example. In another embodiment, the recess may have multiple widths depending on the state of the sensor area (222) or the asymmetrical shape of the first housing structure (210) and the second housing structure (220). According to various embodiments, the sensor area (222) may be formed to have a predetermined (e.g., designated) area adjacent to one corner of the second housing structure (220). However, the arrangement, shape, and size of the sensor area (222) are not limited to the illustrated example. For example, in another embodiment, the sensor area (222) may be provided in another corner of the second housing structure (220) or in any area between the upper corner and the lower corner.In one embodiment, components for performing various functions built into the electronic device (200) may be exposed on the front of the electronic device (200) through the sensor area (222) or through one or more openings provided in the sensor area (222). In various embodiments, the components may include various types of sensors. The sensor may include, for example, at least one of a front camera, a receiver, or a proximity sensor. According to various embodiments, the sensor area (222) in the second housing structure (220) may be omitted or formed in a position different from that shown in the drawing.

[0059] According to various embodiments, at least a portion of the first housing structure (210) and the second housing structure (220) may be formed of a metallic or non-metallic material having a rigidity of a selected size to support the display (250). At least a portion formed of the metallic material may provide a ground plane of the electronic device (200) and may be electrically directly or indirectly connected to a ground line formed directly or indirectly on a printed circuit board disposed inside the foldable housing (201). "Formed" herein may cover both directly and indirectly formed.

[0060] According to various embodiments, the first rear cover (215) is disposed on one side of the folding axis (A) on the rear surface of the electronic device (200) and may have, for example, a substantially rectangular periphery, and the periphery may be wrapped by the first housing structure (210). Similarly, the second rear cover (225) is disposed on the other side of the folding axis (A) on the rear surface of the electronic device (200) and may have the periphery wrapped by the second housing structure (220). "Disposed" herein may directly or indirectly cover what is disposed.

[0061] According to various embodiments, the first rear cover (215) and the second rear cover (225) may have substantially symmetrical shapes with respect to the folding axis (A). However, the first rear cover (215) and the second rear cover (225) do not necessarily have mutually symmetrical shapes, and in other embodiments, the electronic device (200) may include the first rear cover (215) and the second rear cover (225) of various shapes. In yet other embodiments, the first rear cover (215) may be formed integrally with the first housing structure (210), and the second rear cover (225) may be formed integrally with the second housing structure (220).

[0062] According to various embodiments, the first rear cover (215), the second rear cover (225), the first housing structure (210), and the second housing structure (220) may form a space in which various components of the electronic device (200) (e.g., a printed circuit board or a battery) may be placed. According to one embodiment, one or more components may be placed or visually exposed on the rear surface of the electronic device (200). For example, at least a portion of the sub-display may be visually exposed through the first rear area (216) of the first rear cover (215). In another embodiment, one or more components or sensors may be visually exposed through the second rear area (226) of the second rear cover (225). In various embodiments, the sensors may include a proximity sensor and / or a rear camera.

[0063] According to various embodiments, a front camera exposed on the front side of the electronic device (200) through one or more openings provided in the sensor area (222) or a rear camera exposed through the second rear area (226) of the second rear cover (225) may include one or more lenses, an image sensor, and / or an image signal processor. A flash may include, for example, a light emitting diode or a xenon lamp. In various embodiments, two or more lenses (infrared camera, wide-angle and telephoto lenses) and image sensors may be arranged on one side of the electronic device (200).

[0064] Referring to FIG. 2B, the hinge cover may be configured to be disposed between the first housing structure (210) and the second housing structure (220) so as to cover an internal component (e.g., the hinge structure (230)). According to one embodiment, the hinge structure (230) may be covered by a portion of the first housing structure (210) and the second housing structure (220) or exposed to the outside depending on the state of the electronic device (200) (unfolded state, intermediate state, or folded state).

[0065] According to one embodiment, as illustrated in FIG. 2a, when the electronic device (200) is in an unfolded state (e.g., a fully unfolded state), the hinge structure (230) may not be exposed because it is covered by the first housing structure (210) and the second housing structure (220). As another example, as illustrated in FIG. 2b, when the electronic device (200) is in a folded state (e.g., a fully folded state), the hinge structure (230) may be exposed to the outside between the first housing structure (210) and the second housing structure (220). As another example, when the first housing structure (210) and the second housing structure (220) are in an intermediate state where they are folded at a certain angle, the hinge structure (230) may be partially exposed to the outside between the first housing structure (210) and the second housing structure (220). However, in this case, the exposed area may be less than that in the completely folded state. In one embodiment, the hinge structure (230) may include a curved surface.

[0066] According to various embodiments, the display (250) may be disposed on a space formed by the foldable housing (201). For example, the display (250) may be mounted on a recess formed by the foldable housing (201) and may be visible from the outside through the front of the electronic device (200). For example, the display (250) may comprise most of the front of the electronic device (200). Accordingly, the front of the electronic device (200) may include the display (250) and a portion of the first housing structure (210) adjacent to the display (250) and a portion of the second housing structure (220). And, the back of the electronic device (200) may include a first back cover (215), a portion of a first housing structure (210) adjacent to the first back cover (215), a second back cover (225), and a portion of a second housing structure (220) adjacent to the second back cover (225).

[0067] According to various embodiments, the display (250) may refer to a display in which at least a portion of the display can be transformed into a flat or curved surface. According to one embodiment, the display (250) may include a folding area (253), a first area (251) disposed on one side (e.g., the left side of the folding area (253) illustrated in FIG. 2A) with respect to the folding area (253), and a second area (252) disposed on the other side (e.g., the right side of the folding area (253) illustrated in FIG. 2A).

[0068] However, the division of regions of the display (250) illustrated in FIG. 2A is exemplary, and the display (250) may be divided into a plurality of regions (for example, four or more or two) depending on the structure or function. For example, in the embodiment illustrated in FIG. 2A, the regions of the display (250) may be divided by a folding region (253) extending parallel to the folding axis (A), but in other embodiments, the regions of the display (250) may be divided based on another folding axis (for example, a folding axis parallel to the width direction of the electronic device).

[0069] According to various embodiments of the present disclosure, the display (250) may be coupled with or disposed adjacent to a touch panel equipped with a touch detection circuit and a pressure sensor capable of measuring the intensity (pressure) of a touch. For example, the display (250) may be coupled with or disposed adjacent to a touch panel that detects an electromagnetic resonance (EMR) stylus pen, as an example of a touch panel.

[0070] According to various embodiments, the first region (251) and the second region (252) may have an overall symmetrical shape centered on the folding region (253). However, unlike the first region (251), the second region (252) may include a cut notch depending on the presence of the sensor region (222), but may have a shape symmetrical with respect to the first region (251) in other regions. For example, the first region (251) and the second region (252) may include a portion having a symmetrical shape and a portion having an asymmetrical shape.

[0071] According to various embodiments, the edge thicknesses of the first region (251) and the second region (252) may be formed differently from the edge thickness of the folding region (253). The edge thickness of the folding region (253) may be formed thinner than the thicknesses of the first region (251) and the second region (252). In terms of thickness, the first region (251) and the second region (252) may have an asymmetrical shape when the first region (251) and the second region (252) are viewed in cross-section. For example, the edge of the first region (251) may be formed to have a first radius of curvature, and the edge of the second region (252) may be formed to have a second radius of curvature that is different from the first radius of curvature. In another embodiment, the first region (251) and the second region (252) in terms of thickness may have a symmetrical shape when the first region (251) and the second region (252) are viewed in cross section.

[0072] Hereinafter, the operation of the first housing structure (210) and the second housing structure (220) and each area of ​​the display (250) according to the state of the electronic device (200) (e.g., folded state, unfolded state, or intermediate state) will be described.

[0073] According to various embodiments, when the electronic device (200) is in an unfolded state (e.g., FIG. 2a), the first housing structure (210) and the second housing structure (220) may be arranged to form an angle of 180 degrees and face the same direction. The surface of the first region (251) and the surface of the second region (252) of the display (250) may form an angle of 180 degrees with each other and face the same direction (e.g., toward the front of the electronic device). The folding region (253) may form the same plane as the first region (251) and the second region (252).

[0074] According to various embodiments, when the electronic device (200) is in a folded state (e.g., FIG. 2b), the first housing structure (210) and the second housing structure (220) may be arranged to face each other. The surface of the first region (251) and the surface of the second region (252) of the display (250) may form a narrow angle (e.g., between 0 and 10 degrees) with each other and may face each other. The folding region (253) may be formed as a curved surface having at least a portion of a predetermined curvature.

[0075] According to various embodiments, when the electronic device (200) is in an intermediate state, the first housing structure (210) and the second housing structure (220) may be arranged at a certain angle with respect to each other. The surface of the first region (251) and the surface of the second region (252) of the display (250) may form an angle that is greater than an angle in a folded state and less than an angle in an unfolded state. The folding region (253) may be formed as a curved surface having at least a portion of a predetermined curvature, and the curvature in this case may be less than that in a folded state.

[0076] FIG. 2c illustrates a fully unfolded state of the electronic device (200), and FIG. 2d may illustrate an intermediate state in which the electronic device (200) is partially unfolded. As described above, the electronic device (200) may be variable between a folded state and an unfolded state. According to one embodiment, the electronic device (200) may be folded in two ways, for example, in 'in-folding' in which the front surface of the electronic device (200) is folded to form an acute angle when viewed in the folding axis direction (e.g., the A-axis of FIG. 2a), and in 'out-folding' in which the front surface of the electronic device (200) is folded to form an obtuse angle. For example, in the electronic device (200), in a folded state in an in-folding manner, a first surface of the first housing structure (210) may face a third surface of the second housing structure (220), and in a fully unfolded state, the first surface of the first housing structure (210) and the third surface of the second housing structure (220) may face the same direction (e.g., a direction parallel to the Z-axis).

[0077] Also, for example, the electronic device (200) may be folded in an out-folding manner so that the second side of the first housing structure (210) faces the fourth side of the second housing structure (220).

[0078] Additionally, the electronic device (200) may include multiple hinge axes (e.g., two mutually parallel hinge axes including the A-axis of FIG. 2A and another axis parallel to the A-axis), although not shown in the drawing, in which case the electronic device (200) may be folded in a 'multi-folding' manner that combines the in-folding and out-folding methods.

[0079] The above-described in-folding type may refer to a state in which the display (250) is not exposed to the outside in a fully folded state. The above-described out-folding type may refer to a state in which the display (250) is exposed to the outside (e.g., visible) in a fully folded state. FIG. 2d illustrates an intermediate state in which the electronic device (200) is partially unfolded during the in-folding process.

[0080] For convenience, the following description focuses on a state in which the electronic device (200) is folded in an in-folding manner, but it should be noted that these descriptions can also be applied to a state in which the electronic device (200) is folded in an out-folding manner.

[0081] FIGS. 3A, 3B, 3C, and 3D are drawings illustrating a fully unfolded state, a partially unfolded intermediate state, and a fully folded state of an electronic device according to various embodiments.

[0082] Referring to FIGS. 3A, 3B, 3C, and 3D, an electronic device (300) (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A to 2D) may include a foldable display (330) (e.g., the display (160) of FIG. 1, the display (250) of FIGS. 2A to 2D), a first housing (341), and a second housing (343).

[0083] The state (301) may indicate a fully unfolded state or an unfolded state of the electronic device (300).

[0084] In state (301), the electronic device (300) can be folded. For example, the electronic device (300) can be folded as the first housing (341) and / or the second housing (343) are folded.

[0085] According to one embodiment, as the electronic device (300) is folded, the first region (331) and the second region (333) of the foldable display (330) may form an angle (θ) with respect to the folding axis, such as in states (303) and (305). When the angle (θ) is within a predetermined range, the states (303) and (305) may be referred to as a “partially unfolded intermediate state,” and the angle (θ) formed by the first region (331) and the second region (333) may be referred to as a “folding angle.”

[0086] In one embodiment, the folding angle in the partially unfolded intermediate state (303) may be about 135 degrees, and the folding angle in the partially unfolded intermediate state (305) may be about 45 degrees.

[0087] State (307) may indicate a state in which the electronic device (300) is completely folded.

[0088] In the examples illustrated in FIGS. 3A, 3B, 3C, and 3D, the electronic device (300) can be folded so that the first region (331) and the second region (333) face each other. In other words, the screen can be folded inward. This folding method can be referred to as an in-folding method. Alternatively, the electronic device (300) can be implemented so that the first region (331) and the second region (333) can be folded in opposite directions. In other words, the screen can be implemented so that it folds outward.

[0089] FIG. 4 illustrates a block diagram of an electronic device according to various embodiments.

[0090] An electronic device (400) according to one embodiment (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIGS. 2A to 2D, an electronic device (300) of FIGS. 3A to 3D) includes a hinge (410) for allowing the electronic device (400) to be folded or unfolded, a foldable display (420) (e.g., a display (160) of FIG. 1, a display (250) of FIGS. 2A to 2D) disposed on at least one side of the electronic device (400) so that the electronic device (400) is folded or unfolded around the hinge (410), a sensor (430) (e.g., a sensor (176) of FIG. 1) for detecting a state of the electronic device (400) (e.g., an unfolded state, a partially unfolded intermediate state, a folded state, etc.), and a screen to be displayed through the foldable display (420) according to the state of the electronic device (400). It may include a processor (440) (e.g., including processing circuitry), and an input module (450) (e.g., the input module (150) of FIG. 1).

[0091] The processor (440) may include various processing circuits and may determine the state of the electronic device (400) as one of an unfolded state of the foldable display (420), an intermediate unfolded state in which the foldable display (420) forms a folding angle between a defined folding angle range, and a folded state in which the foldable display (420) is folded.

[0092] According to one embodiment, the hinge (410) allows the electronic device (400) to be folded or unfolded, and as the electronic device (400) is folded or unfolded about the hinge (410), the foldable display (420) can also be folded or unfolded. The foldable display (420) can be disposed on at least one side of the electronic device (400) and can include a first region (421) disposed on one side of the hinge (410) (e.g., the first region (251) of FIGS. 2A to 2D) and a second region (423) disposed on the other side of the hinge (410) (e.g., the second region (252) of FIGS. 2A to 2D).

[0093] According to one embodiment, the hinge (410) may include a first hinge and a second hinge, and the foldable display (420) may include a first region (421) disposed on one side of the first hinge, a second region (423) disposed on the other side of the first hinge and on one side of the second hinge, and a third region (not shown) disposed on the other side of the second hinge.

[0094] According to one embodiment, the sensor (430) (e.g., sensor (176) of FIG. 1) may include at least one sensor and may detect a folding angle of the electronic device (400) (e.g., the folding angle (θ) of FIGS. 3A, 3B, 3C, and 3D). The sensor (430) according to one embodiment may be a hall sensor, an acceleration sensor, and / or a gyro sensor (e.g., a gyroscope). For example, the acceleration sensor and / or the gyro sensor may detect the folding angle of the electronic device (400). The sensor (430) according to one embodiment may be disposed within the hinge (410) to detect the number of gear rotations to detect the folding angle. The sensor (430) according to one embodiment may detect not only the folding angle but also the folding start point and the angle at which folding stops.

[0095] For example, the sensor (430) may be a Hall sensor. The Hall sensor may be a transducer that generates an electrical signal (e.g., voltage) in response to a magnetic field. The Hall sensor may generate an electrical signal of relatively high intensity when the magnetic field is strong, and may generate an electrical signal of relatively low intensity when the magnetic field is weak. For example, the Hall sensor may be located in a first housing structure (e.g., the first housing structure (210) of FIGS. 2A to 2D) and an element that generates a magnetic field (e.g., a magnetic body) may be located in a second housing structure (e.g., the second housing structure (220) of FIGS. 2A to 2D). Depending on the implementation, the Hall sensor may be located in the second housing structure and the magnetic body may be located in the first housing structure. When the electronic device (400) changes from a fully unfolded state to a folded state, the Hall sensor can come close to the magnetic body and detect the folded state of the foldable display (420) by reacting to the magnetic field of the magnetic body. In addition, the Hall sensor can detect the folding angle through the intensity of the electrical signal generated in response to the magnetic field.

[0096] The Hall sensor is an example of the sensor (430), and the sensor (430) is not limited to the Hall sensor. According to one embodiment, the folding angle of the electronic device (400) can be detected using a magnetic (or geomagnetic) sensor and a Hall sensor. For example, the magnetic (or geomagnetic) sensor and the Hall sensor can include a transmitter for generating a magnetic field of a specific frequency and a receiver for receiving the magnetic field generated by the transmitter, and can detect the folding angle based on a change in the state of the electronic device (400). For example, the magnetic (or geomagnetic) sensor can measure the direction using a magnetic field and magnetic force lines, and the Hall sensor can detect the intensity of the magnetic field to confirm the change in the state of the electronic device (400), and can detect the folding angle (e.g., the folding angle (θ) of FIGS. 3A, 3B, 3C, and 3D) according to the confirmed change in state.

[0097] As described above, the sensor (430) detects the folded state of the foldable display (420) and the folding angle. However, according to one embodiment, the processor (440) can detect the folded state of the foldable display (420) and calculate the folding angle based on the sensing result of the sensor (430). For example, the processor (440) can receive an electrical signal according to magnetic field detection from a hall sensor. The processor (440) can detect the folded state of the foldable display (420) by receiving the electrical signal from the hall sensor. In addition, the processor (440) can calculate the folding angle of the foldable display (420) based on the intensity of the electrical signal received from the hall sensor.

[0098] FIG. 5 is a flowchart illustrating an example of a method for an electronic device according to various embodiments to generate and display a converted image according to display conditions.

[0099] An electronic device according to one embodiment (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIGS. 2A to 2D, an electronic device (300) of FIGS. 3A to 3D, or an electronic device (400) of FIG. 4) can generate and display a converted image according to display conditions.

[0100] In one embodiment, a display condition (e.g., a first display condition or a second display condition) may refer to a condition regarding the environment and / or situation in which the image is displayed. The display condition may include a condition regarding at least one of a device displaying the image, an area of ​​the device's display in which the image is displayed, or a time at which the image is displayed.

[0101] For example, if a display of an electronic device includes a first area and a second area, a first display condition may include displaying an image in the first area, and a second display condition may include displaying an image in the second area. Examples according to display conditions regarding areas where an image is displayed are described in more detail below in FIG. 10.

[0102] For example, display conditions may include conditions regarding the time at which the image is displayed. A first display condition may include that the time at which the image is displayed falls within a first time range, and a second display condition may include that the time at which the image is displayed falls within a second time range. Examples of display conditions regarding the time at which the image is displayed are described in more detail below in FIG. 11.

[0103] For example, display conditions may include conditions regarding a device displaying an image. A first display condition may include an electronic device displaying an image, and a second display condition may include another electronic device displaying an image. Examples of display conditions regarding a device displaying an image are described in more detail below in FIG. 12.

[0104] Below, the operations of an electronic device that generates and displays a converted image according to display conditions are described.

[0105] In operation (510), the electronic device can detect a plurality of candidate objects from a plurality of images.

[0106] In one embodiment, the plurality of images may include images accessible to the electronic device. For example, the images accessible to the electronic device may include images stored in a memory of the electronic device (e.g., memory (130) of FIG. 1) or an external device connected to the electronic device (e.g., electronic device (102) of FIG. 1, electronic device (104) of FIG. 1, server (108) of FIG. 1).

[0107] In one embodiment, a plurality of images may be specified based on user input. For example, the plurality of images may be specified by the user based on at least one of an application, a directory (e.g., a folder) in which the images are stored, or a device storing the images.

[0108] An electronic device can detect a candidate object from a plurality of images. According to one embodiment, the electronic device can detect a specific type of object as a candidate object. For example, the electronic device can detect a human-type object as a candidate object. However, the electronic device according to various embodiments of the present disclosure is not limited to detecting only human-type objects as candidate objects, and the electronic device can detect an animal-type object (e.g., a dog or a cat), an object-type object (e.g., a car, food, or furniture), or a natural-type object (e.g., a tree, a flower, or a mountain) as a candidate object.

[0109] The electronic device may attempt to detect a candidate object in each image. The electronic device may fail to detect a candidate object in one image, or may succeed in detecting one or more candidate objects.

[0110] According to one embodiment, the electronic device can determine the identity between detected candidate objects. For example, if the electronic device identifies an object detected in a first image and an object detected in a second image as the same object, the electronic device can map (e.g., label or tag) the same object identifier to the objects detected in the first image and the second image. As described in more detail below with reference to FIGS. 6 and 7 , the electronic device can determine an attribute (e.g., size or brightness) of a graphic representation corresponding to a specific object based on the number of images in which a specific object (e.g., an object having a specific object identifier) ​​is detected among a plurality of images.

[0111] In operation (520), the electronic device can determine a first classification result by classifying at least one of a plurality of candidate objects as an object of interest or an object of non-interest based on a user input for a first display condition.

[0112] According to one embodiment, the user input for the first display condition may include a user input for determining a first classification result for a first transformed image to be displayed when the first display condition is satisfied. As will be described later in step (540), the electronic device may generate the first transformed image based on the first classification result. The classification setting interface, which is a user interface for obtaining user input for the display condition, is described in more detail below with reference to FIGS. 6 and 7 .

[0113] According to one embodiment, the classification result (e.g., the first classification result or the second classification result) may include a result of classifying at least one of a plurality of candidate objects as an object of interest or an object of no interest. For example, an object of interest may refer to an object set to appear in an image when a corresponding display condition is satisfied. For example, an object of no interest may refer to an object set not to appear in an image (e.g., to be excluded) when a corresponding display condition is satisfied.

[0114] According to one embodiment, the classification result (e.g., the first classification result or the second classification result) may include the results of classifying a plurality of candidate objects into one of objects of interest, objects of no interest, or unclassified objects. An unclassified object may refer to an object that is not classified as an object of interest or an object of no interest, and may or may not appear in the image when a corresponding display condition is satisfied.

[0115] In various embodiments of the present disclosure, each of an object of interest, an object of non-interest, and an unclassified object may be expressed as a class of objects, and determining a particular object as one of an object of interest, an object of non-interest, or an unclassified object may be expressed as determining the class of the particular object.

[0116] In operation (530), the electronic device can determine a second classification result by classifying at least one of the plurality of candidate objects as an object of interest or an object of no interest based on a user input for a second display condition.

[0117] Similar to or identical to the user input for the first display condition, the user input for the second display condition may include an input for determining a second classification result for a second transformed image to be displayed when the second display condition is satisfied. As will be described later in step (550), the electronic device may generate the second transformed image based on the second classification result.

[0118] In one embodiment, the first classification result and the second classification result may be determined independently of each other. For example, an object classified as an object of interest in the first classification result may be classified as an object of no interest or an unclassified object in the second classification result. Conversely, an object classified as an object of interest in the second classification result may be classified as an object of no interest or an unclassified object in the first classification result. A user may want to display an image including a specific object in the first display condition and not display an image including the specific object in the second display condition. For example, the specific object may be a private object (e.g., a lover). The user may generate a user input for classifying the specific object as an object of interest as a user input for the first display condition, and generate a user input for classifying the specific object as an object of no interest as a user input for the second display condition.

[0119] According to one embodiment, the electronic device may select at least one image, from among a plurality of images, in which at least one of the objects of interest of the first classification result or the objects of interest of the second classification result appears, as a target image. However, the electronic device is not limited to selecting the target image based on the objects of interest of the first classification result or the objects of interest of the second classification result, and the electronic device may also select the target image based on a user input designating at least one image from among the plurality of images as the target image.

[0120] In operation (540), the electronic device may generate a first conversion image corresponding to a first display condition by retaining objects of interest of the first classification result and excluding objects of no interest of the first classification result from a target image selected from among a plurality of images. The first conversion image may refer to an image to be displayed instead of the target image when the first display condition is met.

[0121] An electronic device according to one embodiment may generate a transformed image (e.g., a first transformed image or a second transformed image) by applying image inpainting to a target image. The electronic device may detect an area in which an uninterested object of a classification result (e.g., the first classification result or the second classification result) appears from the target image. The electronic device may obtain an intermediate image in which the area in which the uninterested object of the classification result appears is removed from the target image. The electronic device may reconstruct the removed area by applying image inpainting to the intermediate image. The electronic device may generate a transformed image by applying an inpainting model for image inpainting to the intermediate image. The inpainting model may refer to a model generated and / or trained to output output data corresponding to a transformed image from input data corresponding to the intermediate image. The inpainting model may include a model based on a machine learning model (e.g., a neural network, a convolutional neural network (CNN), or a generative adversarial network (GAN)).

[0122] In operation (550), the electronic device can generate a second transformed image corresponding to the second display condition by retaining objects of interest from the second classification result and excluding objects of no interest from the second classification result in the target image. The target image may be an image selected from among a plurality of images, but is not limited thereto, and may also be a separate image independent from the plurality of images. The second transformed image may refer to an image to be displayed instead of the target image when the second display condition is satisfied. The electronic device can generate the second transformed image by applying image inpainting to the target image.

[0123] As described above, since the first classification result and the second classification result are independent, objects removed from the first transformed image may be maintained in the second transformed image, and / or objects maintained in the first transformed image may be removed from the second transformed image.

[0124] In operation (560), the electronic device may display the first transformed image while the first display condition is satisfied. While the first display condition is satisfied, the electronic device may display the first transformed image in which the object of interest of the first classification result is maintained and the uninteresting object of the first classification result is excluded. For example, the electronic device may not display the uninteresting object of the first classification result while the first display condition is satisfied.

[0125] In operation (570), the electronic device may display a second transformed image while the second display condition is satisfied. While the second display condition is satisfied, the electronic device may display a second transformed image in which the objects of interest of the second classification result are maintained and the uninteresting objects of the second classification result are excluded. For example, the electronic device may not display uninteresting objects of the second classification result while the second display condition is satisfied.

[0126] FIG. 6 is a diagram illustrating an example of a classification setting interface for an electronic device to determine a classification result according to various embodiments.

[0127] An electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIGS. 2A to 2D, electronic device (300) of FIGS. 3A to 3D, or electronic device (400) of FIG. 4) may provide a classification setting interface (600-1, 600-2) for obtaining user input for determining a classification result corresponding to a display condition.

[0128] According to one embodiment, the classification setting interface (600-1, 600-2) may include an object of interest area (610) corresponding to an object of interest, an object of non-interest area (620) corresponding to an object of non-interest, and an unclassified object area (630) corresponding to an unclassified object. The classification setting interface (600-1, 600-2) may include a source area (640) for specifying a plurality of images. The source area (640) is an area for specifying a plurality of images based on a user input, and at least one of an application, a directory in which images are stored, or a device for storing images may be added and / or deleted. As an example in FIG. 6, in response to the addition of an icon of a message application and an icon of a mail application to the source area (640), the plurality of images may be specified as images acquired through the message application and images acquired through the mail application.

[0129] According to one embodiment, the electronic device may display a plurality of graphical representations respectfully corresponding to a plurality of candidate objects in one of the object of interest area (610), object of no interest area (620), or unclassified object area (630) of the classification setting interface (600-1, 600-2).

[0130] Referring to FIG. 6, the electronic device may display nine graphical representations (601-1, 602-1, 603-1, 604-1, 605-1, 606-1, 607-1, 608-1, 609-1) individually corresponding to nine candidate objects in the classification setting interface (600-1). In the classification setting interface (600-1), the graphical representations (601-1, 602-1, 603-1, 604-1, 605-1, 606-1) may be located in an object of interest area (610), and the graphical representations (607-1, 608-1, 609-1) may be located in an unclassified object area (630).

[0131] According to one embodiment, when an electronic device acquires an image by receiving, storing, and / or capturing the image, the electronic device may detect an object from the image. The electronic device may determine whether a candidate object identified as the same object as the detected object exists among previously detected candidate objects. If a candidate object identified as the same object as the detected object exists among previously detected candidate objects, the electronic device may map an object identifier of the identified candidate object to the detected object and change (e.g., increase) the frequency of appearance of the identified candidate object. The frequency of appearance may be determined by the number of images in which the candidate object is detected among a plurality of images.

[0132] According to one embodiment, if there is no candidate object identified as the same object as the detected object among previously detected candidate objects, the electronic device may assign a new object identifier to the detected object that is different from the object identifiers of the previously detected candidate objects. The electronic device may map the new object identifier to the object detected in the image and add it as a new candidate object to the classification setting interface (600-1). The electronic device may display a graphical representation corresponding to the new candidate object on the classification setting interface (600-1).

[0133] According to one embodiment, the electronic device may initially classify a new candidate object into a determined class (e.g., an unclassified object) among objects of interest, objects of no interest, or unclassified objects. In various embodiments of the present disclosure, "initially classifying" may mean that the electronic device determines a default class of the new candidate object after detection of the new candidate object and before detecting a user input for classifying the new candidate object. The electronic device may display a graphical representation corresponding to the new candidate object in an area corresponding to the default class of the new candidate object.

[0134] However, the electronic device according to various embodiments of the present disclosure is not limited to initially classifying a new candidate object into a determined class. For example, the electronic device may initially classify a new candidate object based on the frequency of appearance of the new candidate object. If the frequency of appearance of the new candidate object is less than or equal to a first threshold frequency (e.g., 2 times), the electronic device may initially classify the new candidate object as an uninteresting object. If the frequency of appearance of the new candidate object exceeds the first threshold frequency (e.g., 2 times) and is less than or equal to a second threshold frequency (e.g., 10 times), the electronic device may initially classify the new candidate object as an unclassified object. If the frequency of appearance of the new candidate object exceeds the second threshold frequency (e.g., 10 times), the electronic device may initially classify the new candidate object as an object of interest.

[0135] According to one embodiment, the electronic device may display each of a plurality of graphical representations in a size based on the frequency of appearance of the corresponding candidate object in the classification setting interface (600-1). For example, the electronic device may determine, for each candidate object, the number of images in which the corresponding candidate object is detected among a plurality of images as the frequency of appearance of the corresponding candidate object. The electronic device may display each candidate object in a size determined based on the frequency of appearance of the corresponding candidate object. The electronic device may display the graphical representation corresponding to the candidate object in a larger size as the frequency of appearance of the candidate object increases (e.g., as the number of images in which the candidate object is detected increases).

[0136] Referring to FIG. 6, in the classification setting interface (600-1), the frequency of appearance of a candidate object corresponding to a graphical representation (603-1) may be higher than the frequency of appearance of a candidate object corresponding to a graphical representation (605-1), and the electronic device may display the graphical representation (603-1) larger than the graphical representation (605-1). The electronic device may visually visualize the frequency of appearance of a candidate object through the size of the graphical representation corresponding to the candidate object in the classification setting interface (600-1).

[0137] An electronic device can select an image containing a candidate object as a target image based on the frequency of appearance of the candidate object. For example, the higher the frequency of appearance of the candidate object, the higher the likelihood that the image containing the candidate object will be selected as the target image. The electronic device can visualize the likelihood that an image containing the candidate object will be selected as the target image by displaying a graphical representation corresponding to the candidate object with a size based on the frequency of appearance of the candidate object.

[0138] The electronic device can obtain user input for adjusting information about a candidate object in the classification setting interface (600-1). The electronic device can display updated information based on the obtained user input in the classification setting interface (600-2). Various examples of user input for adjusting information about a candidate object are described below.

[0139] According to one embodiment, the electronic device may change the position of at least one graphical representation among a plurality of graphical representations based on a user input (e.g., drag and drop) that moves the at least one graphical representation. The electronic device may classify the candidate object based on an area among an object of interest area (610), an object of no interest area (620), or an object of no interest area (630) that includes the position of the graphical representation corresponding to each candidate object. When the position of the at least one graphical representation is changed from one area among the object of interest area (610), the object of no interest area (620), or the object of no interest area (630) to another area, the electronic device may change the class of the at least one graphical representation from a class corresponding to one area to a class corresponding to the other area.

[0140] Referring to FIG. 6, the electronic device may classify candidate objects corresponding to the graphic representations (608-1, 609-1) as unclassified objects based on the locations of the graphic representations (608-1, 609-1) in the classification setting interface (600-1). The electronic device may detect a user input for moving the graphic representations (608-1, 609-1) located in the unclassified object area (630) to the uninteresting object area (620) in the classification setting interface (600-1). The electronic device may display the graphic representations (608-2, 609-2) in the uninteresting object area (620) in the classification setting interface (600-2). The electronic device can classify candidate objects corresponding to the graphical representations (608-2, 609-2) as uninteresting objects based on the positions of the graphical representations (608-2, 609-2) in the classification setting interface (600-2).

[0141] According to one embodiment, when an electronic device changes the position of at least one graphical representation in response to a user input for moving at least one graphical representation, the distance between the graphical representations may be changed. The electronic device may determine a likelihood of selecting an image in which candidate objects appear together as a target image based on the distance between the graphical representations corresponding to the candidate objects. The distance between the graphical representations may be calculated as a distance between the center points of bounding boxes surrounding the graphical representations. The electronic device may adjust a likelihood of selecting an image in which a first candidate object and a second candidate object appear as a target image based on the distance between a first graphical representation corresponding to a first candidate object among a plurality of candidate objects and a second graphical representation corresponding to a second candidate object among a plurality of images.

[0142] For example, the electronic device may increase the likelihood of selecting an image in which both the first candidate object and the second candidate object appear as the target image if the distance between the first graphical representation and the second graphical representation is less than or equal to a threshold distance. The electronic device may apply a visual effect indicating that the distance between the first graphical representation and the second graphical representation is less than or equal to the threshold distance if the distance between the first graphical representation and the second graphical representation is less than or equal to the threshold distance. The visual effect may include, for example, overlaying a visual object that covers at least a portion of an area corresponding to the first graphical representation and the second graphical representation and has a determined transparency, or changing a visual property (e.g., color, brightness, or saturation) of an area corresponding to the first graphical representation and the second graphical representation.

[0143] According to one embodiment, an electronic device may group three or more graphical representations based on a distance between the graphical representations. For example, if the distance between the first graphical representation and the second graphical representation is less than or equal to a threshold distance, the electronic device may group the first candidate object and the second candidate object into a candidate object group. If the distance between at least one of the first or second graphical representation and a third graphical representation corresponding to the third candidate object is less than or equal to the threshold distance, the electronic device may add the third candidate object to the candidate object group. The electronic device may apply a visual effect to graphical representations corresponding to candidate objects belonging to the same candidate object group. The electronic device may adjust (e.g., increase) the likelihood of selecting an image in which two or more candidate objects included in a candidate object group appear as a target image. The electronic device may adjust the likelihood more significantly as the number of candidate objects included in a candidate object group that appears in an image increases.

[0144] Referring to FIG. 6, the electronic device can obtain a user input for moving graphical representations (604-1, 605-1, 606-1) in the classification setting interface (600-1). The electronic device can display the graphical representations (604-2, 605-2, 606-2) at the changed positions in the classification setting interface (600-2) based on the user input. In the classification setting interface (600-2), candidate objects corresponding to the graphical representations (604-2, 605-2, 606-2) can be grouped into one candidate object group based on the positions of the graphical representations (604-2, 605-2, 606-2). For example, the electronic device may display a line (650) surrounding the graphical representations (604-2, 605-2, 606-2) as a visual effect indicating that the graphical representations (604-2, 605-2, 606-2) are grouped into one candidate object group. The electronic device may adjust the likelihood of selecting an image in which two or more candidate objects corresponding to the graphical representations (604-2, 605-2, 606-2) appear as a target image.

[0145] According to one embodiment, overlapping between graphical representations may occur when the position of at least one graphical representation changes in response to a user input that moves at least one graphical representation.

[0146] According to one embodiment, the electronic device may determine, based on an overlapping area of ​​a first graphical representation and a second graphical representation among a plurality of graphical representations, that a first candidate object corresponding to a first graphical representation is the same object as a second candidate object corresponding to a second graphical representation. The overlapping area between the first graphical representation and the second graphical representation may be determined as an overlapping area between a bounding box of the first graphical representation and a bounding box of the second graphical representation. The electronic device may determine that the first candidate object is the same object as the second candidate object if the size of the overlapping area exceeds a threshold size.

[0147] However, and not limited thereto, the electronic device may determine that the first candidate object is the same object as the second candidate object based on a result of comparing the Intersection over Union (IoU) between the first graphical representation and the second graphical representation with a threshold value.

[0148] According to one embodiment, the electronic device may change the first candidate object and the second candidate object to be the same object based on a user input, even if the electronic device initially determines that the first candidate object and the second candidate object are different objects. According to one embodiment, the electronic device may erroneously determine that the first candidate object and the second candidate object detected in the first image are different objects because the appearance of a specific object appearing in the first image is very different from the appearance of a specific object appearing in the second image. The user may adjust whether the first candidate object and the second candidate object are the same object by moving the first graphical representation and / or the second graphical representation.

[0149] According to one embodiment, the electronic device may integrate one of the first candidate object and the second candidate object (e.g., the first candidate object) with another candidate object (e.g., the second candidate object). For example, the electronic device may replace the object identifier of the second candidate object with the object identifier of the first candidate object in an image mapped to the object identifier of the second candidate object among a plurality of images. The electronic device may adjust (e.g., update) the appearance frequency of the first candidate object by adding the appearance frequency of the second candidate object to the appearance frequency of the first candidate object. For example, the electronic device may stop displaying the second graphical representation and display the first graphical representation in an adjusted (e.g., increased) size based on the adjusted appearance frequency.

[0150] Referring to FIG. 6, candidate objects corresponding to graphical representations (601-1) and (602-1) are identified as different objects, but in reality, they may be the same person, with only different hairstyles. The electronic device may obtain a user input to move the graphical representation (602-1) toward the graphical representation (601-1) in the classification setting interface (600-1). Based on the overlapping area between the graphical representations (602-1) and (601-1), the electronic device may determine that the candidate object corresponding to the graphical representation (602-1) is the same object as the candidate object corresponding to the graphical representation (601-1). In the classification setting interface (600-2), the electronic device may display the graphical representation (602-2) in an adjusted size, without displaying the graphical representation (602-1).

[0151] According to one embodiment, an electronic device may obtain a user input for adjusting the size of at least one graphical representation among a plurality of graphical representations individually corresponding to a plurality of candidate objects. The electronic device may adjust the size of the at least one graphical representation based on the user input. Based on the adjusted size, the electronic device may adjust the likelihood of selecting an image in which the candidate object corresponding to the at least one graphical representation appears as a target image.

[0152] For example, the electronic device may, upon obtaining user input that reduces the size of at least one graphical representation, reduce the size of the at least one graphical representation and reduce the likelihood of selecting an image in which a candidate object corresponding to the at least one graphical representation appears as a target image.

[0153] For example, when the electronic device obtains a user input that increases the size of at least one graphical representation, the electronic device may increase the size of the at least one graphical representation and increase the likelihood of selecting an image in which a candidate object corresponding to the at least one graphical representation appears as a target image.

[0154] Referring to FIG. 6, the electronic device can detect a user input that reduces the size of a graphical representation (603-1) displayed in a classification setting interface (600-1). The electronic device can display the graphical representation (603-2) in a reduced size in a classification setting interface (600-2). The electronic device can reduce the likelihood of selecting an image in which a candidate object corresponding to the graphical representation (603-2) appears as a target image.

[0155] FIG. 7 is a diagram illustrating an example of an operation of an electronic device highlighting a specific graphical representation in a classification setting interface according to various embodiments.

[0156] An electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A to 2D, the electronic device (300) of FIGS. 3A to 3D, or the electronic device (400) of FIG. 4) may highlight a specific graphical representation when displaying a classification setting interface (700).

[0157] According to one embodiment, the electronic device may display a visual effect on a graphical representation corresponding to a candidate object when an event occurs for the candidate object. For example, an event for the candidate object may include acquiring (e.g., receiving, capturing, creating, sharing, or storing) images containing a threshold number (e.g., 10) of the candidate object within a determined period (e.g., the last three days).

[0158] According to one embodiment, the visual effect may include overlaying a line (e.g., a straight line and / or a curve) surrounding the graphical representation, or a visual object covering at least a portion of the graphical representation and having a determined transparency, or changing a visual property (e.g., color, brightness, or saturation) of the graphical representation.

[0159] However, in various embodiments of the present disclosure, events for a candidate object are not limited to those related to the acquisition of an image of the candidate object. For example, events for a candidate object may include events based on communication with a device associated with the candidate object (e.g., a call or sending or receiving a message), or the arrival of a schedule associated with the candidate object.

[0160] Referring to FIG. 7, an electronic device may display graphical representations corresponding to a plurality of candidate objects in a classification setting interface (700). When an event occurs for a specific object among the plurality of candidate objects, the electronic device may apply a visual effect to the graphical representation (701) corresponding to the specific object and display it. For example, the electronic device may overlay a visual object (702) covering the graphical representation (701) and having a determined transparency onto the graphical representation (701).

[0161] FIG. 8 is a diagram illustrating an example of an operation of an electronic device according to various embodiments to select a transformation image from a target image based on a classification result.

[0162] An electronic device according to one embodiment (e.g., an electronic device (101) of FIG. 1, an electronic device (200) of FIGS. 2A to 2D, an electronic device (300) of FIGS. 3A to 3D, or an electronic device (400) of FIG. 4) can generate a transformation image from a target image based on a classification result (e.g., a first classification result or a second classification result).

[0163] For example, an electronic device may obtain user input to transmit (e.g., share) a specific image to another device. The electronic device may determine the specific image as a target image and, based on the classification results, generate a transformed image from the target image, excluding uninteresting objects from the classification results. The electronic device may share the transformed image instead of the target image.

[0164] For example, an electronic device may obtain a user input for selecting a specific image as a setting image. The setting image is an image set as at least a portion of a specific screen according to the user input, and may include, for example, an image for forming at least a portion (e.g., a background) of a home screen and / or a lock screen. The electronic device may determine the specific image selected as the setting image as a target image. The electronic device may generate at least one converted image from the target image. The electronic device may display one converted image from the at least one converted image instead of the target image. One converted image to be displayed from the at least one converted image may be determined according to a display condition. The display of the converted image according to the display condition will be described in more detail below with reference to FIGS. 10 to 12.

[0165] The electronic device can obtain a classification result (810) through a classification setting interface (e.g., the classification setting interfaces (600-1, 600-2) of FIG. 6, or the classification setting interface (700) of FIG. 7). Referring to FIG. 8, the classification result (810) may include a result of classifying seven candidate objects (e.g., the first candidate object (811) to the seventh candidate object (817)) into objects of interest or objects of non-interest. In the classification result (810), the first candidate object (811), the second candidate object (812), and the third candidate object (813) may be classified as objects of interest. The fourth candidate object (814), the fifth candidate object (815), the sixth candidate object (816), and the seventh candidate object (817) may be classified as objects of non-interest.

[0166] An electronic device may select a target image (830) from among a plurality of images (820). The electronic device may select an image in which at least one object of interest of the classification result (810) appears from among the plurality of images (820) as the target image (830). The electronic device may exclude an image in which the object of interest does not appear (e.g., an image in which only an uninterested object appears) from among the plurality of images (820) from the target image (830). However, the electronic device is not limited to excluding an image in which the object of interest does not appear from among the plurality of images from the target image, and the electronic device may adjust the possibility of selecting an image in which the object of interest does not appear from among the plurality of images as the target image to be low. The electronic device may select an image in which the object of interest does not appear as the target image, even if the possibility is low.

[0167] Referring to FIG. 8, the plurality of images (820) may include a first image (821) to a sixth image (826). In the first image (821), a first candidate object (811), a fourth candidate object (814), and a fifth candidate object (815) may appear. In the second image (822), a second candidate object (812) and a third candidate object (813) may appear. In the third image (823), the first candidate object (811) and the second candidate object (812) may appear. In the fourth image (824), the first candidate object (811), the third candidate object (813), and the fifth candidate object (815) may appear. In the fifth image (825), the second candidate object (812) and the fourth candidate object (814) may appear. In the sixth image (826), the sixth candidate object (816) and the seventh candidate object (817) may appear. The electronic device may not select the sixth image (826) in which the object of interest does not appear among the plurality of images (820) as the target image (830). For example, the electronic device may select the first image (821) to the fifth image (825) in which at least one object of interest appears among the plurality of images (820), as the target image (830).

[0168] In FIG. 8, an example is mainly described in which all of the first image (821) to the fifth image (825) in which at least one object of interest appears are selected as target images (830), but is not limited thereto. For example, the electronic device may select some of the images (e.g., the second image (822), the third image (823), and the fourth image (824)) among the images (e.g., the first image (821) to the fifth image (825)) in which at least one object of interest appears as target images (830).

[0169] According to one embodiment, the electronic device can generate a transformed image by retaining objects of interest of the classification result (810) in the target image (830) and excluding uninteresting objects. For example, excluding uninteresting objects from the target image (830) may include deleting uninteresting objects using image inpainting if the uninteresting objects appear in the target image (830). If the uninteresting objects do not appear in the target image (830), image inpainting may not be applied because the uninteresting objects have already been excluded from the target image (830).

[0170] Referring to FIG. 8, the electronic device can generate a plurality of transformed images (840) based on a target image including a first image (821) to a fifth image (825).

[0171] For example, the electronic device can obtain the converted image (841) by excluding the fourth candidate object (814) and the fifth candidate object (815) from the first image (821) among the target images (830) and maintaining the first candidate object (811). The electronic device can obtain the second image (822) as the converted image (842) based on the fact that the uninteresting object of the classification result (810) does not appear in the second image (822) among the target images (830). The electronic device can obtain the third image (823) as the converted image (843) based on the fact that the uninteresting object of the classification result (810) does not appear in the third image (823) among the target images (830). The electronic device can obtain a transformed image (844) by excluding the fifth candidate object (815) and maintaining the first candidate object (811) and the third candidate object (813) from the fourth image (824) among the target images (830). The electronic device can obtain a transformed image (845) by excluding the fourth candidate object (814) and maintaining the second candidate object (812) from the fifth image (825) among the target images (830).

[0172] FIG. 9 is a diagram illustrating an example of an operation of an electronic device according to various embodiments to select a transformation image from a target image based on a classification result.

[0173] An electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIGS. 2A to 2D, electronic device (300) of FIGS. 3A to 3D, or electronic device (400) of FIG. 4) can generate a plurality of transformed images from a target image (930) based on a plurality of classification results corresponding to a plurality of display conditions.

[0174] According to one embodiment, the electronic device can obtain a first classification result (901) corresponding to a first display condition and a second classification result (902) corresponding to a second display condition through a classification setting interface (e.g., the classification setting interface (600-1, 600-2) of FIG. 6, or the classification setting interface (700) of FIG. 7).

[0175] Referring to FIG. 9, each of the first classification result (901) and the second classification result (902) may include the results of classifying seven candidate objects (e.g., the first candidate object (911) to the seventh candidate object (917)) into objects of interest or objects of no interest.

[0176] For example, in the first classification result (901), the first candidate object (911) and the third candidate object (913) can be classified as objects of interest. In the first classification result (901), the second candidate object (912), the fourth candidate object (914), the fifth candidate object (915), the sixth candidate object (916), and the seventh candidate object (917) can be classified as objects of no interest.

[0177] For example, in the second classification result (902), the first candidate object (911) and the second candidate object (912) can be classified as objects of interest. In the second classification result (902), the third candidate object (913), the fourth candidate object (914), the fifth candidate object (915), the sixth candidate object (916), and the seventh candidate object (917) can be classified as objects of no interest.

[0178] According to one embodiment, the electronic device may select a target image (930) from among a plurality of images (920). The electronic device may select an image in which at least one of the objects of interest of the first classification result (901) or the objects of interest of the second classification result (902) appears, as the target image (930), from among the plurality of images (920). The electronic device may exclude an image in which the objects of interest do not appear (e.g., an image in which only uninterested objects appear) from among the plurality of images (920) from the target image (930).

[0179] However, the electronic device is not limited to excluding images in which the object of interest of the first classification result (901) and the object of interest of the second classification result (902) do not appear from among the plurality of images (920) from the target image (930), and the electronic device can adjust the possibility of selecting an image in which the object of interest of the first classification result (901) and the object of interest of the second classification result (902) do not appear from among the plurality of images (920) as the target image (930) to a low level. Despite the low possibility, the electronic device can select an image in which the object of interest of the first classification result (901) and the object of interest of the second classification result (902) do not appear as the target image (930).

[0180] Referring to FIG. 9, the plurality of images (920) may include, for example, a first image (921) to a sixth image (926). In the first image (921), a first candidate object (911), a fourth candidate object (914), and a fifth candidate object (915) may appear. In the second image (922), a second candidate object (912) and a third candidate object (913) may appear. In the third image (923), the first candidate object (911) and the second candidate object (912) may appear. In the fourth image (924), the first candidate object (911), the third candidate object (913), and the fifth candidate object (915) may appear. In the fifth image (925), the second candidate object (912) and the fourth candidate object (914) may appear. In the sixth image (926), the sixth candidate object (916) and the seventh candidate object (917) may appear. For example, the electronic device may not select the sixth image (926) in which the object of interest does not appear among the plurality of images (920), as the target image (930). The electronic device may select the first image (921) to the fifth image (925) in which at least one of the object of interest of the first classification result (901) or the object of interest of the second classification result (902) appears among the plurality of images (920), as the target image (930).

[0181] In FIG. 9, an example is mainly described in which all of the first image (921) to the fifth image (925) in which at least one of the objects of interest of the first classification result (901) or the objects of interest of the second classification result (902) appear are selected as target images (930), but the present invention is not limited thereto. For example, the electronic device may select the second image (922), the third image (923), and the fourth image (924) in which both the objects of interest of the first classification result (901) and the objects of interest of the second classification result (902) appear as target images (930).

[0182] According to one embodiment, the electronic device can generate a transformed image corresponding to the classification result (or a display condition corresponding to the classification result) by maintaining the object of interest of each classification result in the target image (930) and excluding the object of no interest.

[0183] Referring to FIG. 9, the electronic device can generate first transformed images (940) based on the first classification result (901) and second transformed images (950) based on the second classification result (902) from a target image (930) including the first image (921) to the fifth image (925).

[0184] For example, the electronic device can generate a first transformed image (941) of the first image (921) by excluding the fourth candidate object (914) and the fifth candidate object (915), which are uninteresting objects of the first classification result (901), from the first image (921) among the target images (930), and maintaining the first candidate object (911), which is an object of interest of the first classification result (901). The electronic device can generate a second transformed image (951) of the first image (921) by maintaining the first candidate object (911), which is an object of interest of the second classification result (902), from the first image (921) among the target images (930), and excluding the fourth candidate object (914) and the fifth candidate object (915), which are uninteresting objects of the second classification result (902).

[0185] For example, the electronic device can generate a first transformed image (942) of the second image (922) by excluding a second candidate object (912), which is an object of no interest in the first classification result (901), from the second image (922) among the target images (930), and maintaining a third candidate object (913), which is an object of interest in the first classification result (901). The electronic device can generate a second transformed image (952) of the second image (922) by excluding a third candidate object (913), which is an object of no interest in the second classification result (902), from the second image (922) among the target images (930), and maintaining a second candidate object (912), which is an object of interest in the second classification result (902).

[0186] For example, the electronic device can generate a first transformed image (943) of the third image (923) by excluding the second candidate object (912), which is an uninteresting object of the first classification result (901), from the third image (923) among the target images (930), and maintaining the first candidate object (911), which is an object of interest of the first classification result (901). The electronic device can obtain the third image (923) as a second transformed image (953) of the third image (923) based on the fact that the uninteresting object of the second classification result (902) does not appear in the third image (923) among the target images (930).

[0187] For example, the electronic device can generate a first transformed image (944) of the fourth image (924) by excluding the fifth candidate object (915), which is an object of no interest in the first classification result (901), from the fourth image (924) among the target images (930), and maintaining the first candidate object (911) and the third candidate object (913), which are objects of interest in the first classification result (901). The electronic device can generate a second transformed image (954) of the fourth image (924) by maintaining the first candidate object (911), which is an object of interest in the second classification result (902), and excluding the third candidate object (913) and the fifth candidate object (915), which are objects of no interest in the second classification result (902), from the fourth image (924) among the target images (930).

[0188] For example, the electronic device can generate a first transformed image (945) of the fifth image (925) by excluding the second candidate object (912) and the fourth candidate object (914), which are uninteresting objects of the first classification result (901), from the fifth image (925) among the target images (930). The electronic device can generate a second transformed image (955) of the fifth image (925) by maintaining the second candidate object (912), which is an object of interest of the second classification result (902), and excluding the fourth candidate object (914), which is an uninteresting object of the second classification result (902), from the fifth image (925) among the target images (930).

[0189] Although not explicitly shown in FIG. 9, among the transformed images for a specific classification result, a transformed image in which the object of interest of the specific classification result does not appear may be excluded. For example, among the first transformed images (940) for the first classification result (901), the first transformed image (945) of the fifth image (925) in which the object of interest of the first classification result (901) does not appear may be excluded from the first transformed images (940). For example, among the second transformed images (950) for the second classification result (902), the second transformed image (951) of the first image (921) in which the object of interest of the second classification result (902) does not appear may be excluded from the second transformed images (950). The electronic device may display at least one of the first transformed images (940) of the first image (921), the second image (922), the third image (923), and the fourth image (924) while satisfying the first display condition. The electronic device may display at least one of the second transformed images (950) of the second image (922), the third image (923), the fourth image (924), and the fifth image (925) while satisfying the second display condition.

[0190] FIG. 10 is a diagram illustrating an example of an operation of an electronic device according to various embodiments to display converted images according to display conditions regarding an area in which an image is displayed during a display.

[0191] An electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A to 2D, the electronic device (300) of FIGS. 3A to 3D, or the electronic device (400) of FIG. 4) may display one of a plurality of transformed images according to a plurality of display conditions regarding an area in which an image is displayed during a display.

[0192] According to one embodiment, a first candidate object (1011) and a second candidate object (1012) may appear in a target image (1010). In the first classification result, the first candidate object (1011) and the second candidate object (1012) may be classified as objects of interest. In the second classification result, the first candidate object (1011) may be classified as an object of no interest, and the second candidate object (1012) may be classified as an object of interest. As described above with reference to FIG. 9, the electronic device may generate a first transformed image (1021) from the target image (1010) in which the first candidate object (1011) and the second candidate object (1012) are maintained. The electronic device may generate a second transformed image (1022) from the target image (1010) in which the first candidate object (1011) is excluded and the second candidate object (1012) is maintained.

[0193] In FIG. 10, as an example, an electronic device may obtain a user input instructing to set one image among a plurality of images as a setting image. The electronic device may select the image selected as the setting image as a target image (1010) based on the user input. The setting image may be displayed in a plurality of areas and / or a plurality of displays when the display of the electronic device includes a plurality of areas and / or includes a plurality of displays. The electronic device may generate a plurality of transformation images according to display conditions from the target image (1010) based on the user input for setting the target image (1010) as the setting image.

[0194] For example, a display of an electronic device may include a first area (e.g., a first area (251) of FIGS. 2A to 2D) and a second area (e.g., a second area (252) of FIGS. 2A to 2D). A first display condition may include displaying an image in the first area. A second display condition may include displaying an image in the second area. The electronic device may display a first converted image in the first area based on displaying an image generated from a target image in the first area. The electronic device may display a second converted image in the second area based on displaying an image generated from the target image in the second area.

[0195] For example, a display of an electronic device may include a main display and a sub-display capable of changing states. The state of the electronic device may be switchable between a plurality of states, including a first state (1030) (e.g., an at least partially unfolded state) or a second state (1040) (e.g., a folded state), depending on a change in the folding angle of the main display. A first display condition may include displaying an image on the main display. A second display condition may include displaying an image on the sub-display.

[0196] For example, whether an electronic device displays an image on a main display or a sub-display may be determined based on the state of the electronic device. For example, while the state of the electronic device is in a first state (1030) (e.g., at least partially unfolded), the electronic device may activate the main display and deactivate the sub-display. While the state of the electronic device is in a second state (1040) (e.g., folded), the electronic device may deactivate the main display and activate the sub-display.

[0197] The electronic device may determine that a first display condition for displaying an image on the main display is satisfied when the state of the electronic device is a first state (1030) (e.g., an at least partially unfolded state). Accordingly, the electronic device may display a first transformed image (1021) on the main display while the state of the electronic device is the first state (1030) (e.g., an at least partially unfolded state).

[0198] The electronic device may determine that a second display condition for displaying an image on the sub-display has been satisfied when the state of the electronic device is in the second state (1040) (e.g., folded state). Accordingly, the electronic device may display the second transformed image (1022) on the sub-display while the state of the electronic device is in the second state (1040).

[0199] When the state of the electronic device changes, the displayed image may also change (e.g., switch) between the first transformed image (1021) and the second transformed image (1022).

[0200] For example, the electronic device may display a first transformed image (1021) on the main display while the state of the electronic device is a first state (1030). When the state of the electronic device changes (e.g., transitions) from the first state (1030) to the second state (1040), the electronic device may stop displaying the first transformed image (1021) through the main display and display the second transformed image (1022) through the sub-display.

[0201] For example, the electronic device may display a second transformed image (1022) on the sub-display while the state of the electronic device is a second state (1040). When the state of the electronic device changes (e.g., transitions) from the second state (1040) to the first state (1030), the electronic device may stop displaying the second transformed image (1022) through the sub-display and display the first transformed image (1021) through the main display.

[0202] FIG. 11 is a diagram illustrating an example of an operation of an electronic device according to various embodiments to display converted images according to display conditions regarding the time at which the images are displayed.

[0203] An electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIGS. 2A to 2D, electronic device (300) of FIGS. 3A to 3D, or electronic device (400) of FIG. 4) may display one of a plurality of transformed images according to a plurality of display conditions regarding the time at which the image is displayed.

[0204] For example, in the target image (1110), a first candidate object (1111), a second candidate object (1112), and a third candidate object (1113) may be included. In the first classification result, the first candidate object (1111) and the second candidate object (1112) may be classified as objects of interest, and the third candidate object (1113) may be classified as an object of no interest. In the second classification result, the first candidate object (1111) and the third candidate object (1113) may be classified as objects of no interest, and the second candidate object (1112) may be classified as an object of interest. As described above with reference to FIG. 9, the electronic device may generate a first transformed image (1121) from the target image (1110) in which the first candidate object (1111) and the second candidate object (1112) are maintained and the third candidate object (1113) is excluded. The electronic device can generate a second transformed image (1122) in which the first candidate object (1111) and the third candidate object (1113) are excluded from the target image (1110) and the second candidate object (1112) is maintained.

[0205] In FIG. 11, for example, an electronic device may obtain a user input for setting a target image (1110) as a background and / or lock screen of a home screen. The home screen or lock screen may be repeatedly displayed at multiple time points. For example, based on a user input for setting the target image (1110) as a background and / or lock screen of a home screen, the electronic device may generate a plurality of transformed images from the target image (1110) according to display conditions for the time at which the image is to be displayed.

[0206] For example, a first display condition may include that the time at which the image is displayed falls within a first time range (e.g., from 9:00 AM to 6:00 PM every day). A second display condition may include that the time at which the image is displayed falls within a second time range different from the first time range (e.g., from 6:00 PM every day to 9:00 AM the next day).

[0207] On the screen (1130), the electronic device can display a first converted image (1121) based on whether the timepoint of display falls within a first time range. The timepoint of display may refer to a timepoint at which one of the converted images generated from the target image (1110) is displayed. On the screen (1140), the electronic device can display a second converted image (1122) based on whether the timepoint of display falls within a second time range.

[0208] In one embodiment, as time elapses, the electronic device may switch the image it displays between a first transformed image (1121) and a second transformed image (1122).

[0209] For example, the second time range of the second display condition may include a time range that is temporally subsequent to at least a portion of the first time range of the first display condition. For example, the second time range may be temporally subsequent to the first time range. The electronic device may display the first transformed image (1121) based on whether the display time falls within the first time range. As time passes, if the display time falls outside the first time range and falls within the second time range, the electronic device may change the image displayed on the display from the first transformed image (1121) to the second transformed image (1122).

[0210] Conversely, the second time range of the first display condition may include a time range that is temporally subsequent to at least a portion of the first time range of the first display condition. The electronic device may display the second transformed image (1122) based on whether the display time falls within the second time range. As time passes, if the display time falls outside the second time range and within the first time range, the electronic device may change the image displayed on the display from the second transformed image (1122) to the first transformed image (1121).

[0211] FIG. 12 is a diagram illustrating an example of an operation of an electronic device displaying converted images according to display conditions for a device displaying images according to various embodiments.

[0212] An electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A to 2D, the electronic device (300) of FIGS. 3A to 3D, or the electronic device (400) of FIG. 4) may display one of a plurality of transformed images according to a plurality of display conditions for a device displaying an image.

[0213] For example, as in FIG. 12, the target image (1210) may include a first candidate object (1211), a second candidate object (1212), and a third candidate object (1213). In the first classification result, the first candidate object (1211) and the second candidate object (1212) may be classified as objects of interest, and the third candidate object (1213) may be classified as an object of no interest. In the second classification result, the first candidate object (1211) and the third candidate object (1213) may be classified as objects of no interest, and the second candidate object (1212) may be classified as an object of interest. The electronic device may generate a first transformed image (1221) from the target image (1210) in which the first candidate object (1211) and the second candidate object (1212) are maintained and the third candidate object (1213) is excluded. The electronic device can generate a second transformed image (1222) in which the first candidate object (1211) and the third candidate object (1213) are excluded from the target image (1210) and the second candidate object (1212) is maintained.

[0214] In FIG. 12, as an example, an electronic device may obtain a user input instructing to set a specific image (e.g., a target image (1210)) as a common setting image for multiple devices (e.g., the electronic device and other electronic devices). The electronic device may use the classification results determined for each device to generate multiple transformation images according to display conditions related to the multiple devices.

[0215] For example, a first display condition may include an electronic device displaying an image. A second display condition may include another electronic device displaying an image.

[0216] On the screen (1230), the electronic device can display the first converted image (1221) as a setting image of the electronic device based on obtaining a user input that instructs the electronic device and other electronic devices to set the target image (1210) as a setting image.

[0217] The electronic device can cause the other electronic device to display the second converted image (1222) as a configuration image of the other electronic device by transmitting the second converted image (1222) to the other electronic device. The other electronic device can receive the second converted image (1222) from the electronic device. On the screen (1240), the other electronic device can display the second converted image (1222) as a configuration image of the other electronic device.

[0218] However, the other electronic device is not limited to receiving the second converted image (1222) directly from the electronic device. The other electronic device may receive the second converted image (1222) from the electronic device via a server or cloud device. For example, the electronic device may transmit (e.g., upload) the generated second converted image (1222) to a server or cloud device. The other electronic device may receive the second converted image (1222) from a server or cloud device.

[0219] FIG. 13 is a block diagram illustrating an example configuration of an electronic device according to various embodiments.

[0220] An electronic device (1300) according to one embodiment (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIGS. 2A to 2D, the electronic device (300) of FIGS. 3A to 3D, and the electronic device (400) of FIG. 4) may include a user interface component (UI component) (1310) (hereinafter, also referred to as a 'UI component') and a content component (1320). Each of the user interface component (1310) and the content component (1320) may include a processing circuit.

[0221] According to one embodiment, a UI component (1310) may refer to a software and / or hardware component that provides a user interface (e.g., a classification setting interface), performs a function of obtaining user input obtained through the interface, and performs a function of displaying content (e.g., a target image or a transformed image) obtained from a content component (1320).

[0222] According to one embodiment, the content component (1320) may refer to a software and / or hardware component that performs a function of obtaining user settings (e.g., classification results) and a function of generating and / or storing content (e.g., target images or converted images) based on user input obtained through the UI component (1310).

[0223] According to one embodiment, the UI component (1310) may include a visual design module (1311), a notification interface module (1312), and a personalization interface module (1313).

[0224] According to one embodiment, the visual design module (1311) may apply visual effects to content obtained from the content component (1320). For example, the visual effects may include automatic slide, scroll, playback, and / or transition effects for a content set including one or more contents.

[0225] In one embodiment, the notification interface module (1312) may cause the electronic device to output a notification when it receives information indicating that content (e.g., a converted image) has been generated by the content component (1320). The notification interface module (1312) may add the generated content to the set of content provided to the user by providing the generated content to the visual design module (1311).

[0226] According to one embodiment, the personalization interface module (1313) may provide a user interface (e.g., a classification setting interface) that obtains user input for determining classification results that reflect the user's preferences for a plurality of candidate objects. The personalization interface module (1313) may provide a classification setting interface and determine a classification result based on user input obtained through the classification setting interface. The personalization interface module (1313) may provide a classification setting interface for each display condition and determine a classification result for each display condition.

[0227] According to one embodiment, the content component (1320) may include a data selection module (1321), a content recognition module (1322), a metadata-based classification module (1323), a natural language processing module (1324), a personalization module (1325), and a personalized data generation module (1326).

[0228] According to one embodiment, the data selection module (1321) may access a repository (not shown) that stores content accessible by the electronic device (e.g., images), stores generated content, or stores data related to user settings (e.g., classification results) and / or models (e.g., machine learning models, inpainting models). The repository is a space for storing data and may store content (e.g., images or videos) and metadata of the content. According to one embodiment, the repository may be implemented in the form of a single or distributed repository to ensure the integrity and consistency of the data stored in the repository. According to one embodiment, the repository may be implemented in the form of a database or a file system. The data selection module will be described in more detail below with reference to FIG. 14.

[0229] According to one embodiment, the content recognition module (1322) can analyze the relevance between the content and the candidate object by analyzing the content (e.g., an image or a video including multiple frame images). For example, the content recognition module (1322) can generate metadata regarding whether the content is related to the candidate object (e.g., a person or a pet) (e.g., whether the candidate object appears in the content), which part of the content the candidate object is related to (e.g., where the candidate object appears in the content), how the content is related to the candidate object (e.g., how large or important the candidate object appears in the image), and / or, if the content is related to multiple candidate objects, what the relationship is between the multiple candidate objects (e.g., determining the intimacy and / or atmosphere between the candidate objects).

[0230] According to one embodiment, the metadata-based classification module (1323) can classify and / or select content based on user settings (e.g., classification results) and content creation settings based on metadata mapped to the content.

[0231] According to one embodiment, the natural language processing module (1324) may analyze natural language recognized in content (e.g., images or videos) and, when content is generated, generate a title and / or body in natural language form from metadata.

[0232] According to one embodiment, the personalization module (1325) may transform an image (e.g., a target image) stored in a repository into a desired media (e.g., a transformed image) by processing (e.g., modifying, editing, and / or supplementing) the image based on user settings (e.g., a classification result). The personalization module (1325) is described in more detail below in FIG. 14 .

[0233] According to one embodiment, the personalized content generation module (1326) may generate content to be provided to a user based on the processing results of the content recognition module (1322), the metadata-based classification module, the natural language processing module (1324), and / or the personalization module (1325).

[0234] FIG. 14 is a block diagram illustrating an example configuration of an electronic device according to various embodiments.

[0235] An electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1, electronic device (200) of FIGS. 2A to 2D, electronic device (300) of FIGS. 3A to 3D, electronic device (400) of FIG. 4) may include a personalization module (1410) (e.g., personalization module (1325) of FIG. 13), a data selection module (1420) (e.g., data selection module (1321) of FIG. 13), and / or a content recognition module (1430) (e.g., content recognition module (1322) of FIG. 13).

[0236] According to one embodiment, the data selection module (1420) may provide only some content (e.g., some images) designated by the user from among the data in the storage as input for content creation. The data selection module (1420) may form guidelines necessary for creating an image desired by the user through some content designated by the user. Some content (e.g., multiple images) designated by the user may refer to a portion designated (e.g., limited) to be provided as input to the content creation module (1414) from among the data accessible by the electronic device. For example, some content may be designated based on a device storing the image, a directory (e.g., folder) in which the image is stored, an application, or a service.

[0237] However, some content may be further specified based on device, directory, application, or service. For example, some content may be further specified through user-specifiable conditions. User-specifiable conditions may include file format, file creation date, file name, equipment information, shooting setting information (e.g., aperture value, shutter speed, ISO sensitivity, or focal length), location information, editing program information, copyright information, image size, and / or color space.

[0238] According to one embodiment, the content recognition module (1430) can extract metadata from content (e.g., images or videos) acquired from the data selection module (1420), as described above in FIG. 13 . The content recognition module (1430) can analyze the substance of the content (e.g., images or videos) to distinguish candidate objects or determine (e.g., predict or infer) relationships between candidate objects. Furthermore, the content recognition module (1430) can determine overall semantic information and context of the content.

[0239] Although not explicitly illustrated in FIG. 14, the content recognition module (1430) may include a content processing sub-module, a feature extraction sub-module, or a content recognition sub-module. The content processing sub-module may preprocess content. The feature extraction sub-module may extract features from the preprocessed content. The content recognition sub-module may determine and / or understand the gist of the content based on the features extracted by the feature extraction sub-module. The operations of the content processing sub-module, the feature extraction sub-module, and the content recognition sub-module included in the aforementioned content recognition module (1430) may be performed for each content. For example, the content recognition module (1430) may analyze each content and, based on the results of recognizing features of the content, candidate objects appearing in the content, the background, and / or characters of the content, determine the gist of the content.

[0240] According to one embodiment, the personalization module (1410) may include an object recognition module (1411), an inpainting module (1412), a classification result determination module (1413), a content generation module (1414), and / or a content notification module (1415).

[0241] According to one embodiment, the object recognition module (1411) may recognize and / or track the location and / or movement of a candidate object appearing among a plurality of contents (e.g., sequential images or a plurality of videos) based on information obtained from the content recognition module (1430). In addition, the object recognition module (1411) may select data (e.g., target images) related to a topic required for generating new contents by recognizing and / or tracking the association (or relationship) between contents. The object recognition module (1411) may provide the selected data to the content generation module (1414).

[0242] In one embodiment, the inpainting module (1412) can correct and / or modify content (e.g., an image or video). The inpainting module (1412) can remove candidate objects (e.g., uninteresting objects) from an image (or each frame image of a video) and naturally reconstruct the removed portion.

[0243] According to one embodiment, the classification result determination module (1413) may determine the classification result based on at least one of the basic classification result or the conditional classification result.

[0244] For example, the basic classification result may represent a classification result unique to the user, independent of the display conditions (e.g., common to all display conditions). The basic classification result may include the classification of multiple candidate objects into objects of interest or objects of non-interest, which is applied generally to content generation based on the user's content, and / or information regarding the relationships between objects of interest.

[0245] For example, a conditional classification result may refer to a classification result related to (e.g., dependent on) a display condition. The conditional classification result may include the results of classifying multiple candidate objects into objects of interest or objects of no interest for a specific display condition, and / or information regarding the relationships between objects of interest.

[0246] A classification result determination module (1413) according to one embodiment may, in response to a newly specified display condition, provide a default classification result as an initial value of a condition classification result, and, based on a user input for changing the default classification result through a classification setting interface, obtain a classification result related to the newly specified display condition as a classification result corresponding to the display condition (e.g., a classification result used for generating a converted image).

[0247] The classification result determination module (1413) according to one embodiment may determine a classification result corresponding to a display condition by combining a classification result related to a display condition determined through a classification setting interface with a basic classification result. For example, the distance between objects of interest in the classification result corresponding to the display condition may be determined by averaging (e.g., arithmetic mean, harmonic mean, or geometric mean) the distance between objects of interest in the classification result related to the display condition and the distance between objects of interest in the basic classification result.

[0248] According to one embodiment, the content generation module (1414) can generate new content (e.g., a transformed image) based on the processing results of the data selection module (1420), the content recognition module (1430), the object recognition module (1411), the inpainting module (1412), and / or the classification result determination module (1413).

[0249] According to one embodiment, the content notification module (1415) may store the generated content in a repository and transmit information indicating the creation of new content to an external source (e.g., a UI component (1310) of FIG. 13).

[0250] According to one embodiment, an electronic device (e.g., 101; 200; 300; 400; 1300) comprises: a display (e.g., 160; 250; 330; 420); a processor (e.g., 120; 440); And a memory (e.g., 130) storing instructions, wherein when the instructions are executed by the processor (e.g., 120; 440), the electronic device (e.g., 101; 200; 300; 400; 1300) detects a plurality of candidate objects from a plurality of images (e.g., 820; 920), and determines a first classification result (e.g., 901) by classifying at least one of the plurality of candidate objects as an object of interest or an object of non-interest based on a user input for a first display condition regarding at least one of a device for displaying an image, an area of ​​a display of the device in which the image is displayed, or a time at which the image is displayed, and determines a second classification result (e.g., 902) by classifying at least one of the plurality of candidate objects as an object of interest or an object of non-interest based on a user input for a second display condition, and the target image (e.g., In the first classification result (e.g., 901) and the non-interest object of the first classification result (e.g., 901) are maintained in the first conversion image (e.g., 940; 1021; 1121; 1221) corresponding to the first display condition by maintaining the object of interest in the first classification result (e.g., 901) and excluding the non-interest object of the first classification result (e.g., 901), and in the target image (e.g., 830; 930; 1010; 1110; 1210), the second conversion image (e.g., 950; 1022; 1122; 1222) corresponding to the second display condition is generated by maintaining the object of interest in the second classification result (e.g., 902) and excluding the non-interest object of the second classification result (e.g., 902), and the electronic device (e.g., 101;While the first display condition (e.g., 200; 300; 400; 1300) is satisfied, the first converted image (e.g., 940; 1021; 1121; 1221) may be displayed, and while the electronic device (e.g., 101; 200; 300; 400; 1300) is satisfied, the second converted image (e.g., 950; 1022; 1122; 1222) may be displayed.

[0251] The display (e.g., 160; 250; 330; 420) includes a first region and a second region, and the first display condition includes displaying the image in the first region, and the second display condition includes displaying the image in the second region, and when the instructions are executed by the processor (e.g., 120; 440), causes the electronic device (e.g., 101; 200; 300; 400; 1300) to display the first transformed image (e.g., 940; 1021; 1121; 1221) in the first region based on displaying an image generated from the target image (e.g., 830; 930; 1010; 1110; 1210) in the first region, and to display the target image (e.g., 830; 930; 1010; 1121; 1221) in the second region. Based on displaying the image generated from (1110; 1210), the second transformed image (e.g., 950; 1022; 1122; 1222) can be displayed in the second area.

[0252] The display (e.g., 160; 250; 330; 420) includes a main display (e.g., 250; 330; 420) capable of changing states, and a sub-display, and a state of the electronic device (e.g., 101; 200; 300; 400; 1300) is switchable between a plurality of states including a first state (e.g., 1030) or a second state (e.g., 1040) according to a state change of the main display (e.g., 250; 330; 420), and the first display condition includes displaying the image on the main display (e.g., 250; 330; 420), and the second display condition includes displaying the image on the sub-display, and when the instructions are executed by the processor (e.g., 120; 440), the electronic device (e.g., 101; 200; 300; 400; 1300) is switchable between a plurality of states including a first state (e.g., 1030) or a second state (e.g., 1040). The electronic device (e.g., 101; 200; 300; 400; 1300) may be configured to display the first transformed image (e.g., 940; 1021; 1121; 1221) on the main display (e.g., 250; 330; 420) while the state of the electronic device (e.g., 101; 200; 300; 400; 1300) is the first state (e.g., 1030), and display the second transformed image (e.g., 950; 1022; 1122; 1222) on the sub display while the state of the electronic device (e.g., 101; 200; 300; 400; 1300) is the second state (e.g., 1040).

[0253] The first display condition includes that the time of displaying the image is included in a first time range, and the second display condition includes that the time of displaying the image is included in a second time range different from the first time range, and when the instructions are executed by the processor (e.g., 120; 440), the electronic device (e.g., 101; 200; 300; 400; 1300) can display the first converted image (e.g., 940; 1021; 1121; 1221) based on the timepoint of display being included in the first time range, and display the second converted image (e.g., 950; 1022; 1122; 1222) based on the timepoint of display being included in the second time range.

[0254] The first display condition includes that the time of displaying the image is included in a first time range, and the second display condition includes that the time of displaying the image is included in a second time range temporally subsequent to the first time range, and when the instructions are executed by the processor (e.g., 120; 440), the electronic device (e.g., 101; 200; 300; 400; 1300) displays the first converted image (e.g., 940; 1021; 1121; 1221) based on the display time being included in the first time range, and when the display time elapses and falls within the second time range, the image displayed on the display (e.g., 160; 250; 330; 420) is displayed as the first converted image (e.g., 940; 1021; 1121; 1221). It can be changed from the second conversion image (e.g., 950; 1022; 1122; 1222) to the second conversion image (e.g., 1121; 1221).

[0255] The electronic device (e.g., 101; 200; 300; 400; 1300) further includes a communication circuit, and the first display condition includes that the electronic device (e.g., 101; 200; 300; 400; 1300) displays the image, and the second display condition includes that another electronic device displays the image, and when the instructions are executed by the processor (e.g., 120; 440), causes the electronic device (e.g., 101; 200; 300; 400; 1300) to set the target image (e.g., 830; 930; 1010; 1110; 1210) as a setting image commonly to the electronic device (e.g., 101; 200; 300; 400; 1300) and the other electronic devices. Based on obtaining a user input indicating the user, the first converted image (e.g., 940; 1021; 1121; 1221) may be displayed as a setting image of the electronic device (e.g., 101; 200; 300; 400; 1300), and the second converted image (e.g., 950; 1022; 1122; 1222) may be transmitted to the other electronic device, thereby causing the other electronic device to display the second converted image (e.g., 950; 1022; 1122; 1222) as a setting image of the other electronic device.

[0256] When the instructions are executed by the processor (e.g., 120; 440), the electronic device (e.g., 101; 200; 300; 400; 1300) displays a classification setting interface (e.g., 600-1; 600-2; 700) including an interest object region (e.g., 610) corresponding to the object of interest, an uninterested object region (e.g., 620) corresponding to the object of non-interest, and an unclassified object region (e.g., 630) corresponding to an unclassified object, and, in the classification setting interface (e.g., 600-1; 600-2; 700), displays each of a plurality of graphical representations respectfully corresponding to the plurality of candidate objects in a size based on a frequency of appearance of the corresponding candidate object, and, based on a user input that moves at least one graphical representation among the plurality of graphical representations, The location of the representation can be changed, and the candidate object can be classified based on an area containing the location of the graphic representation corresponding to each candidate object among the area of ​​interest object (e.g., 610), the area of ​​non-interest object (e.g., 620), or the area of ​​unclassified object (e.g., 630).

[0257] When the instructions are executed by the processor (e.g., 120; 440), the electronic device (e.g., 101; 200; 300; 400; 1300) may be caused to adjust a likelihood of selecting an image in which the first candidate object and the second candidate object appear among the plurality of images (e.g., 820; 920) as the target image (e.g., 830; 930; 1010; 1110; 1210) based on a distance between a first graphical representation corresponding to a first candidate object among the plurality of candidate objects and a second graphical representation corresponding to a second candidate object among the plurality of candidate objects.

[0258] When the instructions are executed by the processor (e.g., 120; 440), the electronic device (e.g., 101; 200; 300; 400; 1300) may be caused to adjust the size of at least one graphical representation among a plurality of graphical representations individually corresponding to the plurality of candidate objects based on a user input for adjusting the size of the at least one graphical representation, and to adjust the likelihood of selecting an image in which the candidate object corresponding to the at least one graphical representation appears as the target image (e.g., 830; 930; 1010; 1110; 1210) based on the adjusted size.

[0259] When the instructions are executed by the processor (e.g., 120; 440), the electronic device (e.g., 101; 200; 300; 400; 1300) may be caused to change a position of at least one graphical representation among a plurality of graphical representations individually corresponding to the plurality of candidate objects based on a user input for moving the at least one graphical representation, and determine, based on an overlapping area of ​​a first graphical representation and a second graphical representation among the plurality of graphical representations, that a first candidate object corresponding to the first graphical representation is the same object as a second candidate object corresponding to the second graphical representation.

[0260] When the above instructions are executed by the processor (e.g., 120; 440), the electronic device (e.g., 101; 200; 300; 400; 1300) may be caused to select, from among the plurality of images (e.g., 820; 920), at least one image in which at least one of the object of interest of the first classification result (e.g., 901) or the object of interest of the second classification result (e.g., 902) appears, as the target image (e.g., 830; 930; 1010; 1110; 1210).

[0261] A method performed by an electronic device (e.g., 101; 200; 300; 400; 1300) comprises: detecting a plurality of candidate objects from a plurality of images (e.g., 820; 920); determining a first classification result (e.g., 901) by classifying at least one of the plurality of candidate objects as an object of interest or an object of non-interest based on a user input for a first display condition regarding at least one of a device displaying an image, an area of ​​a display (e.g., 160; 250; 330; 420) of the device in which the image is displayed, or a time of display of the image; determining a second classification result (e.g., 902) by classifying at least one of the plurality of candidate objects as an object of interest or an object of non-interest based on a user input for a second display condition; An operation of generating a first conversion image (e.g., 940; 1021; 1121; 1221) corresponding to the first display condition by maintaining the object of interest of the first classification result (e.g., 901) and excluding the object of no interest of the first classification result (e.g., 901) in the target image (e.g., 830; 930; 1010; 1110; 1210); An operation of generating a second conversion image (e.g., 950; 1022; 1122; 1222) corresponding to the second display condition by maintaining the object of interest of the second classification result (e.g., 902) and excluding the object of no interest of the second classification result (e.g., 902) in the target image (e.g., 830; 930; 1010; 1110; 1210); An operation of displaying the first converted image (e.g., 940; 1021; 1121; 1221) while the electronic device (e.g., 101; 200; 300; 400; 1300) satisfies the first display condition; and the operation of displaying the first converted image (e.g., 940; 1021; 1121; 1221) while the electronic device (e.g., 101; 200; 300; 400;While the second display condition (1300) is satisfied, the second converted image (e.g., 950; 1022; 1122; 1222) may be displayed.

[0262] The first display condition includes displaying the image in the first area of ​​the display (e.g., 160; 250; 330; 420) of the electronic device (e.g., 101; 200; 300; 400; 1300), the second display condition includes displaying the image in the second area of ​​the display (e.g., 160; 250; 330; 420) of the electronic device (e.g., 101; 200; 300; 400; 1300), and the operation of displaying the first converted image (e.g., 940; 1021; 1121; 1221) is based on displaying an image generated from the target image (e.g., 830; 930; 1010; 1110; 1210) in the first area, and the first converted image (e.g., The operation of displaying the second converted image (e.g., 950; 1022; 1122; 1222) may include an operation of displaying the second converted image (e.g., 950; 1022; 1122; 1222) in the second area based on displaying an image generated from the target image (e.g., 830; 930; 1010; 1110; 1210) in the second area.

[0263] The first display condition includes displaying the image on the main display (e.g., 250; 330; 420) in the first area among the main display (e.g., 250; 330; 420) and the sub-display, which are capable of changing states included in the display (e.g., 160; 250; 330; 420) of the electronic device (e.g., 101; 200; 300; 400; 1300), and the second display condition includes displaying the image on the sub-display, and the state of the electronic device (e.g., 101; 200; 300; 400; 1300) is switchable between a plurality of states including a first state (e.g., 1030) or a second state (e.g., 1040) according to a state change of the main display (e.g., 250; 330; 420), and the first transformation The operation of displaying the image (e.g., 940; 1021; 1121; 1221) includes an operation of displaying the first transformed image (e.g., 940; 1021; 1121; 1221) on the main display (e.g., 250; 330; 420) while the state of the electronic device (e.g., 101; 200; 300; 400; 1300) is the first state (e.g., 1030), and the operation of displaying the second transformed image (e.g., 950; 1022; 1122; 1222) includes an operation of displaying the second transformed image (e.g., 950; 1022; 1122; 1222) on the sub display while the state of the electronic device (e.g., 101; 200; 300; 400; 1300) is the second state (e.g., 1040). It may include actions that display 1022; 1122; 1222).

[0264] The first display condition may include that the time of displaying the image is included in a first time range, and the second display condition may include that the time of displaying the image is included in a second time range different from the first time range, and the operation of displaying the first converted image (e.g., 940; 1021; 1121; 1221) may include an operation of displaying the first converted image (e.g., 940; 1021; 1121; 1221) based on the timepoint of display being included in the first time range, and the operation of displaying the second converted image (e.g., 950; 1022; 1122; 1222) may include an operation of displaying the second converted image (e.g., 950; 1022; 1122; 1222) based on the timepoint of display being included in the second time range.

[0265] The first display condition includes that the time of displaying the image is included in a first time range, and the second display condition includes that the time of displaying the image is included in a second time range temporally subsequent to the first time range, and the operation of displaying the first converted image (e.g., 940; 1021; 1121; 1221) includes an operation of displaying the first converted image (e.g., 940; 1021; 1121; 1221) based on the display time being included in the first time range, and the operation of displaying the second converted image (e.g., 950; 1022; 1122; 1222) includes an operation of displaying the image displayed on the display (e.g., 160; 250; 330; 420) based on the display time being included in the first time range, and the display time being included in the second time range as time elapses (e.g., elapses) includes an operation of displaying the image displayed on the display (e.g., 160; 250; 330; 420) based on the display time being included in the first time range. It may include an action of changing from the first transformed image (e.g., 940; 1021; 1121; 1221) to the second transformed image (e.g., 950; 1022; 1122; 1222).

[0266] The first display condition includes that the electronic device (e.g., 101; 200; 300; 400; 1300) displays the image, the second display condition includes that another electronic device displays the image, and the operation of displaying the first converted image (e.g., 940; 1021; 1121; 1221) is based on obtaining a user input that instructs the electronic device (e.g., 101; 200; 300; 400; 1300) and the other electronic device to set the target image (e.g., 830; 930; 1010; 1110; 1210) as a set image. The operation of displaying the second converted image (e.g., 950; 1022; 1122; 1222) may include an operation of transmitting the second converted image (e.g., 950; 1022; 1122; 1222) to the other electronic device, thereby causing the other electronic device to display the second converted image (e.g., 950; 1022; 1122; 1222) as a set image of the other electronic device.

[0267] The operation of determining the first classification result (e.g., 901) comprises: an operation of displaying a classification setting interface (e.g., 600-1; 600-2; 700) including an interest object region (e.g., 610) corresponding to the interest object, an uninterested object region (e.g., 620) corresponding to the uninterested object, and an unclassified object region (e.g., 630) corresponding to the unclassified object; an operation of displaying, in the classification setting interface (e.g., 600-1; 600-2; 700), each of a plurality of graphical representations respectfully corresponding to the plurality of candidate objects, with a size based on a frequency of appearance of the corresponding candidate object; an operation of changing a position of at least one graphical representation based on a user input of moving at least one graphical representation among the plurality of graphical representations; And it may include an operation of classifying the candidate object based on an area including the location of a graphical representation corresponding to each candidate object among the above-mentioned object area (e.g., 610), the above-mentioned object area (e.g., 620), or the above-mentioned unclassified object area (e.g., 630).

[0268] The method may further include adjusting a likelihood of selecting an image in which the first candidate object and the second candidate object appear among the plurality of images (e.g., 820; 920) as the target image (e.g., 830; 930; 1010; 1110; 1210) based on a distance between a first graphical representation corresponding to a first candidate object among the plurality of candidate objects and a second graphical representation corresponding to a second candidate object. Reference numbers are used herein for illustrative purposes and are not intended to be limiting.

[0269] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0270] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0271] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0272] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0273] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0274] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0275] The embodiments described above may be implemented using hardware components, software components, and / or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may be implemented using a general-purpose computer or a special-purpose computer, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and software applications running on the operating system. Furthermore, the processing device may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0276] Software may include computer programs, codes, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, or computer storage medium or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on a computer-readable recording medium.

[0277] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., alone or in combination, and the program commands recorded on the medium may be those specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0278] The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

[0279] While the present disclosure has been illustrated and described with reference to various embodiments, it is to be understood that the various embodiments are illustrative and not restrictive. It will be further understood that various changes in form and detail may be made by those skilled in the art without departing from the spirit and scope of the present disclosure, including the appended claims and their equivalents. Furthermore, it will be understood that any of the embodiment(s) described herein can be utilized in conjunction with other embodiment(s) described herein.

Claims

1. In electronic devices (101; 200; 300; 400; 1300), Display(160; 250; 330; 420); At least one processor (120; 440) comprising a processing circuit; and Includes a memory (130) for storing instructions, When the above instructions are individually and / or collectively executed by the at least one processor (120; 440), the electronic device (101; 200; 300; 400; 1300) causes: Detecting multiple candidate objects from multiple images (820; 920), A first classification result (901) is determined by classifying at least one of the plurality of candidate objects as an object of interest or an object of non-interest based on a user input for a first display condition regarding at least one of a device displaying an image, an area of ​​the display of the device in which the image is displayed, or a time at which the image is displayed, Based on the user input for the second display condition, a second classification result (902) is determined by classifying at least one of the plurality of candidate objects as an object of interest or an object of no interest, In the target image (830; 930; 1010; 1110; 1210), by maintaining the object of interest of the first classification result (901) and excluding the object of no interest of the first classification result (901), a first conversion image (940; 1021; 1121; 1221) corresponding to the first display condition is generated, In the above target image (830; 930; 1010; 1110; 1210), a second transformed image (950; 1022; 1122; 1222) corresponding to the second display condition is generated by maintaining the object of interest of the second classification result (902) and excluding the object of no interest of the second classification result (902). While the above electronic device (101; 200; 300; 400; 1300) satisfies the first display condition, the first converted image (940; 1021; 1121; 1221) is displayed, While the above electronic device (101; 200; 300; 400; 1300) satisfies the second display condition, the second converted image (950; 1022; 1122; 1222) is displayed. To do, Electronic devices (101; 200; 300; 400; 1300).

2. In paragraph 1, The above display (160; 250; 330; 420) is Includes the first area and the second area, The above first display condition is, Including displaying the image in the first area, The above second display condition is, Including displaying the image in the second area, When the above instructions are executed by the at least one processor (120; 440), the electronic device (101; 200; 300; 400; 1300) causes: Based on displaying an image generated from the target image (830; 930; 1010; 1110; 1210) in the first region, displaying the first transformed image (940; 1021; 1121; 1221) in the first region, Based on displaying an image generated from the target image (830; 930; 1010; 1110; 1210) in the second area, displaying the second transformed image (950; 1022; 1122; 1222) in the second area To do, Electronic devices (101; 200; 300; 400; 1300).

3. In any one of paragraphs 1 and 2, The above display (160; 250; 330; 420) is Includes a main display (250; 330; 420) and a sub display that can change status, The status of the above electronic devices (101; 200; 300; 400; 1300) is: It is possible to switch between a plurality of states including a first state (1030) and a second state (1040) according to a change in the state of the above main display (250; 330; 420), The above first display condition is, Including displaying the above image on the main display (250; 330; 420), The above second display condition is, Including displaying the image on the sub-display, When the above instructions are executed by the at least one processor (120; 440), the electronic device (101; 200; 300; 400; 1300) causes: While the state of the electronic device (101; 200; 300; 400; 1300) is the first state (1030), the first transformed image (940; 1021; 1121; 1221) is displayed on the main display (250; 330; 420), While the state of the electronic device (101; 200; 300; 400; 1300) is the second state (1040), the second converted image (950; 1022; 1122; 1222) is displayed on the sub-display. To do, Electronic devices (101; 200; 300; 400; 1300).

4. In any one of paragraphs 1 to 3, The above first display condition is, Including that the time at which the above image is displayed is included in the first time range, The above second display condition is, Including that the time at which the image is displayed is included in a second time range different from the first time range, When the above instructions are executed by the at least one processor (120; 440), the electronic device (101; 200; 300; 400; 1300) causes: Displaying the first transformed image (940; 1021; 1121; 1221) based on the timepoint of display being included in the first time range, Based on the fact that the above display time is included in the second time range, the second transformed image (950; 1022; 1122; 1222) is displayed. To do, Electronic devices (101; 200; 300; 400; 1300).

5. In any one of paragraphs 1 to 4, The above first display condition is, Including that the time at which the above image is displayed is included in the first time range, The above second display condition is, The time at which the image is displayed is included in a second time range that is temporally subsequent to the first time range, When the above instructions are executed by the at least one processor (120; 440), the electronic device (101; 200; 300; 400; 1300) causes: Displaying the first transformed image (940; 1021; 1121; 1221) based on the display time being included in the first time range, As time elapses, if the display point falls outside the first time range and falls within the second time range, the image displayed on the display (160; 250; 330; 420) is changed from the first converted image (940; 1021; 1121; 1221) to the second converted image (950; 1022; 1122; 1222). To do, Electronic devices (101; 200; 300; 400; 1300).

6. In any one of paragraphs 1 to 5, The above electronic devices (101; 200; 300; 400; 1300) Further including communication circuits, The above first display condition is, The electronic device (101; 200; 300; 400; 1300) includes displaying the image, The above second display condition is, Including another electronic device displaying said image, When the above instructions are executed by the at least one processor (120; 440), the electronic device (101; 200; 300; 400; 1300) causes: Based on obtaining a user input instructing to set the target image (830; 930; 1010; 1110; 1210) as a setting image in common to the electronic device (101; 200; 300; 400; 1300) and the other electronic device, displaying the first converted image (940; 1021; 1121; 1221) as a setting image of the electronic device (101; 200; 300; 400; 1300), By transmitting the second converted image (950; 1022; 1122; 1222) to the other electronic device, the other electronic device can display the second converted image (950; 1022; 1122; 1222) as a setting image of the other electronic device. To do, Electronic devices (101; 200; 300; 400; 1300).

7. In any one of paragraphs 1 to 6, When the above instructions are executed by the at least one processor (120; 440), the electronic device (101; 200; 300; 400; 1300) causes: Displaying a classification setting interface (600-1; 600-2; 700) including an interest object area (610) corresponding to the object of interest, an uninterested object area (620) corresponding to the object of non-interest, and an unclassified object area (630) corresponding to the unclassified object, In the above classification setting interface (600-1; 600-2; 700), each of a plurality of graphic representations that individually correspond to the plurality of candidate objects is displayed with a size based on the frequency of appearance of the corresponding candidate object, Changing the position of at least one graphic representation based on a user input that moves at least one graphic representation among the plurality of graphic representations; Classify the candidate object based on the area containing the location of the graphical representation corresponding to each candidate object among the above-mentioned object area (610), the above-mentioned non-interest object area (620), or the above-mentioned unclassified object area (630). To do, Electronic devices (101; 200; 300; 400; 1300).

8. In any one of paragraphs 1 to 7, When the above instructions are executed by the at least one processor (120; 440), the electronic device (101; 200; 300; 400; 1300) causes: Based on the distance between the first graphical representation corresponding to the first candidate object among the plurality of candidate objects and the second graphical representation corresponding to the second candidate object, the possibility of selecting an image in which the first candidate object and the second candidate object appear among the plurality of images (820; 920) as the target image (830; 930; 1010; 1110; 1210) is adjusted. To do, Electronic devices (101; 200; 300; 400; 1300).

9. In any one of paragraphs 1 to 8, When the above instructions are executed by the at least one processor (120; 440), the electronic device (101; 200; 300; 400; 1300) causes: Resizing at least one graphical representation based on a user input that adjusts the size of at least one graphical representation among a plurality of graphical representations individually corresponding to the plurality of candidate objects, Adjusting the likelihood of selecting an image in which at least one graphic representation of a corresponding candidate object appears as the target image (830; 930; 1010; 1110; 1210) based on the adjusted size To do, Electronic devices (101; 200; 300; 400; 1300).

10. In any one of paragraphs 1 to 9, When the above instructions are executed by the at least one processor (120; 440), the electronic device (101; 200; 300; 400; 1300) causes: Changing the position of at least one graphical representation based on a user input that moves at least one graphical representation among a plurality of graphical representations individually corresponding to the plurality of candidate objects, Based on the overlapping area of ​​the first graphic representation and the second graphic representation among the plurality of graphic representations, it is determined that the first candidate object corresponding to the first graphic representation is the same object as the second candidate object corresponding to the second graphic representation. To do, Electronic devices (101; 200; 300; 400; 1300).

11. In any one of paragraphs 1 to 10, When the above instructions are executed by the at least one processor (120; 440), the electronic device (101; 200; 300; 400; 1300) causes: Among the plurality of images (820; 920), at least one image in which at least one of the object of interest of the first classification result (901) or the object of interest of the second classification result (902) appears is selected as the target image (830; 930; 1010; 1110; 1210). To do, Electronic devices (101; 200; 300; 400; 1300).

12. In a method performed by an electronic device (101; 200; 300; 400; 1300), An operation of detecting multiple candidate objects from multiple images (820; 920); An operation of determining a first classification result (901) by classifying at least one of the plurality of candidate objects as an object of interest or an object of non-interest based on a user input for a first display condition regarding at least one of a device displaying an image, an area in which the image is displayed among a display (160; 250; 330; 420) of the device, or a time at which the image is displayed; An operation of determining a second classification result (902) by classifying at least one of the plurality of candidate objects as an object of interest or an object of no interest based on a user input for a second display condition; An operation of generating a first conversion image (940; 1021; 1121; 1221) corresponding to the first display condition by maintaining the object of interest of the first classification result (901) and excluding the object of no interest of the first classification result (901) in the target image (830; 930; 1010; 1110; 1210); An operation of generating a second transformed image (950; 1022; 1122; 1222) corresponding to the second display condition by maintaining the object of interest of the second classification result (902) and excluding the object of no interest of the second classification result (902) in the target image (830; 930; 1010; 1110; 1210); An operation of displaying the first converted image (940; 1021; 1121; 1221) while the electronic device (101; 200; 300; 400; 1300) satisfies the first display condition; and An operation of displaying the second converted image (950; 1022; 1122; 1222) while the electronic device (101; 200; 300; 400; 1300) satisfies the second display condition. How to include.

13. In paragraph 12, The above first display condition is, Including displaying the image in the first area of ​​the display (160; 250; 330; 420) of the electronic device (101; 200; 300; 400; 1300), The above second display condition is, Including displaying the image in the second area of ​​the display (160; 250; 330; 420) of the electronic device (101; 200; 300; 400; 1300), The operation of displaying the above first converted image (940; 1021; 1121; 1221) is as follows: An operation of displaying the first transformed image (940; 1021; 1121; 1221) in the first area based on displaying an image generated from the target image (830; 930; 1010; 1110; 1210) in the first area, The operation of displaying the above second converted image (950; 1022; 1122; 1222) is as follows: An operation of displaying the second transformed image (950; 1022; 1122; 1222) in the second area based on displaying an image generated from the target image (830; 930; 1010; 1110; 1210) in the second area, method.

14. In any one of paragraphs 12 to 13, The above first display condition is, Among the main display (250; 330; 420) and sub-displays capable of changing states included in the display (160; 250; 330; 420) of the electronic device (101; 200; 300; 400; 1300), including displaying on the main display (250; 330; 420) in the first area, The above second display condition is, Including displaying the image on the sub-display, The status of the above electronic devices (101; 200; 300; 400; 1300) is: It is possible to switch between a plurality of states including a first state (1030) or a second state (1040) according to a change in the state of the above main display (250; 330; 420), The operation of displaying the above first converted image (940; 1021; 1121; 1221) is as follows: An operation of displaying the first converted image (940; 1021; 1121; 1221) on the main display (250; 330; 420) while the state of the electronic device (101; 200; 300; 400; 1300) is the first state (1030), The operation of displaying the above second converted image (950; 1022; 1122; 1222) is as follows: An operation of displaying the second converted image (950; 1022; 1122; 1222) on the sub-display while the state of the electronic device (101; 200; 300; 400; 1300) is the second state (1040), method.

15. A computer-readable recording medium storing one or more computer programs including commands for performing the method of any one of claims 12 to 14.

Images