Image generation based on user preference, and electronic device therefor

Abstract

Various embodiments of the present invention can comprise a display (160), a memory (130), and a processor (120). When the processor is executed by means of instructions stored in the memory, an electronic device (101) can be configured to: recognize one or more objects included in one or more images; determine a category corresponding to the one or more objects; select, from among the one or more objects, at least one target object to be displayed on the display; determine arrangement information of the at least one target object on the basis of the determined category and the images; and provide, on the basis of the arrangement information of the at least one target object, a new image in which the at least one target object is arranged. Various embodiments are possible.

Description

Image generation and its electronic devices based on user preferences

[0001] Various embodiments of the present disclosure relate to image generation based on user preferences and electronic devices thereof.

[0002] With the advancement of digital technology, various types of electronic devices, such as mobile terminals, personal digital assistants (PDAs), electronic notebooks, smartphones, tablet PCs (personal computers), and wearable devices, are becoming widely used. These electronic devices are constantly undergoing improvements in their hardware and / or software to support and enhance their functionality.

[0003] Users share their daily lives through social networking services and connect with others with similar interests and tastes. Users may want to create images that reflect their unique personalities, distinguishing them from others.

[0004] In one embodiment, a method and device for recognizing objects (e.g., people, objects, animals) included in an image, arranging the objects based on categories corresponding to the recognized objects to generate a new image, and utilizing the generated image as an album cover or background image may be disclosed.

[0005] An electronic device (101) according to an embodiment of the present disclosure may be configured to cause the electronic device to recognize one or more objects included in one or more images, determine a category corresponding to the one or more objects, select at least one target object to be displayed on the display among the one or more objects, determine arrangement information of the at least one target object, and provide a new image in which the at least one target object is arranged based on the determined category and the arrangement information of the at least one target object based on the image, when the processor is executed by instructions stored in the display (160), the processor (120); and the memory (130).

[0006] An operating method of an electronic device (101) according to an embodiment of the present disclosure may include an operation of recognizing one or more objects included in one or more images, an operation of determining a category corresponding to the one or more objects, an operation of selecting at least one target object to be displayed on the display among the one or more objects, an operation of determining arrangement information of the at least one target object based on the determined category and the image, and an operation of providing a new image in which the at least one target object is arranged based on the arrangement information of the at least one target object.

[0007] In one embodiment, a new image that better reflects the user's preferences and favorite tastes can be provided.

[0008] According to one embodiment, user convenience can be improved by automatically generating an image that represents a user's unique characteristics compared to other users.

[0009] In one embodiment, providing a representative image that reflects the characteristics of a user may provide a more efficient approach to composing background images, album cover images, etc. that are more relevant to the user, and may provide improved navigation and / or access to saved items.

[0010] Accordingly, according to one embodiment, a user-relevant background image of an electronic device may be generated with no or reduced user input. The background image may be periodically updated and refreshed even with no or reduced user input.

[0011] In one embodiment, images (e.g., background images) may be generated for different sized displays, and images may be synchronized between multiple displays of different sizes within a single electronic device.

[0012] In one embodiment, an unstructured but relevant image (e.g., collage-like) may be generated and used as a background image or for other purposes.

[0013] In one embodiment, the generated image may increase the number of objects displayed to the user through extraction and superimposition of image objects so that increased information about the contents of the folder may be presented to the user.

[0014] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0015] FIG. 2 is a diagram illustrating an example of an electronic device recognizing an object included in an image and providing a new image according to one embodiment.

[0016] FIG. 3 is a flowchart illustrating an operating method of an electronic device according to one embodiment.

[0017] FIG. 4 is a diagram illustrating an example of dividing an object display area in an electronic device according to one embodiment.

[0018] FIG. 5A is a flowchart illustrating a method for recognizing an object included in an image of an electronic device according to one embodiment.

[0019] FIG. 5b is a flowchart illustrating a method for determining at least one target object of an electronic device according to one embodiment.

[0020] FIG. 6 is a diagram illustrating an example of providing a new image including a title in an electronic device according to one embodiment.

[0021] FIG. 7 is a flowchart illustrating a method for generating an image including a title of an electronic device according to one embodiment.

[0022] FIGS. 8A and 8B are drawings illustrating an example of placing an object in an object display area in an electronic device according to one embodiment.

[0023] FIG. 8c is a flowchart illustrating a method for placing at least one target object in an electronic device according to one embodiment.

[0024] FIG. 9 is a diagram illustrating an example of determining an object arrangement structure in an electronic device according to one embodiment.

[0025] FIGS. 10A and 10B are drawings illustrating an example of changing the display position of an object in an electronic device according to one embodiment.

[0026] FIGS. 11A and 11B are drawings illustrating an example of applying a background color to an image in an electronic device according to one embodiment.

[0027] FIGS. 12A to 12C are drawings illustrating an example of utilizing a background image in an electronic device according to one embodiment.

[0028] FIG. 13 is a diagram illustrating an example of reconstructing a background image according to a display size in an electronic device according to one embodiment.

[0029] FIG. 14 is a diagram illustrating an example of displaying a background image differently depending on the display size in an electronic device according to one embodiment.

[0030] FIGS. 15A to 15C are drawings illustrating an example of applying a decoration effect to a background image in an electronic device according to one embodiment.

[0031] FIG. 16 is a diagram illustrating an example of generating an image based on a story of an image in an electronic device according to one embodiment.

[0032] FIG. 17 is a diagram illustrating an example of applying motion to an object included in an image in an electronic device according to one embodiment.

[0033] FIGS. 18A and 18B are diagrams illustrating an example of creating a new image from an image stored on a server in an electronic device according to one embodiment.

[0034] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0035] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0036] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0037] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0038] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0039] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0040] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0041] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0042] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0043] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0044] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0045] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0046] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0047] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0048] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0049] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0050] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0051] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0052] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0053] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0054] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0055] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0056] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0057] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0058] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0059] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0060] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0061] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0062] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0063] The implementations presented in this disclosure may be combined in any suitable manner, unless such combinations are explicitly excluded or incompatible. Adaptations of one or more operations of the methods described in this disclosure are also within the scope of this disclosure. For example, operations may be rearranged or eliminated, or new operations may be introduced without departing from the scope of this disclosure.

[0064] FIG. 2 is a diagram illustrating an example of an electronic device recognizing an object included in an image and providing a new image according to one embodiment.

[0065] Referring to FIG. 2, an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may recognize an object(s) included in one or more images by analyzing one or more images using a known suitable form of image recognition. The electronic device (101) may recognize an object included in an image to generate a first image (210). The recognized object may refer to a subject included in the image. For example, the electronic device (101) may analyze an image stored in a memory (e.g., the memory (130) of FIG. 1) to recognize an object included in the image and determine a category corresponding to the recognized object. Alternatively or additionally, the electronic device (101) may also analyze an image stored in a cloud server (e.g., the server (108) of FIG. 1) by a user of the electronic device (101), similarly to the image stored in the memory (130), to recognize an object included in the image and determine a category corresponding to the recognized object. The above category may be a person, an object, or an animal. The electronic device (101) may determine object placement information based on the determined category and / or the recognized object(s) and / or additional information about the recognized image, and may generate a first image (211) in which the object is placed based on the determined placement information.

[0066] The first image (211) may include at least one target object and a title (215) corresponding to a plurality of categories. Here, the category and the at least one target object may have been determined based on the recognition step described above. The at least one target object may include a user object (213) (e.g., a user's image), a first target object (212), a second target object (214), a third target object (216), and a fourth target object (217). The electronic device (101) may determine the target object based on the creation time of the image including the object, the usage time of the image including the object (e.g., viewing, sharing, etc.), the size of the object, or the shape of the object. The electronic device (101) may determine the target object based on the frequency of the category in the stored image so that the target object may represent an object / image that is of greater interest to the user. The electronic device (101) can generate a first image (211) by including a user object (213) as a background, additionally arranging a first target object (212), a second target object (214), a third target object (216), and a fourth target object (217) at the edges of the user object (213), and arranging a title (215) at the top center.

[0067] According to one embodiment, the electronic device (101) may select an image / object category to be displayed on a display (e.g., a display module (160) of FIG. 1) based on the number of images / objects per category, divide (or determine) an object display area corresponding to the selected category, and display at least one target object having the same or similar category in each divided object display area. In the image (211), an example of being divided into four object display areas is illustrated, and the number of object display areas may be more than four (e.g., 5) or less (e.g., 2, 3). A first target object (212) may be for a first category, a second target object (214) may be for a second category, a third target object (216) may be for a third category, and a fourth target object (217) may be for a fourth category. There may be one or more target objects for each category.

[0068] The electronic device (101) can display first tag information (#Painting) corresponding to at least one first target object (212), second tag information (#Dessert) corresponding to at least one second target object (214), third tag information (#Wine) corresponding to at least one third target object (216), and fourth tag information (#Lighting) corresponding to at least one fourth target object (217). The electronic device (101) can analyze the tag information corresponding to at least one target object to extract a title (215). The electronic device (101) can also determine the title (215) based on the criteria for determining the target object, such as the most viewed image or the most common type of image / object. The electronic device (101) can execute a gallery application according to a user request and display an execution screen (210) of the gallery application including the first image (211). The first image (211) can be used as a background image. By providing the first image (211) as the screen of the gallery application, an efficient approach can be provided to display related content of the gallery application (or other applications), which can improve navigation. Alternatively, a background image relevant to the user can be generated with less user input.

[0069] The electronic device (101) can recognize one or more objects included in one or more images through appropriate image recognition to generate a second image (231). The second image (231) may include at least one object of the same category arranged in a spiral shape and a title (Table lights). The electronic device (101) may utilize the second image (231) as an album cover for an album containing images related to table lights. For example, the electronic device (101) may execute a gallery application at a user request and display an execution screen (230) of the gallery application including the second image (231) and a list of light images (233). The second image (231) may be utilized as an album cover. The list of light images (233) may include objects recognized from stored images and / or images including recognized objects. Providing an album cover in this manner may provide an improved navigation interface because the user can quickly and easily recognize the contents of the album due to the customization of the album cover.

[0070] The electronic device (101) may generate a third image (251) in which a plurality of objects recognized from a stored image are randomly arranged based on the category of the object. Tag information corresponding to the category of the object may also be displayed. The third image (251) may include first tag information (252, #My fave Food) corresponding to at least one first target object of a plurality of similar or identical categories, second tag information (253, #Car, #Vintage) corresponding to at least one second target object of a plurality of similar or identical categories, and third tag information (255, #Lighting) corresponding to at least one third target object of a plurality of similar or identical categories. The electronic device (101) may display two pieces of tag information (e.g., #Car, #Vintage) corresponding to at least one second target object of a plurality of similar or identical categories, or such objects commonly found in the image. According to one embodiment, the electronic device (101) may determine a background color of a third image (251) based on a color of at least one target object, and apply the determined background color to the third image (251). The electronic device (101) may execute a gallery application according to a user request, and display an execution screen (250) of the gallery application including the third image (251). The third image (251) may be used as a background image. The background color of the images (211, 231) may also be determined based on the color of one or more target objects included therein.

[0071] An electronic device (101) according to an embodiment of the present disclosure may be configured to cause the electronic device to recognize an object included in an image, determine a category corresponding to the object, select a target object to be displayed on the display among the recognized objects, determine arrangement information of the target object based on the determined category and the image, and provide a new image in which the target object is arranged based on the arrangement information of the target object, when the processor is executed by instructions stored in the display (160), the processor (120), and the memory (130).

[0072] The instructions, when executed by the processor, may cause the electronic device to determine at least one target object based on at least one of a creation time of an image including the object, a usage time of the image including the object, a size of the object, or a shape of the object.

[0073] The instructions may be configured to cause the electronic device, when the processor is executed, to group objects having the same category, select a category based on the number of grouped objects or the number of images per category, divide the display into object display areas corresponding to the selected category, and provide a new image in which the target object is arranged in the divided object display areas based on the arrangement information.

[0074] The above instructions, when executed by the processor, may be configured to cause the electronic device to identify a size of a representative object of a specific category among the target objects and adjust the object display area based on the size of the identified representative object.

[0075] The instructions may be configured to cause the electronic device, when the processor is executed, to extract a title based on tag information of the target object and to generate the new image including the extracted title.

[0076] The above instructions may be configured to cause the electronic device, when the processor is executed, to determine whether a person object is included among the target objects when the title is extracted, and, if the person object is included among the target objects, to arrange the title so as not to overlap with the person object to generate a new image.

[0077] The instructions may be configured to cause the electronic device, when the processor is executed, to generate a new image by placing a title corresponding to a designated location on the display if the target object does not include the person object.

[0078] The instructions may be configured to cause the electronic device, when the processor is executed, to determine a layout structure of the target object based on at least one of a category of the target object, a size of the target object, a shape of the target object, a creation time of an image including the target object, and a usage time of an image including the target object, and to generate a new image in which the target object is arranged based on the determined layout structure.

[0079] The electronic device further includes an inertial sensor, and the instructions, when executed by the processor, may be configured to cause the electronic device to change a display position of a target object included in the new image based on sensing data obtained from the inertial sensor.

[0080] The above instructions, when executed by the processor, may be configured to cause the electronic device to determine a background color of the new image based on color information of a target object included in the new image, and to apply the determined background color to the new image.

[0081] The above instructions may be configured to cause the electronic device, when the processor is executed, to provide a function of generating a background image with the selected target object, sharing or copying the selected target object, or a search function when the target object included in the new image is selected.

[0082] The instructions may be configured to cause the electronic device, when the processor is executed, to generate a background image by reconfiguring the arrangement of target objects included in the new image when a request is made to apply a background image corresponding to a size of a display different from the size of the display.

[0083] The above instructions, when executed by the processor, may be configured to cause the electronic device to edit the new image based on user input and save the edited new image as a background image.

[0084] The above instructions, when executed by the processor, may be configured to cause the electronic device to select a predetermined category or to select a category in which the number of objects within the category is greater than or equal to a threshold value.

[0085] The instructions, when executed by the processor, may be configured to cause the electronic device to generate a new image larger than the size of the display and change the display position of a target object included in the new image based on sensing data acquired from the inertial sensor.

[0086] The instructions may be configured to cause the electronic device, when the processor is executed, to separate a target object and a background included in the new image, apply motion to the target object based on motion information of the separated target object, process the separated background based on image processing technology, and generate a new second image using the target object to which the motion has been applied and the processed background.

[0087] Figure 3 is a flowchart (300) illustrating an operating method of an electronic device according to one embodiment.

[0088] Referring to FIG. 3, in operation 301, a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., electronic device 101 of FIG. 1) according to an embodiment may recognize an object included in an image. The object may refer to a subject of the image or a subject included in the image. The processor (120) may analyze one or more images stored in a memory (e.g., memory (130) of FIG. 1) to recognize one or more objects included in the one or more images. Alternatively, the processor (120) may analyze images stored by a user in a cloud server (e.g., server (108) of FIG. 1) to recognize an object included in the image. The analyzed images may be a subset of stored images, such as images included in a specific folder or generated during a specific period. According to one embodiment, the processor (120) can recognize an object based on at least one designated image processing technique (e.g., object detection and / or saliency object detection (SOD)).

[0089] In operation 303, the processor (120) may determine a category corresponding to the recognized object. According to one embodiment, the processor (120) may determine categories (or types) of various objects based on object detection technology. The categories may include upper categories such as people, things, or animals. Alternatively, the processor (120) may recognize faces stored in the memory (130) or the server (108) to further subdivide the 'person' upper category (e.g., 'person') into subcategories such as user, friend 1, friend 2, and family 1. For example, the processor (120) may recognize faces in images stored in the memory (130) or the server (108) to subdivide the subcategories. The 'Things' supercategory can be divided into subcategories such as 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'food' (e.g., 'coffee', 'milk', 'steak', 'pasta'), and 'lights' (e.g., 'traffic light', 'pendant light', 'wall light', 'floor light', 'desk light'). A single subcategory can in turn be divided into multiple bottom-level categories. The 'Animals' category can be divided into subcategories such as 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow', 'elephant', 'bear', and 'zebra'.

[0090] According to one embodiment, the processor (120) may apply a background erasing effect to the object after classifying the subcategories of the object. The background erasing effect may be to retain only the object in the image and remove the rest by processing it as a background. This may be performed on each image in which the object is recognized or on a selected image. For example, if the processor (120) recognizes one object in an image, the processor (120) may remove the remaining portion except for the object to remove the background. If the processor (120) recognizes two (or more) objects in an image, the processor (120) may remove the remaining portion except for the first object and then remove the remaining portion except for the second object. Alternatively, the processor (120) may select only some of the recognized objects (e.g., based on the level of the category) and delete the remaining portion of the image containing the unselected recognized objects.

[0091] In operation 305, the processor (120) may select (or extract) at least one target object. The at least one target object may include an object to be displayed on a display (e.g., the display module (160) of FIG. 1) among the recognized objects. For example, the processor (120) may determine the target object based on at least one of the creation time of an image including the object (e.g., a recent image), the usage time of the image including the object (e.g., the number of views or shares), the size of the object, or the shape of the object. The processor (120) may extract an object in which a portion (e.g., 50% or more) of the object is not cropped, or an object that is large in size, as a target object. The processor (120) may select a target object based on whether the image including the object was recently captured (or saved), recently viewed, or edited by a user.

[0092] In operation 307, the processor (120) may determine arrangement information of the at least one target object. The arrangement information sets the arrangement of the target object in the new image. The processor (120) may group objects having the same or similar categories (e.g., upper category, lower category) and select a category to be included in the new image based on the number of grouped objects or the number of images per category. In addition, the processor (120) may select a category to be included in the new image based on at least one of the creation time of the image including the object, the usage time of the image including the object, the size of the object, or the shape of the object. The processor (120) may determine the arrangement information (or arrangement structure) of the target object based on at least one of the category of the target object, the number of categories, the size of the target object, the shape of the target object, the creation time of the image including the target object, and the usage time of the image including the target object.

[0093] For example, when the processor (120) determines the categories of four target objects, it can divide the display (e.g., the display module (160) of FIG. 1) into four object display areas and determine which target object to place in each object display area. The object display areas are for displaying target objects included in the same category, and there may be one or more target objects included in the object display areas. The placement information of the target objects may include at least one of which object display area the target object is to be placed in, whether the target objects overlap, or the placement direction (or angle) of the target objects. The display may also be divided into a predetermined number of object display areas, and then an object category may be assigned to each display area. For example, the four categories with the largest number of target objects may be assigned to the four object display areas. If there are more object categories than display areas, target objects corresponding to some categories may not be displayed. In addition, one or more target objects representing the category may be displayed in each object display area. Additionally, the size of the object display area may vary depending on the relative number of target objects within each category and / or the size of the target objects within each category or the representative target object(s) of each category.

[0094] In operation 309, the processor (120) may provide a new image in which target object(s) are arranged based on the determined arrangement information. The processor (120) may generate a new image and display the generated new image on the display module (160). For example, the new image may be utilized as a background image or an album cover, for example, a cover or background of an album / folder in which the analyzed image is stored, or a background or cover for one or more screens of an electronic device. The processor (120) may include a user object including the user's face as a background, and additionally arrange at least one target object with different categories at the edge of the display surrounding the user object. The processor (120) may display one or more target objects having the same or similar categories in a single object display area. The processor (120) may extract tag information based on the category of the target object included in the object display area, and display the tag information on the target object. The processor (120) may extract a title based on the tag information, and include the extracted title in the new image.

[0095] FIG. 4 is a diagram illustrating an example of dividing an object display area in an electronic device according to one embodiment.

[0096] Referring to FIG. 4, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may analyze all images or a subset of images stored in a memory (e.g., the memory (130) of FIG. 1 or a cloud-based storage) to determine one or more categories of one or more objects included in the images, and may select a certain number of categories (e.g., 2, 3, ... 5). For example, the processor (120) may select a category based on at least one of the number of images per category, the order of the most recently created (e.g., captured, saved) image corresponding to the category, or the order of the most frequently used (e.g., viewed, edited, shared) images. The processor (120) may divide the object display area based on the number of selected categories. For example, if there are 2 selected categories, the object display area may be divided into 2, and if there are 5 selected categories, the object display area may be divided into 5. For example, if there is only one selected category, the processor (120) can determine the entire area of ​​the display module (160) as the object display area.

[0097] According to one embodiment, the processor (120) may identify the size of a representative object of a specific category and adjust the object display area based on the size of the representative object. For example, the processor (120) may divide the object display area into four object display areas (431, 433, 435, 437) as in the second user interface (430). If the size of the representative object is less than or equal to a first reference value, the processor (120) may increase the number of object display areas to five and divide the object display areas into five object display areas (411, 413, 415, 417, 419) as in the first user interface (410). If the size of the representative object is greater than or equal to the second reference value, the processor (120) may reduce the number of object display areas to three and divide the object display areas into three object display areas (451, 453, 455) as in the third user interface (450). The second criterion may have a value greater than the first criterion.

[0098] According to one embodiment, the processor (120) may divide the object display area by determining a reference point for each category, rather than dividing the object display area into rectangular screens. Alternatively, the processor (120) may divide the object display area by utilizing a category layout template. The category layout template may be pre-created by appropriately dividing the object display area based on the category. Objects representing a category may overlap each other or extend outside the corresponding object display area. For example, as illustrated in the first user interface (410), some of the objects in the object display areas (411, 412, 415) overlap each other. This arrangement allows for an increased number of objects to be displayed, and objects of various sizes to be displayed more easily. In relation to image album covers, etc., this approach may allow for increased information about the contents of the album to be provided to the user through the generated image.

[0099] Presenting album covers in the manner described above and below can provide an efficient approach to user browsing of stored images. This is because the album covers presented to users will provide accurate representations of the stored images and be more relevant to the user. Consequently, users may have to perform fewer navigational tasks to access relevant images.

[0100] FIG. 5A is a flowchart (500) illustrating a method for recognizing an object included in an image of an electronic device according to one embodiment. FIG. 5A may specifically describe operations 301 and 303 of FIG. 3.

[0101] Referring to FIG. 5A, in operation 501, a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., electronic device 101 of FIG. 1) according to an embodiment may recognize an object included in an image. The object refers to a subject, and a subset of images, one or more objects may be included or appear in one image. The processor (120) may recognize at least one object from an image. The processor (120) may analyze all images or a set of images stored in a memory (e.g., memory (130) of FIG. 1) or a cloud server (e.g., server (108) of FIG. 1) to recognize an object included in an image.

[0102] In operation 503, the processor (120) may classify an upper category of an object from the analyzed image. According to one embodiment, the processor (120) may determine a category (or type) of various objects based on object detection technology. The upper category may include at least one of a person, an object, or an animal. The processor (120) may classify (or determine) whether an object recognized in the image is a person, an object, or an animal.

[0103] In operation 505, the processor (120) may classify subcategories of objects within a higher category. For example, the processor (120) may recognize faces in images stored in the memory (130) or the server (108), and if the higher category is 'person', the processor (120) may segment subcategories based on the faces. Alternatively, if the higher category is 'object', the subcategories of the objects may be 'car', 'food', 'lighting', etc. If the higher category is 'animal', the subcategories of the objects may be 'dog', 'cat', etc., for example.

[0104] In operation 507, the processor (120) can determine whether another object exists in the image. An image may contain only one object or may contain multiple objects. The processor (120) can perform operations 501 to 507 on an image, and if another object exists in the image, the processor can return to operation 501. The processor (120) can perform operations 501 to 507 on an image, and if another object does not exist in the image, the processor can perform operation 509.

[0105] In operation 509, the processor (120) may apply a background erasing effect to an object if no other objects exist in the image. The background erasing effect may be to retain only the object in the image and remove the rest by processing it as a background, thereby allowing the object to be easily included in another image / screen. In some examples, even if multiple objects are recognized in the image, only one object may be selected and the remaining objects and background may be erased.

[0106] FIG. 5b is a flowchart (550) illustrating a method for determining a target object (i.e., a representative opposite decision of a category) of an electronic device according to one embodiment.

[0107] Referring to FIG. 5B, in operation 551, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may select a category to be displayed. For example, the processor (120) may select a category based on at least one of the number of images per category, the order of the most recently created (e.g., captured, saved) image, or the most frequently used (e.g., viewed, edited, shared) image. The processor (120) may select a certain number of categories (e.g., 2, 3, … 5). The category of the image may be determined based on an object recognized and classified in the image.

[0108] In operation 553, the processor (120) may divide the object display area corresponding to the selected category. The number of categories to be selected may be a predetermined number, and the processor (120) may select a category in which the number of objects within the category is greater than or equal to a threshold value. If there are not enough categories that satisfy the predetermined conditions, the processor (120) may determine the minimum number of categories. For example, if the predetermined number of categories is four, and there are three categories that satisfy the selection requirements, the processor (120) may determine three categories, and if there are ten categories, only four categories may be selected according to priority. According to one embodiment, if there is one selected category, the processor (120) may determine the entire area of ​​the display module (160) as one object display area.

[0109] The processor (120) may determine (or select) at least one target object by performing operations 555 to 563 on images included in the selected category. Operations 555 to 563 may be repeatedly performed until a target image or a predetermined number of target images are determined for the images included in the selected category. However, the criteria for repeating operations 555 to 563 may take any form, such as, for example, determining a target object that satisfies a specific size criterion.

[0110] At operation 555, the processor (120) can determine whether a background erasing effect has been manually applied. The user can directly apply the background erasing effect to an object to obtain the desired object from the image. If the background erasing effect has been manually applied to the image, the user's preference for the image may be high. If the user has manually applied the background erasing effect to the image, the processor (120) can perform operation 557, and if the user has not manually applied the background erasing effect to the image, the processor (120) can perform operation 563.

[0111] If the user manually applies the background eraser effect, in operation 557, the processor (120) may determine whether the number of views or shares is greater than or equal to a threshold. The processor (120) may monitor the user's usage history. For example, the processor (120) may accumulate the usage history of at least one of the number of views (or time) of the image, the number of edits, and the number of shares of the associated image for a specified period of time (e.g., 7 days, 30 days, 3 months, etc.). If the number of views or shares of the image is greater than or equal to a threshold, the user's preference for the image may be high. If the number of views or shares of the image is greater than or equal to a threshold, the processor (120) may perform operation 559, and if the number of views or shares of the image is less than or equal to a threshold, the processor (120) may perform operation 563.

[0112] If the number of views or shares of the image is greater than a threshold, in operation 559, the processor (120) may determine whether the image is recent. Images that have been recently captured (or created) or acquired (e.g., downloaded) (e.g., within 7 days, 10 days, or 1 month) may have a higher user preference. If the image is recent, the processor (120) may perform operation 561, and if the image is not recent, the processor (120) may perform operation 563.

[0113] If the image is recent, in operation 561, the processor (120) may determine a target object to be included in the object display area. For example, the processor (120) may determine an object included in an image with a background erase effect applied, an image that users frequently view, or an image that has been edited or shared frequently as the target object. Alternatively, the processor (120) may determine an object in an image in which the object is clearly distinguished from the background as the target object. In some examples, only some of operations 555, 557, and 559 may be performed to determine the target image.

[0114] If the user does not manually apply the background eraser effect, or the number of views or shares of the image is below a threshold, or the image is not recent, at least one of the following occurs: in operation 563, the processor (120) may exclude the image from the target objects in the object display area. The selected category may include multiple images, and the multiple images may include multiple objects. Operations 555 to 563 may be performed on one or more or all of the multiple images and the multiple objects. In operation 550, the processor (120) must select a target object to be included in the object display area from among the multiple objects, and may select the target object by reflecting the user's preference. Accordingly, the processor (120) may exclude from the target objects an object with a low user preference.

[0115] According to one embodiment, the processor (120) may perform operations 555 to 563 on one object display area to select a target object to be included in one object display area. For example, when there are four object display areas, the processor (120) may perform operations 555 to 563 on a first object display area to select a target object to be included in the first object display area, perform operations 555 to 563 on a second object display area to select a target object to be included in the second object display area, perform operations 555 to 563 on a third object display area to select a target object to be included in the third object display area, and perform operations 555 to 563 on a fourth object display area to select a target object to be included in the fourth object display area.

[0116] According to one embodiment, the processor (120) may arrange target objects differently according to categories. For example, if object recognition from an image is not possible, the processor (120) may arrange target objects (3-6) randomly in a list or spiral. If object recognition from an image is possible, the processor (120) may arrange target objects included in the person category radially, target objects included in the animal category spirally, and target objects included in the object category spirally, randomly, or in a predefined list.

[0117] According to one embodiment, the processor (120) may identify the size of a representative object of a specific category and adjust the object display area based on the size of the representative object. For example, one object display area may include multiple target objects, and the processor (120) may identify any one of the multiple target objects as the representative object. The processor (120) may identify the representative object (e.g., an object of interest) using a saliency object detection technique. For example, when the size of the representative object is less than or equal to a first reference value, the processor (120) may increase the object display area, and when the size of the representative object is less than or equal to a second reference value, the processor (120) may decrease the object display area. The second reference value may have a value greater than the first reference value. That is, the processor (120) may adjust the object display area segmented in operation 553 based on the size of the representative object. Alternatively, the size of the representative object may be adjusted depending on the size of the corresponding object display area.

[0118] FIG. 6 is a diagram illustrating an example of providing a new image including a title in an electronic device according to one embodiment.

[0119] Referring to FIG. 6, a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., electronic device 101 of FIG. 1) according to an embodiment may extract a title based on tag information of an object and generate a new image including the extracted title. The processor (120) may extract a title based on tag information of an object included in an object display area. The tag information is extracted based on a category of the object and may include text. A title may be extracted based on one or more objects included in multiple object display areas.

[0120] When a title is extracted, the processor (120) determines whether a person object is included among the target objects, and if a person object is included, a new image such as a first user interface (610) can be generated. The processor (120) can determine whether a person object is included in the background. The first user interface (610) may include a title (611) so as not to overlap with the person object. If a person object is not included in the background, the processor (120) may generate a new image such as a second user interface (630). The second user interface (630) may be one in which a title is placed at the top (651) or center (653) of a display (e.g., a display module (160) of FIG. 1).

[0121] According to one embodiment, the processor (120) may include a title at a designated location, such as the top or center, of the display module (160) for each category of the target object. The processor (120) may determine the title location based on the results of analyzing the location of the target object displayed in the background or the location of the target object for each category. If the title cannot be extracted, the processor (120) may randomly select a similar word, such as 'My favorite', or may not include a title.

[0122] FIG. 7 is a flowchart (700) illustrating a method for generating an image including a title of an electronic device according to one embodiment. FIG. 7 may be included in operation 307 of FIG. 3 and may be operated.

[0123] Referring to FIG. 7, in operation 701, a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., electronic device 101 of FIG. 1) according to an embodiment may determine whether a title is extracted. The processor (120) may extract a title based on tag information of a target object included in an object display area. The tag information is extracted based on a category of the target object and may include text. If a title is extracted, the processor (120) may perform operation 703, and if a title is not extracted, the processor (120) may perform operation 704.

[0124] If the title is not extracted, in operation 704, the processor (120) may provide a new image excluding the title. The processor (120) may generate a new image that does not include the title and includes multiple target objects and tag information, and display the generated new image on a display (e.g., the display module (160) of FIG. 1).

[0125] If a title is extracted, in operation 703, the processor (120) may determine whether the target object includes a person. For example, the processor (120) may determine whether a person object is included in the background. If the target object includes a person, the processor (120) may perform operation 705, and if the target object does not include a person, the processor (120) may perform operation 708.

[0126] If the target object does not include a person, in operation 708, the processor (120) may provide a new image including a title at a designated location. The processor (120) may place the title at the top or center of the display module (160), generate a new image including a plurality of target objects and tag information, and display the generated new image on the display module (160). According to one embodiment, the processor (120) may modify the content or display location of the title based on a user input.

[0127] If the target object includes a person, in operation 705, the processor (120) may determine the title position based on the placement information of the person (or person object) and the target object. For example, the processor (120) may determine the title position so as not to overlap with the person object. Additionally, the processor (120) may determine the title position so as not to overlap with the tag information of the target object.

[0128] In operation 707, the processor (120) may provide a new image including a title. The processor (120) may generate a new image and display the generated new image on the display module (160). For example, the new image may be used as a background image or an album cover. According to one embodiment, the processor (120) may modify the content or display location of the title based on user input.

[0129] FIGS. 8A and 8B are drawings illustrating an example of placing an object in an object display area in an electronic device according to one embodiment.

[0130] Referring to FIG. 8A, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may generate a new image by arranging a plurality of target objects in each object display area. A first user interface (810) may place two target objects corresponding to the food category in a first object display area (811), two target objects corresponding to the mid-century category in a second object display area (813), three target objects corresponding to the wine category in a third object display area (815), and three target objects corresponding to the lighting category in a fourth object display area (817).

[0131] The multiple target objects included in each object display area may overlap each other, and the display directions (e.g., clockwise) or display angles (e.g., between 0 and 90 degrees) of the multiple objects may be different from each other. If the target object included in the object display area is a person, the processor (120) may arrange the person's head, eyes, nose, and mouth so that they are not cut off outside the display module (160). Alternatively, a target object separated from the background within the same category may be arranged so as not to overlap with other target objects, but an entire rectangular image including the background area (e.g., a rectangular image including an object) may overlap with a rectangular image including another target object by, for example, 10 to 50% of the area. Different rotation angles may be applied to each image within a predefined angle range within the same category, or the same rotation angle may be applied to some images. The maximum number of the multiple target objects included in each object display area may be specified.

[0132] According to one embodiment, the processor (120) may determine a display layer between target objects included in each object display area to determine whether the object is positioned above or below tag information. For example, the processor (120) may apply different display layers depending on whether the object is positioned at the top or bottom of a display (e.g., the display module (160) of FIG. 1). For a target object to be positioned at the top of the display module (160), the processor (120) may position the target object above the text area based on whether there is an image adjacent to the text area and whether it overlaps with the text area. For a target object to be positioned at the bottom of the display module (160), the processor (120) may position the target object below the text area based on the size of the object and whether it overlaps with the text area. Here, the text area may mean tag information or a title.

[0133] The processor (120) may display a second user interface (830) including a new image (e.g., a background image) on the display module (160). The second user interface (830) may place first tag information (831) corresponding to the food category in the first object display area, second tag information (833) corresponding to the mid-century category in the second object display area, third tag information (835) corresponding to the wine category in the third object display area, and fourth tag information (837) corresponding to the lighting category in the fourth object display area. The tag information may be placed only within the object display area and not placed at the edge of the display module (160). The processor (120) may place the tag information so as not to overlap with the title.

[0134] Referring to FIG. 8B, the processor (120) may divide the display module (160) into two object display areas to generate a new image in which objects are arranged. The processor (120) may display a third user interface (850) including the new image. For example, the third user interface (850) may be configured to arrange a plurality of first objects corresponding to a first detailed category (852) and a plurality of second target objects corresponding to a second detailed category (854) in a first object display area (851) at the top of the display module (160), and a plurality of third target objects corresponding to a third detailed category (856) and a plurality of fourth target objects corresponding to a fourth detailed category (858) in a second object display area (853) at the bottom of the display module (160). The processor (120) may arrange target objects corresponding to different detailed categories in one object display area.

[0135] The processor (120) may display a fourth user interface (870) including a new image. For example, the fourth user interface (870) may be configured such that a plurality of first target objects corresponding to a first detailed category (e.g., Fruit) and a plurality of second target objects corresponding to a second detailed category (e.g., Latte) are arranged in a first object display area (871) at the top of the display module (160), and a plurality of third target objects corresponding to a third detailed category (e.g., Pasta), a plurality of fourth target objects corresponding to a fourth detailed category (e.g., Cream), and a plurality of fifth target objects corresponding to a fifth detailed category (e.g., Spice) are arranged in a second object display area (873) at the bottom of the display module (160).

[0136] The processor (120) may display a fifth user interface (870) including a new image. For example, the fifth user interface (870) may be configured to display a plurality of first target objects corresponding to a first detailed category (e.g., Walls) and a plurality of second target objects corresponding to a second detailed category (e.g., Pendant) in a first object display area (891) at the top of the display module (160), and a plurality of third target objects corresponding to a third detailed category (e.g., Table light) in a second object display area (893) at the bottom of the display module (160).

[0137] FIG. 8c is a flowchart (800) illustrating a method for placing a target object in an electronic device according to one embodiment.

[0138] Referring to FIG. 8C, in operation 801, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may determine whether a target object is a person. The processor (120) may determine object placement information (or structure) based on the category of the target object. If the target object is a person, the processor (120) may perform operation 807, and if the target object is not a person, the processor (120) may perform operation 802.

[0139] If the target object is not a person, in operation 802, the processor (120) may arrange the target objects so that some of them overlap. If multiple target objects are arranged in one object display area, the processor (120) may arrange the target objects so that some of the different target objects overlap (e.g., 10 to 50%).

[0140] In operation 803, the processor (120) can randomly place the angle of the target object. The processor (120) can randomly place the angle of the target object between 0 degrees and 90 degrees.

[0141] In operation 804, the processor (120) may determine whether the first target object is arranged in the + direction (e.g., upper layer). The processor (120) may perform operations 801 to 809 for one object display area to determine arrangement information of the target objects included in one object display area. For example, if two target objects are included in one object display area and the first object is arranged in the + direction, the processor (120) may perform operation 805, and if the first object is arranged in the - direction (e.g., lower layer), the processor (120) may perform operation 806. According to one embodiment, if only one target object is included in one object display area, operations 805 and 806 may be omitted.

[0142] If the first object is placed in the + direction, in operation 805, the processor (120) may place the second target object in the - direction. The processor (120) may place the second target object in a direction opposite to the placement direction of the first target object.

[0143] If the first object is not placed in the + direction (e.g., if the first object is placed in the - direction), in operation 806, the processor (120) may place the second target object in the + direction. The processor (120) may place the second target object in a direction opposite to the placement direction of the first target object.

[0144] If the target object is a person, in operation 807, the processor (120) may position the person's face so that it is not cut off. If the target object is a person, the processor (120) may position the person object so that the person's head, eyes, nose, and mouth are all included.

[0145] In operation 808, the processor (120) may determine whether the area (or size) of the target object is greater than or equal to a reference value. If the area of ​​the target object is greater than or equal to the reference value, the processor (120) may perform operation 809, and if the area of ​​the target object is less than or equal to the reference value, the processor may terminate the process.

[0146] If the area of ​​the target object is greater than the reference value, in operation 809, the processor (120) may arrange the target objects to overlap with other target objects at a set ratio (e.g., 10 to 50%). According to one embodiment, the processor (120) may display target objects separated from the background within the same category without overlapping, or arrange entire square images included in the background to overlap with each other. The processor (120) may apply different rotation angles to each object within a predefined angle range within the same category, or may apply the same rotation angle to some objects.

[0147] According to one embodiment, the processor (120) may arrange target objects differently according to categories. For example, if object recognition from an image is not possible, the processor (120) may arrange target objects (3-6) randomly in a list or spiral. If object recognition from an image is possible, the processor (120) may arrange target objects included in the person category radially, target objects included in the animal category spirally, and target objects included in the object category spirally or in a random / predefined list.

[0148] FIG. 9 is a diagram illustrating an example of determining an object arrangement structure in an electronic device according to one embodiment.

[0149] Referring to FIG. 9, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may determine an arrangement structure of a target object based on a category of the target object, and generate a new image in which the target object is arranged based on the determined arrangement structure. Here, the new image may mean an album cover. For example, if the category of the target object is 'person', a first album cover (910) may be one in which multiple person objects are arranged radially. If the category of the target object is 'animal', a second album cover (930) may be one in which multiple animal objects are arranged spirally. If the category of the target object is 'food', a third album cover (950) may be one in which multiple food objects are arranged spirally. If the category of the target object is 'car', a fourth album cover (970) may be one in which multiple car objects are arranged spirally. The 5th album cover (990) may be a random arrangement of multiple dessert car objects when the category of the target object is 'dessert'.

[0150] FIGS. 10A and 10B are drawings illustrating an example of changing the display position of an object in an electronic device according to one embodiment.

[0151] Referring to FIG. 10A, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may change the display position of an object included in a new image (e.g., a background image) based on sensing data acquired from an inertial sensor (e.g., the sensor module (176) of FIG. 1). The inertial sensor may include an acceleration sensor or a gyro sensor. For example, when a user holds the short two sides of the electronic device (101) parallel to the user's torso, the processor (120) may display a first user interface (1010) on a display (e.g., the display module (160) of FIG. 1). While displaying the first user interface (1010), the processor (120) may display a second user interface (1030) when sensing data (e.g., a rotation value, a movement value) acquired from the inertial sensor changes. The second user interface (1030) may be displayed when the user holds the electronic device (101) and moves it to the left. Comparing the second user interface (1030) with the first user interface (1010), it can be seen that the display position of the object is tilted to the left.

[0152] Referring to FIG. 10B, when a user holds the electronic device (101) with its short sides tilted to the left, the processor (120) may display a third user interface (1050) on the display module (160). While displaying the third user interface (1050), the processor (120) may display a fourth user interface (1070) when the sensing data acquired from the inertial sensor changes. The fourth user interface (1070) may be displayed when the user holds the electronic device (101) and moves it to the right. Comparing the fourth user interface (1070) with the third user interface (1010), it can be seen that the display position of the object is tilted to the right. This may provide a dynamic background or album cover that reflects the current status of the electronic device and provide a more attractive user interface.

[0153] The processor (120) can adjust the inclination of the target object differently by reflecting the speed at which the electronic device (101) is rotated (or moved). For example, if the user rotates the electronic device (101) at a rotation speed faster than a reference value, the processor (120) can change the inclination of the display position of the target object to 50 or more, and if the user rotates the electronic device (101) at a rotation speed slower than the reference value, the processor (120) can change the inclination of the display position of the target object to about 30 or more.

[0154] FIGS. 11A and 11B are drawings illustrating an example of applying a background color to an image in an electronic device according to one embodiment.

[0155] Referring to FIG. 11A, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may determine a background color of a new image (e.g., a background image) based on color information of a target object included in the new image. The processor (120) may determine a color with a small difference in color distribution of the entire object as the background color. For example, the processor (120) may provide a first user interface (1110) or a third user interface (1130) by applying a background color within a color spectrum that does not overlap with the color of the target object. The first user interface (1110) may set the background color to green based on the color of the target object (e.g., pink, brown, white, black, etc.). The second user interface (1130) may set the background color to gray based on the color of the target object (e.g., orange, white, black, etc.). In one embodiment, the processor (120) may not apply a background color to a new image if the background object corresponds to a high access frequency, a most recently captured image, or exposure information from a social network service (e.g., an image that has been liked). For objects that are not frequently used, the background color may be displayed in a dark color.

[0156] Referring to FIG. 11B, the processor (120) can create a plurality of background images by linking them together so that only a portion of the image can be displayed at any time when scrolling. The processor (120) can display a scrollable third user interface (1150). The processor (120) can set the background color of a background image that was stored a long time ago or is not frequently accessed to be dark, as in ③. The third user interface (1150) can be set to make the background color of the background image placed at the top bright, as in ①, or set to color, and when scrolling down to the bottom, the background color of the background image placed at the bottom can be darkened, as in ②, or set to black and white.

[0157] FIGS. 12A to 12C are drawings illustrating an example of utilizing a background image in an electronic device according to one embodiment.

[0158] Referring to FIG. 12A, a processor (e.g., the processor 120 of FIG. 1) of an electronic device (e.g., the electronic device 101 of FIG. 1) according to an embodiment may display a first user interface (1210) or a second user interface (1220) for generating a background image on an execution screen of a gallery application. The first user interface (1210) may classify objects into several categories. The second user interface (1220) may classify objects corresponding to one category into detailed categories. The second user interface (1220) may include images including objects in a grid format. In some examples, various objects may represent an album (e.g., an album cover) that includes images including objects of the same category as a representative object.

[0159] Referring to FIG. 12B, the processor (120) may display a third user interface (1230) including a background image arranged based on the category of the target object. The third user interface (1230) may include a background image including a plurality of first target objects corresponding to a first category (e.g., My fave Food), a plurality of second target objects corresponding to a second category (e.g., Car, Vintage), and a plurality of third target objects corresponding to a third category (e.g., Lighting). When one target object (e.g., Car) is selected (e.g., long-pressed) in the third user interface (1230), the processor (120) may display a fourth user interface (1240). The fourth user interface (1240) may be a page for creating a background image with the selected target object, or sharing or copying the selected target object. When a target object is selected, the processor (120) may provide a search function or provide search results obtained by searching for keywords of the target object on a web page. The processor (120) can display the selected target object to be distinct from the unselected target objects. The processor (120) can shade the unselected target object.

[0160] The search and share functionality is not limited to the screen illustrated in FIG. 12b, and can be applied to any screen / background considered in this disclosure. For example, any image displayed as an album cover in the background can be selected as described in FIG. 12b, and search or other functions (e.g., sharing) can be performed. This approach can provide an efficient interface for users to perform functions on displayed images / objects.

[0161] Referring to FIG. 12C, the processor (120) may group images stored in a memory (e.g., the memory (130) of FIG. 1) into similar stories (or categories) or similar location information and optionally, representative images of the group, and provide a fifth user interface (1250). When a menu for generating a background image is selected in the fifth user interface (1250), the processor (120) may generate a background image based on the grouped images. The sixth user interface (1260) may include a background image generated based on the grouped images.

[0162] FIG. 13 is a diagram illustrating an example of reconstructing a background image according to a display size in an electronic device according to one embodiment.

[0163] Referring to FIG. 13, a processor (e.g., a processor (120) of FIG. 1) of an electronic device (e.g., an electronic device (101) of FIG. 1) according to an embodiment may provide a first user interface (1310) that allows a user to select whether to provide a new image (e.g., a background image) generated by FIG. 3 to a lock screen (1311) or a home screen (1313). A user may select whether to apply the generated image to either the lock screen (1311) or the home screen (1313), or to both the lock screen (1311) and the home screen (1313) via the first user interface (1310).

[0164] The electronic device (101) may include two displays of different sizes. For example, the electronic device (101) may include a first display and a second display having a smaller size than the first display. The processor (120) may generate a background image based on the first display and provide a second user interface (1330) for applying the generated background image (1331) to the second display. The user may set the background images of the first display and the second display through the second user interface (1330). The processor (120) may reconstruct the background image generated based on the first display and apply it to the second display as the background image (1331). Reconstructing the background image may not simply mean cropping, enlarging, or reducing the background image to fit the size of the second display, but may also mean generating a new background image corresponding to the size of the second display. The background image applied to the first display (e.g., the home screen (1313) image) and the background image applied to the second display (e.g., the background image (1331)) are created using the same object, but the object arrangement information may be different.

[0165] The processor (120) may provide a third user interface (1350) that applies the same background image as the electronic device (101) to an external device (e.g., a watch-type wearable device) connected to the electronic device (101). The processor (120) may reconstruct the background image applied to the electronic device (101) and transmit the reconstructed background image (1351) to the external device. The background image applied to the electronic device (101) (e.g., a home screen (1313) image) and the background image applied to the external device (e.g., the background image (1351)) are generated using the same object, but the object arrangement information may be different.

[0166] FIG. 14 is a diagram illustrating an example of displaying a background image differently depending on the display size in an electronic device according to one embodiment.

[0167] Referring to FIG. 14, an electronic device according to an embodiment (e.g., the electronic device (101) of FIG. 1) may include two displays of different sizes. For example, the electronic device (101) may include a first display and a second display having a smaller size than the first display. The processor (120) may generate a background image based on the first display. The first user interface (1410) may include the background image generated based on the first display. The processor (120) may reconfigure the background image generated based on the first display and apply it as a background image to the second display. The second user interface (1430) may include the background image generated based on the second display. The background image applied to the first display and the background image applied to the second display are generated using the same object, but the object arrangement information may be different.

[0168] FIGS. 15A to 15C are drawings illustrating an example of applying a decoration effect to a background image in an electronic device according to one embodiment.

[0169] Referring to FIG. 15A, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may apply a decorative effect to a background image. The processor (120) may provide a first user interface (1510) for applying a decorative annotation effect (e.g., a cone shape on a dog's head, Leo, etc.) to the background image based on a user input. The first user interface (1510) may be an example of editing a background image or drawing on a background image based on a user input. The second user interface (1520) may be an example of completing editing of a background image. The processor (120) may store the edited background image in a memory (e.g., the memory (130) of FIG. 1).

[0170] Referring to FIG. 15B, the processor (120) may provide a third user interface (1530) for adding text (e.g., "Our members were just ~") to a background image. The third user interface (1530) may illustrate an example of adding text to a background image based on user input. The fourth user interface (1540) may indicate that editing of the background image has been completed. The processor (120) may store the edited background image in the memory (130).

[0171] Referring to FIG. 15c, the processor (120) may provide a fifth user interface (1550) for editing an object included in a background image. The fifth user interface (1550) may illustrate an example of editing the outline thickness of an object included in a background image based on a user input. The sixth user interface (1560) may indicate that editing of the background image has been completed. The processor (120) may store the edited background image in the memory (130).

[0172] FIG. 16 is a diagram illustrating an example of generating an image based on a story of an image in an electronic device according to one embodiment.

[0173] Referring to FIG. 16, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may analyze images stored in a memory (e.g., the memory (130) of FIG. 1) to group images having similar stories or identical location information. The first reference numeral (1610) may represent a list of grouped images. The processor (120) may generate a new image (e.g., a background image) based on objects included in the grouped images. The processor (120) may analyze objects included in the grouped images to correct the color or angle of a target object, or apply a different background color.

[0174] For example, the processor (120) may generate the first background image (1630) or the second background image (1650) by varying the placement information of the target object, the color of the target object, the angle of the target object, or the background color. When the first background image (1630) is compared with the second background image (1650), it can be seen that the placement positions of the target objects are different. The first background image (1630) may include more target objects (e.g., pictures of food) than the second background image (1650). Alternatively, the processor (120) may provide the first background image (1630) or the second background image (1650) with different positions of the target objects applied each time the home screen or the lock screen is entered. The processor (120) may provide the first background image (1630) or the second background image (1650) based on sensing data acquired from an inertial sensor (e.g., the sensor module (176) of FIG. 1).

[0175] FIG. 17 is a diagram illustrating an example of applying motion to an object included in an image in an electronic device according to one embodiment.

[0176] Referring to FIG. 17, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment may generate a background image larger than the size of a display (e.g., the display module (160) of FIG. 1). The first drawing reference numeral (1710) may represent an example of generating a background image larger than the size of the display module (160) (e.g., a small rectangular box) and an image (1730) corresponding to the size of the display module (160). The processor (120) may separate a target object (1750) and a background (1770) included in a new image (1730). Here, the new unknown (1730) may be an original image or a new image generated by one of the above methods. Thereafter, the processor (120) may generate a new outer portion of the background (1770) using an image processing technique (e.g., an outpainting technique) and / or generate a background image by removing the target object (1750) using an image processing technique (e.g., an inpainting technique). The outpainting / inpainting technique may include an AI-based (e.g., deep learning-based) image generation technique that completes a new image by filling in the outer / inner portion of an image based on a given image (e.g., an original image). The processor (120) may apply a movement to the target object based on motion information of the separated target object (1750). Here, the motion information may be derived from a user's touch input to a new image (1730) displayed on the display module (160), a user's swipe input to the display module (160), or a motion of the electronic device (101). The processor (120) may move the new image (1730) to another part of the background image (e.g., a left or right painted part) in response to the motion information so that a target image motion around the background image can be achieved.

[0177] FIGS. 18A and 18B are diagrams illustrating an example of creating a new image from an image stored on a server in an electronic device according to one embodiment.

[0178] Referring to FIG. 18A, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may continuously generate a new image at a set time interval using an image stored in a cloud server (e.g., the server (108) of FIG. 1). A first user interface (1810) may be an example of a screen of an image stored in the server (108). The processor (120) may provide a cloud image retrieval function (1831) to a first background image (1830) to generate a new image. When the cloud image retrieval function (1831) is selected by a user, the processor (120) may classify images in the first background image by the type of object and the image generation time to generate a new background image. When an indicator (1833) for scrolling up and down the first background image (1830) is selected, the processor (120) may provide a category of objects in the cloud for the user to select to create a new background image. The processor (120) may provide a function (1835) for setting a period of time for creating a new image to the first background image (1830). For example, the processor (120) may acquire cloud images by year or month through the period setting function (1835) and generate a new image using the acquired image. The processor (120) may continuously update the new image for a certain period of time and display multiple images by replacing them. For example, the processor (120) may display the first background image (1830) for a certain period of time (e.g., 30 minutes, 1 hour) and then display the second background image (1850) after a certain period of time has passed. The processor (120) may continuously generate a new image and display the new image as a third background image again after a certain period of time has passed.

[0179] Referring to FIG. 18B, the processor (120) may generate a new image using the intimacy with the other party (e.g., friend, family) and the images shared with the other party. The processor (120) may generate a new image using the images shared with the other party in the message application server. The processor (120) may provide a shared image retrieval function (1891) to the third background image (1890) generated as the new image. When the shared image retrieval function (1891) is selected by the user, the processor (120) may obtain the images shared from the message server. For example, the processor (120) may obtain the shared image (1875) from the execution screen (1870) of the message application. The processor (120) may provide the other party information (1893) to the third background image (1890). The other party information (1893) may include at least one of the other party's profile image, the name of the chat window with the other party, and the intimacy with the other party. The processor (120) can provide the name (1895) of the other party who sent the image shared in the chat room to the third background image (1890).

[0180] The approach described above can provide users with an efficient way to create static or dynamically relevant (i.e., tailored to their preferences) composite images, as it reduces the user input required to repeatedly generate new images that can be used as backgrounds. When generating album covers, gallery images, gallery summary images, or other representative images, users may no longer need to manually select multiple images and combine them into a single image to create a background image. Furthermore, as described above, additional features, such as search and sharing, can be integrated into these images, providing an efficient interface for providing these features.

[0181] An operating method of an electronic device (101) according to an embodiment of the present disclosure may include an operation of recognizing an object included in an image, an operation of determining a category corresponding to the object, an operation of selecting a target object to be displayed on the display among the recognized objects; an operation of determining arrangement information of the target object based on the determined category and the image, and an operation of providing a new image in which the target object is arranged based on the arrangement information of the target object.

[0182] The operation of determining the arrangement information of the target object may include an operation of grouping objects having the same category, an operation of selecting a category based on the number of grouped objects and the number of images for each category, an operation of dividing the display into object display areas corresponding to the selected category, an operation of identifying the size of the representative object of a specific category among the recognized target objects, and an operation of adjusting the object display area based on the size of the identified representative object.

[0183] The operation of providing the new image may include an operation of extracting a title based on tag information of the target object, an operation of determining whether a person object is included among the target objects when the title is extracted, an operation of arranging the title so as not to overlap with the person object when the target object includes the person object, and an operation of arranging the title so as to correspond to a specified position of the display to create a new image when the target object does not include the person object.

[0184] The method may further include an operation of changing the display position of a target object included in the new image based on sensing data obtained from an inertial sensor (176) of the electronic device.

[0185] The method may further include an operation of generating a background image with the selected target object, providing a function for sharing or copying the selected target object, or providing a search function when a target object included in the new image is selected.

[0186] The various embodiments of the present invention disclosed in this specification and drawings are merely specific examples presented to facilitate easy explanation of the technical content of the present invention and aid understanding thereof, and are not intended to limit the scope of the present invention. Therefore, the scope of the present invention should be interpreted to include all modifications or variations derived based on the technical concept of the present invention, in addition to the embodiments disclosed herein.

Claims

1. In an electronic device (101), display (160); Processor (120); and When the processor is executed by instructions stored in the memory (130), the electronic device causes: Recognize one or more objects contained in one or more images, Determine the category corresponding to one or more of the above objects, Selecting at least one target object to be displayed on the display from among the one or more objects above, Determine the placement information of at least one target object based on the determined category and the image, An electronic device configured to provide a new image for display on the display by arranging the at least one target object based on the arrangement information of the at least one target object.

2. In the first paragraph, the instructions, when the processor is executed, cause the electronic device to: An electronic device configured to determine at least one target object based on at least one of a creation time of an image including the at least one object, a usage time of the image including the at least one object, a size of the at least one object, or a shape of the at least one object.

3. In the first paragraph, the instructions, when the processor is executed, cause the electronic device to: Group objects that have the same category among one or more objects, Select one or more categories based on the number of grouped objects or the number of images per category, Dividing the display into object display areas corresponding to one or more of the selected categories, An electronic device set to provide a new image in which at least one target object is placed in the segmented object display area based on the above placement information.

4. In the third paragraph, the instructions, when the processor is executed, cause the electronic device to: Identifying the size of a representative object of a specific category among at least one target object, An electronic device configured to adjust the object display area based on the size of the identified representative object.

5. In the first paragraph, the instructions, when the processor is executed, cause the electronic device to: Extracting a title based on tag information of at least one target object, If the above title is extracted, determine whether a person object is included among at least one of the target objects, If at least one of the target objects above includes the person object, the title is placed in the new image so as not to overlap with the person object, An electronic device configured to place a title on the new image to correspond to a designated location on the display if the at least one target object does not include the person object.

6. In the first paragraph, the instructions, when the processor is executed, cause the electronic device to: Determine the arrangement structure of the at least one target object based on at least one of the category of the at least one target object, the size of the at least one target object, the shape of the at least one target object, the creation time of the image including the at least one target object, and the usage time of the image including the at least one target object, An electronic device comprising generating a new image in which at least one target object is placed based on the determined arrangement structure.

7. In paragraph 1, Including more inertial sensors, The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to change the display position of at least one target object included in the new image based on sensing data acquired from the inertial sensor.

8. In the first paragraph, the instructions, when the processor is executed, cause the electronic device to: determining a background color of the new image based on color information of at least one target object; An electronic device set to apply the determined background color to the new image.

9. In the first paragraph, the instructions, when the processor is executed, cause the electronic device to: An electronic device configured to create a background image with the selected target object when a target object included in the new image is selected, or to provide a sharing function, a copy function, or a search function for the selected target object.

10. In the first paragraph, the instructions, when the processor is executed, cause the electronic device to: An electronic device comprising: a device for generating a background image of a different size by reconstructing the arrangement of at least one target object included in the new image when a request is made to apply a background image corresponding to a size of a display different from the size of the display.

11. In the first paragraph, the instructions, when the processor is executed, cause the electronic device to: Edit the new image based on user input, An electronic device set to save the above edited new image as a background image.

12. In the first paragraph, the instructions, when the processor is executed, cause the electronic device to: An electronic device configured to select a given category or to select a category in which the number of objects within the category exceeds a threshold value.

13. In paragraph 1, Including more inertial sensors, The above instructions, when executed by the processor, cause the electronic device to: Create a new image larger than the size of the above display, An electronic device set to change the display position of a target object included in the new image based on sensing data acquired from the inertial sensor.

14. In the first paragraph, the instructions, when the processor is executed, cause the electronic device to: Separate the target object and background contained in the new image above, Process the above separated background and inpaint it into the area of ​​the separated target object, An electronic device set to generate a new second image by moving a separated target object within a separated background processed based on motion information of the separated target object.

15. In the operating method of an electronic device (101), The action of recognizing objects contained in an image; An action for determining a category corresponding to one or more of the above objects; An action of selecting at least one target object to be displayed on the display among the one or more objects; An operation of determining placement information of at least one target object based on the determined category and the image; and A method comprising the action of providing a new image in which at least one target object is placed based on placement information of the at least one target object.

Images