Electronic device and method for providing registration information of image in electronic device

WO2025187990A8PCT designated stage Publication Date: 2025-10-02SAMSUNG ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2025/002266
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-12-20
Filing Date
2025-02-17
Publication Date
2025-10-02

AI Technical Summary

Technical Problem

Existing image search systems in electronic devices require manual registration of names and relationships for each person in images, leading to inefficient and cumbersome user input during image retrieval.

Method used

An electronic device that automatically suggests registration information for names or relationships based on facial recognition and search criteria, minimizing manual input by recommending registration of face images through a pop-up message and allowing users to confirm or reject the suggested registrations.

Benefits of technology

Facilitates efficient image search by reducing manual registration efforts, enhancing user experience through automated suggestions for image tagging based on facial recognition and search criteria.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2025002266_02102025_PF_FP_ABST
    Figure KR2025002266_02102025_PF_FP_ABST
Patent Text Reader

Abstract

An electronic device, according to one embodiment, may comprise: a display; a processor; and a memory storing instructions, wherein the instructions, when executed by the processor, may be configured to instruct the electronic device to: when input of a search word including first words describing an action and a second word indicating a relationship is identified in an image search window, in a state in which an image application for image search is executed, retrieve a face image satisfying a first condition for retrieving a face image of a person corresponding to the second word from among a plurality of images stored in the memory; display, via the display, the retrieved face image and a first message for recommending registration of the retrieved face image as the second word; and register the face image as the second word when selection of the registration is confirmed.
Need to check novelty before this filing date? Find Prior Art

Description

Methods for providing registration information of images in electronic devices and electronic devices

[0001] The present disclosure relates to an electronic device and a method for providing registration information of an image in the electronic device.

[0002] An electronic device can search for and display an image desired by a user among a plurality of images stored in the electronic device by executing an application for image search.

[0003] When a user inputs a search term indicating a name or relationship into the search box provided by the application, the electronic device can search for and display at least one image containing a person whose face image is registered with the name or relationship. In order to search for an image using a search term indicating a name or relationship in the search box, the user must first register the name or relationship for each person included in the image.

[0004] When multiple images containing the same multiple people are searched a specified number of times, the electronic device can register the multiple people as a group to facilitate search.

[0005] The electronic device can search for a face image corresponding to a name or relationship including a search word entered for image search, and suggest registration information for registering the name or relationship to a person having the face image.

[0006] The electronic device can minimize input for registration by providing registration information at the time of searching for an image or at the time of checking an image.

[0007] An electronic device according to an embodiment may include a display, a processor, and a memory storing instructions. When executed by the processor according to an embodiment, the electronic device may, when an image application for image search is executed, confirm an input of a search word including first words describing an action and a second word indicating a relationship in an image search window, search for a facial image satisfying a first condition for searching for a facial image of a person corresponding to the second word among a plurality of images stored in the memory. When executed by the processor according to an embodiment, the electronic device may display, through the display, the searched facial image and a first message recommending registration of the searched facial image with the second word. When executed by the processor according to an embodiment, the electronic device may, when a selection of registration is confirmed, register the facial image with the second word.

[0008] In one embodiment, a method for providing registration information of an image in an electronic device may include, when an image application for image search is executed and a search word including first words describing an action and a second word indicating a relationship is input into an image search window, an operation of searching for a face image satisfying a first condition for searching for a face image of a person corresponding to the second word among a plurality of images stored in the memory may include an operation of displaying, through a display of the electronic device, the searched face image and a first message recommending that the searched face image be registered with the second word. In one embodiment, the method may include an operation of registering the face image with the second word when a selection of the registration is confirmed.

[0009] In one embodiment, a non-volatile storage medium storing commands is provided, wherein the commands are configured to cause the electronic device to perform at least one operation when executed by the electronic device, wherein the at least one operation may include: when an image application for image search is executed, if a search word including first words describing an action and a second word indicating a relationship is input into an image search window, searching for a facial image satisfying a first condition for searching for a facial image of a person corresponding to the second word among a plurality of images stored in the memory. In one embodiment, the at least one operation may include: displaying, through a display of the electronic device, the searched facial image and a first message recommending registration of the searched facial image with the second word. In one embodiment, the at least one operation may include: registering the facial image with the second word when a selection of the registration is confirmed.

[0010] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0011] Figure 2 is a block diagram of an electronic device according to one embodiment.

[0012] FIGS. 3A, 3B, 3C, 3D, and 3E are drawings for explaining an operation of providing registration information of an image at the time of retrieving the image in an electronic device according to one embodiment.

[0013] FIGS. 4A, 4B, and 4C are drawings for explaining an operation of providing registration information of an image at the time of retrieving the image in an electronic device according to one embodiment.

[0014] FIGS. 5A, 5B, and 5C are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0015] FIGS. 6A, 6B, and 6C are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0016] FIGS. 7A, 7B, 7C, 7D, 7E, 7F, 7G, and 7H are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0017] FIGS. 8A, 8B, 8C, and 8D are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0018] FIGS. 9A, 9B, and 9C are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0019] FIGS. 10A, 10B, 10C, and 10D are drawings for explaining an operation of providing registration information of an image at a time of image confirmation in an electronic device according to one embodiment.

[0020] FIGS. 11a, 11b, 11c, 11d, and 11e are drawings for explaining an operation of providing registration information of an image at a time of image confirmation in an electronic device according to one embodiment.

[0021] FIGS. 12a, 12b and 12c are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0022] FIGS. 13a and 13b are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0023] FIGS. 14a, 14b and 14c are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0024] FIGS. 15a, 15b, 15c, and 15d are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0025] FIGS. 16a, 16b, 16c, and 16d are drawings for explaining an operation of providing registration information of an image at a time of image confirmation in an electronic device according to one embodiment.

[0026] FIGS. 17A and 17B are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0027] FIGS. 18a and 18b are flowcharts illustrating an operation of providing registration information of an image at the time of retrieving the image in an electronic device according to one embodiment.

[0028] FIGS. 19A and 19B are flowcharts illustrating an operation of providing registration information of an image at the time of image confirmation in an electronic device according to one embodiment.

[0029] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to an embodiment. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to an embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0030] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0031] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0032] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0033] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0034] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0035] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0036] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0037] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0038] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0039] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0040] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0041] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0042] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0043] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0044] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0045] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0046] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0047] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0048] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent to a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0049] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0050] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0051] Figure 2 is a block diagram of an electronic device according to one embodiment.

[0052] Referring to the above drawing 2, the electronic device (201) may include a processor (220), a memory (230), a display (260), and a camera (280).

[0053] According to one embodiment, the processor (220) may be implemented substantially identically or similarly to the processor (120) of FIG. 1.

[0054] According to one embodiment, the processor (220) may perform overall control operations of the electronic device (201). The processor (220) according to one embodiment may execute software (e.g., the program (140) of FIG. 1) to control at least one other component (e.g., a hardware or software component) of the electronic device (201) connected to the processor (220), and may perform data processing or calculations based on instructions. An instruction according to one embodiment may include a command configured in a machine language that can be processed by the electronic device (201) or the processor (220). For example, the instruction may include a command corresponding to an operation instruction used in a program.

[0055] According to one embodiment, the processor (220) may confirm the capture of an image through the camera (280) while the camera application is running, and if a person is included in the image, recognize the face image of the person using a face recognition function, and check whether a name or relationship corresponding to the recognized face image is registered, and then store the image in the memory. According to one embodiment, the processor (220) may store face identification information (face ID) corresponding to the name or relationship as tag information of the image, if a name or relationship is registered in the face image of the person included in the image.

[0056] According to one embodiment, the processor (220) may store counting information that counts at least one of the number of images included in each person among a plurality of images stored in the memory (230), the number of images having the same facial identification information, the number of images including multiple identical people, the number of images including a person set as a favorite, the number of images included in each object, or the number of images including an object set as a favorite.

[0057] According to one embodiment, the processor (220) may store the number of times an image is searched for each of a plurality of images stored in the memory (230).

[0058] According to one embodiment, when generating a storage image including a plurality of images based on shooting date information, the processor (220) may check and store the number of images including the same plurality of people among the plurality of images included in the storage information.

[0059] According to an embodiment, the processor (220) may confirm the shooting of a video through the camera (280) while the camera application is running, and if a person is included in the video, the processor may recognize a facial image of the person using a facial recognition function, and if voice information including a word related to a name or relationship is repeated a specified number of times or more while shooting the video, the voice information may be detected as voice information related to the facial image. According to an embodiment, the processor (220) may store the video in the memory (230) after confirming whether a name or relationship corresponding to the recognized facial image is registered. According to an embodiment, if a name or relationship is registered in a facial image of a person included in the video, the processor (220) may store face identification information (face ID) corresponding to the name or relationship as tag information of the video. According to an embodiment, if a name or relationship is not registered in a facial image of a person included in the video, the processor (220) may store the facial image and the voice information as tag information of the video.

[0060] According to one embodiment, the processor (220) may identify an image containing a person among a plurality of images stored in the memory (230), and if a name or relationship is registered in the face image of the person contained in the image, the processor (220) may generate the face image as a face icon.

[0061] According to one embodiment, the processor (220) may detect a facial image corresponding to a name or relationship included in a search term at the time of searching for an image and provide the detected facial image as registration information. While the embodiment illustrates an image as an example, the same applies to a video, whereby a facial image corresponding to a name or relationship included in a search term at the time of searching for an image may be detected and provided as registration information.

[0062] According to one embodiment, the processor (220) may confirm the input of a search word including first words describing an action (e.g., eating ice cream) and second words indicating a relationship (e.g., daughter) in an image search window provided by the image application while the image application for searching and displaying images is running. According to one embodiment, the processor (220) may detect a face image satisfying a first condition for searching for a face image of a person corresponding to the second word among a plurality of images stored in a memory (230), and display a face image satisfying the first condition and a first message recommending registration of the face image with the second word as a pop-up window in a first area of ​​the display (260). According to an embodiment, the processor (220), when there are multiple face images satisfying the first condition, detects a specified number (e.g., 3) of face images in the order of highest satisfaction with the first condition among the multiple face images as candidate face images, and displays a first message recommending registration of the candidate face images and the face image corresponding to the second word among the candidate face images in a pop-up window in the first area of ​​the display.

[0063] According to one embodiment, the processor (220) may detect a plurality of images including a person performing an action corresponding to the first word among a plurality of images stored in the memory (230) while displaying the first message as a pop-up window in the first area of ​​the display (260), and display a plurality of images including a person performing an action corresponding to the first word in the second area of ​​the display (260).

[0064] According to one embodiment, the processor (220) may, upon confirming registration of a face image satisfying the first condition or a face image selected by the user from among candidate face images satisfying the first condition, register (store) the face image as the second word. According to one embodiment, the processor (220) may, while displaying a second message in a pop-up window notifying that the face image has been registered (stored) as the second word in the first area of ​​the display (260), display a plurality of images including a person performing an action corresponding to the first word in the second area of ​​the display (260).

[0065] According to an embodiment, the processor (220) may, while displaying the second message as a pop-up window in the first area of ​​the display (260), search for at least one image including a person having a face image registered with the second word performing an action corresponding to the first word among a plurality of images including a person performing an action corresponding to the first word. According to an embodiment, when the processor (220) confirms that a specified time has elapsed, it may release the display of the pop-up window including the second message and display at least one image including a person having a face image registered with the second word performing an action corresponding to the first word in an area including the first area and the second area of ​​the display (260).

[0066] According to one embodiment, the processor (220) may determine that a first condition for searching for a face image of a person corresponding to a second word corresponding to a relationship is satisfied when at least two of the following persons are the same person: a person included in a plurality of images taken a specified number of times or more at a specified shooting location, a person included in a plurality of images taken a specified number of times or more with the same shooting method (e.g., selfie shooting), a person included in a plurality of images taken a specified number of times or more with the user of the electronic device, a person included in a plurality of images taken together with the user of the electronic device on a specific event anniversary, a person included in a plurality of images taken together with a registered person who is the user of the electronic device or the user's family on a specific event anniversary, a person of a gender or a person of a age.

[0067] For example, if the second word is "Me", if the person included in the plurality of images taken a specified number of times or more at the user's home (a designated shooting location that can identify the relationship) of the electronic device and the person included in the plurality of images taken a specified number of times or more by taking selfies using the front camera of the electronic device (201) are the same first person, it is confirmed that the first condition is satisfied to search for a facial image corresponding to "Me", and the facial image of the first person can be searched as a facial image corresponding to "Me".

[0068] For example, if the second word is "spouse (husband or wife)", if the person included in the multiple images taken a specified number of times or more at the home of the user of the electronic device (a designated shooting location that can identify the relationship), the person included in the multiple images taken a specified number of times or more with the user of the electronic device, and the person taken next to the user of the electronic device in an image taken on a family anniversary (e.g., a wedding anniversary) are the same second person, then the first condition is confirmed to be satisfied for searching for a facial image corresponding to the "spouse (husband or wife), and after distinguishing the gender of the second person, the facial image of the second person can be searched as a facial image corresponding to the "spouse (husband or wife)".

[0069] For example, if the second word is "child (daughter or son)", if a person who appears younger than the user of the electronic device or the user's spouse among the people included in a plurality of images taken a specified number of times or more at the user's home (a designated shooting location that can determine the relationship), a person who appears younger than the user of the electronic device or the user's spouse among the people included in a plurality of images taken a specified number of times or more with the user of the electronic device or the user's spouse, and a person who appears younger than the user or the spouse among the people included in a plurality of images taken a specified number of times or more on a family anniversary (e.g., a birthday anniversary) are the same third person, then after confirming that the first condition is satisfied to search for a facial image corresponding to the "child (daughter or son), the gender of the third person is distinguished, and then the facial image of the third person can be searched as a facial image corresponding to "child (daughter or son)".

[0070] For example, if the second word is "parents (mother or father)", if a fourth person is included in a plurality of images taken a specified number of times or more at the home of the user of the electronic device (a designated shooting location that can determine the relationship), and a person who appears to be older than the user of the electronic device or the user's spouse, a person who appears to be older than the user or the user's spouse, and a person who appears to be older than the user or the user's spouse, and a person who appears to be older than the user or the user's spouse, and a person who appears to be older than the user or the user's spouse, and a person who appears to be older than the user or the user's spouse, and a person who appears to be older than the user or the user's spouse, and a fourth person who appears to be older than the user or the user's spouse, and if it is confirmed that the first condition is satisfied to search for a face image corresponding to the "parents (mother or father)", and after distinguishing the gender of the fourth person, the face image of the fourth person can be searched as a face image corresponding to the "parents (mother or father)".

[0071] According to one embodiment, the processor (220) may confirm the input of a search word including first words describing an action (e.g., not at a picnic) and a third word indicating a name (e.g., delayed) in an image search window provided by the image application while the image application for searching and displaying images is running. According to one embodiment, the processor (220) may search for all a plurality of images including a person performing an action corresponding to the first word among a plurality of images stored in the memory (230). According to one embodiment, the processor (220) may display a first message recommending registration of a plurality of face images detected from each of the plurality of images including a person performing an action corresponding to the first word and a face image corresponding to the third word among the plurality of face images in a pop-up window in a first area of ​​the display (260), and may display a plurality of images including a person performing an action corresponding to the first word in a second area of ​​the display (260). According to one embodiment, the processor (220) may, when a selection of a face image is confirmed by a user input from among a plurality of face images displayed in a first area of ​​the display (260), register (store) the face image as the third word. According to one embodiment, the processor (220) may display a second message in a pop-up window notifying that the face image has been registered (stored) as the third word in the first area of ​​the display (260), and while displaying the second message in the first area of ​​the display (260), search for at least one image including a person having a face image registered as the third word performing an action corresponding to the first word among a plurality of images including a person performing an action corresponding to the first word.According to one embodiment, the processor (220) may, upon confirming the passage of a specified period of time, release the display of the pop-up window including the second message and display at least one image including a person having a facial image registered with the third word performing an action corresponding to the first word in an area including the first area and the second area of ​​the display (260).

[0072] According to one embodiment, the processor (220) may provide registration information based on the number of searches of a gesture or image at the time of image confirmation. In one embodiment, images are described as an example, but the same may be applied to videos to provide registration information based on the number of searches of a gesture or image at the time of image confirmation.

[0073] According to one embodiment, the processor (220) may, while an image application for searching and displaying images is running and an image including a plurality of people selected by a user's input from among a plurality of images stored in a memory (230) is displayed on the display (260), if a first gesture (e.g., a long press) is confirmed to occur on the display (260), display a first message recommending that the plurality of people included in the image be set as a group in a pop-up window.

[0074] According to one embodiment, when the processor (220) confirms the occurrence of a first gesture (e.g., long press) on the display (260) displaying the image including the plurality of persons, the processor (220) can confirm relationship information of the plurality of persons included in the image, and when the plurality of persons are confirmed as family members based on the relationship information about the plurality of persons, the processor can display a first message in a pop-up window recommending (proposing) adding or modifying the family members.

[0075] According to one embodiment, the processor (220) may determine that at least one of the plurality of people included in the image satisfies the condition of a family member if at least one person is included in at least one of the following: a person identical to a profile picture of a contact registered as a family relationship; a person included in an image taken at the home of the user of the electronic device (a designated shooting location that can determine the relationship); a person included in a plurality of images taken at the home of the user of the electronic device (a designated shooting location that can determine the relationship) a specified number of times (e.g., 300 times); a person included in a plurality of images taken at least a specified number of times with the user of the electronic device; a person included in a plurality of images taken at least a specified number of times on a family anniversary (e.g., a birthday anniversary and / or a wedding anniversary); or a person whose gender or age can be determined based on the user of the electronic device.

[0076] According to one embodiment, the processor (220) can confirm the gender or age of the user of the electronic device by referring to below.

[0077] No. Relationship Name Gender Age 1. Mom (Female) Older than me 2. Dad (Father) Dad (Male) Older than me 3. Brother (Male) Older than me 4. Sister (Female) Older than me 5. Brother (Younger) Male 6. Sister (Younger) Female 7. Husband (Spouse) Male - 8. Wife (Spouse) Female - 9. Daughter (Female) Younger than me 10. Son (Male) Younger than me

[0078] According to one embodiment, when a plurality of people included in the image are registered as a family, if the processor (220) confirms the input of a search word including “family” in an image search window provided by the image application, the processor (220) may search for at least one image including the plurality of people registered as members of the “family” among the plurality of images stored in the memory (230) and display the image on the display (260). According to one embodiment, when the processor (220) confirms the occurrence of a first gesture (e.g., long press) on the display (260) displaying the image including the plurality of people, the processor (220) may confirm relationship information of the plurality of people included in the image, and if the plurality of people are not confirmed as members of the family based on the relationship information for the plurality of people, the processor (220) may confirm the number of images including the plurality of people among the plurality of images stored in the memory (230). According to one embodiment, the processor (220) may display a first message in a pop-up window recommending that the plurality of people be registered as a group so that the plurality of people can be searched by group name when the number of images including the plurality of people is greater than or equal to a specified number.According to one embodiment, the processor (220) may determine that the condition of a family member is not satisfied if all of the plurality of people included in the image do not include at least one of the following: a person identical to a profile picture of a contact registered as a family relationship, a person included in an image taken at the home of the user of the electronic device (a designated shooting location that can determine the relationship), a person included in a plurality of images taken at the home of the user of the electronic device (a designated shooting location that can determine the relationship) a specified number of times (e.g., 300 times), a person included in a plurality of images taken at the home of the user of the electronic device a specified number of times, a person included in a plurality of images taken at a family anniversary (e.g., a birthday anniversary and / or a wedding anniversary) a specified number of times, or a person whose gender or age can be determined based on the user of the electronic device. According to one embodiment, when a plurality of people included in the image are registered under a group name such as, for example, “middle school classmates,” the processor (220) can, when a search term including “middle school classmates” is input into an image search window provided by the image application, search for at least one image including the plurality of people registered as the “middle school classmates” group among the plurality of images stored in the memory (230) and display the searched image on the display (260).

[0079] According to one embodiment, the processor (220) may, when an image search function is selected while displaying an image selected by a user input from among a plurality of images stored in the memory (230) through the display (260) while an image application for searching and displaying images is running, detect faces and / or objects of a person in the image, and display the detected faces and / or objects in a second area of ​​the display (260) while displaying the image in a first area of ​​the display (260). The objects according to one embodiment may include objects and animals other than people. According to one embodiment, when displaying the objects in the second area of ​​the display (260), the processor (220) may display a general object name (e.g., sofa, bag, and / or cushion) or an animal name (e.g., dog and / or cat) indicating a type of animal based on the shape of the object. According to one embodiment, the processor (220) may confirm selection of a first object through a user input from among the objects, and may display a first message in a pop-up window recommending registration of a name (nickname) for the first object. According to one embodiment, when the first object (e.g., cushion) is registered with a name (nickname) of, for example, "shrimp pillow," and when a search word including "shrimp pillow" is input into an image search window provided by the image application, the processor (220) may search for at least one image including the first object among a plurality of images stored in the memory (230) and display the searched image on the display (260).

[0080] According to one embodiment, when the processor (220) confirms selection of a story function that automatically creates a story with images and / or videos taken on the same date along with music matching the images and / or videos while an image application for searching and displaying images is running, the processor (220) may display a plurality of story images on the display (260). According to one embodiment, the processor (220) may confirm that the plurality of images included in the first story image include the same plurality of people while playing (sequentially displaying) the plurality of images included in the first story image selected by the user input among the plurality of story images along with music. According to one embodiment, when the processor (220) completes playing the plurality of images included in the first story image, the processor (220) may display a first message in a pop-up window recommending that the plurality of identical people included in the plurality of images of the first story image be registered as a group. According to one embodiment, when the same plurality of people included in the plurality of images of the first story image are registered under a group name such as, for example, “Friend 1,” when a search word including “Friend 1” is input into the image search window provided by the image application, the processor (220) can search for at least one image including the plurality of people registered as the “Friend 1” group among the plurality of images stored in the memory (230) and display the searched image on the display (260).

[0081] According to one embodiment, when an image application for searching and displaying images is executed and an image selected by a user's input from among a plurality of images stored in a memory (230) is displayed through the display (260), if the number of searches for the image is confirmed to be a specified number or more, the processor (220) may display a first message in a pop-up window recommending registration of a name or relationship corresponding to a person included in the image. According to one embodiment, when the processor (220) confirms input of a name or relationship for a person included in the image, the processor may register (store) the person included in the image with the input name or relationship.

[0082] In one embodiment, the processor (220) may, while an image application for searching and displaying images is running and an image including a plurality of people selected by a user's input from among a plurality of images stored in the memory (230) is displayed through the display (260), if the number of searches for the image is confirmed to be a specified number or more, display a first message recommending that the plurality of people included in the image be registered as a group in a pop-up window. In one embodiment, the processor (220) may, if the input of a group name for the plurality of people included in the image is confirmed, register (store) the plurality of people included in the image with the input group name.

[0083] According to one embodiment, the processor (220) may count the number of searches of the image by increasing it by one when the image selected by the user's input is displayed on the display (260) for a certain period of time or more, or when the display of the image ends after a detailed view function of the image in which the zoom in or zoom out function is performed.

[0084] According to one embodiment, when the processor (220) displays an image including a plurality of people selected by a user input from among a plurality of images stored in the memory (230) through the display (260) while an image application for searching and displaying images is running, if a selection of a first indicator for displaying a person icon displayed in a certain area of ​​the display (260) is confirmed, the processor (220) may display the registered name or relationship together with the person icon near the people registered by name or relationship among the plurality of people. According to one embodiment, the processor (220) may display a second indicator (“?”) near the people not registered by name or relationship among the plurality of people to induce registration because they are not registered. According to one embodiment, when the processor (220) confirms selection of the second indicator ("?"), it may display a first message in a pop-up window in the first area of ​​the display (260) recommending registration of a name or relationship corresponding to a person who is not registered by name or relationship, and may display at least one image including the unregistered person among a plurality of images stored in the memory (230) in the second area of ​​the display (260). According to one embodiment, when the processor (220) confirms input of a name or relationship for a person who is not registered by name or relationship, it may register (store) the person with the input name or relationship.

[0085] In one embodiment, the processor (220) may, while an image application for searching and displaying images is running and displaying an image including a plurality of people selected by a user input from among a plurality of images stored in a memory (230), display an image through the display (260), and upon confirming selection of a first indicator for displaying a person icon displayed in a certain area of ​​the display (260), display the registered name or relationship together with the person icon near the people registered by name or relationship among the plurality of people. In one embodiment, the processor (220) may display a second indicator (“?”) near the people not registered by name or relationship among the plurality of people to induce registration because they are not registered. According to one embodiment, when the processor (220) confirms the selection of the second indicator ("?"), the processor (220) may display a first message in a pop-up window in the first area of ​​the display (260) recommending the registration of persons registered by name or relationship and persons not registered by name or relationship as a group, and may display at least one image including persons registered by name or relationship and persons not registered by name or relationship among a plurality of images stored in the memory (230) in the second area of ​​the display (260). According to one embodiment, when the processor (220) confirms the selection of group creation based on a user's input, the processor (220) may recommend a group name based on calendar information of a calendar application and contact information of a contact application. According to one embodiment, when calendar information recorded on the shooting date of the image exists in the calendar application, the processor (220) may provide the calendar information as a recommended group name.According to one embodiment, the processor (220) may, if group names are stored in the contact information of persons registered by name or relationship in the contact application and in the contact information of persons not registered by name or relationship, provide the group names stored in the contact information as recommended group names. According to one embodiment, the processor (220) may, if it confirms the selection of a recommended group name based on a user's input, register persons registered by name or relationship and persons not registered by name or relationship as recommended group names.

[0086] According to one embodiment, the processor (220) may play a video among a plurality of videos stored in the memory (230) in a state where an image application for searching and displaying images is executed, based on a user's input. According to one embodiment, if the processor (220) confirms tag information of the video including a face image and voice information while playing the video, when the video is completed, the processor (220) may display a first message in a pop-up window recommending registration of the face image as text information (e.g., name) corresponding to the voice information together with the face image. According to one embodiment, if the processor (220) confirms registration of the face image as text information (e.g., name) based on the user's input, the processor (220) may register the face image as the text information (e.g., name). According to one embodiment, when the video is finished being recorded and stored, the processor (220) may store tag information of the video including a face image detected by a face recognition function and voice information including a word related to a name or relationship that has been repeated a specified number of times or more.

[0087] According to one embodiment, the processor (220) may check at least one contact whose contact profile image is registered as a person among a plurality of contacts stored in a contact application, and if at least one image including the person is included in a plurality of images stored in a memory (230), the facial data of the person may be automatically registered (stored) as the name, nickname, and / or relationship stored as contact information of the contact. According to one embodiment, the processor (220) may check the input of a search word including any one of the name, nickname, or relationship stored as contact information of the contact in an image search window provided in the image application while the image application for searching and displaying images is running, and may display at least one image including a person whose facial image is registered as any one of the name, nickname, or relationship included in the search word among a plurality of images stored in the memory (230).

[0088] According to one embodiment, the processor (220) may check a search word entered in an image search window provided in an image application while an image application for searching and displaying images is running, and if the search word (e.g., wedding) exists as calendar information of a calendar application, search for at least one image among a plurality of images stored in the memory (230) that includes a date on which calendar information corresponding to the search word is stored as a shooting date, and display the searched image on the display (260). According to one embodiment, while displaying an image selected by a user among a plurality of images stored in the memory (230) through the display (260), if calendar information (e.g., “Kim Ye-jin’s wedding”) exists on the shooting date of the image in the calendar application, the processor (220) may check a name (e.g., “Kim Ye-jin”) or relationship corresponding to a person included in the image based on the calendar information, and display a first message in a pop-up window recommending that the person included in the image be registered with the name or relationship confirmed by the calendar information.

[0089] According to one embodiment, the processor (220), while an image application for searching and displaying images is running, and an image selected by a user input from among a plurality of images stored in a memory (230) is displayed through the display (260), if it is confirmed that the image is displayed for a specified period of time (e.g., 3 seconds) or longer, that the image includes a single person, and that the single person included in the image satisfies the conditions of a family member, the processor may generate a thumbnail image of the face of the single person included in the image, and display a first message recommending that the person be registered as a family member together with the generated face thumbnail image in a pop-up window.

[0090] According to one embodiment, when an image application for searching and displaying images is running, and an image including a plurality of people selected by a user's input from among a plurality of images stored in a memory (230) is displayed through the display (260), if the image is displayed for a specified time (e.g., 3 seconds) or longer, the number of the plurality of people included in the image is greater than or equal to the number of the specified people (e.g., 3 people), and the plurality of people included in the image satisfy the condition of a family member, the processor (220) may display a first message recommending (proposing) that the plurality of people included in the image be registered as a family member in a pop-up window.

[0091] According to one embodiment, when the processor (220) captures at least one image including a plurality of persons registered as a family, it may display a message (1615) in a pop-up window suggesting sharing of the at least one image with a plurality of electronic devices corresponding to the plurality of persons registered as a family.

[0092] In one embodiment, while an image application for searching and displaying images is running, the processor (220) may display a first image including a plurality of people selected by a user's input from among a plurality of images stored in the memory (230) through the display (260), and may confirm that a specified number (e.g., 300) or more of images including a plurality of people taken together with the user of the electronic device at the user's home (a specified shooting location that can determine the relationship) of the user of the electronic device exist among the plurality of images stored in the memory (230), and if the first image is included among the images exceeding the specified number, it may be confirmed whether at least one person among the plurality of people included in the first image satisfies the condition of a family member. In one embodiment, if the processor (220) confirms that at least one person among the plurality of people included in the first image satisfies the condition of a family member, it may display a first message in a pop-up window recommending (proposing) registering the plurality of people included in the first image as family members.

[0093] In one embodiment, the processor (220), while an image application for searching and displaying images is running, displays a second image including a plurality of people selected by a user's input from among a plurality of images stored in a memory (230) through the display (260), if the plurality of people included in the second image include people registered as family members, including the user of the electronic device, and a new person who is not registered as a family member, if the shooting date information of the first image is the same as the date information of a family schedule (e.g., family birthdays, family dinners, and / or family gatherings) based on calendar information of a calendar application, and if there are a specified number or more images of the new person taken together with the user of the electronic device within a specified period (e.g., the last 30 days) based on the current date, and if the face of the new person is registered as a contact image in a contact application, and the relationship is registered as "family" in the contact information, the processor (220) may display a first message in a pop-up window recommending (proposing) additional registration of the new person as a family member.

[0094] According to one embodiment, the memory (230) may be implemented substantially identically or similarly to the memory (130) of FIG. 1.

[0095] According to one embodiment, the memory (230) may store a plurality of images, names or relationships registered as people included in the images, and / or group names registered as people included in the images.

[0096] According to one embodiment, the display (260) may be implemented substantially identically or similarly to the display (160) of FIG. 1.

[0097] According to one embodiment, the display (260) may display an image selected by the user from among a plurality of images, a first message recommending registration, a second message indicating completion of registration, and / or at least one image including at least one person included in the plurality of images.

[0098] According to one embodiment, the camera (280) may be implemented substantially identically or similarly to the camera module (280) of FIG. 1.

[0099] A camera (280) according to an embodiment (e.g., at least one front camera and at least one rear camera) can capture still images and videos. According to an embodiment, the camera (280) may include one or more lenses, image sensors, image signal processors, or flashes. In an embodiment, the electronic device (201) may include cameras each having different properties or functions (or uses). For example, the camera (280) may include cameras having different angles of view. The angles of view may include, for example, a super wide angle of 114° to 94°, a wide angle, a normal lens of 84° to 63°, a telephoto of 28° to 8°, and a super telephoto of 6° to 3°. For example, the camera (280) may include at least one front camera positioned on the front to capture images and / or videos as described above, and at least one rear camera positioned on the rear to capture images and / or videos.

[0100] FIGS. 3A, 3B, 3C, 3D, and 3E are drawings for explaining an operation of providing registration information of an image at the time of retrieving the image in an electronic device according to one embodiment.

[0101] As shown in the above FIG. 3A, when the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) confirms the input of the search word “daughter eating ice cream” including first words describing an action (e.g., eating ice cream) and second words indicating a relationship (e.g., daughter) in the image search window (311) provided by the image application while the image application is running, the electronic device can detect at least one face image that satisfies a first condition for searching for a face image of a person corresponding to the second word among a plurality of images stored in the memory of the electronic device (e.g., the memory (230) of FIG. 2).

[0102] As shown in the above FIG. 3b, when the electronic device (201) detects one face image satisfying the first condition, the electronic device (201) may display a message (313a) recommending registration of the face image as the second word, “daughter,” together with the detected face image, as a pop-up window on the first area (261) of the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2), and may display, among the plurality of images stored in the memory, a plurality of images (331a) including a person performing an action corresponding to the first word, “an action of eating ice cream,” and a plurality of images (33b) stored in the memory, separately.

[0103] As shown in the above FIG. 3c, when the electronic device (201) detects a plurality of face images satisfying the first condition, the electronic device (201) detects a designated number (e.g., 3) of face images in the order of highest satisfaction with the first condition among the plurality of face images as candidate face images, and displays a first message (313b) recommending selection of a face image to be registered as the second word, “daughter,” among the candidate images as a pop-up window on the first area (261) of the display together with the candidate face images, and can display, on the second area (263) of the display of the electronic device (201), a plurality of images (331a) including a person performing an action corresponding to the first word, “an action of eating ice cream,” and a plurality of images (331b) stored in the memory (230), by distinguishing them.

[0104] As in the above FIG. 3d, when the selection (a1) of “Yes” that can confirm registration in the above FIG. 3b is confirmed or the selection (a2) of the first candidate image among the candidate face images is confirmed in the above FIG. 3c, a second message (315) notifying that the face image has been registered (saved) as the second word “daughter” is displayed as a pop-up window in the first area (261) of the display, while a plurality of images (331a) including a person performing an action corresponding to the first word, “an action of eating ice cream,” among the plurality of images stored in the memory and a plurality of images (331b) stored in the memory (230) can be displayed separately in the second area (263) of the display.

[0105] As in the above FIG. 3e, when the passage of a specified time (e.g., 3 seconds) while displaying the second message (315) as a pop-up window in the above FIG. 3d is confirmed, a plurality of images (331a) including a person performing an action corresponding to the first word, which is an action of "eating ice cream" among the plurality of images stored in the memory on the display, a plurality of images (331b) stored in the memory (230), and a plurality of images (331c) including a person performing an action corresponding to the first word, which is an action of "eating ice cream" among the plurality of images (331a) including a person performing an action corresponding to the first word, which is an action of "eating ice cream", and having a face image registered as the second word, which is "daughter", can be displayed separately.

[0106] FIGS. 4A, 4B, and 4C are drawings for explaining an operation of providing registration information of an image at the time of retrieving the image in an electronic device according to one embodiment.

[0107] When an electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) confirms an input of a search term “delay not at a picnic” including first words describing an action (e.g., sitting at a picnic) and a third word indicating a name (e.g., delay) in an image search window provided by the image application while the electronic device (201) is running an image application, the electronic device can confirm a plurality of images including a person performing the action “delay not at a picnic” corresponding to the first word among a plurality of images stored in a memory of the electronic device (e.g., the memory (230) of FIG. 2), and confirm a plurality of face images detected from each of the confirmed plurality of images.

[0108] As shown in the above FIG. 4A, the electronic device (201) may display a first message (413) recommending selection of a facial image to be registered with the third word “delay” among the plurality of facial images as a pop-up window on a first area (261) of a display of the electronic device (201) (e.g., a display (260) of FIG. 2), and may display a plurality of images (431) including a person performing an action corresponding to the first word “not at a picnic” among the plurality of images stored in the memory on a second area (263) of the display of the electronic device (201).

[0109] As shown in the above FIG. 4b, when the electronic device confirms selection (b1) of a first face image among the plurality of face images in the above FIG. 4a, it may display a second message (415) in a pop-up window notifying that the selected face image has been registered (saved) as the third word, “delay,” in the first area (261) of the display, and display a plurality of images (431) including a person performing an action corresponding to the first word, “not being at a picnic,” among the plurality of images stored in the memory in the second area (263) of the display.

[0110] As in the above FIG. 4c, when the specified time (e.g., 3 seconds) has elapsed while the second message (415) is displayed as a pop-up window in the above FIG. 4b, a plurality of images including a person performing the action corresponding to the first word, “not at a picnic,” among a plurality of images including a person having a face image registered with the third word, “delay,” performing the action corresponding to the first word, “not at a picnic,” can be displayed on the display (260).

[0111] FIGS. 5A, 5B, and 5C are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0112] As shown in the above FIG. 5A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) may display an image (511) including a plurality of people selected based on a user input from among a plurality of images stored in the memory (e.g., the memory (230) of FIG. 2) of the electronic device (201) while executing an image application, through the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2), and may confirm a first gesture (c1) (e.g., a long press) on the display (260).

[0113] As shown in the above FIG. 5b, when the electronic device (201) confirms a first gesture (c1) (e.g., long press) on the display (260) displaying the image (511), the electronic device (201) displays a pop-up window (513) including menus that can perform functions related to the image (511), and confirms selection (c2) of the “search in gallery” menu that can search for multiple images stored in the memory among the menus included in the pop-up window (513).

[0114] As shown in the above FIG. 5c, when the electronic device (201) confirms the selection (c2) of the "search in gallery" menu, it checks the relationship information of the plurality of people (517, 518, 519) included in the image (511), and when it confirms that the plurality of people (515, 517, 519) are members of the family based on the relationship information for the plurality of people, it can display a first message (515) suggesting addition or modification as a family member on the display (261) as a pop-up window.

[0115] FIGS. 6A, 6B, and 6C are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0116] As shown in the above FIG. 6A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) may display an image (611) including a plurality of people selected based on a user input from among a plurality of images stored in the memory (e.g., the memory (230) of FIG. 2) of the electronic device (201) while executing an image application, through the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2), and may confirm a first gesture (d1) (e.g., a long press) on the display (260).

[0117] As shown in the above FIG. 6b, when the electronic device (201) confirms a first gesture (d1) (e.g., long press) on the display (260) displaying the image (611), the electronic device (201) displays a pop-up window (613) including menus that can perform functions related to the image (611), and confirms selection (d2) of the “search in gallery” menu that can search for multiple images stored in the memory among the menus included in the pop-up window (613).

[0118] As shown in the above drawing 6c, when the electronic device (201) confirms the selection (d2) of the "search in gallery" menu, it checks the relationship information of the plurality of people (615, 616, 617, 618, 619, and 620) included in the image (611), and if not all of the plurality of people (615, 616, 617, 618, 619, and 620) are confirmed as family members based on the relationship information for the plurality of people, it can check the number of images including the plurality of people among the plurality of images stored in the memory. When the number of images including the plurality of people is equal to or greater than a specified number, the electronic device (201) displays the plurality of face images (615a, 616a, 617a, 618a, 619a, and 620a) detected from each of the plurality of people and the plurality of people in the first area (261) of the display. A first message (613) recommending that the plurality of people be registered as a group so that they can be searched by group name may be displayed in a pop-up window, and a plurality of images (631) including the plurality of people may be displayed in a second area (263) of the display.

[0119] FIGS. 7A, 7B, 7C, 7D, 7E, 7F, 7G, and 7H are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0120] As shown in the above FIG. 7A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) may, while executing an image application, display an image (711) selected based on a user input from among a plurality of images stored in the memory (e.g., the memory (230) of FIG. 2) of the electronic device (201) through the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2). While the electronic device (201) displays the image (711) on the display (260), the electronic device (201) may confirm selection (e1) of an icon (713) indicating an image search function displayed in a portion of the display (260).

[0121] As shown in the above FIG. 7B, when the electronic device (201) confirms selection (e1) of an icon (713) representing the image search function, the electronic device (201) can detect faces of people and objects in the image (711), and display the detected faces of people (“me” and “daughter”) and objects (top, bag, sofa, and cushion) in the second area (263) of the display while displaying the image in the first area (261) of the display. The electronic device (201) can confirm a user input (e2) for selection of a cushion (715) among the objects included in the image (711) displayed in the first area (261) of the display.

[0122] As shown in the above FIG. 7c, when the electronic device (201) confirms a user's input (e2) for selecting a cushion (715), the electronic device (201) can distinguishably display the cushion (715) among the faces and objects of the person included in the image displayed in the first area (261) of the display. The electronic device (201) can confirm the occurrence of a second gesture (e3) (e.g., upward drag) on ​​the cushion (715a) displayed in the second area of ​​the display.

[0123] As shown in the above FIG. 7d, when the electronic device (201) confirms the user's input (e2) for selecting the cushion (715), it can display a first message (717) in a pop-up window in the first area (261) of the display, recommending that a name (nickname) for the cushion (715) be registered. The electronic device (201) can confirm the user's input (e4) for registering a name (nickname) for the cushion (715).

[0124] As shown in the above FIG. 7e, the electronic device (201) can display an input window (719) in the first area (261) of the display and a keypad (721) in the second area (263) of the display so that the user can input a name (nickname) for the cushion (715).

[0125] As shown in the above drawing 7f, when the electronic device (201) confirms the selection (e5) of “save” for registration after the name (nickname) “shrimp pillow” is entered by the user in the input window (719) of the first area (261) of the display, the electronic device (201) can register (save) the cushion (715) as “shrimp pillow.”

[0126] As shown in FIG. 7g, the electronic device (201) can confirm the input of the search word “shrimp pillow” in the image search window (723) provided by the image application.

[0127] As shown in FIG. 7h, when the electronic device (201) confirms that the search word “shrimp pillow” is entered in the image search window (723), it searches for a plurality of images including a cushion (715) registered as a shrimp pillow among a plurality of images stored in the memory and displays a plurality of images (715) including a cushion (715) registered as a shrimp pillow on the display (260).

[0128] FIGS. 8A, 8B, 8C, and 8D are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0129] When an electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) confirms selection of a story function while executing an image application, the electronic device can display a plurality of story images on a display of the electronic device (e.g., the display (260) of FIG. 2).

[0130] As shown in the above drawing 8a, while playing (sequentially displaying) multiple images included in a first story image selected by a user input from among the multiple story images along with music, it can be confirmed that the multiple images included in the first story image (811) include the same multiple people.

[0131] As shown in the above FIG. 8b, when the electronic device (201) completes playback of a plurality of images included in the first story image (811), it displays a first message (813) in a pop-up window recommending registration of a plurality of identical people included in the plurality of images of the first story image (811) as a group, and confirms selection (f1) of “Yes” to register the plurality of people.

[0132] As shown in the above FIG. 8c, when the electronic device (201) confirms a user's input (f1) for registering the plurality of persons, the electronic device (201) can display an input window (815) in the first area (261) of the display so that the user can input a group name for the plurality of persons, and can display a keypad (817) in the second area (263) of the display. When the electronic device (201) confirms a selection (f2) of "save" for registration after the user inputs the name (nickname) "Friend 1" in the input window (815) in the first area (261) of the display, the electronic device (201) can register (save) the plurality of persons as "Friend 1".

[0133] As shown in the above FIG. 8d, when the electronic device (201) registers (saves) the plurality of people as “Friend 1”, it displays a second message (819) in a pop-up window on the first area (261) of the display, indicating that the plurality of people have been registered as “Friend 1”, and can display a plurality of images including the plurality of people registered as “Friend 1” among the plurality of images stored in the memory on the first area (261) of the display.

[0134] FIGS. 9A, 9B, and 9C are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0135] As shown in the above FIG. 9A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) can display an image (911) selected based on a user input from among a plurality of images stored in the memory of the electronic device (201) (e.g., the memory (230) of FIG. 2)) through the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2) while executing an image application.

[0136] As shown in the above drawing 9b, when the electronic device (201) confirms that the number of searches for the image (911) is greater than a specified number while displaying the image (911) through the display (260), the electronic device (201) displays a first message (913) in a pop-up window recommending registration of a plurality of people included in the image (911) as a group, and confirms the selection (g1) of “Yes” to register the plurality of people as a group in the first message (913).

[0137] As shown in the above FIG. 9c, when the electronic device (201) confirms the selection (g1) of “Yes” for registering the plurality of persons as a group, the electronic device (201) can display an input window (915) in the first area (261) of the display so that the user can input a group name for the plurality of persons, and can display a keypad (917) in the second area (263) of the display.

[0138] The electronic device (201) can confirm selection (e1) of an icon (713) indicating an image search function displayed in a portion of the display (260) while displaying the image (711) on the display (260).

[0139] FIGS. 10A, 10B, 10C and 10D are drawings for explaining an operation of providing registration information of an image at a time of image confirmation in an electronic device according to one embodiment.

[0140] As shown in the above FIG. 10A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) can display an image (1011) including a plurality of people selected based on a user input from among a plurality of images stored in the memory (e.g., the memory (230) of FIG. 2) of the electronic device (201) while executing an image application, through the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2). The electronic device (201) can confirm the selection (h1) of the first indicator (1013) for displaying a person icon displayed in a certain area of ​​the display (260).

[0141] As shown in the above drawing 10b, when the electronic device (201) confirms the selection (h1) of the first indicator (1013), it can display the registered name or relationship (1015a, 1018a) together with the person icon near the persons (1015, 1018) registered by name or relationship among the plurality of persons (1015, 1016, 1017, 1018, 1019) included in the image (1011). The electronic device (201) can display a second indicator (“?”) (1016a, 1017a, 1019a) that can induce registration near the persons (1016, 1017, 1019) among the plurality of persons that are not registered by name or relationship because they are not registered. The above electronic device (201) can confirm the selection of the second indicator (1016a) among a plurality of second indicators (1016a, 1017a, 1019a).

[0142] As shown in the above FIG. 10c, when the electronic device (201) confirms selection of the second indicator (1016a) among the plurality of second indicators (1016a, 1017a, 1019a), the electronic device (201) may display a first message (1021) in a pop-up window in the first area (261) of the display, recommending registration of a name or relationship corresponding to the person (1016) indicated by the second indicator (1016a), and may display a plurality of images (1023) including the person (1016) among a plurality of images stored in the memory of the electronic device (e.g., the memory (230) of FIG. 2)) in the second area (263) of the display.

[0143] As shown in the above drawing 10d, when the electronic device (201) confirms the input of a name (“Lim”) for a person (1016) who is not registered with the name or relationship, the electronic device (201) can register (store) the person (1016) with the input name (“Lim”).

[0144] FIGS. 11a, 11b, 11c, 11d, and 11e are drawings for explaining an operation of providing registration information of an image at a time of image confirmation in an electronic device according to one embodiment.

[0145] As shown in the above FIG. 11A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) can display an image (1111) including a plurality of people selected based on a user input from among a plurality of images stored in the memory (e.g., the memory (230) of FIG. 2) of the electronic device (201) while executing an image application, through the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2). The electronic device (201) can confirm the selection (i1) of the first indicator (1113) for displaying a person icon displayed in a certain area of ​​the display (260).

[0146] As shown in the above drawing 11b, when the electronic device (201) confirms the selection (i1) of the first indicator (1113), it can display the registered name or relationship (1115a, 1118a) together with the person icon near the persons (1115, 1118) registered by name or relationship among the plurality of persons (1115, 1116, 1117, 1118) included in the image (1111). The electronic device (201) can display a second indicator (“?”) (1116a, 1117a) that can induce registration near the persons (1116, 1117) among the plurality of persons that are not registered by name or relationship because they are not registered. The above electronic device (201) can confirm the selection of the second indicator (1116a) among a plurality of second indicators (1116a, 1117a).

[0147] As shown in the above drawing 11c, when the electronic device (201) confirms selection of the second indicator (1116a) among the plurality of second indicators (1116a, 1117a), the electronic device (201) may display a first message (1119) in a pop-up window in the first area (261) of the display recommending that persons (1115, 1118) registered by name or relationship and persons (1116, 1117) not registered by name or relationship be registered as a group, and may display a plurality of images (1121) including persons (1115, 1118) registered by name or relationship and persons (1116, 1117) not registered by name or relationship among the plurality of images stored in the memory in the second area (263) of the display. The electronic device (201) can confirm a selection (i2) for registering the plurality of persons (1115, 1116, 1117, 1118) as a group in the first message (1119).

[0148] As shown in the above drawing 11d, when the electronic device (201) confirms the selection (i2) for registering the plurality of people as a group, the electronic device (201) may display an input window (1123) and recommended group names (1127a, 1127b) in the first area (261) of the display so that the user can input a group name for the plurality of people, and may display a keypad (1125) in the second area (263) of the display. When the electronic device (201) checks the calendar information saved as "Middle School Friends Gathering, 8 / 3 18:00, Seongsu-dong" on the shooting date of the image (1111) in the calendar application, the electronic device (201) may display "Middle School Friends Gathering" as the recommended group name (1127a). The electronic device (201) may check the contact information of the person (1116) of the second indicator (1116a) among the plurality of persons (1115, 1116, 1117, 1118) in the contact application, and if the contact information of the person (1116) contains "Samsung Girls" as the group name, the electronic device (201) may display "Samsung Girls" as the recommended group name (1127b). The electronic device (201) may check the selection (i) of the recommended group name (1127a) displayed based on calendar information of the calendar application among the recommended group names (1127a, 1127b).

[0149] As shown in the above FIG. 11e, when the electronic device (201) confirms selection (i) of the recommended group name (1127a) displayed based on calendar information of the calendar application among the recommended group names (1127a, 1127b), the electronic device (201) can display a second message (1129) in a pop-up window notifying that a plurality of people have been registered with the recommended group name (1127a) in the first area (261) of the display, and can display a plurality of images (1131) including the plurality of people among the plurality of images stored in the memory in the second area (262) of the display.

[0150] FIGS. 12a, 12b and 12c are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0151] As shown in the above FIG. 12A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) checks the shooting of a video (1211) through the camera (280) while the camera application is running, and if a person (1201) is included in the video (1211), the face image of the person (1201) is recognized using a face recognition function, and if voice information (1215, 1216) including a word related to a name (e.g., "sunny") is repeated a specified number of times or more while shooting the video, the voice information can be detected as voice information related to the face image. When the electronic device (201) stores the video (1211) in the memory of the electronic device (201) (e.g., the memory (230) of FIG. 2), if a name or relationship is not registered in the face image of the person included in the video (1211), the face image (e.g., face ID) and the voice Information (“sunny”) can be stored as tag information of the above video (1211).

[0152] As shown in the above drawing 12b, the electronic device (201) can play a video from among a plurality of videos stored in the memory of the electronic device by user input while the image application is running.

[0153] As shown in the above drawing 12c, when the electronic device (201) checks the tag information of the video including a face image and voice information while playing the video, it can display a first message (1213) in a pop-up window recommending registration of the face image as text information corresponding to the voice information, “sunny,” together with the face image, at the time when the video is completed playing.

[0154] FIGS. 13a and 13b are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0155] As shown in the above FIG. 13A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) checks a contact (1311) whose contact profile image is registered as a person (1331) among a plurality of contacts stored in a contact application, and if the memory (e.g., the memory (230) of FIG. 2) of the electronic device (201) includes at least one image including the person (1331), the facial data of the person (1331) can be automatically registered (stored) as the name (“Evu”, “Ev”) (1333), nickname (“Cutie”) (1335), and / or relationship (“Little Brother”) (1337) stored as contact information of the contact (1311).

[0156] As shown in the above drawing 13b, when the electronic device (201) confirms the input of a search word including the word “cute” in the image search window (1351) provided by the image application while the image application is running, the electronic device (201) can display a plurality of images (1353) including a person registered as “cute” among a plurality of images stored in the memory through the display (260) of the electronic device (201).

[0157] FIGS. 14a, 14b and 14c are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0158] As shown in the above FIG. 14A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) checks calendar information related to a “wedding” in a calendar application (1411), and when checking a plurality of images taken on the same date as the date on which the calendar information related to the “wedding” is stored among a plurality of images stored in the memory of the electronic device (201) (e.g., the memory (230) of FIG. 2), the plurality of images taken on the same date as the date on which the calendar information related to the “wedding” is stored can be automatically registered (saved) as a “wedding.”

[0159] As shown in the above FIG. 14b, when the electronic device (201) confirms the input of a search word such as “wedding” in the image search window provided by the image application while the image application is running, the electronic device (201) searches for a plurality of images registered as “wedding” and displays the plurality of images (1413) classified by the date of the “wedding” on the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2). The electronic device (201) can, when displaying the weddings by date on the display (260), display the name information of each wedding (“Kim Ye-jin’s Wedding”, “Lee Ye-ji’s Wedding”, Jung Woo’s Wedding Yeouido”), date information (“23 / 6 / 3 11:30 - 12:30”, “23 / 5 / 13 11:00-12:00”, “22 / 10 / 22 8:00-9:00”), and location information (“Tobhesed”, “The Convention Hall Munjeong Branch”, “The Partyum”) together based on the calendar information of the calendar application.

[0160] As shown in the above drawing 14c, while the electronic device (201) displays an image (1415) selected by the user from among a plurality of images stored in the memory of the electronic device (201) while the image application is running on the display (260) of the electronic device, if the image (1415) is identified as a “Kim Ye-jin wedding” image based on the shooting date information (“23 / 6 / 3, 12:00”) of the image and the item (e.g., dress) worn by the person (1415a) included in the image (1415), and if the person (1415a) is identified as a “bride,” a first message (1417) recommending (proposing) that the person (1415a) included in the image (1415) be registered under the name “Kim Ye-jin” can be displayed.

[0161] FIGS. 15a, 15b, 15c, and 15d are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0162] As shown in the above FIG. 15A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) may, while executing an image application, display an image (1511) selected based on a user input from among a plurality of images stored in the memory (e.g., the memory (230) of FIG. 2) of the electronic device (201) through the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2). If the electronic device (201) confirms that the image is displayed for a specified period of time (e.g., 3 seconds) or longer through the display (260), that the image includes a single person (1501), and that the single person included in the image satisfies the condition of a family member, the electronic device (201) may generate a thumbnail image of the face of the single person (15012) included in the image. The electronic device (201) may display a first message (1513) recommending registration of the person (1501) as a family member (e.g., daughter) in a pop-up window together with the generated face thumbnail image (1513a) in a certain area of ​​the display (260) displaying the image (1511). The electronic device (201) may use the condition of the family member to predict the person (1501) as a corresponding family member (e.g., daughter) and display the first message (1513) recommending registration of the person (1501) as the corresponding family member (e.g., daughter) in the pop-up window. The electronic device (201) may confirm the user's selection (j1) to register the person (1501) as a family member in the pop-up window.

[0163] As shown in the above drawing 15b, when the electronic device (201) confirms the user's selection (j1) for registering the person (1501) as a family member, the electronic device (201) can display a registration screen including a facial thumbnail image (1513a) through the display (206) and confirm the user's selection (j2) for entering a name on the registration screen.

[0164] As shown in the above-described FIG. 15c, when the electronic device (201) confirms the user's selection (j2) for entering a name on the registration screen, the electronic device (201) can display a keypad on the registration screen for the user to enter a name. After the user enters a name using the keypad, the electronic device (201) can confirm the selection (j3) of "Save" to register the person (1501) with the entered name (e.g., Dana).

[0165] As shown in the above drawing 15d, when the electronic device (201) confirms the selection (j3) of “save” to register the person (1501) with the input name (e.g., Dana), the person (1501) can be registered (saved) in the memory of the electronic device with the input name (e.g., Dana).

[0166] FIGS. 16a, 16b, 16c, and 16d are drawings for explaining an operation of providing registration information of an image at a time of image confirmation in an electronic device according to one embodiment.

[0167] As shown in the above FIG. 16A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) can display an image (1611) including a plurality of people selected based on a user input from among a plurality of images stored in the memory of the electronic device (201) (e.g., the memory (230) of FIG. 2)) through the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2) while executing an image application. The electronic device (201) may display a first message (1613) in a pop-up window, recommending (proposing) that the plurality of persons included in the image (1611) be registered as family members, if the image (1611) is displayed for a specified period of time (e.g., 3 seconds), the number of the plurality of persons included in the image (1611) is 3 or more, which is the number of the specified persons, and the plurality of persons included in the image (1611) satisfy the conditions of family members. The electronic device (201) may confirm the user's selection (k1) to register the plurality of persons as family members in the pop-up window.

[0168] As shown in the above drawing 16b, when the electronic device (201) confirms the user's selection (k1) for registering the plurality of people as a family, the electronic device (201) may display a registration screen including a thumbnail image (1601) corresponding to an image including the plurality of faces through the display (206), and may display a pop-up window (1603) in a certain area of ​​the registration screen through which the user can select an additional family member. The electronic device (201) may confirm that the user selects "Save" for registering the plurality of people included in the image as a family member.

[0169] As shown in the above drawing 16c, when the electronic device (201) confirms that “save” for registering multiple people included in the image (1611) as a family is selected by the user, the electronic device (201) can register multiple people included in the image (1611) as a family.

[0170] As shown in the above drawing 16d, when the electronic device (201) captures multiple images including multiple people registered as a family, it can display a message (1615) in a pop-up window suggesting sharing of the multiple images with multiple electronic devices corresponding to the multiple people registered as a family.

[0171] FIGS. 17A and 17B are drawings for explaining an operation of providing registration information of an image at the time of confirmation of the image in an electronic device according to one embodiment.

[0172] As shown in FIG. 17A, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) may, while executing an image application, display an image (1711) including a plurality of people selected based on a user input from among a plurality of images stored in the memory (e.g., the memory (230) of FIG. 2) of the electronic device (201) through the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2). While the electronic device (201) displays the image (1711) through the display (260), the electronic device (201) may confirm that a specified number (e.g., 300) or more of images including a plurality of people taken at a specified shooting location where the relationship with the user of the electronic device can be determined from among the plurality of images stored in the memory (memory (230)) of the electronic device exist. The electronic device (201) may, if the image (1711) is included among a plurality of images of the specified number (e.g., 300 images) or more, determine whether at least one person among the plurality of people included in the image (1711) satisfies the condition of a family member. If the electronic device (1711) determines that at least one person among the plurality of people included in the image (1711) satisfies the condition of a family member, the electronic device (1711) may display a first message in a pop-up window recommending (proposing) that the plurality of people included in the image (1711) be registered as family members.

[0173] As shown in the above FIG. 17b, the electronic device (201) (e.g., the electronic device of FIG. 1 and / or the electronic device of FIG. 2) can display an image (1731) including a plurality of people (1701 to 1713) selected based on a user input from among a plurality of images stored in the memory (e.g., the memory (230) of FIG. 2) of the electronic device (201) while executing an image application, through the display (260) of the electronic device (201) (e.g., the display (260) of FIG. 2). The electronic device (201), while displaying the image (1731) through the display (260), if a plurality of people included in the image (1731) include people (1701 to 1711) registered as family members including the user of the electronic device and a new person (1713) not registered as a family member, can check whether the shooting date information of the image (1731) is the same as the date information of a family schedule (e.g., family birthdays, family dinners, and / or family gatherings) based on calendar information of a calendar application. If the shooting date information of the image (1731) is the same as the date information of the family schedule, the electronic device (201) can check whether there are a specified number or more images of the new person (1713) taken together with the user of the electronic device within a specified period (e.g., the last 30 days) based on the current date. The electronic device (201) can check whether there are a specified number or more images of the new person (1713) taken together with the user of the electronic device, and whether the face of the new person is registered as a contact image in the contact application and whether the relationship is registered as a "family member" in the contact information.When the electronic device (201) confirms that a new person's face is registered as a contact image in the contact application and that the relationship is registered as "family" in the contact information, the electronic device (201) may display a first message in a pop-up window recommending (proposing) that the new person (1713) be added as a family member.

[0174] In an embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) may include a display (160 of FIG. 1; 260 of FIG. 2), a processor (120 of FIG. 1; 220 of FIG. 2), and a memory (130 of FIG. 1; 130 of FIG. 2). When executed by the processor according to an embodiment, the electronic device may cause the electronic device to, when an image application for image search is executed and a search word including first words describing an action and a second word indicating a relationship is input into an image search window, search for a face image satisfying a first condition for searching for a face image of a person corresponding to the second word among a plurality of images stored in the memory. When executed by the processor according to one embodiment, the electronic device may display, through the display, the searched facial image and a first message recommending registration of the searched facial image with the second word. When executed by the processor according to one embodiment, the electronic device may register the facial image with the second word upon confirming the selection of registration.

[0175] When executed by the processor according to one embodiment, the electronic device may display a plurality of images including a person performing an action corresponding to the first word in a second area of ​​the display while displaying the first message in a first area of ​​the display.

[0176] When executed by the processor according to one embodiment, the electronic device may cause, when registering a facial image with the second word, to display a second message notifying that the facial image has been registered with the second word in a first area of ​​the display, and to display a plurality of images including a person performing an action corresponding to the first word in a second area of ​​the display.

[0177] When executed by the processor according to an embodiment, the electronic device may cause the electronic device to display a second message indicating that the facial image has been registered as the second word in a first area of ​​the display, while searching for at least one image including a person having a facial image registered as the second word performing an action corresponding to the first word among a plurality of images including a person performing an action corresponding to the first word. When executed by the processor according to an embodiment, the electronic device may cause the electronic device to, when a specified period of time has elapsed, cancel the display of the second message and display at least one image including a person having a facial image registered as the second word performing an action corresponding to the first word in an area including the first area and the second area of ​​the display.

[0178] When executed by the processor according to an embodiment, the electronic device may determine that a first condition for searching for a face image of a person corresponding to the second word is satisfied when at least two of the following persons are the same person: a person included in a plurality of images taken a specified number of times or more in the same shooting method (e.g., selfie shooting); a person included in a plurality of images taken a specified number of times or more with the user of the electronic device; a person included in a plurality of images taken together with the user of the electronic device on a specific event anniversary; a person included in a plurality of images taken together with a registered person who is the user of the electronic device or the user's family on a specific event anniversary; a person of a gender or a person of an age.

[0179] When executed by the processor according to an embodiment, the electronic device may, when confirming the input of a search word including first words describing an action and a third word indicating a name in the image search window, search for a plurality of images including a person performing an action corresponding to the first word. When executed by the processor according to an embodiment, the electronic device may detect a plurality of face images included in each of the plurality of images including a person performing an action corresponding to the first word. When executed by the processor according to an embodiment, the electronic device may display a first message recommending the selection of a face image that can be registered as the third word among the plurality of face images in a first area of ​​the display, and display a plurality of images including a person performing an action corresponding to the first word in a second area of ​​the display. When executed by the processor according to an embodiment, the electronic device may register a face image selected from among the plurality of face images as the third word.

[0180] When executed by the processor according to an embodiment, the electronic device may, when registering the face image with the third word, display a second message in a first area of ​​the display notifying that the face image has been registered with the third word. When executed by the processor according to an embodiment, the electronic device may, while displaying the second message indicative of registering the face image with the third word, search for at least one image including a person having a face image registered with the third word performing an action corresponding to the first word among a plurality of images including a person performing an action corresponding to the first word. When executed by the processor according to an embodiment, the electronic device may, when confirming the passage of a specified time, release the display of the second message and display at least one image including a person having a face image registered with the third word performing an action corresponding to the first word in an area including the first area and the second area of ​​the display.

[0181] When executed by the processor according to one embodiment, the electronic device may cause the display to display an image including a plurality of persons through the display, while confirming the occurrence of a first gesture on the display, and if the number of images including the plurality of persons among the plurality of images stored in the memory is greater than or equal to a threshold count, display a first message recommending registration of the plurality of persons as a group. When executed by the processor according to one embodiment, the electronic device may cause the electronic device to register the plurality of persons with the input group name when confirming the input of a group name for the plurality of persons.

[0182] When executed by the processor according to an embodiment, the electronic device may, when displaying an image through the display, search for an object in the image using a search function of the image, and display the searched object. When executed by the processor according to an embodiment, the electronic device may display a first message recommending registration of a name for the object. When executed by the processor according to an embodiment, the electronic device may, when confirming input of a name for the object, register the object with the input name.

[0183] When executed by the processor according to one embodiment, the electronic device may, when confirming the input of a search word including a name representing the object in an image search window, search for at least one image including the object among a plurality of images stored in the memory. When executed by the processor according to one embodiment, the electronic device may display at least one image including the searched object through the display.

[0184] FIGS. 18A and 18B are flowcharts illustrating an operation of providing registration information of an image at the time of image retrieval in an electronic device according to an embodiment. The operation of providing registration information of an image at the time of image retrieval in the device may include operations 1801 to 1823. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or another operation may be added.

[0185] In operation 1801, an electronic device (e.g., electronic device (101) of FIG. 1 and / or electronic device (201) of FIG. 2) may execute an image application for image search.

[0186] According to one embodiment, the electronic device can execute an image application (e.g., a gallery application) for searching and displaying an image selected by a user from among a plurality of applications stored in the electronic device.

[0187] In operation 1803, an electronic device (e.g., electronic device (101) of FIG. 1 and / or electronic device (201) of FIG. 2) can confirm the input of a search word.

[0188] According to one embodiment, the electronic device can confirm the input of a search word into an image search window provided by the image application.

[0189] In operation 1805, if the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) determines that the search word includes first words describing an action and second words indicating a relationship, then in operation 1807, the electronic device can search for a facial image satisfying a first condition for searching for a facial image of a person corresponding to the second word among a plurality of images.

[0190] According to one embodiment, the electronic device may determine that a first condition for searching for a face image of a person corresponding to a second word corresponding to a relationship is satisfied when at least two of the following persons are the same person: a person included in a plurality of images taken a specified number of times or more at a specified shooting location; a person included in a plurality of images taken a specified number of times or more with the same shooting method (e.g., selfie shooting); a person included in a plurality of images taken a specified number of times or more with a user of the electronic device; a person included in a plurality of images taken together with the user of the electronic device on a specific event anniversary; a person included in a plurality of images taken together with a registered person, a person of a gender or a person of an age;

[0191] In operation 1059, the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) may display a first message recommending registration of a facial image and a second word of the facial image.

[0192] According to one embodiment, the electronic device may detect a facial image satisfying a first condition for searching for a facial image of a person corresponding to the second word among a plurality of images stored in a memory of the electronic device (e.g., memory (230) of FIG. 2), and display a facial image satisfying the first condition and a first message recommending registration of the facial image with the second word as a pop-up window in a first area of ​​a display of the electronic device (e.g., display (260) of FIG. 2).

[0193] In one embodiment, the electronic device may detect, when there are multiple face images satisfying the first condition, a specified number (e.g., three) of face images from among the multiple face images in the order of highest satisfaction with the first condition as candidate face images, and display a first message recommending registration of the candidate face images and the face image corresponding to the second word among the candidate face images in a pop-up window in a first area of ​​the display.

[0194] In one embodiment, the electronic device may detect a plurality of images including a person performing an action corresponding to the first word among a plurality of images stored in the memory while displaying the first message as a pop-up window in a first area of ​​the display, and display a plurality of images including a person performing an action corresponding to the first word in a second area of ​​the display.

[0195] In operation 1811, if the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) confirms registration of the face image as the second word, then in operation 1813, the electronic device can register the face image as the second word.

[0196] According to one embodiment, the electronic device may, upon confirming registration of a face image satisfying the first condition or a face image selected by the user from among candidate images satisfying the first condition, register (store) the face image as the second word.

[0197] In one embodiment, the electronic device may display a plurality of images including a person performing an action corresponding to the first word in the second area of ​​the display while displaying a second message in a pop-up window notifying that the facial image has been registered (saved) as the second word in the first area of ​​the display.

[0198] In one embodiment, the electronic device may, when confirming that a specified period of time has elapsed while displaying the second message as a pop-up window in a first area of ​​the display, release the display of the pop-up window containing the second message, and display at least one image including a person having a face image registered with the second word performing an action corresponding to the first word among a plurality of images including a person performing an action corresponding to the first word through the display.

[0199] In operation 1815, if the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) determines that the search term includes first words and a third word representing a name, in operation 1817, the electronic device may search for a plurality of images including a person performing an action corresponding to the first words among the plurality of images.

[0200] In one embodiment, the electronic device can search for all of the plurality of images that include people performing an action corresponding to the first word among the plurality of images stored in the memory.

[0201] In operation 1819, an electronic device (e.g., electronic device (101) of FIG. 1 and / or electronic device (201) of FIG. 2) may display a first message recommending selection of a plurality of face images included in each of a plurality of images including people performing an action corresponding to a first word and a face image that can be registered as a third word among the plurality of face images.

[0202] According to one embodiment, the electronic device may display a first message recommending registration of a plurality of facial images detected from each of a plurality of images including a person performing an action corresponding to the first words and a facial image corresponding to the third word among the plurality of facial images in a pop-up window in a first area of ​​the display, and may display a plurality of images including a person performing an action corresponding to the first word in a second area of ​​the display.

[0203] In operation 1821, if the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) confirms registration of the facial image as a third word, then in operation 1823, the electronic device can register the facial image as a third word.

[0204] According to one embodiment, the electronic device may register (store) the facial image as the third word when the user inputs a selection of a facial image from among a plurality of facial images displayed in the first area of ​​the display.

[0205] According to one embodiment, the electronic device may display a second message in a pop-up window notifying that the facial image has been registered (saved) as the third word in the first area of ​​the display.

[0206] In one embodiment, the electronic device may, upon confirming that a specified period of time has elapsed, release the display of the pop-up window including the second message, and display at least one image including a person having a face image registered with the third word performing an action corresponding to the first word among a plurality of images including a person performing an action corresponding to the first word through the display.

[0207] FIGS. 19A and 19B are flowcharts illustrating an operation of providing registration information of an image at the time of image verification in an electronic device according to an embodiment. The operation of providing registration information of an image at the time of image search in the device may include operations 1901 to 1921. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or another operation may be added.

[0208] In operation 1901, an electronic device (e.g., electronic device (101) of FIG. 1 and / or electronic device (201) of FIG. 2) may execute an image application.

[0209] According to one embodiment, the electronic device can execute an image application (e.g., a gallery application) for searching and displaying an image selected by a user from among a plurality of applications stored in the electronic device.

[0210] In operation 1903, an electronic device (e.g., electronic device (101) of FIG. 1 and / or electronic device (201) of FIG. 2) may display an image including multiple people.

[0211] According to one embodiment, the electronic device may display an image including a plurality of people selected based on a user input from among a plurality of images stored in a memory of the electronic device (e.g., memory (230) of FIG. 2) through a display of the electronic device (e.g., display (260) of FIG. 2).

[0212] In operation 1905, the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) can, upon confirming the occurrence of the first gesture, confirm in operation 1907 whether a plurality of persons are identified as family members.

[0213] According to one embodiment, the electronic device, when it detects the occurrence of a first gesture (e.g., a long press) on the display displaying the image including the plurality of persons, can check relationship information of the plurality of persons included in the image and, based on the relationship information for the plurality of persons, can check whether the persons are members of a family.

[0214] In one embodiment, the electronic device may identify a family member if at least one of a plurality of people included in the image is included in at least one of the following: a person identical to a profile picture of a contact registered as a family member; a person included in an image taken at the home of the user of the electronic device (a designated shooting location that can identify the relationship); a person included in a plurality of images taken a specified number of times or more with the user of the electronic device; a person included in a plurality of images taken a specified number of times or more on a family anniversary (e.g., a birthday anniversary and / or a wedding anniversary); and a person whose gender or age can be identified based on the user of the electronic device.

[0215] In the above operation 1907, if the electronic device confirms that multiple people are family members, it may display a first message recommending that they be added or modified as family members in operation 1909.

[0216] In operation 1911, if an electronic device (e.g., electronic device (101) of FIG. 1 and / or electronic device (201) of FIG. 2) confirms registration of multiple persons as family, it can register multiple persons as family in operation 1913.

[0217] In the above operation 1907, if the electronic device cannot confirm that the plurality of people are family members, in operation 1915, the number of images that include the plurality of people among the plurality of images can be confirmed.

[0218] In one embodiment, the electronic device may not be able to identify a family member if all of the plurality of people included in the image are the same as the profile picture of a contact registered as a family relationship, a person included in an image taken at the home of the user of the electronic device (a designated shooting location that can identify the relationship), a person included in a plurality of images taken a specified number of times or more with the user of the electronic device, a person included in a plurality of images taken a specified number of times or more on a family anniversary (e.g., a birthday anniversary and / or a wedding anniversary), or a person whose gender or age can be identified based on the user of the electronic device.

[0219] In one embodiment, the electronic device can check the number of images containing the plurality of people among the plurality of images stored in the memory of the electronic device if the plurality of people are not confirmed as members of the family.

[0220] In operation 1917, when the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) determines that the number of images containing multiple people is greater than a specified number, the electronic device may display a first message in a pop-up window recommending registration of the multiple people as a group.

[0221] In operation 1919, if the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) confirms registration of multiple persons into a group, the electronic device can register the multiple persons with the input group name in operation 1921.

[0222] According to an embodiment, a method for providing registration information of an image in an electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) may include an operation of, when an image application for image search is executed and a search word including first words describing an action and a second word indicating a relationship is input into an image search window, searching for a face image satisfying a first condition for searching for a face image of a person corresponding to the second word among a plurality of images stored in the memory. According to an embodiment, the method may include an operation of displaying, through a display of the electronic device, the searched face image and a first message recommending registration of the searched face image with the second word. According to an embodiment, the method may include an operation of registering the face image with the second word when a selection of the registration is confirmed.

[0223] The method according to one embodiment may further include displaying a plurality of images including a person performing an action corresponding to the first word in a second area of ​​the display while displaying the first message in a first area of ​​the display.

[0224] According to one embodiment, the method may further include an operation of, when the facial image is registered with the second word, displaying a second message notifying that the facial image has been registered with the second word in a first area of ​​the display, and displaying a plurality of images including a person performing an action corresponding to the first word in a second area of ​​the display.

[0225] In one embodiment, the method may include an operation of searching for at least one image including a person having a face image registered with the second word performing an action corresponding to the first word among a plurality of images including a person performing an action corresponding to the first word while displaying a second message notifying that the face image has been registered with the second word in a first area of ​​the display. In one embodiment, the method may further include an operation of releasing the display of the second message when a specified period of time has elapsed and displaying at least one image including a person having a face image registered with the second word performing an action corresponding to the first word in an area including the first area and the second area of ​​the display.

[0226] The method according to one embodiment may further include an operation of confirming that at least two of the following persons are the same person: a person included in a plurality of images taken a specified number of times or more in the same shooting method (e.g., selfie shooting); a person included in a plurality of images taken a specified number of times or more with the user of the electronic device; a person included in a plurality of images taken together with the user of the electronic device on a specific event anniversary; a person included in a plurality of images taken together with a registered person, a person of a gender or a person of an age; and a first condition for searching for a face image of a person corresponding to the second word is satisfied.

[0227] According to one embodiment, the method may include an operation of searching for a plurality of images including a person performing an action corresponding to the first word when a search word including first words describing an action and a third word indicating a name is input into the image search window. According to one embodiment, the method may include an operation of detecting a plurality of face images included in each of the plurality of images including a person performing an action corresponding to the first word. According to one embodiment, the method may include an operation of displaying a first message recommending a selection of a face image that can be registered with the third word among the plurality of face images in a first area of ​​the display, and displaying a plurality of images including a person performing an action corresponding to the first word in a second area of ​​the display. According to one embodiment, the method may further include an operation of registering a face image selected from among the plurality of face images as the third word.

[0228] According to one embodiment, the method may include an operation of, when the face image is registered with the third word, displaying a second message notifying that the face image has been registered with the third word in a first area of ​​the display. According to one embodiment, the method may include an operation of, while displaying the second message notifying that the face image has been registered with the third word, searching for at least one image including a person having a face image registered with the third word performing an action corresponding to the first word among a plurality of images including a person performing an action corresponding to the first word. According to one embodiment, the method may further include an operation of, when confirming the passage of a specified time, releasing the display of the second message and displaying at least one image including the person registered with the third word performing an action corresponding to the first word in an area including the first area and the second area of ​​the display.

[0229] The method according to one embodiment may include an operation of confirming the occurrence of a first gesture on the display while displaying an image including a plurality of persons through the display. The method according to one embodiment may include an operation of displaying a first message recommending registration of the plurality of persons as a group if the number of images including the plurality of persons among the plurality of images stored in the memory of the electronic device is greater than or equal to a threshold value. The method according to one embodiment may further include an operation of registering the plurality of persons with the input group name when confirming the input of a group name for the plurality of persons.

[0230] According to one embodiment, the method may include an operation of displaying an object found in an image using a search function while displaying an image through the display. According to one embodiment, the method may include an operation of displaying a first message encouraging registration of a name for the object. According to one embodiment, the method may further include an operation of registering the object with the entered name upon confirming input of a name for the object.

[0231] According to one embodiment, the method may include an operation of searching for at least one image containing the object among a plurality of images stored in the memory when a search term including a name representing the object is input in an image search window. According to one embodiment, the method may further include an operation of displaying at least one image containing the searched object through the display.

[0232] Electronic devices according to embodiments disclosed herein may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments disclosed herein are not limited to the aforementioned devices.

[0233] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0234] The term "module" used in one embodiment of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0235] An embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101) or an electronic device (301)). For example, a processor (e.g., a processor (520)) of the machine (e.g., an electronic device (301)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0236] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0237] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, Display (160 in Fig. 1; 260 in Fig. 2): Processor (120 in Fig. 1; 220 in Fig. 2); and A memory (130 in FIG. 1; 230 in FIG. 2) for storing commands, said commands, when executed by said processor, causing said electronic device to: When an image application for image search is executed, when a search word including first words describing an action and second words indicating a relationship is input into the image search window, a facial image satisfying a first condition for searching for a facial image of a person corresponding to the second word among a plurality of images stored in the memory is searched, Through the above display, the searched face image and the first message recommending registration of the searched face image with the second word are displayed, An electronic device set to register the facial image as the second word upon confirming the selection of the above registration.

2. In paragraph 1, The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to display a plurality of images including a person performing an action corresponding to the first word in a second area of ​​the display while displaying the first message in a first area of ​​the display.

3. In paragraph 1 or 2, The above instructions, when executed by the processor, cause the electronic device to: An electronic device configured to display a second message notifying that the facial image has been registered as the second word in the first area of ​​the display when the facial image is registered as the second word, and to display a plurality of images including a person performing an action corresponding to the first word in the second area of ​​the display.

4. In any one of paragraphs 1 to 3, The above instructions, when executed by the processor, cause the electronic device to: While displaying a second message indicating that the face image has been registered with the second word in the first area of ​​the display, searching for at least one image including a person having a face image registered with the second word performing an action corresponding to the first word among a plurality of images including a person performing an action corresponding to the first word, An electronic device set to, when a specified time has elapsed, turn off the display of the second message and display at least one image including a person having a facial image registered with the second word performing an action corresponding to the first word in an area including the first area and the second area of ​​the display.

5. In any one of paragraphs 1 to 4, The above instructions, when executed by the processor, cause the electronic device to: An electronic device set to check whether at least two of the following persons are the same person: a person included in a plurality of images taken a specified number of times or more in the same shooting method (e.g., selfie shooting); a person included in a plurality of images taken a specified number of times or more with the user of the electronic device; a person included in a plurality of images taken together with the user of the electronic device on a specific event anniversary; a person included in a plurality of images taken together with a registered person, a person of different genders, or a person of different ages; and a first condition for searching for a face image of a person corresponding to the second word is satisfied.

6. In any one of paragraphs 1 to 5, The above instructions, when executed by the processor, cause the electronic device to: When a search term including first words describing an action and a third word indicating a name is input into the image search window above, a plurality of images containing a person performing an action corresponding to the first word are searched, Detecting multiple facial images included in each of the multiple images including a person performing an action corresponding to the first word, A first message is displayed in a first area of ​​the display, which recommends selection of a facial image that can be registered with the third word among the plurality of facial images, and a plurality of images including a person performing an action corresponding to the first word are displayed in a second area of ​​the display. An electronic device set to register a selected face image from among the above multiple face images as the third word.

7. In any one of paragraphs 1 to 6, The above instructions, when executed by the processor, cause the electronic device to: When the above facial image is registered with the third word, a second message is displayed in the first area of ​​the display, indicating that the facial image has been registered with the third word. While displaying a second message indicating that the face image has been registered with the third word, searching for at least one image including a person having a face image registered with the third word performing an action corresponding to the first word among a plurality of images including a person performing an action corresponding to the first word, An electronic device configured to, upon confirming the passage of a specified period of time, release the display of the second message and display at least one image including a person performing an action corresponding to the first word and having a facial image registered with the third word in an area including the first area and the second area of ​​the display.

8. In any one of paragraphs 1 to 7, The above instructions, when executed by the processor, cause the electronic device to: While displaying an image including a plurality of people through the display, the occurrence of a first gesture is confirmed on the display, and if the number of images including the plurality of people among the plurality of images stored in the memory is greater than or equal to a threshold number, a first message recommending registration of the plurality of people as a group is displayed, An electronic device set to register the plurality of persons with the entered group name when confirming the input of the group name for the plurality of persons.

9. In any one of paragraphs 1 to 8, The above instructions, when executed by the processor, cause the electronic device to: While displaying an image through the above display, if an object is searched for in the image using the image search function, the searched object is displayed, Display a first message encouraging the user to register a name for the above object, An electronic device set to register the object with the entered name upon confirming the input of a name for the object.

10. In any one of paragraphs 1 to 9, The above instructions, when executed by the processor, cause the electronic device to: When a search term including a name representing the object is input in the image search window, at least one image including the object is searched among a plurality of images stored in the memory, An electronic device set to display at least one image containing the searched object through the display.

11. A method for providing registration information of an image in an electronic device, An operation of searching for a face image that satisfies a first condition for searching for a face image of a person corresponding to the second word among a plurality of images stored in the memory when an image application for image search is executed and a search word including first words describing an action and a second word indicating a relationship is input into an image search window; An action of displaying the searched facial image and a first message recommending that the searched facial image be registered with the second word through the display of the electronic device; and A method comprising an action of registering the facial image as the second word upon confirming the selection of the above registration.

12. In paragraph 11, A method further comprising the action of displaying a plurality of images including a person performing an action corresponding to the first word in a second area of ​​the display while displaying the first message in a first area of ​​the display.

13. In paragraph 11 or 12, A method further comprising: when registering the facial image with the second word, displaying a second message notifying that the facial image has been registered with the second word in the first area of ​​the display; and displaying a plurality of images including a person performing an action corresponding to the first word in the second area of ​​the display.

14. In any one of paragraphs 11 to 13, While displaying a second message indicating that the face image has been registered with the second word in the first area of ​​the display, an operation of searching for at least one image including a person having a face image registered with the second word performing an action corresponding to the first word among a plurality of images including a person performing an action corresponding to the first word; and A method further comprising: when a specified time has elapsed, deactivating the display of the second message and displaying at least one image including a person having a facial image registered with the second word performing an action corresponding to the first word in an area including the first area and the second area of ​​the display.

15. In a non-volatile storage medium storing commands, the commands are configured to cause the electronic device to perform at least one operation when executed by the electronic device, wherein the at least one operation is: An operation of searching for a face image that satisfies a first condition for searching for a face image of a person corresponding to the second word among a plurality of images stored in the memory when an image application for image search is executed and a search word including first words describing an action and a second word indicating a relationship is input into an image search window; An action of displaying the searched facial image and a first message recommending that the searched facial image be registered with the second word through the display of the electronic device; and A storage medium including an operation for registering the facial image as the second word upon confirming the selection of the above registration.