Image recommendation method in messenger, recording medium and computing device

Abstract

A method for recommending images in a messenger, a recording medium, and a computing device are provided. The method for recommending images in a messenger, executed by a computing device including a processor, includes the steps of generating and tagging additional information for images managed by the messenger, registering the images tagged with the additional information in a recommendation list of the messenger, recommending at least one image registered in the recommendation list based on recommendation criteria information for the chat room and the additional information in response to a sharing request from a user who has joined a chat room, and sharing the selected image in the chat room in response to the user's selection of the recommended image.

Description

[Technical Field]

[0001] The present disclosure relates to a method, a recording medium, and a computing device for recommending images in a messenger, and more particularly to a method, a recording medium, and a computing device for recommending images that help users easily select content to share via a messenger. [Background technology]

[0002] Recently, communication via instant messenger applications, social media, etc. has expanded the scope of interaction beyond conversations to include the exchange of various forms of content. Users can store content they have taken personally or obtained from external sources on their devices or in the cloud, and share the content with other messenger users. Content can be images such as videos and photos, audio such as music and voice, documents, etc., and the content that is primarily shared between users may be images.

[0003] To share image content via a messenger, a user must individually review a large number of images stored in an image repository (e.g., an image album folder, a gallery folder, etc.) of the device that includes the messenger and select the images to share. To efficiently review images, the user can significantly reduce the number of images to be reviewed by creating a separate shared space (e.g., a shared folder) in the device or messenger and pre-storing images of interest in the image repository. This method also involves the inconvenience of the user having to review and transfer a large number of images through the image repository.

[0004] In a world where image sharing via messengers is widely used, there is a demand for technology that allows users to quickly search for shared images. Summary of the Invention [Problem to be solved by the invention]

[0005] The present disclosure aims to provide an image recommendation method and computing device that help users easily select content to share via messenger.

[0006] Another object of the present disclosure is to provide a computer-readable recording medium having recorded thereon a program for causing a computing device to execute the method.

[0007] The technical problems of the present disclosure are not limited to the above-mentioned technical problems, and other technical problems not described above will be clearly understood by a person having ordinary knowledge in the technical field to which the present disclosure pertains (hereinafter referred to as "ordinary engineers") from the following description. [Means for solving the problem]

[0008] According to one aspect of the present disclosure, a method for recommending images in a messenger, executed by a computing device including a processor, includes the steps of generating and tagging additional information for images managed by the messenger, registering the images tagged with the additional information in a recommendation list of the messenger, recommending at least one image registered in the recommendation list based on recommendation criteria information for the chat room and the additional information in response to a sharing request from a user who has joined a chat room, and sharing the selected image in the chat room in response to the user's selection of the recommended image.

[0009] According to another embodiment of the present disclosure, the additional information may include detailed data including at least one of time data of the image, position data of the image, and object data having information identifying at least one object of the image.

[0010] According to another embodiment of the present disclosure, the object data may be managed to associate a general identifier that classifies each object included in the image with the object, and in response to at least one of profile data of a user who has joined the chat room and name data of an object associated with the user matching with an object recognized in the image, the object data may be managed to associate a detailed identifier extracted from at least one of the profile data and the name data with the recognized object.

[0011] According to another embodiment of the present disclosure, the additional information includes sharing-related data including at least one of history data managing the sharing history of the image and keyword data managing keywords used to select the shared image, wherein the history data includes the sharing history of the image shared in at least one of the current chat room in which the user participates and other chat rooms in which the user participated, and the keyword data includes keywords used to select the shared image in at least one of the current chat room and the other chat rooms.

[0012] According to another embodiment of the present disclosure, the keyword data includes at least one of related data related to the selection of the shared image among conversation data exchanged between users of the chat room, and query data including questions used by the user to search for the shared image via the messenger, and the related data and the query data can be inferred through machine learning on the conversation data and the questions.

[0013] According to another embodiment of the present disclosure, the sharing request may be either an image sharing request from the user using a menu of the chat room, or an image sharing request by a keyword entered in a message input window of the chat room.

[0014] According to another embodiment of the present disclosure, in the case of an image sharing request based on the keyword, the step of recommending the image may further include a step of presenting external content including at least one of device images stored in the computing device and images searched by a search engine based on the recommendation criteria information based on the keyword, and a step of adding the external content to at least one of an image list managed by the messenger and the recommendation list at the user's request.

[0015] According to another embodiment of the present disclosure, the recommendation criteria information may include at least one of sharing criteria information based on predetermined conditions, context information of the chat room, or keywords entered by the user for the sharing request, and the context information may include at least one of user link information related to users who have joined the chat room and conversation information extracted from conversation data of the chat room.

[0016] According to another embodiment of the present disclosure, the step of recommending an image includes a step of preferentially searching for images registered in the recommendation list and recommending the images;

[0017] The method may include a step of searching for and presenting a device image that matches the recommendation criteria information from device images stored in the computing device in response to the image matching the recommendation criteria information not being found from the recommendation list, and a step of searching for and presenting an image that matches the recommendation criteria information by a search engine in response to the device image not being found.

[0018] According to another embodiment of the present disclosure, the method may further include generating and tagging additional information for an image managed by the computing device, and adding, at the user's request, the image tagged with the additional information to at least one of an image list managed by the messenger and the recommendation list.

[0019] According to another aspect of the present disclosure, a computing device for implementing instructions includes a memory that stores at least one instruction, and a processor that executes the at least one instruction stored in the memory, wherein the processor is configured to generate and tag additional information for images managed by a messenger, register the images tagged with the additional information in a recommendation list of the messenger, recommend at least one image registered in the recommendation list based on recommendation criteria information for the chat room and the additional information in response to a sharing request from a user who has joined a chat room, and share the selected image in the chat room in response to the user's selection of the recommended image.

[0020] A computer-readable recording medium according to another aspect of the present disclosure may include a computer program for executing the image recommendation method in a messenger according to the present disclosure.

[0021] The above briefly summarized features of the present disclosure are merely exemplary aspects of the detailed description of the present disclosure that follows and are not intended to limit the scope of the present disclosure. [Effects of the Invention]

[0022] According to the present disclosure, an image recommendation method can be provided that helps users easily select content to share via messenger.

[0023] The present disclosure also provides a computing device for performing the method.

[0024] According to the present disclosure, a non-transitory computer-readable recording medium can be provided that stores a program for causing a computing device to execute the method.

[0025] In addition, according to the present disclosure, the convenience of content sharing for users can be increased by analyzing conversation characteristics between users using machine learning and efficiently selecting and recommending content that suits the intent of the conversation.

[0026] The effects obtained in the present disclosure are not limited to the effects described above, and other effects not described above will be clearly understood by those having ordinary skill in the art to which the present disclosure pertains from the following description. [Brief explanation of the drawings]

[0027] [Figure 1] 1 is a diagram illustrating a system in which an image recommendation method in a messenger according to an embodiment of the present disclosure is implemented. [Figure 2] FIG. 2 is a block diagram illustrating a user device and a server implementing an image recommendation method in a messenger according to an embodiment of the present disclosure. [Figure 3] FIG. 2 is a block diagram illustrating a user device and a server implementing an image recommendation method in a messenger according to an embodiment of the present disclosure. [Figure 4] 1 is a flowchart illustrating an image recommendation method in a messenger according to an embodiment of the present disclosure. [Figure 5] 10 is a flowchart illustrating generation and tagging of additional information for an image. [Figure 6] FIG. 10 is a diagram illustrating an example of image recommendation realized in a messenger. [Figure 7a] FIG. 10 is a diagram illustrating an example of image recommendation realized in a messenger. [Figure 7b] FIG. 10 is a diagram illustrating an example of image recommendation realized in a messenger. [Figure 8] FIG. 10 is a diagram illustrating an example of image recommendation realized in a messenger. [Figure 9] FIG. 10 is a diagram showing another example of image recommendation realized in a messenger. [Figure 10] FIG. 10 is a diagram showing another example of image recommendation realized in a messenger. [Figure 11] FIG. 10 is a diagram showing another example of image recommendation realized in a messenger. [Figure 12] 1 is a flowchart of a method for adding external content to a Messenger image list. [Figure 13] 13 is a diagram illustrating an example of an inquiry about adding external content according to FIG. 12. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0028] The present disclosure will be described in detail below with reference to the accompanying drawings, so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein.

[0029] In describing the embodiments of the present disclosure, if it is determined that a detailed description of a known configuration or function may obscure the gist of the present disclosure, the detailed description thereof will be omitted. In addition, in the drawings, parts that are not related to the description of the present disclosure will be omitted, and similar parts will be designated by similar reference numerals.

[0030] In this disclosure, when a component is referred to as being "coupled," "coupled," or "connected" to another component, this includes not only a direct connection, but also an indirect connection where another component exists between them. Furthermore, when a component is referred to as "including" or "having" another component, this does not mean that the other component is excluded, but that the component can further include the other component, unless otherwise specified.

[0031] In this disclosure, terms such as "first" and "second" are used only to distinguish one component from another component, and do not limit the order or importance of the components unless otherwise specified. Therefore, within the scope of this disclosure, a first component in one embodiment may be called a second component in another embodiment, and similarly, a second component in one embodiment may be called a first component in another embodiment.

[0032] In this disclosure, each of the phrases "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, C or combination thereof" can include any or all possible combinations of the items listed together in that phrase.

[0033] In this disclosure, components that are distinguished from one another are used to clearly describe the respective features and do not necessarily mean that the components are separate. In other words, multiple components may be integrated into a single hardware or software unit, or a single component may be distributed into multiple hardware or software units. Therefore, even if not otherwise specified, such integrated or distributed embodiments are also included within the scope of this disclosure.

[0034] In this disclosure, the components described in various embodiments are not necessarily essential components, and some may be optional components. Therefore, an embodiment consisting of a subset of the components described in one embodiment is also within the scope of this disclosure. Furthermore, an embodiment including other components in addition to the components described in various embodiments is also within the scope of this disclosure.

[0035] In addition, in this specification, the term "network" may be a concept that includes both wired and wireless networks. In this case, the term "network" may refer to a communication network through which data can be exchanged between devices and systems, and between devices, and is not limited to a specific network.

[0036] Furthermore, in this specification, a computing device or a device may be a mobile device such as a smartphone, a tablet PC, a wearable device, a laptop, or an HMD (Head Mounted Display). A device may also be a fixed device such as a PC or a home appliance with a display function. As another example, a computing device or a device may be a computing device capable of operating as a server or an IoT (Internet of Things) device. That is, in this specification, a device may refer to an apparatus capable of performing a method according to the present disclosure and is not limited to a specific type.

[0037] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0038] FIG. 1 is a diagram illustrating a system in which a method for recommending images in a messenger according to an embodiment of the present disclosure is implemented.

[0039] A system according to the present disclosure may include one or more user devices 100 a , 100 b , 100 c and a server 200 connected via a network 300 .

[0040] Each of the user devices 100a to 100c is also called a client or a user terminal, and can connect to the server 200 via the network 300 to send and receive data to and from other user devices or servers.

[0041] The image recommendation method for a messenger according to the present disclosure may be performed using a messenger service provided in conjunction with various online services. The messenger service may be a communication service provided by an instant messenger provider, social media, community sites, online games, portal sites, shopping malls, etc. Specifically, an instant messenger provider may provide a messenger service as a basic function, and social media, community sites, online games, etc. may provide a messenger service for user communication by adding it to the basic functions of the service. In the present disclosure, a messenger service does not simply include communication via an instant messenger but may broadly include communication services additionally provided by various services. A service that at least implements the image recommendation method for user communication according to the present disclosure may be considered to implement a messenger service, regardless of its basic form. Hereinafter, an instant messenger will be described as an example of a messenger service that implements the image recommendation method according to the present disclosure. However, this does not exclude the application of the method to various services that implement the messenger service, regardless of its basic form.

[0042] A client module for using the messenger service may be installed in each of the user devices 101, 102, and 103. Also, a server module for supporting the messenger service may be installed in the server 200. In the present disclosure, an application installed on a user device may refer to a client module installed on each of the user devices 101, 102, and 103 for using the instant messenger service. The application may include a function for automatically recommending and sharing content in communication between users.

[0043] The server 200 can provide services such as a messenger application. A user who uses the service can connect to the server 200 that provides the service by inputting predetermined connection information (ID and password) through a user device. The server 200 can identify and authenticate the connected user through the connection information input from the user device. The server 200 can also collect, accumulate, store, and query information about the identified user, and facilitate data transmission and reception between the identified users.

[0044] The server 200, like the user devices 100a to 100c, can perform a function of automatically recommending and sharing content in communication between users through the application.

[0045] 2 and 3 are block diagrams illustrating a user device and a server implementing an image recommendation method in a messenger according to an embodiment of the present disclosure.

[0046] 2, the user device 100 may include a communication unit 110, an image capture unit 120, an input unit 130, an output unit 140, a memory 150, and a processor 160. The user devices 100a to 100c may further include other components or modules related to the operation and function of the device, and are not limited to the above-described embodiments.

[0047] The communication unit 110 can exchange data with the server 200 or other user devices via a network. The communication unit 110 can include any type of wired or wireless communication module that can communicate with the outside.

[0048] The image capturing unit 120 may include any type of image capturing means capable of capturing still or moving images of an object. Taking a smartphone as an example, the image capturing unit may be a camera module provided in the smartphone. Although not described in this disclosure, the user devices 100a to 100c may further include a multi-sensor module for detecting surrounding conditions, position, and user motion, in addition to the image capturing unit.

[0049] The input unit 130 is an interface for receiving user input and may include various input means. For example, the input unit 130 may include an input means using a pressure sensor, an electrostatic touch sensor, etc. (e.g., a virtual keyboard displayed on a touch screen), mechanical buttons, etc. The user device 100 may acquire information sensed by the sensor or input from the mechanical buttons as input information. The input unit 130 may also include a microphone for receiving voice or sound.

[0050] The output unit 140 can output to the outside information acquired or received by the user device 100, information processed by the user device 100, etc. The output unit 140 can include, for example, a display that outputs visual information, a speaker that outputs audio information, etc.

[0051] The memory 150 can store and manage applications that implement various functions of the user device 100, data generated or transmitted by the processor 160, or an external request.

[0052] Specifically, the memory 150 may store information acquired from a user, such as information acquired through the input unit 130. The memory 150 may store information received from the server 200 or another user device via the communication unit 110. The memory 150 may also store images captured by the user device 100 or external images acquired from an external source. The memory 150 may have a storage area for storing images, and the storage area may store image data, as well as specific information and additional information about the image. The specific information may include, for example, the image format and shooting-related parameters, and the image format may include information about an image compression method. The additional information may include at least one description data used to recommend an image for sharing, rather than parameters required for image playback. Specifically, the additional information may include the time the image was captured, the location where it was captured, and detailed data related to objects in the image.

[0053] The memory 150 may store and manage shared images sent or received by a messenger application and recommended images selected by the application. The memory 150 may store and manage additional information about the shared images and recommended images. In addition to the above-mentioned data, the additional information may include sharing-related data for images that have a sharing history via the messenger application.

[0054] For example, images shared by a user via a messenger application are stored in an image list provided as a submenu of the messenger, and memory 150 may have a storage area for the image list. Furthermore, when the messenger application executes the image recommendation method according to the present disclosure, recommended images and additional information tagged with the recommended images can be stored in a recommendation list provided as a submenu of the messenger. Memory 150 may have a storage area for the recommendation list.

[0055] In addition, the messenger application may provide a shared storage service for at least some data of the user device 100. When images stored in the device are managed in a messenger image list in response to a request from the user device 100, the memory 150 may store images and their additional information acquired individually by the user device 100. As another example, when a user allows the messenger application to link with a server of another cloud service, the memory 150 may store and manage images and their additional information acquired from the cloud server.

[0056] Additionally, the memory 150 may incorporate a messenger application to implement the image recommendation method according to the present disclosure by the processor 160. To recommend an image to be shared in the messenger application, the memory 150 may transmit additional information about the image to the processor 160 in response to a recommendation request from the application.

[0057] The processor 160 can control the operations of other components within the user device 100. For example, the processor 160 can process information acquired via the input unit 130 and the communication unit 110. The processor 160 can also read and process information and applications stored in the memory 150 as required. The processor 160 can output the processed information via the output unit 140, store it in the memory 150, or transmit it to the outside via the communication unit 110.

[0058] In addition, processor 160 can generate additional information about an image taken by a user or image content obtained from an external source and tag the image or image-related information. In response to a request for image recommendation from a messenger application, processor 160 can analyze the additional information about images managed in memory 150 and determine an image to be recommended.

[0059] 3, the server 200 may include a communication unit 210, a memory 220, and a processor 230. The server 200 may further include other components and modules related to the operation of the server or system, and is not limited to the above-described embodiments.

[0060] The communication unit 210 can exchange data with user devices or other servers connected to the network 300. The communication unit 210 can include any type of wired or wireless communication module that can communicate with the outside.

[0061] The memory 220 may store information received from an external source via the communication unit 210. The memory 220 may store information generated within the server 200. For example, profile data of a user using a messenger application may be stored and managed in the memory 220. The profile data may include the user's personal information and a user profile image. The profile image may be an image designated by the user as a representative image and registered in the application, or an image of the user that has been confirmed to include the user among images accumulated and stored in the application by the user. If at least one of the images and representative images stored by the user through the messenger application includes objects other than the user, such as the user's family, other people with close relationships, or pets, name data of the other objects may be stored and managed in the memory 220. The name data may be generated by the user's records or extracted from keywords used to share the image. Such keywords may be a type of sharing-related data. In another example, the profile data and name data may be managed by the user device 100 that generates the data, or may be transmitted upon request from the server 200 or another user device.

[0062] The processor 230 may control the operations of other components within the server 200. For example, the processor 230 may process information acquired via the communication unit 210. The processor 230 may also read and process information stored in the memory 220. The processor 230 may store the processed information in the memory 220 or transmit it to the outside via the communication unit 210.

[0063] The processor 230 can execute a messenger application to process requests from the user device 100. For example, the processor 230 can implement the image recommendation method according to the present disclosure, similar to the user device 100. For another example, the processor 230 can cooperate with the user device 100 to perform distributed processing of various requests according to the image recommendation method according to the present disclosure. As a result, the user device 100 and / or the server 200 implementing the image recommendation method according to the present disclosure can be an example of a computing device.

[0064] 4 is a flowchart illustrating a method for recommending images in a messenger according to an embodiment of the present disclosure. The image recommendation method according to the present disclosure is performed by a computing device including at least one of the user device 100 and the server 200, and more specifically, may be implemented by the processor 160 of the user device 100 and / or the processor 230 of the server 200. For ease of explanation, the terms processors 160 and 230 will be omitted, and the steps of the method will be mainly described as being performed by the user device 100. However, the operations described below may be implemented by the server 200 running a messenger application, or may be performed by distributed processing between the user device 100 and the server 200.

[0065] In addition, although the present disclosure will be described with a focus on the image recommendation method being implemented in a messenger application provided by an instant messenger service, the method can be substantially similarly applied to messengers provided as ancillary services by other services. For convenience of explanation, the term "messenger application" will be used interchangeably with "messenger."

[0066] First, when an image is shared via the application or uploaded to the image list of the application, or when a user device 100 equipped with a messenger application acquires an image, additional information of the image can be generated and tagged to the image (S105).

[0067] When a user shares an image stored in the user device 100 through a messenger, the user device 100 stores the shared image in a storage area of ​​the messenger, and the user device 100 may generate additional information for the shared image and store it in the storage area. The storage area may be, for example, a storage space associated with an image list provided as a submenu of the messenger. The image list may be provided for each shared chat room (see 402 in FIG. 6 ), or may be a storage space for storing all shared images sent from each chat room. The images stored in the image list may be, for example, image files, or may be thumbnails of the images to efficiently use the storage capacity of the user device 100. The original image files associated with the thumbnails may be stored in a predetermined area of ​​the memory of the user device 100, for example, in the device's image repository. When a user shares an image that has already been shared with another user through a messenger, the user device 100 may send the image stored in the image repository via the messenger.

[0068] A user can upload and store an image in the image list of Messenger, regardless of whether it is shared. The user device 100 can generate additional information for the stored image and store the uploaded image and the additional information in the image list.

[0069] When a user captures an image via the user device 100, the user device 100 can store the image in memory 150 and generate additional information about the image.

[0070] As an example of the present disclosure, in order to reduce resources and processing, additional information may be generated only for images stored and shared in Messenger, and additional information may not be generated for images of the user device 100 acquired via a route other than Messenger. As another example, additional information may be generated for only some of the images of the user device 100, depending on the user's selection and the settings of the device 100. As an example of the settings, additional information may be generated for images of the device 100 that match at least some of the metadata and object identification data of images stored or shared in Messenger. As another example, additional information may be generated for all images in Messenger and the device 100.

[0071] Here, as described above, the additional information may include at least one description data used to recommend an image for sharing, rather than parameters required for image playback. Specifically, the additional information may include detailed data and, in some cases, sharing-related data. The detailed data may include any of time data, location data, and object data of the image. The sharing-related data may include history data that manages the sharing history of the image, and keyword data that manages keywords used to select the image to be shared. The detailed data that constitutes the additional information will be described in detail below.

[0072] The process of generating and tagging additional information in step S105 will be described with reference to Fig. 5. Fig. 5 is a flowchart of generating and tagging additional information for an image.

[0073] First, if images already shared by a messenger application or uploaded by a user using the messenger are present in the messenger's image list, additional information can be generated for each image to include metadata (S205).

[0074] The metadata is a type of detailed data and may include at least one of the image capture time data and the image capture location data. For example, the metadata may be generated by the settings of a messenger application.

[0075] In addition, depending on the user's settings, the messenger application may generate metadata for images of the user device 100 (hereinafter referred to as "device images"). The device images may be stored in a storage space named, for example, a gallery of the user device 100. The additional information may also include metadata for each device image. The device images may be captured by the camera unit 120 of the user device 100 or may be acquired from an external device other than the messenger. As another example, the metadata may be generated according to the specific settings of the user device 100, extracted by the messenger application, and managed as detailed image data.

[0076] For device images, the metadata may be tagged to the image and managed in an image repository on the user device 100. For images shared or uploaded to a messenger application, the metadata may be managed in a storage area for the image, such as a list of images stored in the application.

[0077] Next, the user device 100 may identify an object in the image and generate first object data (S210), where the image may include a shared image, an uploaded image, or a device image.

[0078] The object data includes information identifying at least one object of an image, and the identification information is divided into first object data and second object data according to the type. The object data may include second object data along with the first object data depending on the sharing history of the image, which will be described later.

[0079] An object in an image can be a distinctive element in the image, excluding a simple background, such as a person or a non-human object. The object can be, for example, a living organism, or a unique man-made structure or natural landscape that appears in the image.

[0080] The first object data may be managed so that an object identifier for classifying each object included in an image is associated with the object. Identification of the object utilized to generate the general identifier may be achieved using a conventional image analysis technique, for example, an object recognition technique in an image through machine learning. At least a portion of the process of the object recognition technique using machine learning may be achieved by applying a deep learning model. The object recognition technique to which a deep learning model is applied may be a Region-Based Convolutional Neural Network (R-CNN) model group, a YOLO model group, or the like. The R-CNN model group may be one of R-CNN, Fast R-CNN, and Faster R-CNN. The YOLO model group may be one of YOLO, YOLOv2, and YOLOv3.

[0081] For example, in an image of multiple people, the image can be analyzed using an object recognition technique to identify each person. A different general identifier can be assigned to each identified person and associated with them. The general identifier can be composed of an object indicator that indicates that each object is different from the others, without linking it to personal information for each person.

[0082] Next, the user device 100 may check whether there are any images shared through the chat room among the image list of the messenger and the images stored in the image archive of the user device 100 (S215).

[0083] If the result of the check is that there is no image to share (N in S215), the metadata and first object data generated in steps S205 and S210 constitute detailed data, which can be managed by tagging with additional information about the image.

[0084] If the result of the check shows that there is an image to be shared (Y in S215), the user device 100 can generate history data for the image to be shared and generate second object data according to predetermined conditions (S220).

[0085] The history data is data that manages the image sharing history, and more specifically, may be data related to the sharing history of images sent from at least one of the chat rooms in which the user participated. The history data may include, for example, chat room information, the time of sharing, the frequency of sharing, etc. The chat room information may include, for example, data related to the user who sent the image, the participants who received the image, and all users who have participated in the shared chat room, the time of opening the chat room, the conversation activity level of the chat room, etc. The sharing frequency may include, for example, the number of shares for each chat room, the number of shares in a predetermined period, the total number of shares in all chat rooms, the number of images shared in a predetermined period, etc.

[0086] In the case of an image shared via a messenger chat room, the messenger application may check whether at least one of the profile data of users who joined the chat room and the name data of objects associated with the users matches the object recognized in the shared image. The profile data and name data may be substantially the same as those described in FIG. 2. If the check results in an object matching the above data being present in the shared image, second object data may be generated to associate a detailed identifier extracted from at least one of the profile data and the name data with the recognized object. The series of processes for generating the detailed identifier may be performed by at least one of the user device 100 and the server 200.

[0087] Next, the user device 100 may check whether there are any keywords associated with the shared image (S225).

[0088] The keyword may be an indexing element used to select or relate to an image in a chat room where the image is shared. The keyword may be various types of elements, such as text, image, sound, etc. When an image is shared in multiple chat rooms, the keyword of the shared image may be detected from at least one of the multiple chat rooms.

[0089] Specifically, the keywords may include related keywords and query keywords.

[0090] The related keywords may be keywords related to the selection of shared images among conversation data exchanged between users in a chat room. Specifically, the messenger application can infer related keywords through machine learning on the correlation between conversation data and the selection of shared images. For example, when content is sent / shared while discussing a topic related to a specific participant and their associates through a conversation between users participating in a chat room, the content of the conversation before sharing can be learned and the specific conversation content that infers the basis for selecting the shared content can be detected as a keyword.

[0091] The keywords may also include query keywords, which include queries used by users to search for shared images. The search may be performed, for example, by an image search function provided in the message input window (see 412 in FIG. 6 ) of the messenger. For example, the user may touch an image search key 416 provided in the message input window 412, causing the messenger (or user device 100) to convert the input window 412 into an image search field. The input window 412 functioning as an image search field may present a recommended list of images that match the input text, rather than outputting the text as a message in the chat room 402.

[0092] In addition, the search can be performed using at least one of a search function provided in an image repository of the user device 100 linked to a messenger application and a search function using a service other than the messenger during a chat room conversation. When a user actually shares an image finally selected through the search, the messenger application can detect the searched question for selecting the shared image as a keyword. Query keywords can include not only questions entered by the user but also expanded queries inferred through machine learning based on the questions.

[0093] If the result of the check is that the keyword does not exist (N in S225), the metadata and the first and second object data generated in steps S205 to S220 constitute the detailed data, and the history data can be adopted as the shared related data. The detailed data and the shared related data may be managed by tagging them with additional information about the image.

[0094] If the confirmation result indicates that a keyword is found (Y in S215), the user device 100 can generate the confirmed keyword as keyword data for the shared image (S230).

[0095] The keyword data can generate the related data and the query data based on the related keywords and the query keywords associated with the shared image.

[0096] Next, the detailed data and the sharing related data generated in steps S205 to S220 and steps S220 to S230 constitute additional information, which can be tagged to the image (S235).

[0097] Steps S205 to S220 are generated in the initial generation step of the recommendation list, but after the recommendation list is generated, steps S220 to S230 can be performed when image sharing via messenger or image upload to the messenger image list is detected.

[0098] Referring again to FIG. 4, the user device 100 can automatically register the tagged image in the messenger's recommendation list (S110).

[0099] The user device 100 can register at least shared images in the messenger and images uploaded to the messenger along with additional information in a recommendation list. In addition, the user device 100 can inquire of the user whether to register a device image tagged with additional information through the messenger in a recommendation list. In response to the user's additional response, the messenger can automatically register the tagged device image in the recommendation list. The messenger can also control the registration of an image selected by the user from among the tagged device images in the recommendation list. As another example, the messenger can inquire of the user whether to register the tagged device image in at least one of the messenger's image list and recommendation list. The messenger can register the device image in the list selected by the user.

[0100] In the present disclosure, the registration inquiry for the device image is performed in step S110 as an example, but as another example, the messenger may perform the registration inquiry for the user in step S105.

[0101] Next, the user device 100 can detect whether a user request to share an image has occurred in a chat room in which the user has participated (S115).

[0102] Here, the sharing request can be implemented in various forms. It can be detected whether the sharing request has occurred from a user's selection of a recommendation-related menu or a keyword entered in the message input window 412 that provides an image search function. The recommendation-related menu can be, for example, a recommendation item (or recommendation menu 428) or a search item provided as a submenu of the chat room 402, as illustrated in FIGS. 6 to 8. The menu is not limited to the embodiments illustrated in FIGS. 6 to 8 and can be provided in various ways. Another example, a sharing request based on a keyword, is illustrated in FIGS. 9 to 11.

[0103] 6 to 8 are diagrams showing an example of image recommendation realized by a messenger.

[0104] FIG. 6 illustrates an example in which multiple users, Lee, Kim, Jung, and Ahn, participate in a chat room 402 and exchange conversations 406 on the topic of Lee's daughter. Here, users Lee and Kim exchange numerous conversations 406 on the topic of their daughters, and share images 404 of Lee's daughter during the conversations. Furthermore, after numerous conversations between users Lee and Kim, users Jung and Ahn may later join the chat room 402, or even if they have already joined, they may not be involved in the conversations for long. Therefore, the images 404 already shared may not be immediately visible on the current screen of the chat room 402 where users Jung and Ahn started the conversation. Because many conversations cannot be displayed on the screen, users Jung and Ahn can view the conversations 406 already held between users Lee and Kim and the shared images 404 through a scroll function provided in the interface of the chat room 402.

[0105] In Figure 6, the already shared image 404 is shown to appear on the chat screen of Jung and Ahn for easy understanding of the conversation situation, but this is merely illustrated to emphasize that it was already shared before the conversation between Jung and Ahn. Figure 6 does not exclude the already shared image 404 being simultaneously visible on the chat screen as actually illustrated.

[0106] 6 also illustrates representative profile images 408a, 408b, and 408c containing images that Kim, Jung, and Ahn want to show to other users to distinguish them from one another. For example, Jung's representative profile image 408b is registered using a face photo, and Ahn's representative profile image 408c is registered using a photo of a natural landscape. Kim's representative profile image 408a is registered as, for example, a graphic avatar provided by the application or a graphic character provided by another service. The representative profile images 408a, 408b, and 408c can be used as objects to be compared with first and second object data of images owned by users to be shared in the process of recommending images to be shared.

[0107] In addition, the messenger application has a profile menu for managing user profile information. The user can designate a representative profile image and register personal information and other images through the profile menu. The user device 100 can identify objects in the profile image and other images registered through the menu. The user device 100 can compare and analyze objects identified in the profile image and other images based on first and second object data of the images stored in a recommendation list of the user who requested sharing. Object identification can be performed in the same manner as described for the first object data. If a user adds a comment to an image managed through the profile menu, the user device 100 can extract names associated with objects identified in the image based on the comment. The objects identified in the image through the profile menu and the extracted names can be used as profile data and name data.

[0108] Lee, aware of the conversation between Jung and Ahn, plans to share an image of his daughter, and can input a phrase 420 through a message input window 412 (hereinafter referred to interchangeably as the input window) to be displayed in the form of a message in the chat room 402. The input window 412 can receive inputs from the user, such as various emoticons, icons, etc., in addition to text such as the phrase 420. Meanwhile, the image search key 416 provided in the input window 412 is an interface for receiving a sharing request, and after touching the image search key 416, the user can input a keyword or query for searching for an image to be shared through the input window 412. Examples of a sharing request using the image search key 416 and the input window 412 are shown in FIGS. 9 to 11.

[0109] 7a and 7b, the messenger application may sequentially activate a service menu tab 414, an overall album 424 provided as a sub-service of the service menu 422, and a recommendation menu 428 at Lee's request. When the recommendation menu 428 is selected, the user device 100 may recognize that a sharing request from user Lee has been received. The overall album 424 may manage images stored in at least one of the application's image list and the image repository of the user device 100. The chat room menu 410 may provide functions for managing various information and activities occurring in the chat room 402 and controlling them at the user's request.

[0110] Next, in response to the sharing request from user Lee, the user device 100 can recommend images having additional information that meets the recommendation criteria information of the chat room 402 from among the images in the recommendation list (S120).

[0111] The recommendation criteria information may include at least one of sharing criteria information according to predetermined conditions and context information of the chat room 402. The sharing criteria information may be the sharing frequency required for the recommended image by the messenger or the current chat room 402, and an object identified from the image shared in the current chat room 402. For example, the sharing frequency may include at least one of the number of shares required for the image in at least one of the current and other chat rooms 402, the image shared during a specific period, and the number of shares required for the image during a predetermined period. As shown in FIG. 6, the identified object may be the face of Lee's daughter extracted from the image 404 shared in the chat room 402.

[0112] The context information may be situation information inferred from users and conversations in the chat room 402. Specifically, the context information may include at least one of user association information related to users who participated in the chat room 402 and conversation information extracted from conversation data in the chat room 402. The user association information may be information related to the user and other objects related to the user. The other objects may be, for example, the user's family, close friends, pets, etc. The user association information may be obtained through profile data and name data of each user provided by the messenger application. The profile data may include, for example, representative profile images 408a, 408b, and 408c, and images of users managed by the messenger. The conversation information may be, for example, conversation topic words extracted from the conversation data, expressions inferring characteristic objects, information, and situations from the conversation, etc. The conversation information may be keywords extracted through machine learning on the conversation data.

[0113] 6 and 7b, the recommendation criteria information illustrates sharing criteria information related to a shared image 404, participants (Kim, Jung, Ahn, Lee), and context information inferred from a conversation 406. The sharing criteria information may include the face of Lee's daughter identified from the shared image 404 in FIG. 7a and the frequency of sharing. While FIG. 6 illustrates the sharing of one image of Lee's daughter, if multiple images have already been shared, the identified object of the sharing criteria information may be an object (e.g., a face or other object) that commonly appears in the multiple shared images, and the sharing frequency may further include the number of times the commonly appearing object is shared.

[0114] The context information may be Jung's face identified from the representative profile images 408a, 408b, and 408c in Fig. 7a, Ahn's landscape, the profile data and name data of participating users, and feature information related to the subject (Lee's daughter) and the daughter's name extracted from the conversation 406, etc.

[0115] The messenger application may search the recommendation list for images with additional information matching the recommendation criteria information, including the information exemplified above. Furthermore, images may be searched for via various routes via the recommendation menu 428. For example, the messenger may search for images matching the recommendation criteria information from the recommendation list, device images, and images searched on external sites, in addition to the recommendation list. To improve the efficiency of the search process and reduce resource burden, the image search may prioritize images stored in the recommendation list of the messenger application. If an image matching the recommendation criteria information is not found in the recommendation list, device images stored in the user device 100 may be searched for.

[0116] If the user device 100 does not find an image matching the recommendation criteria information, the search engine may search for an image matching the recommendation criteria information. The search engine may be, for example, an engine provided by a search service linked to a messenger application. In the case of a search engine, at least one of shared criteria information and context information may be used as a search query. The shared criteria information provided as a query to the search engine may be, for example, an object image identified from a shared image and its feature information. The context information provided as a query may be information related to participants in the chat room 402 extracted from profile data and name data, conversation information extracted from the participants' conversations, etc. Image search is not limited to the above embodiment and may be processed through various routes. As another example, the images in the recommendation list and the images in the device 100 may all be searched simultaneously, and the search engine may be used second. As another example, images may be searched using the three routes described above.

[0117] 7b for example, the recommendation criteria information may include the face of Lee's daughter appearing in the image 404 shared in the current chat room 402 and the sharing frequency of the existing shared images. Also, the recommendation criteria information may include Jung's face and Ahn's appearance identified from the representative profile images 408a, 408b, and 408c illustrated in FIG. 7a, the profile data and name data of participants Kim, Jung, Ahn, and Lee, and the conversation text related to Lee's daughter extracted from the conversation 406.

[0118] The messenger application may preferentially search for additional information corresponding to the recommendation criteria information through the recommendation list. The corresponding additional information may be additional information of images managed in the recommendation list, such as first and second object data, history data, related data, query data, etc. Images 404 that have already been shared may be managed in the recommendation list. However, if there are no other images matching the recommendation criteria information in the recommendation list, the messenger application may sequentially search for images and the additional information via the device 100 and a search engine.

[0119] Images having additional information that matches the recommendation criteria information are adopted as recommended images 430, and a sharing recommendation list including the recommended images 430 selected as sharing candidates can be displayed on the screen of the device 100, as shown in Fig. 7b. The sharing recommendation list can be provided in the same way as the recommendation menu 428 or via a separate screen. Fig. 7b illustrates an example in which the recommended image 430 has been selected from the images in the recommendation list.

[0120] The recommended images 430 can be adapted to include images 404 already shared in the current chat room 402, other images of Lee's daughter related to the shared image 404 and the conversation text, images including Jung related to the representative profile image 408b, and the like.

[0121] Next, the messenger application may check user Lee's response as to whether or not to select an image from the shared recommendation list (S125). If Lee selects at least one of the recommended images 430, the messenger application may share the image selected by Lee in the chat room 402 and update additional information about the shared image (S130).

[0122] 7b and 8, Lee can select a recommended image 430 via the selection tab in the upper right corner of the recommended image 430 presented in the recommendation list. Lee selects an image 432 related to her daughter to match the content of the conversation, and does not select an image 432 related to Jung. Depending on Lee's selection response, an image 434 related to her daughter can be uploaded to be shared in the chat room. While this example shows that all participants in the chat room 402 share the daughter-related image 442, as another example, the daughter-related image can be shared through private sharing (e.g., mention, whisper, secret chat room opened in conjunction with the chat room 402, etc.) in which the image is sent only to a portion of the participants.

[0123] Additionally, additional information of the shared image 442 may be updated by the messenger application and managed by the user device 100. In this example, the additional information that is updated may be history data and related data of the shared image 442, etc.

[0124] On the other hand, if Lee does not select the recommended image 430 provided in the shared recommendation list, but instead selects a non-recommended image through another menu, such as photos or videos, as illustrated in FIG. 7b, the messenger application may share the selected non-recommended image in the chat room 402 and manage additional information about the shared image (S130).

[0125] If additional information has not been generated for the shared, unrecommended image, additional information appropriate for the sharing status of the chat room 402 may be generated and tagged to the image. If additional information has already been tagged for the shared, unrecommended image, the additional information may be updated to reflect the sharing status. The above process may refer to the management of additional information.

[0126] Although the present disclosure provides an example of a user requesting to share an image via a recommendation menu, a sharing request via a menu may be made via other menus besides the recommendation menu. For example, a menu such as an image list managed by the application, recent items (see FIG. 7b), download, or search may be activated to initiate recommendations in response to the sharing request. The search menu may include an interface for inputting a search query to find an image to share. The search query belongs to recommendation criteria information, and the search criteria information may be generated to include the search query, sharing criteria information related to the search query, and related context information. A messenger application may provide recommended images with additional information that matches the recommendation criteria information related to the search query. When a user shares a recommended image, the messenger application may reflect the search question and the context information related to the question in query data, related data, history data, and other additional information.

[0127] Fig. 9 is a diagram showing another example of image recommendation realized by a messenger. Fig. 9 is an example illustrating a sharing request using the keyword image search function provided in the input window 412, and shows the situation subsequent to Fig. 6. From the above viewpoint, it differs from the examples of Figs. 6 to 8 (particularly Figs. 7a and 7b) which respond to a sharing request by selecting a menu.

[0128] Specifically, the embodiment of Fig. 9 differs from the embodiment of Fig. 6 in step S115 of Fig. 4. For example, when a user performs touch input on the image search key (see 416 in Fig. 6) in input window 412, user device 100 can control the messenger to make input window 412 function as an image search field. When input window 412 functions as an image search field, image search key 416 can be changed to text key 418. When a user wants to enter text for conversation 406 in chat room 402, the user can perform touch input on text key 418, causing input window 412 to function as a text input interface.

[0129] In step S115, when the user device 100 detects input of a keyword 436 in the input window 412 that functions as an image search field, the user device 100 can recognize that there is a request to share an image. Figure 9 illustrates an example in which the user Lee inputs a keyword 436, such as "my daughter Jane," into the input window 412 that functions as an image search field.

[0130] As in step S120 described with reference to Figures 6 to 8, the user device 100 can select images from the recommendation list that satisfy the recommendation criteria information as recommended images 444 and generate a shared recommendation list 440.

[0131] As an example, the recommendation criteria information may be generated based on the input keywords 436. As another example, the recommendation criteria information may be generated based on shared criteria information together with the input keywords 436. In the above example, the input keywords 436 may be analyzed by machine learning to derive extended keywords that are estimated to have identity and / or relevance to the input keywords.

[0132] 9, when the recommendation criteria information is based on the keyword 436 and the sharing criteria information, the recommendation criteria information based on the keyword 436 can include the phrase and extended keyword of the keyword 436. The recommendation criteria information based on the keyword 436 can include, for example, the keyword phrase "my daughter Jane," as well as extended keywords such as "Lee's daughter," "7-year-old daughter," and "daughter Jane" that are generated by referring to conversation text related to Lee's daughter in the chat room 402. The sharing criteria information can be, for example, the face of Lee's daughter identified from the shared image 404 in FIG. 6 and the sharing frequency.

[0133] The user device 100 may preferentially search for additional information corresponding to the recommendation criteria information through the recommendation list. In the case of Fig. 9, the additional information may be, for example, first and second object data, history data, related data, query data, etc.

[0134] Images having additional information that matches the recommendation criteria information are adopted as recommended images 440, and as illustrated in Fig. 9, a shared recommendation list 440 including the recommended images 440 can be displayed on the same screen as the input window 412. As illustrated in Fig. 6, the recommended images 440 can include images (404 in Fig. 6) that have been previously shared in the current chat room 402 and other images of Lee's daughter. Here, Fig. 9 illustrates the recommended images being selected from the images in the recommendation list.

[0135] The user can select at least one recommended image from the shared recommendation list 440 as a shared image and touch the send key 438 to display the shared image in the chat room 402 .

[0136] According to the present disclosure, by inputting keywords related to the image the user wants to share, images that better match the user's intentions can be recommended.

[0137] 10 and 11 are diagrams illustrating another example of image recommendations implemented in a messenger. Similar to FIG. 9, FIGS. 10 and 11 are examples illustrating a sharing request that utilizes an image search function using keywords provided in an input window 412. Additionally, the present disclosure illustrates a sharing recommendation list 440 that includes recommended images selected from external content, such as device images and images from a search engine, in addition to the messenger recommendation list. From the above perspective, the present disclosure differs from recommendations that rely solely on images in the recommendation list illustrated in FIGS. 6 to 8.

[0138] The user device 100 may recognize a request to share an image when it detects the entry of a keyword 436 in the input window 412 that functions as an image search field. Figure 10 illustrates an example in which the user Lee enters a keyword 444, such as "AA Nearby Pub," into the input window 412 that functions as an image search field.

[0139] The user device 100 can generate a shared recommendation list 446 by selecting, as recommended images 448, images that satisfy the recommendation criteria information from among the images in the recommendation list, the device images, and the images from the search engine.

[0140] In the present disclosure, recommendation criteria information can be generated based on keywords 444, shared criteria information, conversation data from chat rooms 402, and context information.

[0141] The recommendation criteria information based on the keyword 444 may include a phrase and an extended keyword of the keyword 444. For example, the recommendation criteria information based on the keyword 444 may include, in addition to the keyword phrase "Nearby AAPub," extended keywords such as "Nearby AA," "Izakaya in Nearby AA," "Restaurant in Nearby AA," and "Famous Places in Nearby AA" generated with reference to the conversation text 420a related to the chat room 402. The sharing criteria information may be, for example, the name of an object such as a pub or restaurant identified from an existing shared image, the frequency of sharing, etc.

[0142] The participants are conversing about a meeting that took place a few days ago at a pub in a specific nearby AA. The user device 100 can extract conversation information from the conversation data 420a. The conversation information can be, for example, a predetermined period prior to the current conversation date, a location such as a specific AA, distinctive environmental objects related to the pub, or a situation involving multiple people. The user device 100 can also identify the faces of Jung, Ahn, Kim, and Lee from the representative profile images 408a, 408b, and 408c, and possibly identify related people for each user based on the image, profile data, and name data possessed by each user. Information related to the identified participants can be user association information. The user device 100 can generate recommendation criteria information based on context information including the conversation information and user association information.

[0143] The user device 100 may preferentially search for additional information corresponding to the recommendation criteria information through the recommendation list. In the case of FIG. 10 , the additional information may include, for example, metadata, first and second object data, history data, related data, query data, etc. The metadata may include, for example, at least one of shooting time data and shooting location data. In the case of FIG. 10 , the first object data may be a general identifier of an image related to a pub or bar, and the second object data may be, for example, a detailed identifier of an image related to Jung's profile data. In FIG. 10 , the related data may include conversation data of participants in the chat room 402 related to past image sharing, and the query data may include, for example, keywords used in an image search via the input window 412.

[0144] In FIG. 10, additional information that matches the recommendation criteria information may be, for example, that at least one of the participants in the chat room 402 gathered at a bar, pub, or tourist spot located in a nearby AA a few days ago.

[0145] 11, the user device 100 can present, in the recommendation list, images having additional information proximate to the recommendation criteria information, such as an image and multiple images taken by Jung at a nearby AA attraction with other participants, as recommended images 448. This is exemplified as an album (recommended) in FIG.

[0146] In addition, the user device 100 may present, as recommended images 448, images of device images having additional information that meet the recommendation criteria, such as images taken by Jung and other participants at a pub in a nearby AA. Here, the device images are images not included in the recommendation list and may include additional information such as detailed data and first object data, as described in FIG. 5. The additional information of the device images may be generated in advance or may be generated during the process of presenting recommended images. Accordingly, the additional information of the device images in FIG. 11 may include the location of the nearby AA, the date of the photo, and a general identifier of the image related to Jung, the pub, the bar, etc.

[0147] Although not shown in FIG. 11, the user device 100 can search for images that match the recommendation criteria information through a search engine using keywords 444 and images from the recommendation criteria information, and present recommended images 448.

[0148] That is, the shared recommendation list 446 can be displayed as a recommendation image 448 that includes an image of the recommendation list, a device image, and an image from the search engine.

[0149] In this disclosure, it is exemplified that all images in the recommendation list, all images in the device 100 are searched simultaneously.

[0150] In another example, the user device 100 can sequentially search the images in the recommendation list, the device images, and the images from the search engine according to predetermined conditions, and present only the images that match the recommendation criteria information as recommended images.

[0151] 6 to 8, the user device 100 searches preferentially for images in the recommendation list, and if an image matching the recommendation criteria information is not found in the recommendation list, it can search for device images stored in the user device 100. Furthermore, if a device image matching the recommendation criteria information is not found, the user device 100 can search for an image matching the recommendation criteria information by a search engine using the above-mentioned keywords 444 or the like.

[0152] 11, the user device 100 first searches for images in the recommendation list, but if no images in the recommendation list that match the recommendation criteria information are found, the user device 100 can subsequently search for device images. If a device image that matches the recommendation criteria information is found, the user device 100, unlike in FIG. 11, can present only the device image as the recommendation image 448 without providing images related to the messenger recommendation list as recommendation images.

[0153] Fig. 12 is a flowchart of a method for adding external content to a messenger image list. Fig. 13 is a diagram illustrating an external content addition query according to Fig. 12. The present disclosure will be exemplified in relation to the situations of Figs. 10 and 11.

[0154] 10 and 11, when the user device 100 detects input of a keyword 444 in the input window 412 that functions as an image search field (S305), the user device 100 can recognize that there is a request to share an image. FIG. 13 illustrates an example in which the user Lee inputs a keyword 444, such as "AA Nearby Pub," into the input window 412 that functions as an image search field.

[0155] Next, the user device 100 may present, as shown in Fig. 13, images from the recommendation list, the device images, and the search engine images that satisfy the recommendation criteria information as recommended images 448. The recommended images 448 may include external content having data related to at least one of the device images and the search engine images (S310).

[0156] The process of presenting the recommended images is substantially the same as that described in Figures 10 and 11. The device image may already have additional information or images not included in the recommendation list, or the additional information of the device image may be generated during the recommendation process. The data related to the image by the search engine may include, for example, at least one of a content file and content link information.

[0157] If the external content is presented as a recommended image 448, the user device 100 may inquire whether to add the external content to the messenger's image list (S315).

[0158] As shown in FIG. 13 , the user device 100 may display a selection tab 450 for device images and a key related to adding to an image list (e.g., "Add Album"). "Add Album" may be an interface for adding a device image selected in the selection tab 450 to an image list. "Share" may be an interface for displaying the selected device image in the chat room 402. In the present disclosure, "Add Album" is illustrated as being located in the shared recommendation list 440, but the interface related to adding to an image list may be modified in various forms.

[0159] Next, the user device 100 can add at least one of the external content and the link information of the content to the image list of the messenger in response to the addition request for the selected device image (S320).

[0160] For example, after the user selects a device image, the device image can be added to the image list by touching "Add to Album."

[0161] Although the present disclosure focuses on adding an image list, as another example, in step S315, a user may be asked whether to add the image to at least one of an image list and an additional list in Messenger. As another example, by touching "Add Album," an interface related to adding an image list (e.g., the overall album in FIG. 7b or an image album managed by Messenger) and adding a recommendation list may be displayed. When external content is added to the recommendation list, keyword data including keywords 444 entered in input window 412 may be generated as additional information for the image.

[0162] According to the present disclosure, images that a user is likely to share later are managed in Messenger, which eliminates the hassle of a user having to search through all images in Messenger and the user device 100 to select an image suitable for sharing. Also, device images are managed in Messenger as much as possible, which increases the usability of Messenger.

[0163] Although the exemplary methods of the present disclosure are expressed as a series of operations for clarity of explanation, this is not intended to limit the order in which the steps are performed, and the steps may be performed simultaneously or in a different order, if necessary. To achieve a method according to the present disclosure, other steps may be included in addition to the steps illustrated, or some steps may be omitted and the remaining steps may be included, or some steps may be omitted and additional other steps may be included.

[0164] The various embodiments of the present disclosure are not intended to list all possible combinations, but are intended to illustrate representative aspects of the present disclosure, and the matters described in the various embodiments may be applied independently or in combination of two or more.

[0165] Furthermore, methods according to embodiments of the present disclosure may be embodied in the form of program instructions and recorded on computer-readable media for execution by various computer devices. The computer-readable media may include, alone or in combination, program instructions, data files, data structures, and the like. The program instructions recorded on the media may be those specially designed and constructed for the present disclosure, or may be those well known and available to those of ordinary skill in the computer software arts. Examples of computer-readable media include magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include not only machine code, such as produced by a compiler, but also high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices may be configured to operate as one or more software modules to perform the operations of the present disclosure, or vice versa.

[0166] Furthermore, various embodiments of the present disclosure may be implemented in hardware, firmware, software, or a combination thereof. In the case of a hardware implementation, one or more ASICs (Application Specific Integrated Circuits) may be used. Integrated It can be realized by devices such as Digital Signal Processors (DSPs), Digital Signal Processors (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), general processors, controllers, microcontrollers, and microprocessors.

[0167] The scope of the present disclosure includes software or machine-executable instructions (e.g., operating systems, applications, firmware, programs, etc.) that cause operations according to the methods of the various embodiments to be performed on a device or computer device, as well as non-transitory computer-readable media on which such software or instructions, etc., can be stored and executed on a device or computer.

Claims

1. 1. A method for recommending images in a messenger executed by a computing device including a processor, the method comprising: generating and tagging additional information for images managed by the messenger; registering the image tagged with the additional information in a recommendation list of the messenger; recommending at least one image registered in the recommendation list based on recommendation criteria information of the chat room and the additional information in response to a sharing request from a user who has joined the chat room; and sharing the selected image in the chat room in response to the user's selection of the recommended image.

2. The image recommendation method in a messenger according to claim 1, wherein the additional information includes detailed data including at least one of time data of the image, position data of the image, and object data having information identifying at least one object of the image.

3. The object data is managed by associating a general identifier for classifying each object included in the image with the object; 3. The image recommendation method in a messenger according to claim 2, wherein in response to at least one of profile data of a user who has joined the chat room and name data of an object associated with the user matching with an object recognized in the image, the object data is managed so as to associate a detailed identifier extracted from at least one of the profile data and the name data with the recognized object.

4. the additional information includes sharing-related data including at least one of history data for managing a sharing history of the image and keyword data for managing keywords used to select the shared image; the history data includes a sharing history of images shared in at least one of a current chat room in which the user participates and other chat rooms in which the user has participated; The method of claim 1 , wherein the keyword data includes keywords used in selecting the shared image in at least one of the current chat room and the other chat room.

5. The keyword data includes at least one of related data related to the selection of the shared image among conversation data exchanged between users of the chat room, and query data including a question used by the user to search for the shared image via the messenger; The image recommendation method in a messenger according to claim 4 , wherein the related data and the query data are inferred through machine learning on the conversation data and the questions.

6. The image recommendation method in a messenger according to claim 1, wherein the sharing request is either a request for sharing an image from the user using a menu of the chat room, or a request for sharing an image by a keyword entered in a message input window of the chat room.

7. In the case of the keyword-based image sharing request, the step of recommending an image includes presenting external content including at least one of device images stored on the computing device and images searched by a search engine based on the recommendation criteria information according to the keyword; The image recommendation method for a messenger according to claim 6 , further comprising the step of adding the external content to at least one of an image list and the recommendation list managed by the messenger at the user's request.

8. 2. The image recommendation method for a messenger according to claim 1, wherein the recommendation criteria information includes at least one of sharing criteria information based on predetermined conditions, context information of the chat room, or keywords input by the user for the sharing request, and the context information includes at least one of user link information related to users who have joined the chat room and conversation information extracted from conversation data of the chat room.

9. The step of recommending an image includes: a step of preferentially searching for images registered in the recommendation list and recommending the images; In response to the image matching the recommendation criteria information not being found from the recommendation list, searching for the device image matching the recommendation criteria information from device images stored in the computing device and presenting the device image; 2. The method of claim 1, further comprising: in response to the device image not being found, searching for and presenting images that match the recommendation criteria information by a search engine.

10. generating and tagging additional information for images managed by the computing device; 2. The image recommendation method for a messenger according to claim 1, further comprising: adding, at the user's request, the image tagged with the additional information to at least one of an image list managed by the messenger and the recommendation list.

11. A non-transitory computer-readable recording medium storing a program for executing an image recommendation method in a messenger on a computer, The image recommendation method in the messenger includes: generating and tagging additional information for images managed by the messenger; registering the image tagged with the additional information in a recommendation list of the messenger; recommending at least one image registered in the recommendation list based on recommendation criteria information of the chat room and the additional information in response to a sharing request from a user who has joined the chat room; and in response to the user's selection of the recommended image, sharing the selected image in the chat room.

12. A computing device that implements instructions, comprising: a memory storing at least one instruction; a processor for executing the at least one instruction stored in the memory; The processor: Generate and tag additional information for images managed by Messenger, registering the image tagged with the additional information in a recommendation list of the messenger, and recommending at least one image registered in the recommendation list based on recommendation criteria information of the chat room and the additional information in response to a sharing request from a user who has joined the chat room; A computing device configured to, in response to the user's selection of the recommended image, share the selected image in the chat room.

13. 13. The computing device of claim 12, wherein the additional information comprises detail data including at least one of time data of the image, location data of the image, and object data having information identifying at least one object of the image.

14. The object data is managed by associating a general identifier for classifying each object included in the image with the object; 14. The computing device of claim 13, wherein in response to at least one of profile data of a user who has joined the chat room and name data of an object associated with the user matching with an object recognized in the image, the object data is managed to associate a detailed identifier extracted from at least one of the profile data and the name data with the recognized object.

15. the additional information includes sharing-related data including at least one of history data for managing a sharing history of the image and keyword data for managing keywords used to select the shared image; the history data includes a sharing history of images shared in at least one of a current chat room in which the user participates and other chat rooms in which the user has participated; The computing device of claim 12 , wherein the keyword data includes keywords used in selecting the shared image in at least one of the current chat room and the other chat rooms.

16. The keyword data includes at least one of related data related to the selection of the shared image among conversation data exchanged between users of the chat room, and query data including a question used by the user to search for the shared image via the messenger; The computing device of claim 15 , wherein the association data and the query data are inferred via machine learning on the conversation data and the questions.

17. The computing device of claim 12 , wherein the sharing request is one of a request from the user to share an image using a menu of the chat room and a request to share an image by a keyword entered in a message input window of the chat room.

18. In the case of an image sharing request by the keyword, recommending the image includes: presenting external content including at least one of device images stored on the computing device and images retrieved by a search engine based on the recommendation criteria information according to the keywords; 20. The computing device of claim 17, further comprising adding the external content to at least one of an image list and a recommendation list managed by the messenger at the user's request.

19. 13. The computing device of claim 12, wherein the recommendation criteria information includes at least one of sharing criteria information based on predetermined conditions, context information of the chat room, or keywords entered by the user for the sharing request, and the context information includes at least one of user link information related to users who have joined the chat room and conversation information extracted from conversation data of the chat room.

20. Recommending the image includes: preferentially searching for images registered in the recommendation list and recommending the images; In response to the image matching the recommendation criteria information not being found from the recommendation list, searching for the device image matching the recommendation criteria information from device images stored in the computing device and presenting the device image; The computing device of claim 12 , further comprising, in response to the device image not being located, searching for and presenting, by a search engine, images that match the recommendation criteria information.

21. The processor: generating and tagging additional information for device images managed by the computing device; 13. The computing device of claim 12, further configured to, at the user's request, add the device image tagged with the additional information to at least one of an image list managed by the messenger and the recommendation list.

Images