Information processing apparatus, information processing method, program, and recording medium

Abstract

To provide useful information about a transmission image to a user who transmits an image in a network print technology.SOLUTION: Specifying a feature of a transmitted image from a first user for each transmitted image, specifying a correspondence relationship between the feature of the transmitted image and an execution history of image printing on a second user side for each second user, calculating a value related to an execution frequency of the image printing for each second user and for each feature based on the correspondence relationship specified for each second user, and specifying a first image from the transmitted images for each second user; Two or more second users having a common feature of the first image are extracted, a second image having a feature of an image that has not been transmitted to the target user and having a feature of a transmission image that has been printed by a non-target user other than the target user is specified among the extracted two or more second users, and the first user who has transmitted the transmission image to the target user is notified of the second image.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an information processing apparatus, an information processing method, a program, and a recording medium for allowing a user to print an image transmitted from another user. [Background technology]

[0002] In recent years, with the spread of network communication technology, it has become possible for users to send images to each other. Furthermore, technology has already been developed that allows one user to print an image provided by another user via a network, i.e., network printing technology (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-192016 Summary of the Invention [Problem to be solved by the invention]

[0004] In the network printing technology described in Patent Document 1, if it is possible to send an image that is likely to be preferred by the image recipient, it is expected that the satisfaction of the user will be increased. Also, if the image source user can easily find such an image, the burden of selecting an image to send can be reduced.

[0005] The present invention has been made in consideration of the above circumstances, and specifically aims to provide an information processing device, an information processing method, a program, and a recording medium that can provide useful information regarding the transmitted image to a user who transmits an image using network printing technology. [Means for solving the problem]

[0006] In order to achieve the above object, the information processing device of the present invention is an information processing device that includes a processor and causes a second user to print images sent from a first user, wherein the processor identifies the characteristics of the sent image for each sent image, identifies a correspondence between the characteristics of the sent image and the history of printing of sent images by the second user for each second user, calculates a value related to the frequency of printing of sent images for each second user and for each characteristic based on the correspondence identified for each second user, identifies first images from the sent images that have characteristics determined according to the magnitude of the value, extracts two or more second users that have common characteristics of the first images, identifies second images from the extracted two or more second users that have the characteristics of images that have not been sent to a target user and that have the characteristics of sent images that have been printed by non-target users other than the target user, and notifies first users who have sent sent images to the target user.

[0007] The processor may also identify characteristics for each of a group of images that can be transmitted by a first user who has previously transmitted a transmission image to the target user, and identify a second image from the group of images based on the characteristics of each of the images.

[0008] The processor may also identify at least one of the following as features: a feature amount of a subject in a transmission image; information about the type of subject; information about the date and time the transmission image was taken; and information about the location where the transmission image was taken. The processor may also identify the above features by analyzing an area of ​​the transmitted image where the subject is present. The processor may also identify the above features based on additional information added to the transmitted image.

[0009] Furthermore, when a plurality of second images are identified, the processor may preferentially notify, among the plurality of second images, a second image having a characteristic that has been printed more frequently by non-target users.

[0010] The processor may identify a correspondence by associating the second user with a first user who has transmitted a transmitted image to the second user.

[0011] The processor may identify, for each second user, a first image from among the transmitted images that has the characteristic with the largest value.

[0012] When the transmitted image is printed by the second user, the processor may acquire print information relating to the printed transmitted image, and identify the above-mentioned correspondence based on the print information.

[0013] In addition, in order to solve the above-mentioned problem, the information processing method of the present invention is an information processing method for causing a second user to print images sent from a first user, and is characterized in that the following steps are carried out by a processor: identifying the characteristics of the sent image for each sent image; identifying, for each second user, a correspondence between the characteristics of the sent image and the history of printing sent images at the second user's side; calculating a value related to the frequency of printing sent images for each second user and for each characteristic based on the correspondence identified for each second user; identifying, for each second user, first images among the sent images having characteristics determined according to the magnitude of the value; extracting two or more second users having common characteristics of the first images; identifying, from the extracted two or more second users, second images having characteristics of images that have not been sent to the target user and, from the two or more second users, having characteristics of sent images that have been printed by non-target users other than the target user; and notifying first users who have sent sent images to the target user of the second images.

[0014] In addition, in the above information processing method, the processor may identify characteristics of each of a group of images that can be transmitted by a first user who has previously transmitted a transmission image to the target user, and identify a second image from the group of images based on the characteristics of each of the above group of images.

[0015] Furthermore, in the above information processing method, when a plurality of second images are identified, the processor may preferentially notify the second images having a characteristic that they have been printed more frequently by non-target users.

[0016] In the information processing method, the processor may specify the correspondence by associating the second user with a first user who has transmitted a transmission image to the second user.

[0017] In addition, in the above information processing method, when the transmitted image is printed on the second user side, the processor may acquire print information regarding the printed transmitted image, and identify the above correspondence relationship based on the print information.

[0018] According to the present invention, it is also possible to realize a program for causing a computer to execute each step included in the above-described information processing method. Furthermore, according to the present invention, it is also possible to realize a computer-readable recording medium on which a program for causing a computer to execute each step included in the above-described information processing method is recorded. [Effects of the Invention]

[0019] According to the present invention, an information processing device, an information processing method, a program, and a recording medium are realized that can provide useful information about an image to a user who transmits an image using network printing technology. [Brief explanation of the drawings]

[0020] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an image print system. [Figure 2] FIG. 10 is a diagram showing the procedure for printing an image. [Figure 3] FIG. 1 is an explanatory diagram of image recommendation. [Figure 4] 1 is a diagram illustrating a hardware configuration of an information processing apparatus according to an embodiment of the present invention. [Figure 5]FIG. 2 is a diagram illustrating functions of an information processing device according to an embodiment of the present invention. [Figure 6] FIG. 10 is a diagram showing an example of an analysis result of an image. [Figure 7] FIG. 10 is a diagram showing an example of a print execution history. [Figure 8] FIG. 10 is a diagram showing an example of a calculation result regarding the frequency of printing an image. [Figure 9] FIG. 10 is an explanatory diagram of a procedure for identifying a characteristic common group. [Figure 10] FIG. 2 is a diagram showing an information processing flow according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0021] A specific embodiment of the present invention will be described with reference to the drawings. However, the embodiment described below is merely an example given to facilitate understanding of the present invention and is not intended to limit the present invention. Furthermore, the present invention can be modified or improved from the following embodiments without departing from the spirit of the invention. The present invention also includes equivalents thereof.

[0022] In this specification, the concept of "device" includes a single device that performs a specific function by itself, as well as multiple devices that exist independently and in a distributed manner but cooperate (link) to perform a specific function.

[0023] In this specification, unless otherwise specified, "image" refers to image data. Examples of image data include lossy compressed image data such as JPEG (Joint Photographic Experts Group) format, and lossless compressed image data such as GIF (Graphics Interchange Format) or PNG (Portable Network Graphics). Image data may also include data indicating information such as the file name, date and time of capture, and location of capture.

[0024] In this specification, a "user" refers to a user who uses the information processing device of the present invention. Using the information processing device means using the functions of the information processing device, and includes not only directly operating the information processing device but also using the functions of the information processing device from other devices (e.g., a user terminal).

[0025] <Image print system configuration> The present invention is an information processing technology relating to the transmission, reception, and printing of images, and is specifically applied to an image print system S shown in Fig. 1. The image print system S is a system for network printing, and includes the information processing device of the present invention.

[0026] The information processing device of the present invention transmits an image from one user (hereinafter referred to as the first user) to another user (hereinafter referred to as the second user) via a network, and causes the second user who receives the image to print the image. Here, in this specification, "causing the second user to print the image" does not mean that the information processing device directly instructs the second user to print, but rather that the second user is able to print the image by sending and receiving the image from the information processing device.

[0027] Note that "sending an image from a first user" is synonymous with sending an image from a device used by the first user. Furthermore, "sending an image to a second user" is synonymous with sending an image to a device used by the second user. An example of a device used by a user is the user terminal 10 described below, but it may also include a device that is not owned by the user but can be used by logging in by entering account information, a PIN, or the like, such as a terminal installed in a store. Also, "printing the image on the second user's side" means that the second user prints the image using a printer available to the second user.

[0028] Furthermore, the first user and the second user are relative concepts (positions), and a user who was the first user at one point in time may become the second user at another point in time. That is, each user becomes the first user when sending an image, and becomes the second user when receiving an image.

[0029] 1, the image print system S is composed of a user terminal 10 used by each user, a printer 12 used by a second user, and a server computer 16. The server computer 16 and each user's user terminal 10 are connected in a communicable state via a network 14 such as the Internet and a mobile network. In FIG. 1, for convenience of illustration, the number of first users and the number of second users are three, but the number of first users and the number of second users is not particularly limited.

[0030] The user terminal 10 is a computer used by a user, and specifically is configured as a smartphone, a tablet terminal, a notebook PC (Personal Computer), etc. The user terminal 10 includes a processor, a memory, and a communication interface.

[0031] The user terminal 10 also stores an application program (hereinafter simply referred to as the terminal-side program) for using the image print service. The image print service is a cloud service related to sending and receiving images, editing images, and printing images. By using the image print service through the terminal-side program, each user can send or receive images via the network and print images.

[0032] Furthermore, if the user terminal 10 of the first user is equipped with a camera, the first user can take images using that camera. Furthermore, the first user can connect a photographing device such as a digital camera to the user terminal 10 and import images taken by the photographing device into the user terminal 10. In this way, the first user acquires images, and as the number of times images are acquired increases, an image group consisting of two or more images is acquired.

[0033] The group of images acquired by the first user (hereinafter referred to as the first user's image group) corresponds to a group of images that the first user can transmit (provide). That is, the first user selects one or more images from the group of images, and the user terminal 10 transmits the selected one or more images, specifically uploads them to the server computer 16.

[0034] Note that the destination where each image in the first user's image group is saved is not particularly limited, as long as it can be sent to the second user at the first user's discretion. In other words, each image in the first user's image group does not need to be saved in the first user's user terminal 10, and some or all of the first user's image group may be stored in a device connected to the user terminal 10 via a network, such as a server computer 16.

[0035] The printer 12 is a device used by the second user when printing an image sent from the first user. The printer 12 is connected to the user terminal 10 wirelessly via Wi-Fi (registered trademark) or Bluetooth (registered trademark), or is connected to the user terminal 10 via a wired connection.

[0036] The printer 12 is controlled by the user terminal 10 based on the operation of the second user, and can print images received by the user terminal 10. Specifically, when the second user specifies an image to be printed from among the images received by the user terminal 10 through the user terminal 10, the user terminal 10 controls the printer 12 in accordance with the specifying operation. Under this control, the printer 12 prints the image specified by the user.

[0037] The image printing method used by printer 12 is, for example, instant photography. Specifically, a latent image is formed by exposing a photosensitive film housed in printer 12 to light, and a developer in a developer pot provided at the end of the film is spread on the surface of the film to form a visualized image. However, the printing method is not limited to instant photography, and may be inkjet printing, dye-sublimation thermal transfer printing, electrophotography using toner, or the like.

[0038] The printer 12 may also be a device dedicated to the user, a home printer installed in the user's home, or a store-installed printing device that can be used when the user visits a store or the like.

[0039] The server computer 16 is a computer that provides a platform for the image print service, which is a cloud service, and constitutes the information processing device of the present invention. Specifically, the server computer 16 relays the transmission and reception of images between users and also executes processing related to the printing of images on the side of the second user.

[0040] The server computer 16 also stores information about each user who uses the image print service. This information includes the user's image sending and receiving history and the user's image printing history. This history information may be stored in each user's user terminal 10 or printer 12. In this case, the server computer 16 may communicate with the user terminal 10 to obtain the information stored in that user terminal 10.

[0041] Furthermore, the server computer 16 has a function to analyze each image in the image group of the first user and the images printed by the second user, and further has a function to notify (recommend) the first user of useful information regarding image transmission based on the analysis results. The above functions can be realized by an API (Application Programming Interface) installed in the server computer 16. The first user can check the recommendation information provided by the server computer 16 by using the API.

[0042] It should be noted that notifying (recommending) information to the first user means transmitting information to a device available to the first user (e.g., the user terminal 10) and having the device output the information. The method of outputting the information is not particularly limited, and for example, the information may be displayed on a display screen, or audio corresponding to the information may be played and emitted from a speaker or the like.

[0043] <Sending and receiving images and printing images> Next, the transmission and reception of images between users and the printing of images performed through the image print service will be described with reference to Fig. 2. The following description will be given mainly from the perspective of the GUI (Graphical User Interface) displayed on the screen of the user terminal 10.

[0044] Note that the content described below is not limited to cases where images are sent and received between two users, but can also be applied to cases where one first user sends and receives images between multiple second users.

[0045] When using the image print service, both the first user and the second user download the terminal-side program and install it on the user terminal 10. When obtaining the terminal-side program, the first user and the second user may each perform an account registration input operation, such as name, age, and gender. In this case, the input information is stored in, for example, the server computer 16.

[0046] Thereafter, when the second user starts the terminal-side program and creates a folder for receiving images (hereinafter referred to as an inbox for convenience), the information is notified to the first user, as shown in Fig. 2. The means of notification at this time is not particularly limited, and may be, for example, sending an email or posting a message on a social networking service (SNS) linked to the image print service.

[0047] When the first user starts the terminal-side program and then performs a predetermined operation, a list LI of the first user's images is displayed on the first user's user terminal 10, as shown in FIG. 2. The first user selects an image to send to the second user from the list LI and performs an operation for sending the image (for example, pressing the send button). As a result, the image selected by the first user is sent from the first user's user terminal 10. The sent image is temporarily received by the server computer 16, and then sent from the server computer 16 to the user terminal 10 of the second user.

[0048] When the user terminal 10 of the second user receives an image (hereinafter, a received image) sent from the first user via the server computer 16, it saves the received image in its inbox and notifies the second user of this fact. The second user checks the received image saved in its inbox on the screen of the user terminal 10, and if the second user wishes to print the received image, performs a print request operation (for example, pressing the print button). As a result, the image to be printed and a print command are sent from the user terminal 10 of the second user to the printer 12.

[0049] The printer 12 prints the image designated by the second user as the print target in accordance with the print command. This allows the second user to print the received image (in other words, the image sent from the first user) and obtain the printout P. When the second user prints the image, print information regarding the printed image (i.e., the image sent from the first user) is sent from the user terminal 10 of the second user to the server computer 16.

[0050] <About image recommendations> Next, image recommendations by the server computer 16 will be described with reference to Fig. 3. In the following description, it is assumed that user A is a first user who sends an image, users B and C are second users who receive the image, and user A has sent an image to user B in the past.

[0051] For example, when user A sends an image to user B, the server computer 16 can identify an image from user A's group of images that is suitable to send to user B, and notify (recommend) user A of the identified image.

[0052] More specifically, the server computer 16 identifies the characteristics of images that have been printed by the user B. The image characteristics include the characteristic amount of the subject in the image, information about the type of subject, information about the date and time the image was taken, and information about the location where the image was taken, and the server computer 16 identifies at least one of these.

[0053] The subject refers to the people, objects, and background that appear in an image. In this specification, the concept of subject may also include scenery (e.g., the sea or mountains), scenes (e.g., dawn or dusk, clear skies, etc.), and themes (e.g., travel, meals, or events such as sports days) identified from an image.

[0054] The feature amount of the subject in the image may be, for example, the resolution of the subject in the image, the amount of data, the degree of blur, the size ratio to the angle of view, the position in the angle of view, the color tone, or a combination of these feature amounts. The feature amount may be identified by applying a known image analysis technique to analyze the area in the image where the subject exists. Furthermore, the feature may be a value output by inputting an image into a trained model previously constructed by machine learning, and may be, for example, a one-dimensional or multidimensional vector value. Here, the feature output from the trained model may not be interpretable by humans, but any value that is uniquely output when at least one image is input can be used as the feature.

[0055] The information about the type of subject is information that indicates the category (classification), state, appearance, attributes, and other content related to the type of subject. The information about the type of subject may also be information that indicates the theme or scene of the image. If the subject is a person, the subject's identity may be identified from the subject's feature values, and the identification result may be used as information about the type of subject. Information about the type of subject may be identified by applying a known subject recognition technology and analyzing the area in the image where the subject exists. Also, if additional information indicating the type of subject (specifically, tag information, etc.) is added to the image, information about the type of subject may be identified based on the additional information.

[0056] The date and time and location of an image may be identified based on additional information added to the image, such as tag information in the Exchangeable Image File Format (Exif) format.

[0057] Returning to the explanation of image recommendations, the server computer 16 also identifies the characteristics of images that have been printed by second users other than user B (e.g., user C). In addition, the server computer 16 identifies the characteristics of the most frequently printed image (hereinafter, the first image) for each of multiple second users including user B. In the following, it is assumed that the feature of the first image identified for user B, specifically, the information on the type of subject, is "ocean" (see FIG. 3).

[0058] After the characteristics of the first image are identified, the server computer 16 extracts second users who share the same characteristics of the first image as user B, i.e., second users who most frequently print images of the ocean. Here, assume that user C is identified as a second user who shares the same characteristics of the first image as user B. In this case, users B and C correspond to two or more second users who share the same characteristics of the first image, and will hereinafter be referred to as a "common-characteristic group."

[0059] Server computer 16 identifies the second image based on the image print history of user C, a user other than user B, from among the common characteristic group. The second image is an image that user A has never sent to user B, and that has the characteristics of an image that has been printed many times among images that user C has received in the past (i.e., images sent to user C from any first user). To give a specific example, if an image other than an image of "ocean" that has been printed many times by user C has the characteristic of, for example, "mountain," then the image of "mountain" corresponds to the second image.

[0060] Thereafter, the server computer 16 identifies a second image, i.e., an image of a "mountain," from the group of images of user A. Then, the server computer 16 notifies (recommends) the second image identified from the group of images of user A as an image to be sent to user B.

[0061] According to the above procedure, it is possible to notify (recommend) user A of an image that user B may like. To explain in more detail, the second image recommended as an image to be sent to user B is an image that has the characteristics of an image frequently printed by user C who belongs to the same common characteristic group as user B. Here, user C who belongs to the same common characteristic group as user B is presumed to be a user who is highly likely to have similar or common interests and tastes to user B. Therefore, if the image is an image that user B has not received before and is an image that user C has frequently printed, it is expected that there is a high probability that user B will like (like) it.

[0062] For the above reasons, the second image having the characteristics of the image frequently printed by user C is notified (recommended) to user A as an image suitable for sending to user B. This reduces the burden on user A, who is the image sender, of finding an image that user B, who is the image recipient, will like.

[0063] <Configuration of an information processing device according to an embodiment of the present invention> As described above, an information processing device according to an embodiment of the present invention is configured by a server computer 16. The number of computers configuring the information processing device may be one, or two or more. That is, the information processing device of the present invention is realized by a processor and a program executable by the processor, and is configured by, for example, a general-purpose computer.

[0064] As shown in FIG. 4, the server computer 16 includes a processor 16A, a memory 16B, a communication interface 16C, a storage device 16D, and the like.

[0065] The processor 16A is configured by, for example, a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), or a tensor processing unit (TPU). The memory 16B is configured by, for example, semiconductor memory such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The communication interface 16C is configured by, for example, a network interface card or a communication interface board.

[0066] The storage device 16D is configured, for example, by a storage built into or externally attached to the server computer 16, or a NAS (Network Attached Storage), etc. However, without being limited thereto, the storage device 16D may also be a third computer that can communicate with the server computer 16, such as a so-called online storage.

[0067] The storage device 16D stores various information necessary for the image print service. The storage device 16D also stores images provided (transmitted) from a first user to a second user. The storage device 16D also stores, for each second user, a history of the second user printing images transmitted from the first user, i.e., a history of image printing.

[0068] In addition, a program (hereinafter referred to as a server-side program) for functioning as the information processing device of the present invention is installed in the server computer 16. The server-side program is a program for causing a computer to execute each step included in the information processing method of the present invention. That is, the processor 16A reads the server-side program and executes a series of processes related to the image print service.

[0069] The server-side program may be acquired by reading it from a computer-readable recording medium, or by receiving (downloading) it via a communication line such as the Internet or an intranet.

[0070] The configuration of the server computer 16 that constitutes the information processing device will now be described from a functional perspective. As shown in Fig. 5, the server computer 16 has an analysis unit 21, an acquisition unit 22, a discrimination unit 23, an identification unit 24, a calculation unit 25, a search unit 26, an extraction unit 27, a selection unit 28, and a notification unit 29. These functional units are realized by cooperation between hardware devices included in the server computer 16 and software including a server-side program.

[0071] Each functional unit will be described below. In the following description, the user terminal 10 of the first user will be referred to as the "first terminal 10A," and the user terminal 10 of the second user will be referred to as the "second terminal 10B."

[0072] (Analysis Department) The analysis unit 21 analyzes the images received by the second user, in other words, the images transmitted from the first user (specifically, the first terminal 10A) for each transmitted image, and identifies the characteristics of each transmitted image. Specifically, the transmitted image from the first user is temporarily stored in the storage device 16D of the server computer 16. At this time, the analysis unit 21 analyzes the transmitted image stored in the storage device 16D. Note that the transmitted image refers to an image transmitted by one first user to one second user. For example, if the first user transmits the same image to multiple second users, the images received by each second user will correspond to different transmitted images.

[0073] The analysis unit 21 analyzes the transmitted image to identify at least one of the following features: a feature amount of the subject in the transmitted image, information about the type of subject, information about the date and time the transmitted image was taken, and information about the location where the transmitted image was taken. More specifically, when the analysis unit 21 identifies the feature amount of the subject as the feature, it identifies the feature by analyzing the area in the transmitted image where the subject exists. In addition, when the analysis unit 21 identifies information regarding the type of subject as a feature, it identifies the feature by analyzing the area in the transmitted image where the subject is present, or it identifies the feature based on additional information (tag information) added to the transmitted image. In addition, when the analysis unit 21 identifies information regarding the date and time the transmitted image was taken and information regarding the location where the transmitted image was taken as features, it identifies the features based on additional information added to the transmitted image (for example, tag information in Exif format, etc.).

[0074] The characteristics identified by the analysis unit 21 are associated with the identification ID (image ID) of the transmitted image having the characteristics and stored in the storage device 16D. An example of the analysis result of the transmitted image is shown in FIG. The image ID of each transmitted image is associated with the first user who transmitted the image and the second user who receives the image, and is stored in the storage device 16D.

[0075] (Acquisition Department) When a transmitted image is printed by the second user, the acquisition unit 22 acquires print information about the printed transmitted image. Specifically, the acquisition unit 22 receives data indicating the print information from the user terminal 10 of the second user who performed the printing (i.e., the second terminal 10B). The print information includes the image ID of the printed image, information for identifying the second user who performed the printing (e.g., the identification ID of the second terminal 10B), and the like. The acquired print information is stored in the storage device 16D for each second user.

[0076] The method and timing of acquiring the print information are not particularly limited. For example, data indicating the print information may be transmitted from second terminal 10B each time a transmitted image is printed on the second user side, and acquisition unit 22 may receive the data each time. Alternatively, print information may be stored in second terminal 10B, and acquisition unit 22 may request second terminal 10B to transmit the print information at a predetermined time, and receive the print information data transmitted in response to the request.

[0077] (Discrimination part) Based on the print information acquired for each second user, the determination unit 23 determines for each second user whether or not each image received by the second user from the first user has been printed. Furthermore, the determination unit 23 identifies, for each second user, the number of times the second user has printed an image that has been printed. Here, the whether or not printing has been performed and the number of times printing has been performed correspond to the printing history. Furthermore, the number of times printing has been performed corresponds to a value related to the frequency of printing, and may be the total number of times printing has been performed, or the number of times printing has been performed within a certain period (for example, one year).

[0078] The printing history of each transmitted image determined by the determination unit 23 is stored in the storage device 16D for each second user. In detail, the printing history of each transmitted image is stored in association with the identification number (transmission ID) of the image transmission and the combination of the first user and the second user associated with each transmitted image, as shown in Fig. 7 .

[0079] (Specific part) The identification unit 24 identifies, for each second user, a correspondence between the features of each transmitted image identified by the analysis unit 21 and the print history of each transmitted image identified by the discrimination unit 23. At this time, the identification unit 24 identifies the above correspondence by associating the features with a first user who has transmitted an image (transmitted image) to the second user.

[0080] Specifically, the identification unit 24 identifies the correspondence between the features of each transmitted image and the print history by associating it with the combination of the first user and the second user linked to each transmitted image. Here, the print history is identified based on the print information acquired by the acquisition unit 22, as described above. From this perspective, it can be said that the identification unit 24 identifies the above correspondence based on the print information.

[0081] The correspondence relationship identified for each transmitted image is associated with the first user who transmitted the transmitted image and is stored in the storage device 16D for each second user.

[0082] (Calculation section) The calculation unit 25 calculates the number of times that a transmitted image has been printed for each second user based on the correspondence relationship identified for each second user by the identification unit 24. More specifically, the calculation unit 25 calculates the number of times that a transmitted image has been printed for each second user for each feature of the transmitted image. The calculated number of times that an image has been printed is stored in the storage device 16D for each second user and for each feature.

[0083] An example of the calculation result by the calculation unit 25 is shown in Fig. 8. Fig. 8 shows the number of times a certain second user (a second user whose user ID is U0002B) has printed transmitted images for each feature. In the case shown in Fig. 8, the second user has printed transmitted images whose subject type is "ocean" 10 times, and has printed transmitted images whose subject type is "mountain" 8 times.

[0084] Calculating the number of times printing has been performed for each feature includes calculating the number of times printing has been performed for each type of subject, as well as calculating the number of times printing has been performed for a combination of multiple types of subjects, as shown in Figure 8. For example, the number of times printing has been performed may be calculated for images whose subject types are "sea" and "clouds" (i.e., images that show sea and clouds).

[0085] (Search section) The search unit 26 searches (identifies) a first image for each second user from among the images received by each second user. The first image is an image having characteristics determined according to the number of times the image has been printed (i.e., the magnitude of the value related to the frequency of printing), for example, an image having characteristics that have been printed the most frequently. In the case shown in FIG. 8, an image whose subject type is "ocean" corresponds to the first image. The characteristics of the searched first image are stored in the storage device 16D for each second user.

[0086] The first image is not limited to the image having the characteristic of being printed the most frequently, but may be an image having a characteristic that ranks 1st to nth (n is a natural number of 2 or more) in terms of the number of times printed. Also, the first image may be an image having a characteristic that has been printed a predetermined number of times or more. Alternatively, the first image may be an image having a characteristic that has been printed the most frequently in a predetermined period (for example, within the past few months to one year).

[0087] (Extraction part) The extraction unit 27 extracts two or more second users whose first images share common features, that is, a common feature group. Here, common features mean, for example, that the features are identical. To explain the procedure for extracting a common feature group using a specific example, assume that the number of prints calculated for each feature for each of second users, user B and user C, is as shown in FIG. 9. As can be seen from FIG. 9, user B and user C most frequently print images whose subject type is "ocean." In other words, user B and user C share common features in their first images. In this case, the extraction unit 27 extracts user B and user C as a common feature group.

[0088] The number of second users extracted as a feature-common group is not particularly limited, as long as it is at least two people. Furthermore, the procedure for extracting a feature-common group is not particularly limited. For example, a feature-common group may be extracted by focusing on one second user (e.g., a target user described below) and searching for other second users who share features of the first image with that user.

[0089] Note that having common features may include not only the same features but also similar features. Similar features may mean, for example, that the feature quantities are similar. Specifically, the feature quantities of the two features to be compared may be defined in a feature quantity space, and the similarity between the features may be evaluated based on the distance between the features in the space. In this case, the smaller the distance between the features, the more similar the features are (the higher the similarity). Furthermore, when the feature is information about the type of subject, the information may be digitized (more specifically, vectorized) using a known method such as Word2vec, the digitized information may be defined in a vector space, and the similarity between the features may be evaluated based on the distance between the vectors in the space. In this case, the smaller the distance between the vectors, the more similar the information is.

[0090] (Selection Department) When a target user is determined from the characteristic common group extracted by the extraction unit 27, the selection unit 28 selects (specifies) a second image for the target user. The target user is a user among multiple second users belonging to the characteristic common group to whom the first user using the image recommendation will send an image, that is, a user who will be the recipient of the second image. In addition, second users in the characteristic common group other than the target user will be referred to as non-target users hereinafter. Incidentally, whether each second user in the characteristic common group corresponds to a target user or a non-target user is determined depending on the destination of the second image, that is, to whom the first user using the image recommendation will send the image.

[0091] The second image is an image that has the characteristics of an image that has not been sent to the target user (hereinafter referred to as an unsent image) and also has the characteristics of a sent image that has been printed by a non-target user. The image identified as the second image may be an image that has been printed relatively frequently among unsent images that have been printed by a non-target user (sent images). For example, among unsent images that have been printed by a non-target user, an image that has been printed the second most frequently after the first image may be identified as the second image.

[0092] 9 as an example, when user B is set as a target user and user C is set as a non-target user, the selection unit 28 may specify an image in which the type of subject is "mountain" as the second image. When user C is set as a target user and user B is set as an asymmetric user, the selection unit 28 may specify an image in which the type of subject is "temple" as the second image.

[0093] The method for selecting the second image is not particularly limited, and the second image may be selected according to any criteria from among images that have been printed by non-target users. For example, the top N images (N is a natural number equal to or greater than 2) that have been printed the most may be selected as the second image. Furthermore, among images that have been printed by non-target users, images that have characteristics of images that have not been sent to the target user may be selected as the second image.

[0094] Furthermore, when there are multiple non-target users in the same characteristic common group, the second image may be selected for each non-target user from among images that the non-target user has printed.

[0095] (Notification Department) The notification unit 29 notifies (recommends) the second image selected by the selection unit 28 to first users who have sent images (transmitted images) to the target user. Specifically, the notification unit 29 identifies first users who have sent images to the target user based on the print history of each transmitted image (see FIG. 7). Hereinafter, the identified first users will be referred to as "identified first users."

[0096] Next, the notification unit 29 identifies a group of images of the specific first user and identifies features for each of the identified group of images. The procedure for identifying the features of each of the group of images of the specific first user is the same as the procedure used by the analysis unit 21 when characterizing the features of a transmitted image. Then, the notification unit 29 determines whether or not there is a second image in the group of images of the specific first user based on the features of each of the identified group of images, and if there is a second image, recommends the second image to the specific first user.

[0097] 9 as an example, assume that user B is the target user and user A is a specific first user who has previously sent images to user B. In this case, if an image (second image) whose subject type is "mountain" is included in the group of images of user A, notification unit 29 recommends the image to user A as an image to be sent to user B.

[0098] As described above, in this embodiment, the system (server computer 16) determines whether the second image is included in the image group of the specific first user, which saves the specific first user the trouble of checking whether the second image is included in the image group. Note that the notification unit 29 may notify (recommend) the specific first user of the second image selected by the selection unit 28 without determining whether the second image is included in the image group of the specific first user.

[0099] Furthermore, the notification (recommendation) method is not particularly limited, and for example, data indicating information about the second image may be transmitted to the user terminal 10 of the specific first user, and the information may be displayed on the screen of the user terminal 10. Alternatively, the information may be output (played) as audio on the user terminal 10.

[0100] Furthermore, when the selection unit 28 identifies a plurality of second images, the notification unit 29 may preferentially notify (recommend) to the specific first user a second image that has a characteristic of being printed more frequently by non-target users among the plurality of second images. This is because it is estimated that if an image has been printed more frequently, the target user is more likely to like (favour) that image.

[0101] <Information processing flow according to one embodiment of the present invention> An information processing flow (hereinafter referred to as an image recommendation flow) by an information processing device according to one embodiment of the present invention will be described. The image recommendation flow employs the information processing method of the present invention. In other words, each step (each process) in the image recommendation flow corresponds to a component of the information processing method of the present invention.

[0102] For ease of understanding, the following description will be given taking as an example a case where the first user is user A, the second users are users B and C, and user A sends an image to user B. Also, user A is assumed to be a first user who has previously sent an image to user B, i.e., a specific first user.

[0103] The image recommendation flow is initiated, for example, when user A performs a predetermined operation on the user terminal 10. However, this is not limited to this, and the image recommendation flow may be performed periodically at a fixed cycle. The image recommendation flow proceeds as shown in FIG. 10, and each step in the flow is executed by the processor 16A of the server computer 16 that constitutes the information processing device.

[0104] In the image recommendation flow, first, processor 16A analyzes each image that users B and C have received so far (in other words, images transmitted from the first user) and identifies the features of each image (S001). The identified features are the feature amount of the subject in the transmitted image, information about the type of subject, information about the date and time the transmitted image was taken, or information about the location where the transmitted image was taken, or a combination of these. In more detail, processor 16A analyzes the area in the transmitted image where the subject exists and identifies the feature amount of the subject and information about the type of subject. Furthermore, processor 16A identifies information about the type of subject, information about the date and time the transmitted image was taken, and information about the location where the transmitted image was taken, based on the additional information added to the transmitted image. The identified feature is associated with the identification ID (image ID) of the transmitted image having the feature and stored in the storage device 16D (see FIG. 6).

[0105] In the image recommendation flow, when each of user B and user C prints a transmitted image, the processor 16A acquires print information from the user terminal 10 of each of user B and user C (S002). The acquired print information is stored in the storage device 16D for each user (specifically, for each second user).

[0106] Thereafter, based on the print information acquired for each second user, processor 16A identifies for each second user, for each of user B and user C, whether or not each transmitted image has been printed and the number of times it has been printed (S003). The print history of each transmitted image is stored in storage device 16D in association with the transmission ID of each transmitted image and the combination of the first user and the second user associated with each transmitted image.

[0107] Next, for each of user B and user C, processor 16A identifies a correspondence between the features of each transmitted image identified in step S001 and the print history of each transmitted image identified in step S003 (S004). At this time, the correspondence is identified in association with a first user who has transmitted an image to user B or a first user who has transmitted an image to user C. The identified correspondence is stored in storage device 16D for each second user.

[0108] Next, the processor 16A calculates the number of times the transmitted image has been printed for each feature of the transmitted image for each of the users B and C based on the correspondence relationship identified in step S004 (S005). The calculated number of times the image has been printed for each feature of the transmitted image for each of the users B and C is stored in the storage device 16D (see FIG. 8).

[0109] Next, based on the number of times each feature has been printed calculated in step S005, the search unit 26 of the processor 16A identifies a first image for each user (each second user) from among the images received by each of user B and user C (S006). Specifically, among the transmitted images printed by each user, the image having the feature with the most number of times each feature has been printed is identified as the first image. The features of the first images identified for each of user B and user C are stored in the storage device 16D.

[0110] Next, processor 16A extracts two or more second users who share common features of the first images, that is, a common feature group (S007). Here, it is assumed that the features of the first images identified for user B and the features of the first images identified for user C are common, and users B and C are extracted as a common feature group. In the following, it is assumed that user B is set as a target user and user C is a non-target user in the common feature group.

[0111] Next, processor 16A identifies a second image for user B, who is the target user (S008). Specifically, it identifies images (unsent images) that have characteristics of images that have not been sent to user B, and identifies, from among the unsent images, an image that has characteristics of a sent image that user C has printed as the second image. In this step S008, for example, among the unsent images that user C has printed, the image that has the second most number of prints after the first image is identified as the second image.

[0112] Thereafter, processor 16A notifies (recommends) user A, the identified first user, of the second image identified in step S008. Specifically, processor 16A identifies features for each of user A's image group, and determines whether or not the second image is present in user A's image group based on the features of each of the identified image group (S009). Then, if the second image is present in user A's image group, processor 16A recommends the second image to user A (S010).

[0113] If multiple second images are identified in step S008, processor 16A performs steps S009 and S010 so that second images having characteristics that have been printed more frequently are preferentially notified (recommended).

[0114] Once the above series of steps are completed, the image recommendation flow ends.

[0115] <Other embodiments> The embodiment described above is a specific example given to clearly explain the information processing device and information processing method of the present invention, and is merely an example, and other embodiments are also possible.

[0116] In the above embodiment, the recommended image (i.e., the second image) is selected based on the type of subject, such as "mountain" or "temple," but the present invention is not limited to this. For example, the second image may be selected based on the feature amount of the subject (specifically, the feature amount of a person's face). The second image may also be selected based on the location where the image was taken or the date and time of the image. In this case, for example, suppose two second users who frequently print images taken during the daytime on Sundays from among images sent from the first user are extracted as a characteristic common group. Furthermore, suppose one of the users (non-target user) frequently prints images taken during the night on weekdays, while the other user (target user) has never received images taken during the night on weekdays. In this case, images taken during the night on weekdays may be recommended to the user (first user) who regularly sends images to the target user as candidates for images to send to the target user.

[0117] In the above embodiment, the number of times a second user has printed an image transmitted from a first user is calculated for each feature of the transmitted image, and the first image is identified from among the transmitted images based on the calculation result. However, this is not limited to this, and the number of times a print has been performed may include the number of times the second user has printed an image transmitted from the first user, as well as the number of times the first user has printed an image of the first user. Here, images printed by the first user are not necessarily sent to the second user. In light of this, when adding the number of times a print has been performed by the first user to the number of times a print has been performed by the first user, it is preferable to set a weight for the number of times a print has been performed by the first user that is smaller than the weight for the number of times a print has been performed by the second user.

[0118] In the above embodiment, the functions of the information processing device of the present invention are performed by the processor 16A provided in the server computer 16, but this is not limiting. The processor provided in the information processing device of the present invention may be provided in the user terminal 10 on the user side or the printer 12. In other words, some or all of the above-mentioned functional units provided in the information processing device of the present invention may be provided in the user terminal 10 or the printer 12.

[0119] The processor included in the information processing device of the present invention includes various types of processors, including, for example, a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units. The various processors also include PLDs (Programmable Logic Devices), which are processors whose circuit configuration can be changed after manufacturing, such as FPGAs (Field Programmable Gate Arrays). Furthermore, various processors include dedicated electrical circuits such as ASICs (Application Specific Integrated Circuits), which are processors having circuit configurations designed specifically for performing specific processes.

[0120] Furthermore, one functional unit possessed by the information processing device of the present invention may be configured by one of the various processors described above, or may be configured by a combination of two or more processors of the same or different types, for example, a combination of multiple FPGAs, or a combination of an FPGA and a CPU, etc. Furthermore, the multiple functional units of the information processing device of the present invention may be configured by one of various processors, or two or more of the multiple functional units may be collectively configured by one processor. Furthermore, as in the above-described embodiment, one processor may be configured by combining one or more CPUs and software, and this processor may function as multiple functional units.

[0121] Furthermore, for example, a processor may be used that realizes the functions of the entire system including multiple functional units in the information processing device of the present invention on a single IC (Integrated Circuit) chip, as typified by an SoC (System on Chip), etc. Furthermore, the hardware configuration of the various processors described above may be an electric circuit (Circuitry) that combines circuit elements such as semiconductor elements. [Explanation of symbols]

[0122] 10 User terminal 10A Terminal 1 10B Terminal 2 12 Printers 14 Network 16 Server Computers 21 Analysis Department 22 Acquisition Department 23 Discrimination part 24 Specific part 25 Calculation section 26 Search Section 27 Extraction part 28 Selection Department 29 Notification Department P Printed material S Image Print System

Claims

1. An information processing device including a processor, The processor: Identifying a feature of each transmitted image transmitted from the first user; Identifying, for each second user, a correspondence between the characteristics and a history of printing of the transmitted image at the second user side that received the transmitted image; calculating a value relating to a frequency of printing the transmitted image for each of the second users and for each of the characteristics based on the correspondence relationship identified for each of the second users; identifying a high frequency feature determined according to the magnitude of the value among the features for each second user; extracting two or more second users having the high frequency feature in common; An information processing device that identifies, from among the extracted two or more second users, the high frequency feature of a non-target user other than the target user as a first feature for the target user.

2. The information processing device according to claim 1 , wherein the first feature is the feature obtained by subtracting the high-frequency feature of the target user from the high-frequency feature of the non-target user.

3. The information processing apparatus according to claim 1 , further comprising: extracting the first user who has acquired an image having the first characteristic; and notifying the extracted first user of the image having the first characteristic.

4. The information processing apparatus according to claim 1 , wherein the first user is a user who has transmitted the transmission image to the target user in the past.

5. 4. The information processing device according to claim 3, wherein, when a plurality of the first characteristics are identified, the processor preferentially notifies images having the first characteristics that have been printed more frequently by the non-target users among the plurality of the first characteristics.

6. 6. The information processing device according to claim 1, wherein the processor identifies the features for each of a group of images that can be transmitted by the first user who has previously transmitted the transmitted image to the target user, and identifies the first feature from among the features of each of the group of images.

7. The information processing device according to claim 1 , wherein the processor identifies at least one of the following as the features: a feature of the subject in the transmitted image; information about the type of the subject; information about the date and time the transmitted image was taken; and information about the location where the transmitted image was taken.

8. The information processing device according to claim 7 , wherein the processor identifies the feature by analyzing an area in the transmitted image where the subject is present.

9. The information processing device according to claim 1 , wherein the processor identifies the feature based on additional information added to the transmitted image.

10. The information processing device according to claim 1 , wherein the processor identifies the correspondence by associating the second user with the first user who has previously transmitted the transmission image to the second user.

11. The information processing device according to claim 1 , wherein the processor identifies, for each second user, the high frequency feature having the largest value among the features.

12. 12. The information processing device according to claim 1, wherein when the transmitted image is printed by the second user, the processor acquires print information regarding the printed transmitted image, and identifies the correspondence based on the print information.

13. identifying characteristics of each transmitted image transmitted from a first user; specifying, for each second user, a correspondence between the characteristics and a history of printing of the transmitted image at the second user side that received the transmitted image; calculating a value relating to a frequency of printing the transmitted image for each of the second users and for each of the characteristics based on the correspondence relationship identified for each of the second users; identifying, for each second user, a high frequency feature determined according to the magnitude of the value among the features; extracting two or more second users having the high frequency feature in common; and identifying, by a processor, the high-frequency features of non-target users other than the target user among the extracted two or more second users as first features for the target user.

14. The information processing method according to claim 13 , wherein the processor extracts the first user who has acquired an image having the first characteristic, and notifies the extracted first user of the image having the first characteristic.

15. The information processing method according to claim 14 , wherein, when a plurality of the first characteristics are identified, the processor preferentially notifies images having the first characteristics that have been printed more frequently by the non-target users.

16. An information processing method according to any one of claims 13 to 15, wherein the processor identifies the features for each of a group of images that can be sent by the first user who has sent the transmitted image to the target user, and identifies the first feature from among the features of each of the group of images.

17. The information processing method according to claim 13 , wherein the processor identifies the correspondence by associating the second user with the first user who has previously transmitted the transmission image to the second user.

18. An information processing method according to any one of claims 13 to 17, wherein when the transmitted image is printed by the second user, the processor acquires print information regarding the printed transmitted image, and identifies the correspondence based on the print information.

19. A program for causing a computer to execute each step included in the information processing method according to any one of claims 13 to 18.

20. A computer-readable recording medium, 19. A recording medium having recorded thereon a program for causing a computer to execute each step included in the information processing method according to any one of claims 13 to 18.

Images