Information processing apparatus, information processing method, program, and recording medium

Abstract

To provide an information processor, an information processing method, a program and a recording medium for proposing proper information to a user in a network print technology.SOLUTION: An information processing apparatus of the present invention is an apparatus that includes a processor and causes a second user to print an image sent from a first user. The processor executes a proposal process of proposing, to a second user, information on an image to be sent to the second user, information on a print setting, or information on a material to be used for printing, based on an action history of a first user regarding the image and an action history of the second user regarding the image.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an information processing apparatus, an information processing method, a program, and a recording medium for printing an image. [Background technology]

[0002] With the spread of network communication technology, it has become possible in recent years for users to send images to each other and for one user to print an image provided by another user (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-192016 Summary of the Invention [Problem to be solved by the invention]

[0004] In the network printing technology described in Patent Document 1, if information about image usage can be proposed to users who provide images or users who are recipients of images, it would be possible to promote the use of network printing. In this case, it is desirable that the information proposed to users be appropriately determined.

[0005] The present invention has been made in consideration of the above circumstances, and specifically aims to provide an information processing device, information processing method, program, and recording medium that can propose appropriate information to users in network printing technology. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the information processing device of the present invention is an information processing device that includes a processor and causes a second user to print an image sent from a first user, and is characterized in that the processor executes a proposal process that proposes to the first user or the second user information regarding the image to be sent to the second user, information regarding print settings, or information regarding materials to be used for printing, based on the first user's behavioral history regarding the image and the second user's behavioral history regarding the image.

[0007] The processor may further perform a process of identifying attributes of the second user from the behavior history of the second user. In this case, the suggestion process may preferably suggest information according to the attributes to the first user or the second user.

[0008] The processor may also execute an estimation process to estimate a relationship between the first user and the second user based on the behavioral history of the first user and the behavioral history of the second user. In this case, the suggestion process may preferably suggest information according to the relationship to the first user or the second user. Furthermore, in the identification process, psychological attributes of the second user may be identified as the attributes of the second user. In this case, it is preferable that in the suggestion process, information corresponding to the psychological attributes based on the relationship among the psychological attributes of the second user is suggested to the first user or the second user.

[0009] The behavior history of the first user may include a history of printing images performed by the first user and a history of sending images from the first user to the second user, and the behavior history of the second user may include a history of printing images taken by the second user and a history of printing images sent from the first user. Furthermore, the behavior history of the second user may further include a history of images sent from the second user to the first user.

[0010] The processor may further perform a selection process to select candidate images to be transmitted to the second user from a group of images acquired by the first user based on the behavioral history of the first user and the behavioral history of the second user. In this case, the suggestion process preferably suggests information about the candidate images to be transmitted to the first user or the second user. Furthermore, in the selection process, a plurality of relevant images that satisfy a predetermined condition may be identified from the group of images, and a candidate image for transmission may be selected from the plurality of relevant images. Furthermore, in the selection process, a plurality of relevant images may be identified based on the shooting date and time of each of the above-mentioned image group.

[0011] The resource may also be a medium on which the image is to be printed. In this case, the suggestion process may suggest to the first user or the second user information about the type of medium to be used for printing. More preferably, in the proposal process, it is preferable to propose to the first user or the second user information regarding the type of medium corresponding to an image selected from the group of images acquired by the first user based on the behavioral history of the first user and the behavioral history of the second user.

[0012] Furthermore, the items of information proposed in the proposal process or the frequency of execution of the proposal process may be set based on the behavior history of the first user and the behavior history of the second user.

[0013] In addition, in order to solve the above-mentioned problems, the information processing method of the present invention is an information processing method in which a second user prints an image sent from a first user, and is characterized in that a processor executes a suggestion process to suggest to the first user information regarding the image to be sent to the second user, information regarding print settings, or information regarding materials to be used for printing, based on the first user's behavioral history regarding the image and the second user's behavioral history regarding the image.

[0014] In the information processing method, the processor may execute an estimation process to estimate a relationship between the first user and the second user based on the behavioral history of the first user and the behavioral history of the second user. In this case, it is preferable that the suggestion process suggests information according to the relationship to the first user or the second user.

[0015] In the above information processing method, the processor may further execute a selection process to select candidate images to be transmitted to the second user from a group of images acquired by the first user based on the behavioral history of the first user and the behavioral history of the second user. In this case, it is preferable that the suggestion process suggests information about the candidate images to be transmitted to the first user or the second user.

[0016] In the information processing method, the resource may be a medium on which the image is printed. In this case, the suggestion process preferably suggests to the first user or the second user information about the type of medium to be used for printing.

[0017] According to the present invention, it is also possible to realize a program for causing a computer to execute each process included in the above-described information processing method. Furthermore, according to the present invention, it is also possible to realize a computer-readable recording medium on which a program for causing a computer to execute each process included in the above-described information processing method is recorded. [Effects of the Invention]

[0018] According to the present invention, in a network printing system in which an image sent from a first user is printed by a second user, appropriate information can be proposed to the first user or the second user. [Brief explanation of the drawings]

[0019] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an image print system. [Figure 2] FIG. 10 is a diagram showing the procedure for printing an image. [Figure 3]1 is a diagram illustrating a hardware configuration of an information processing apparatus according to an embodiment of the present invention. [Figure 4] FIG. 2 is a diagram illustrating functions of an information processing device according to an embodiment of the present invention. [Figure 5A] FIG. 10 is a diagram showing an example of an action history (photographing history) relating to images. [Figure 5B] FIG. 10 is a diagram showing an example of an action history (reception history) relating to an image. [Figure 5C] FIG. 10 is a diagram showing an example of an action history (transmission history) relating to an image. [Figure 5D] FIG. 10 is a diagram showing an example of an action history (print history) relating to an image. [Figure 6] FIG. 2 is a diagram of an information processing flow according to one embodiment of the present invention. [Figure 7] FIG. 10 is a diagram showing the results of estimation of relationships between users. [Figure 8] FIG. 10 is an explanatory diagram of a procedure for selecting a transmission candidate image. DETAILED DESCRIPTION OF THE INVENTION

[0020] Specific embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are merely examples given to facilitate understanding of the present invention and are not intended to limit the present invention. Furthermore, the present invention may be modified or improved from the following embodiments without departing from the spirit of the present invention. Furthermore, the present invention includes equivalents thereof.

[0021] In this specification, the concept of "device" includes a single device that performs a specific function by itself, as well as multiple devices that exist independently and in a distributed manner but cooperate (link) to perform a specific function.

[0022] In this specification, unless otherwise specified, "image" refers to image data, including, for example, lossy compressed image data such as JPEG (Joint Photographic Experts Group) format, and lossless compressed image data such as GIF (Graphics Interchange Format) or PNG (Portable Network Graphics) format.

[0023] In this specification, a "user" refers to a user who uses the information processing device of the present invention. Using the information processing device means using the functions of the information processing device, and includes not only directly operating the information processing device but also using the functions of the information processing device from other devices (e.g., a user terminal).

[0024] In this specification, attributes include demographic attributes and psychographic attributes. Demographic attributes include, for example, social status such as age, gender, address, and occupation, and family structure. Psychological attributes include, for example, interests, tastes (preferences), hobbies, concerns, behavioral patterns, and trends in awareness or attitude.

[0025] <Image print system configuration> The present invention is an information processing technology relating to the transmission, reception, and printing of images, and is specifically applied to an image print system S shown in Fig. 1. The image print system S is a network print system in which an image is sent from one user to another user via a network, and the image is printed by the user who receives the image. Note that "sending an image from a user" is synonymous with sending an image from a device used by the user. Also, "sending an image to a user" is synonymous with sending an image to a device used by the user. An example of a device used by a user is the user terminal 10 described below, but it may also include a device that is not owned by the user but can be used by logging in by entering a PIN or account information, such as a terminal installed in a store.

[0026] The image print in the present invention is, for example, an instant photography print. Specifically, a latent image is formed by exposing a photosensitive film F, and a developer pot provided at the end of the film is broken to allow the developer in the pot to spread onto the film surface, thereby forming a visualized image from the latent image. Note that the printing method is not limited to the instant photography method, and may be an inkjet method, a dye-sublimation thermal transfer method, an electrophotographic method using toner, or the like.

[0027] Photosensitive film F is an example of a medium on one surface of which an image is formed (hereinafter referred to as the image forming surface), and is also called instant color film, and is a film for portable printers 12. There are multiple types of photosensitive film F, and each type of film has a different color (background color), design, picture or pattern, etc., of the frame area on the image forming surface. The frame area is a rectangular frame-shaped area on the image forming surface that surrounds the central area where the image is formed.

[0028] The image print system S is made up of a user terminal 10 and a portable printer 12 used by each user, and a server computer 16 that can communicate with the user terminal 10 via a network 14.

[0029] The user terminal 10 is a computer used by a user, and specifically, is configured as a smartphone, a tablet terminal, a notebook PC (Personal Computer), or the like. The user terminal 10 is equipped with a processor, memory, and a communication interface. The user terminal 10 also stores an application program (hereinafter simply referred to as a terminal-side program) for using an image print service provided by a server computer 16. The image print service is a cloud service related to sending and receiving images, editing images, and printing images.

[0030] By starting the terminal-side program and operating the user terminal 10, each user can send images they own to other users, edit images, and print images. Editing an image means, for example, superimposing text information (a text message) on an image before editing (hereinafter referred to as the original image). When printing an image, the original image or an edited image may be printed, or a collage print may be performed in which multiple images are combined and printed as a single image. An example of a collage print is printing an original image or an edited image superimposed on a frame image (hereinafter referred to as a template image) that decorates the edges of the image formation area. The user can set whether or not to use a template image in the print and the type of template image when printing.

[0031] Furthermore, if the user terminal 10 is equipped with a camera, the user can take images using the user terminal 10. Furthermore, by connecting a photographic device such as a digital camera to the user terminal 10, the user can import images taken by the photographic device into the user terminal 10. In this way, the user can acquire images, and by increasing the number of times images are acquired, an image group consisting of two or more images can be acquired.

[0032] A user terminal 10 can transmit one or more images selected by the user from a group of images acquired by the user to another user terminal 10. The group of images acquired by the user may be stored in a server computer 16.

[0033] The portable printer 12 stores an unused photosensitive film F inside the printer, and prints an image (positive image) on the image forming area of ​​the photosensitive film F by operating an exposure head and a transport mechanism (not shown) provided inside the printer. The portable printer 12 is wirelessly connected to the user terminal 10 via Wi-Fi (registered trademark) or Bluetooth (registered trademark). The portable printer 12 and the user terminal 10 may also be connected via a wired connection.

[0034] The portable printer 12 performs a printing operation in response to a print request from the user terminal 10. Specifically, when the user designates an image to be printed (hereinafter referred to as a target image) through the user terminal 10 and requests printing of the target image, the portable printer 12 prints the target image on a photosensitive film F.

[0035] Photosensitive film F is sold in sets of, for example, several sheets, and the user opens a packaging box or the like and sets one set of photosensitive film F in the portable printer 12. Thereafter, each time an image is printed, one sheet of photosensitive film is consumed, and the exposed and developed photosensitive film F is ejected from the portable printer 12. Then, when the photosensitive film stored in the portable printer 12 runs out, a new set of photosensitive film F is set (refilled) in the portable printer 12.

[0036] In the above embodiment, the device (printer) that prints images is the portable printer 12 owned by the user, but this is not limited to this and any device that the user can use to print images may be used. For example, it may be a home printer installed in the user's home, or a store-installed printer that the user can use when visiting a store, etc. In this specification, the act of the user printing an image using the portable printer 12, a home printer, a store-installed printer, etc. is referred to as "printing an image on the user's side."

[0037] The server computer 16 is a computer that provides a platform for an image print service, which is a cloud service. Specifically, the server computer 16 relays the transmission and reception of images between users and also executes processing related to printing of the images on the side of the user (receiver) who receives the images.

[0038] The server computer 16 also stores information about users who use the image print service, specifically, user registration information including gender, age, etc., and the user's image-related behavior history for each user. The user's behavior history includes a reception history of images received by the user, a transmission history of images sent by the user, and a print history of images printed by the user.

[0039] Note that information about users, including behavioral history, etc., may be stored in the user terminal 10 of each user or the portable printer 12. In this case, the server computer 16 may acquire the information about users stored in the user terminal 10 by communicating with the user terminal 10.

[0040] Furthermore, the server computer 16 has a function for analyzing information about the user and images sent, received, or printed by the user. Furthermore, the server computer 16 has a function for suggesting useful information to the user regarding the sending, receiving, and printing of images by the user based on the results of the analysis. This function is available through an API (Application Programming Interface) installed in the server computer 16. The user can check the suggestions from the server computer 16 on the user terminal 10 through the API. Providing information to a user means, for example, transmitting information (more specifically, data indicating the information) to a device used by the user and causing the device to output the information. The method of outputting the information is not particularly limited, and for example, the information may be displayed on a display screen, or audio corresponding to the information may be reproduced and emitted from a speaker or the like.

[0041] <Sending and receiving images and printing images> Next, transmission and reception of images between users and printing of images performed through the image print service will be described with reference to Fig. 2. The following description will mainly focus on the GUI (Graphical User Interface) displayed on the screen of the user terminal 10.

[0042] In the following, we will take the example of a case where images are sent and received between two users, and refer to one user as the “first user” and the other user as the “second user.” The first user and the second user are relative concepts, and a user who is the first user at one point in time may be the second user at another point in time.

[0043] Note that the content described below is not limited to cases where images are sent and received between two users, but can also be applied to cases where one first user sends and receives images between multiple second users.

[0044] When using the image print service, both the first user and the second user download the terminal-side program from a predetermined site (for example, an introduction site for the image print service) and install it on the user terminal 10. When obtaining (downloading) the terminal-side program, each of the first user and the second user may perform an input operation for account registration, such as name, age, and gender. In this case, the input information may be saved in the server computer 16.

[0045] Thereafter, when the second user starts the terminal-side program and creates a folder for receiving images (hereinafter referred to as an inbox for convenience), the information is notified to the first user, as shown in Fig. 2. The means of notification at this time is not particularly limited, and may be, for example, sending an email or posting a message on a social networking service (SNS) linked to the image print service.

[0046] When the first user starts the terminal-side program and then performs a predetermined operation, a list LI of images owned by the first user is displayed on the user terminal 10 of the first user, as shown in Fig. 2. The first user selects an image to send to the second user from the list LI and performs an operation for sending the image (for example, an operation of pressing a send button). As a result, the image selected by the first user is sent to the user terminal 10 of the second user. The group of images owned by the first user (i.e., the multiple images displayed in the list LI) may be images saved on the first user's user terminal 10, or may be images uploaded and stored on the server computer 16.

[0047] When the user terminal 10 of the second user receives the image sent from the first user (hereinafter referred to as the received image), it saves the received image in its inbox and notifies the second user of this fact. The notification method at this time is not particularly limited, and may be displayed on the screen of the terminal-side program as shown in Figure 2, or may be to light up a notification lamp provided on the portable printer 12 used by the second user.

[0048] The second user checks the newly received image saved in the inbox through the screen of the terminal-side program, and if he / she wishes to print the received image, he / she performs an operation to request printing (for example, pressing the print button). As a result, the image to be printed and a print request (print command) are sent from the second user's user terminal 10 to the second user's portable printer 12.

[0049] In accordance with the print request, the portable printer 12 prints the received image onto the photosensitive film F. By the printing operation of the portable printer 12, the second user can obtain the photosensitive film F on which the image sent from the first user (the received image) is printed. When the second user has completed printing the image, the first user may be notified of this information.

[0050] The above procedure is an example of a case where a first user sends an image to a second user and the second user prints the image, but the procedure is similar when a second user sends an image to a first user and the first user prints the image. In other words, the first user and the second user may send images to each other (bidirectionally).

[0051] <Configuration of an information processing device according to an embodiment of the present invention> An information processing device according to one embodiment of the present invention is configured by a computer, for example, a server computer 16. The number of computers configuring the information processing device may be one or two or more. That is, the information processing device is realized by a processor and a program executable by the processor, and is configured by, for example, a general-purpose computer.

[0052] As shown in FIG. 3, the server computer 16 constituting the information processing device includes a processor 16A, a memory 16B, a communication interface 16C, a storage device 16D, and the like.

[0053] The processor 16A is configured by, for example, a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), or a tensor processing unit (TPU). The memory 16B is configured by, for example, semiconductor memory such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The communication interface 16C is configured by, for example, a network interface card or a communication interface board. The storage device 16D is configured, for example, by a storage device built into or externally attached to the server computer 16. However, without being limited to this, the storage device 16D may also be configured by a third computer (for example, an external server) that can communicate with the server computer 16.

[0054] In addition, a program (hereinafter referred to as a server-side program) for functioning as the information processing device of the present invention is installed in the server computer 16. The server-side program is a program for causing a computer to execute each process included in the information processing method of the present invention. That is, when the processor 16A reads and executes the server-side program, the server computer 16 can provide an image print service.

[0055] The server-side program may be acquired by reading it from a computer-readable recording medium, or by receiving (downloading) it via a communication line such as the Internet or an intranet.

[0056] The configuration of the server computer 16 that constitutes the information processing device will be explained again from a functional perspective. As shown in Fig. 4, the server computer 16 has an acquisition unit 21, a storage unit 22, an identification unit 23, an estimation unit 24, a selection unit 25, a proposal unit 26, and a setting unit 27. These functional units are realized by cooperation between hardware devices included in the server computer 16 and software including the server-side program described above.

[0057] Each functional unit will be described below. Note that the following description will be given assuming a case where an image sent from a first user is printed by a second user. In the following description, the user terminal 10 of the first user will be referred to as the "first terminal 10A," and the user terminal 10 of the second user will be referred to as the "second terminal 10B."

[0058] (Acquisition Department) The acquisition unit 21 acquires registration information and image-related behavior history for each of the first user and the second user. The registration information for each user includes the gender, age, etc. of each user, and is input through the user terminal 10 when each user starts using the image print service. The acquisition unit 21 acquires the input registration information from the first terminal 10A and the second terminal 10B.

[0059] The action history relating to images includes a history relating to image capture (capture history), a history relating to image reception (reception history), a history relating to image transmission (transmission history), and a history relating to image printing (print history).

[0060] 5A, the shooting history is information including the subject appearing in the captured image, the shooting scene, the user who took the photo, the shooting date and time, etc. The method and timing for acquiring the shooting history are not particularly limited, but for example, when a user takes an image using the user terminal 10, the acquisition unit 21 may acquire a history (record) for one shooting from the user terminal 10.

[0061] 5B, the reception history includes the subject appearing in the received image, the shooting scene of the received image, the user who is the recipient, the user who is the sender of the received image, the shooting date and time of the received image, etc. The method and timing of acquiring the reception history are not particularly limited, but for example, when the user receives an image at the user terminal 10, the acquisition unit 21 may acquire a history (record) of one image reception from the user terminal 10.

[0062] 5C, the transmission history includes the subject appearing in the transmitted image, the shooting scene of the transmitted image, the user who sent it, the user to whom the transmitted image is to be sent, the shooting date and time of the transmitted image, etc. Regarding the method and timing of acquiring the transmission history, for example, when a user sends an image using the user terminal 10, the acquisition unit 21 may acquire a history (record) of one image transmission from the user terminal 10.

[0063] 5D, the print history includes the subject appearing in the printed image, the shooting scene of the image, the user who performed the print, the user who provided the printed image, the number of prints, and the date and time when the printed image was taken. The method and timing of acquiring the print history are not particularly limited, but for example, when a user operates the user terminal 10 to print an image, the acquisition unit 21 may acquire a history (record) of one print from the user terminal 10. The print history may also be acquired from the portable printer 12 that printed the image.

[0064] Incidentally, the subject and the photographed scene in an image can be identified by analyzing the image using known subject recognition technology and known scene recognition technology. The image analysis may be performed on the user terminal 10 side or on the server computer 16 side. Furthermore, when the subject and the photographed scene in an image are identified, the identification results may be added to the image as tag information. For images to which this tag information is added, the various behavioral histories described above can be easily obtained.

[0065] The acquisition unit 21 acquires, as the behavior history of the first user, a history of printing of images performed by the first user (print history) and a history of sending of images from the first user to the second user (transmission history). The acquisition unit 21 may further acquire, as the behavior history of the first user, a history of images taken by the first user (photography history) and a history of images received from the second user (reception history).

[0066] Furthermore, the acquisition unit 21 acquires, as the behavior history of the second user, a history (print history) regarding printing of images taken by the second user and a history (print history) regarding printing of images sent from the first user. The acquisition unit 21 may further acquire a history (transmission history) regarding transmission of images from the second user to the first user as the behavior history of the second user.

[0067] (Storage part) The storage unit 22 stores the behavior history (more specifically, the behavior history related to images) of each of the first and second users acquired by the acquisition unit 21. The behavior history of each user may be stored in the user terminal 10 of each user. In this case, it is preferable to communicate with the user terminal 10 of each user and read out the behavior history of each user from the user terminal 10 as needed.

[0068] Furthermore, images taken by each of the first and second users may be stored in the storage unit 22. Alternatively, images sent by one of the first and second users to the other may be stored in the storage unit 22.

[0069] (Specific part) The identification unit 23 executes an identification process to identify attributes of each of the first user and the second user based on the behavioral histories of the first user and the second user acquired by the acquisition unit 21. The attributes identified in the identification process include demographic attributes such as age and family structure, and psychological attributes such as hobbies and preferences. Preferences (tastes) are preferences for specific targets, and examples of preference targets include people, objects, and events. Examples of preference targets include one's own children or grandchildren. Examples of preference targets include landscapes such as mountains and the sea, and scenes such as daytime and evening. Examples of preference targets include events and special events such as travel, sports days, and fireworks. The preference targets identified in the identification process are events that can be estimated from the above objects.

[0070] In the identification process, the identification unit 23 identifies demographic and psychological attributes of the first user from the print history of the first user. For example, if the first user routinely prints pictures of children, it is identified that the first user is a parent and that the first user's preference (interest) is their own children. Also, if the first user frequently prints pictures of pets and cooking, it is identified that the first user's hobbies are pets and cooking.

[0071] In addition, in the identification process, the identification unit 23 identifies the demographic and psychological attributes of the second user from the print history of the second user. For example, if the second user prints many images of scenery from travel destinations and the printed images frequently feature elderly people, it is identified that the second user is of the senior generation and that the second user's preference is travel. Also, if the second user of the senior generation frequently prints images of children, it is identified that the second user's preference (interest) is children, or more specifically, their own grandchildren.

[0072] The method for identifying attributes from behavioral histories is not particularly limited, but for example, machine learning may be performed on the behavioral tendencies of people with certain attributes (more specifically, behavioral tendencies related to images). In this case, it is preferable to understand the correspondence between the behavioral histories and attributes from the results of the machine learning, and identify the attributes from the behavioral history based on the correspondence.

[0073] (Estimation Department) The estimation unit 24 executes an estimation process and estimates the relationship between the first user and the second user based on the behavioral histories of the first user and the second user acquired by the acquisition unit 21.

[0074] Specifically, in the estimation process, the estimation unit 24 refers to the sending history of the first user and the printing history of the second user. Here, the sending history of the first user is a history of sending images from the first user to the second user, and the printing history of the second user is a history of printing images sent from the first user. The estimation unit 24 then estimates the relationship between the first user and the second user based on the sending history of the first user and the printing history of the second user. At this time, the estimation unit 24 takes into account the attributes (such as age and preferences) of the first user and the second user identified by the identification unit 23.

[0075] For example, if a first user regularly sends images of a child to a second user, and the second user frequently prints the images of the child sent by the first user, the estimation unit 24 estimates that the relationship between the first user and the second user is that of a parent and a grandparent.

[0076] Furthermore, when a first user and a second user mutually send images, the estimation unit 24 estimates the relationship between the first user and the second user in the estimation process based on the sending history and receiving history of the first user and the print history of the second user. Here, the receiving history of the first user is a history of receiving images sent from the second user. For example, suppose that the first user and the second user mutually send images of the same soccer team, and the second user frequently prints images of the soccer team. In this case, the estimation unit 24 estimates that the relationship between the first user and the second user is that they are both fans of the soccer team.

[0077] The method for estimating the relationship between users from the behavioral history is not particularly limited, but for example, several patterns of the relationship between users may be set in advance, and conditions for the behavioral history may be determined for each pattern. Then, if the behavioral history satisfies the conditions of any of the patterns, the relationship of that pattern may be estimated as the relationship between the users.

[0078] Furthermore, when estimating the relationship between users, the estimation unit 24 may take into account the frequency of image transmission and reception between users, the frequency of printing, the number of prints, etc. For example, the estimation unit 24 may estimate that the relationship between users is deeper as the frequency of transmission and reception increases. Furthermore, when estimating the relationship between users, the estimation unit 24 may place emphasis on image content (specifically, the subject and the photographed scene) that is frequently printed or has a high number of prints.

[0079] Furthermore, when estimating the relationship between users, the estimation unit 24 may take into consideration the registered information of each user (specifically, gender, age, etc.) in addition to the behavioral history of each user. Furthermore, if the image printed by the second user is an edited image, for example, an image with a text message added, the estimation unit 24 may take into consideration the content of the text message when estimating the relationship between users.

[0080] (Selection Department) The selection unit 25 executes a selection process and selects candidate images to be sent to the second user from the group of images acquired by the first user based on the behavior history of the first user and the behavior history of the second user.

[0081] Specifically, the selection unit 25 selects a candidate image to be transmitted based on the relationship between users estimated by the estimation unit 24 and the attributes of the second user identified by the identification unit 23. Here, the attributes of the second user are psychological attributes, more specifically, preferences and hobbies, and more specifically, preferences and hobbies based on the relationship between users.

[0082] For example, suppose that the second user's preferences are identified as "children (grandchildren)" and "pets," and the relationship between the first user and the second user is estimated to be that of parent and grandparent. In this case, the second user's preference based on the relationship between the first user and the second user is "children (grandchildren)." As a result, the selection unit 25 selects images of children (more specifically, images of children that have not yet been sent to the second user) from the group of images acquired by the first user as candidate images to be sent to the second user.

[0083] Furthermore, suppose that the second user's preferences are identified as "a specific soccer team" and "food," and that the relationship between the first user and the second user is estimated to be that they are fans of the same soccer team. In this case, the second user's preference based on the relationship between the first user and the second user is "a specific soccer team." As a result, the selection unit 25 selects images of the soccer team (more specifically, images that have not yet been sent to the second user) from the group of images acquired by the first user as candidate images to be sent to the second user. Furthermore, in the above case, it is assumed that the first user and the second user are sending images to each other. In this case, the selection unit 25 may select, from the group of images acquired by the second user, an image of the soccer team (more specifically, an image that the first user has not yet acquired), as a candidate image to be sent to the first user.

[0084] Alternatively, the selection unit 25 may identify a plurality of relevant images that satisfy a predetermined condition from among the group of images acquired by the first user, and select a candidate image to be sent from among the plurality of relevant images. Specifically, the selection unit 25 identifies the shooting date and time of each of the group of images acquired by the first user. The shooting date and time of each image can be identified, for example, from tag information in the Exchangeable Image File Format (Exif) format added to the image.

[0085] Then, the selection unit 25 identifies multiple relevant images based on the subjects and shooting scenes of images captured on the same shooting date or on two or more consecutive shooting dates. For example, suppose an important event such as the birthday or athletic meet of the first user's child is held, and the first user takes multiple images (specifically, images of the child) on the day the event is held. The selection unit 25 may identify the multiple images captured on the event day as relevant images, and select candidate images to be sent to the grandparents, who are the second users, from the multiple relevant images.

[0086] In the above embodiment, images captured on the same capture date or two or more consecutive capture dates are identified as relevant images based on the capture dates and times of the group of images acquired by the first user, but this is not limiting. For example, an image that includes a subject that appears most frequently among the group of images may be identified as the relevant image. The conditions for identifying the relevant image may be set in advance, specifically, may be set before the relevant image is identified. The conditions may be set automatically by a function of the server computer 16, or may be set based on an input from the first or second user.

[0087] (Proposal Department) The suggestion unit 26 executes a suggestion process and suggests information about printing by the second user to the first user or the second user based on the behavioral history of the first user and the behavioral history of the second user. The information suggested by the suggestion unit 26 is information about images sent from the first user to the second user, information about print settings, or information about materials used for printing. The suggestion unit 26 may suggest one or two, or all three types of information out of these three types of information to the first user or the second user.

[0088] In the following, a case where information is proposed to a first user will be described as an example, but the contents described below can also be applied to a case where information is proposed to a second user.

[0089] Information about an image sent from a first user to a second user (hereinafter, "suggested image information") is information about an image to be sent that has been selected by the selection unit 25. As described above, the image to be sent is selected based on the behavioral history of the first user and the behavioral history of the second user, and more specifically, is selected according to the psychological attributes (preferences) of the second user based on the relationship between the users. In other words, the suggested image information is information according to the relationship between the users and the psychological attributes of the second user.

[0090] Furthermore, the information relating to print settings (hereinafter, proposed setting information) includes, for example, settings for collage printing using images sent from the first user, such as information relating to the type of template image to be used for collage printing.

[0091] Furthermore, the information on the materials used for printing (hereinafter referred to as proposed material information) includes, for example, information on the type of photosensitive film F used to print the image sent from the first user. Here, the type of photosensitive film F proposed corresponds to the image to be sent selected by the selection unit 25, i.e., the image selected based on the behavior history of the first user and the behavior history of the second user.

[0092] Specifically, the subject and shooting scene of an image are classified into several categories, the type of photosensitive film F suitable for each category is determined in advance, and the correspondence between the category and the film type is stored as an LUT (Look Up Table). From this LUT, the type of photosensitive film F corresponding to the category to which the image candidate for transmission belongs is identified. However, this is not limited to this, and for example, machine learning may be performed on the correspondence between the subject and shooting scene of a printed image and the type of photosensitive film F used for the print. In this case, the type of photosensitive film F corresponding to the image candidate for transmission may be identified using the results of the machine learning.

[0093] (Settings section) The setting unit 27 executes a setting process to set the information items to be proposed to the first user by the proposal unit 26 in the proposal process, or the frequency of execution of the proposal process. Setting the information items means setting which information to propose from among proposed image information, proposed setting information, and proposed material information. The setting unit 27 may set both the information items to be proposed and the frequency of execution of the proposal process.

[0094] In the setting process, the setting unit 27 sets items of information to be proposed or the frequency of execution of the proposed process based on the behavioral history of the first user and the behavioral history of the second user, more specifically, the relationship between the users estimated from the behavioral history of each user. For example, if the relationship between the users is that between parents and grandparents, the setting unit 27 sets suggested image information and suggested material information as items of information to be proposed.

[0095] Furthermore, when the relationship between the users is that of friends, the setting unit 27 sets the execution frequency of the suggested process to be relatively low. On the other hand, when the relationship between the users is that of parents and grandparents, the setting unit 27 sets the execution frequency of the suggested process to be relatively high.

[0096] The procedure for setting the execution frequency of the proposed process is not particularly limited. For example, the relationships between users may be divided into several patterns, the execution frequency may be determined in advance for each pattern, and the correspondence between the patterns and the execution frequencies may be stored as an LUT. In this case, the execution frequencies corresponding to the relationships between users may be set from the LUT. However, without being limited to this, machine learning may be performed on the correspondence between the patterns and the execution frequencies, and the execution frequencies corresponding to the relationships between users may be set based on the results of the machine learning.

[0097] <Information processing flow according to one embodiment of the present invention> An information processing flow (hereinafter referred to as the proposed flow) by an information processing device according to one embodiment of the present invention will be described. The proposed flow employs the information processing method of the present invention. In other words, each step in the proposed flow corresponds to a component of the information processing method of the present invention.

[0098] The proposed flow proceeds as shown in FIG. 6, and each step in the flow is executed by a processor of a computer (for example, the server computer 16) that constitutes the information processing device.

[0099] For ease of understanding, the following description will be given taking as an example a case where the first user is user A, the second users are users B and C, and user A sends an image to users B and C.

[0100] The proposed flow is executed based on, for example, the intention of user A, and is started, for example, when user A performs a predetermined operation on first terminal 10A. However, the proposed flow is not limited to this, and may be executed periodically at a fixed cycle. In the proposed flow, first, the processor acquires the image-related behavior history, specifically the shooting history, receiving history, sending history, and printing history, for each of users A, B, and C (S001).

[0101] Next, the processor executes an identification process to identify the attributes of each of users A, B, and C based on the behavioral history acquired in step S001 (S002). In step S002, the attributes of each user, specifically, their age group and preferences, are identified based on the print history of each user. For example, suppose that the print history of user A reveals that user A frequently prints images of children and images of cooking. In this case, user A's attributes are identified as being of the parent generation and their preferences (interests) are children and cooking.

[0102] Similarly, in step S002, the attributes of users B and C are identified from the print histories of users B and C. In the following, it is assumed that user B's attributes are identified as being of the senior generation and his preferences are travel and children (grandchildren), and user C's attributes are identified as being of the parent generation and his preferences are cooking.

[0103] Next, the processor executes an estimation process to estimate the relationship between user A and user B and the relationship between user A and user C based on the behavioral history of each user acquired in step S001 (S003). To explain step S003 in an easy-to-understand manner, assume a case in which user A unilaterally sends images to user B. In this case, the relationship between user A and user B is estimated based on the history of image transmission from user A to user B and the history of user B printing the images sent from user A. At this time, the attributes (e.g., age and preferences) of users A and B identified in step S002 are taken into consideration. For example, assume that user A periodically sends images of their children to user B, and user B frequently prints the images of their children sent by user A. In this case, the relationship between user A and user B is estimated to be that of parent and grandparent, as shown in FIG. 7.

[0104] On the other hand, if we consider a case where user A and user C mutually send images, the relationship between the first user and the second user is estimated based on user A's sending history and receiving history and user C's printing history. At this time, the attributes (age, preferences, etc.) of users A and C identified in step S002 are taken into consideration. For example, suppose user A and user C send each other images of food, and user C frequently prints out images of food. In this case, the relationship between user A and user C is estimated to be that of friends who love cooking, as shown in FIG. 7.

[0105] Thereafter, the processor executes a selection process to select candidate images for transmission from the group of images acquired by user A based on the behavioral history of each user (S004). In this step S004, candidate images for transmission are selected for each of users B and C. Candidate images for transmission to user B are selected based on the relationship between user A and user B estimated in step S003 and the attributes (preferences) of user B identified in step S002. More specifically, candidate images for transmission to user B are selected based on the preference of user B taking into account the relationship between user A and user B. For example, if user B's preference taking into account the relationship between user A and user B is "children (grandchildren)," then, as shown in FIG. 8, images of children are selected from the group of images of user A as candidate images for transmission to user B.

[0106] Similarly, candidate images to be sent to user C are selected based on the preference of user C in consideration of the relationship between user A and user C. For example, if user C's preference in consideration of the relationship between user A and user C is "cooking," then, as shown in FIG. 8, from the group of user A's images, images of cooking are selected as candidate images to be sent to user C.

[0107] Furthermore, in step S004, the processor may identify the shooting date and time of each of the group of images of user A, and identify multiple relevant images based on the subjects and shooting scenes of images taken on the same shooting date or two or more consecutive shooting dates. For example, suppose that an important event such as user A's child's birthday or a sports day is held, and user A takes multiple images on the day of the event. In this case, the multiple images taken on the day of the event may be identified as multiple relevant images, and candidate images to be sent to user B may be selected from the multiple relevant images.

[0108] Next, the processor executes a setting process to set the information items to be proposed in the subsequent proposal process or the execution frequency of the proposal process (S005). In this step S005, the information items to be proposed or the execution frequency of the proposal process are set based on the behavioral history of each user, more specifically, the relationship between the users estimated in step S003. For example, if the relationship between user A and user B is that of parent and grandparent, then proposed image information and proposed material information are proposed, and the execution frequency of the proposal process is set relatively high. On the other hand, if the relationship between user A and user C is that of friends, then proposed image information is proposed, and the execution frequency of the proposal process is set relatively low.

[0109] Next, the processor executes a proposal process to propose information of the items set in step S005 to user A (S006). In this step S006, information is proposed to each of users B and C according to the contents set in step S005.

[0110] Specifically, with regard to user B, information about the images selected in step S004 as candidates for transmission to user B, as well as information about the types of photosensitive film F corresponding to the images, are proposed to user A. On the other hand, with regard to user C, information about the images selected in step S004 as candidates for transmission to user C is proposed to user A.

[0111] Then, the proposed process is executed at the execution frequency set in step S005 for each of users B and C. That is, the proposed process is executed relatively frequently for user B, and relatively infrequently for user C.

[0112] The proposed flow described above ends when, for example, user A performs an operation to request the end of the flow.

[0113] <Effectiveness of one embodiment of the present invention> In one embodiment of the present invention, in a network printing system in which a second user prints an image sent from a first user, predetermined information can be proposed to the first user. Specifically, information (proposed image information) about the image to be sent to the second user, more specifically, about images that are candidates for transmission to the second user, can be proposed. This allows the first user, who is the image sender, to appropriately decide which image to send to the second user, based on the proposed information. As a result, the use of network printing can be promoted.

[0114] In one embodiment of the present invention, information (proposed setting information) regarding print settings, such as whether or not to perform collage printing and the type of template image to be used for collage printing, can be proposed. This allows a first user who is the image sender to know a template image that is suitable for a second user to receive the image for collage printing. As a result, the first user can send a composite image, for example, by combining the template image with an original image, to the second user.

[0115] Furthermore, in one embodiment of the present invention, it is possible to propose information (proposed material information) about materials used for printing, for example, the type of photosensitive film F. This allows a first user who is an image sender to know the type of photosensitive film F that is suitable for the second user to print the image, and, for example, to give that photosensitive film F as a gift to the second user. As a result, it is possible to further promote the use of network printing. The above-mentioned effect is particularly effective when the second user to whom the image is to be sent is someone who is not accustomed to purchasing photosensitive film F, or someone who lives in a place where it is difficult to purchase photosensitive film F, and sends the image to have it printed.

[0116] In one embodiment of the present invention, the above-mentioned proposed information (proposed image information, proposed setting information, and proposed material information) can be proposed to the second user who is the image transmission destination. This allows, for example, the first user to inform the second user of an image to be provided to the second user (i.e., a candidate image for transmission), and the second user can request the first user to provide the image.

[0117] Furthermore, the information to be proposed is determined based on the action history of the first user regarding the image and the action history of the second user regarding the image, thereby making it possible to propose appropriate information to the first user or the second user in consideration of the action history of each of the first user and the second user.

[0118] Here, it is preferable that the behavior history of the first user includes a history of printing images performed by the first user and a history of sending images from the first user to the second user, and it is also preferable that the behavior history of the second user includes a history of printing images taken by the second user and a history of printing images sent from the first user. In the above case, the attributes of each user, particularly psychological attributes such as preferences, can be identified from the behavioral history of each user. As a result, for example, it is possible to select candidate images to send to the second user based on the preferences of the second user, and to propose information about the images to the first user or the second user.

[0119] The behavioral history of the second user may further include a history of image transmission from the second user to the first user. In other words, when the first user and the second user exchange images, this may be reflected in the behavioral history of the second user. This allows for the selection of candidate images to be sent to the second user while taking into consideration the bidirectional transmission of images between the users.

[0120] In one embodiment of the present invention, the relationship between the first user and the second user is estimated from the behavioral history of each of the first user and the second user. Then, based on the second user's preferences in light of the estimated relationship, images to be sent to the second user are selected. This allows images to be selected as transmission candidates that match the second user's preferences while taking into account the relationship between the users. As a result, the use of network printing can be further promoted.

[0121] In one embodiment of the present invention, the shooting date and time of each of the group of images acquired by the first user is identified, and, for example, multiple images (relevant images) captured on the same shooting date and time or two or more consecutive shooting dates and times are identified. Then, from the multiple relevant images, candidate images to be sent to the second user are selected. This makes it possible, for example, to extract images of important events from the group of images of the first user, and select candidate images to be sent from the extracted images.

[0122] In one embodiment of the present invention, the items of information proposed in the proposal process or the frequency of the proposal process are set based on the estimated relationship between the first user and the second user, which allows the content of the proposal or the number of proposals to be adjusted depending on the relationship between the users (more specifically, the depth of the relationship, etc.).

[0123] <Other embodiments> The embodiment described above is a specific example given to clearly explain the information processing device and information processing method of the present invention, and is merely an example, and other embodiments are also possible.

[0124] In the above embodiment, the image sent from the first user to the second user is received by the user terminal 10 (second terminal 10B) of the second user, but this is not limiting. For example, the portable printer 12 of the second user may directly receive the image sent from the first user.

[0125] In the above embodiment, attributes such as preferences of each user are identified from the behavioral history of each of the first user and the second user, and the relationship between the users is estimated. Then, information according to the relationship between the users and the user attributes is proposed to the first user. However, this is not limited to this, and the process of estimating the relationship between the users may be omitted. In other words, the information proposed to the first user may be determined based only on the user's attributes (preferences), without considering the relationship between the users.

[0126] In the above embodiment, the functions of the information processing device of the present invention are performed by a processor provided in a server computer, but this is not limited to this. The processor provided in the information processing device of the present invention may be provided in the user terminal 10 or the portable printer 12 on the user side. In other words, some or all of the above-mentioned functional units provided in the information processing device of the present invention may be provided in the user terminal 10 or the portable printer 12.

[0127] The processor included in the information processing device of the present invention includes various types of processors, including, for example, a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units. The various processors also include PLDs (Programmable Logic Devices), which are processors whose circuit configuration can be changed after manufacturing, such as FPGAs (Field Programmable Gate Arrays). Furthermore, various processors include dedicated electrical circuits such as ASICs (Application Specific Integrated Circuits), which are processors having circuit configurations designed specifically for performing specific processes.

[0128] Furthermore, one processing unit possessed by the information processing device of the present invention may be configured by one of the various processors described above, or may be configured by a combination of two or more processors of the same or different types, for example, a combination of multiple FPGAs, or a combination of an FPGA and a CPU, etc. Furthermore, the multiple functional units of the information processing device of the present invention may be configured by one of various processors, or two or more of the multiple functional units may be collectively configured by one processor. Furthermore, as in the above-described embodiment, one processor may be configured by combining one or more CPUs and software, and this processor may function as multiple functional units.

[0129] Furthermore, for example, a processor may be used that realizes the functions of the entire system including multiple functional units in the information processing device of the present invention on a single IC (Integrated Circuit) chip, as typified by an SoC (System on Chip), etc. Furthermore, the hardware configuration of the various processors described above may be an electric circuit (Circuitry) that combines circuit elements such as semiconductor elements. [Explanation of symbols]

[0130] 10 User terminal 10A Terminal 1 10B Terminal 2 12 Portable Printer 14 Network 16 Server computer (information processing device) 16A processor 16B memory 16C communication interface 16D storage device 21 Acquisition Department 22 Memory section 23 Specific section 24 Estimation part 25 Selection Department 26 Proposal Department 27 Setting section F Photosensitive film S Image Print System

Claims

1. An information processing apparatus including a processor, which causes a second user to print an image sent from a first user, The processor executes a proposal process to propose to the second user information regarding the image to be sent to the second user, information regarding the print settings, or information regarding materials to be used for the print, based on the first user's behavioral history regarding the image and the second user's behavioral history regarding the image.

2. the processor executes a specification process for specifying attributes of the second user from the behavior history of the second user; The information processing device according to claim 1 , wherein the suggestion process proposes the information according to the attribute to the second user.

3. the processor executes an estimation process to estimate a relationship between the first user and the second user based on the behavior history of the first user and the behavior history of the second user; The information processing device according to claim 2 , wherein the suggestion process proposes the information according to the relationship to the second user.

4. In the identification process, a psychological attribute of the second user is identified as the attribute of the second user; The information processing device according to claim 3 , wherein the suggestion process proposes to the second user the information according to the psychological attribute based on the relationship, among the psychological attributes of the second user.

5. The behavior history of the first user includes a history of printing images performed by the first user and a history of sending images from the first user to the second user, The information processing device according to claim 1 , wherein the behavior history of the second user includes a history of printing images taken by the second user and a history of printing images sent by the first user.

6. The information processing device according to claim 5 , wherein the behavior history of the second user further includes a history of image transmission from the second user to the first user.

7. the processor further performs a selection process of selecting, from a group of images acquired by the first user, an image to be transmitted to the second user, based on the behavior history of the first user and the behavior history of the second user; The information processing device according to claim 1 , wherein the suggestion process proposes the information related to the image of the candidate for transmission to the second user.

8. The information processing device according to claim 7 , wherein the selection process identifies a plurality of relevant images from the image group that satisfy a predetermined condition, and selects the transmission candidate image from the plurality of relevant images.

9. The information processing apparatus according to claim 8 , wherein the selection process identifies the plurality of relevant images based on the shooting date and time of each of the group of images.

10. the material being a medium on which an image is printed; The information processing apparatus according to claim 1 , wherein the suggestion process suggests the information regarding the type of the medium used for the printing to the second user.

11. The information processing device described in claim 10, wherein the proposal process proposes to the second user the information regarding the type of medium corresponding to an image selected from the group of images acquired by the first user based on the behavioral history of the first user and the behavioral history of the second user.

12. The information processing device according to claim 1 , wherein the items of information proposed in the proposal process or the frequency of execution of the proposal process are set based on the behavior history of the first user and the behavior history of the second user.

13. An information processing method for causing a second user to print an image sent from a first user, comprising: An information processing method in which a processor executes a suggestion process to suggest to the second user information about an image to be sent to the second user, information about the print settings, or information about materials to be used for the print, based on the first user's behavioral history regarding images and the second user's behavioral history regarding images.

14. an estimation process is executed by the processor to estimate a relationship between the first user and the second user based on the behavior history of the first user and the behavior history of the second user; The information processing method according to claim 13 , wherein the suggestion process proposes the information according to the relationship to the second user.

15. a selection process is further executed by the processor to select candidate images to be transmitted to the second user from a group of images acquired by the first user based on the behavior history of the first user and the behavior history of the second user; The information processing method according to claim 13 or 14, wherein the suggestion process proposes the information related to the image of the candidate for transmission to the second user.

16. the material being a medium on which an image is printed; The information processing method according to claim 13 , wherein the suggestion process suggests the information regarding the type of the medium to be used for the printing to the second user.

17. A program for causing a computer to execute each process included in the information processing method according to any one of claims 13 to 16.

18. A computer-readable recording medium, 17. A recording medium having recorded thereon a program for causing a computer to execute each process included in the information processing method according to any one of claims 13 to 16.

Images