Information processing device, information processing method, recording medium, and information processing system

Abstract

This information processing device includes the following. One or more processors and a non-transitory computer-readable memory for executing instructions, wherein when an instruction is executed by the one or more processors, a plurality of image data and information of a user group associated with the image data are stored in one or more storage devices, candidate image data for posting is generated from image data including the image of a person associated with the user group from one or more image data associated with the user group, a set of candidate image data for posting is presented for presentation on the client device operated by a user belonging to the user group, and an indication regarding selection of the candidate image data for posting is received from the user.

Description

Information processing device, information processing method, recording medium, and information processing system

[0001] The present disclosure relates to an information processing device, an information processing method, a recording medium, and an information processing system.

[0002] Currently, there are services that allow users to easily share private photos and videos with their family members. Users of these services can simply upload images to an album on the Internet and share the uploaded images with their family members.

[0003] Japanese Patent Application Laid-Open No. 2021-57719

[0004] The current service also provides a function to input comments and impressions on images shared among family members (hereinafter referred to as "shared images"), which aims to stimulate communication. However, the use of shared images is limited to viewing and downloading.

[0005] An object of the present disclosure is to provide an information processing device, an information processing method, a recording medium, and an information processing system that can increase opportunities to use shared images.

[0006] An information processing device according to one embodiment of the present disclosure includes: one or more processors and a non-transitory computer-readable memory that executes instructions, which, when executed by the one or more processors, store a plurality of image data and information about a user group associated with the image data in one or more storage devices, generate candidate image data to post from image data including an image of a person associated with the user group among the one or more image data related to the user group, present a set of candidate image data to post for presentation on a client device operated by a user belonging to the user group, and receive an instruction from the user regarding selection of the candidate image data to post.

[0007] According to an embodiment of the present disclosure, opportunities for using shared images can be increased.

[0008] 1 is a diagram illustrating an example of the configuration of an information processing system assumed in embodiment 1. FIG. 1 is a diagram illustrating an example of the functional configuration of a server. FIG. 2 is a diagram illustrating an example of album information. FIG. 3 is a diagram illustrating an example of participating user information. FIG. 4 is a diagram illustrating an example of uploaded image information. FIG. 5 is a diagram illustrating an example of image usage history. FIG. 6 is a diagram illustrating an example of generation of sticker candidates. FIG. 7 is a flowchart illustrating an example of the processing operation of a generation unit and a presentation unit in embodiment 1. FIG. 8 is a diagram illustrating an example of a presentation screen for sticker candidates in embodiment 1. FIG. 9 is a diagram illustrating another example of presentation of sticker candidates. FIG. 10 is a flowchart illustrating an example of the processing operation of a control unit in embodiment 1. FIG. 11 is a diagram illustrating an example of a browsing screen for uploaded images with a display button for sticker candidates. FIG. 12 is a diagram illustrating an example of presentation of sticker candidates assuming posting. FIG. 13 is a diagram illustrating an example of a display screen after posting of sticker candidates. FIG. 14 is a flowchart illustrating an example of the processing operation of a presentation unit in embodiment 2. FIG. 15 is a diagram illustrating an example of presentation of sticker candidates. FIG. 16 is a flowchart illustrating an example of the processing operation of a presentation unit in embodiment 3. FIG. 17 is a flowchart illustrating an example of the processing operation of a presentation unit in embodiment 4. FIG. 18 is a diagram illustrating an example of a presentation screen for sticker candidates in embodiment 4. FIG. 19 is a flowchart illustrating an example of the processing operation of a presentation unit in embodiment 5. FIG. 19 is a diagram illustrating an example of a presentation screen for sticker candidates in embodiment 5. FIG. 14 is a diagram illustrating an example of a presentation screen for sticker candidates in embodiment 7. FIG. 15 is a flowchart illustrating an example of the processing operation of the presentation unit in embodiment 8. FIG. 16 is a flowchart illustrating an example of the processing operation of the presentation unit in embodiment 9. FIG. 17 is a flowchart illustrating internal processing of step 3 specific to embodiment 10. FIG. 18 is a flowchart illustrating an example of the processing operation of the presentation unit in embodiment 11. FIG. 19 is a flowchart illustrating an example of the processing operation of the presentation unit in embodiment 12. FIG. 20 is a flowchart illustrating an example of the processing operation of the presentation unit in embodiment 13. FIG. 21 is a diagram illustrating an example of a screen corresponding to a sticker candidate editing function. FIG. 22 is a diagram illustrating an example of a screen for editing sticker candidates. FIG. 23 is a diagram illustrating an example of a screen after the sticker candidates have been edited. FIG. 24 is a flowchart illustrating an example of the processing operation of the presentation unit in embodiment 14.10 is a diagram illustrating an example of the display of suggested candidates. FIG. 11 is a diagram illustrating an example of a screen after editing sticker candidates. FIG. 12 is a flowchart illustrating an example of the processing operation of the presenting unit in embodiment 15. FIG. 13 is a diagram illustrating screen transitions corresponding to steps 51 and 52. FIG. 14 is a diagram illustrating screen transitions corresponding to steps 61, 62, 54, 55, and 57. FIG. 15 is a diagram illustrating screen transitions corresponding to steps 51 and 52. FIG. 16 is a diagram illustrating screen transitions corresponding to steps 61, 62, 54, 55, and 57. FIG. 17 is a flowchart illustrating an example of the processing operation of the presenting unit in embodiment 16. FIG. 18 is a table illustrating an example of uploaded image information used in embodiment 17. FIG. 19 is a flowchart illustrating an example of the processing operation of the presenting unit and the control unit in embodiment 17. FIG. 19 is a diagram illustrating an example of a viewing screen for uploaded images with a display button for sticker candidates. FIG. 19 is a diagram illustrating display examples of a selection screen corresponding to an instruction to post to people outside the family and a selection screen corresponding to an instruction to post to people within the family. FIG. 19 is a diagram illustrating an example of a warning output when a sticker candidate generated from an uploaded image limited to family members is selected. FIG. 19 is a diagram illustrating an example of a viewing screen for uploaded images on which a display button for a selection screen for reaction sticker candidates is arranged. FIG. 19 is a diagram illustrating an example of a display screen for a selection screen for reaction sticker candidates that is displayed after operating the reaction button. FIG. 10 is a diagram illustrating an example of a display for confirming sticker candidates selected by a user. FIG. 10 is a diagram illustrating an example of a display of posted stickers. FIG. 10 is a diagram illustrating an example of a screen displaying a plurality of stickers. FIG. 10 is a diagram illustrating an example of a display of a posting user information field that is displayed when a user other than the person who made the reaction taps on a sticker. FIG. 10 is a diagram illustrating changes in the screen that occur when the person who made the reaction operates the sticker. FIG. 10 is a diagram illustrating another example of ... an example of a screen that allows editing of stickers posted as reactions. FIG. 10 is a diagram illustrating an example of a suggestion screen that pops up after operating the "Edit" button. FIG. 10 is a diagram illustrating an example of a display screen after the sticker design has been changed.FIG. 1 is a diagram explaining that a reaction button may or may not be displayed depending on the user. FIG. 2 is a diagram explaining an example in which the designs of sticker candidates presented differ depending on the conditions met by the user. FIG. 3 is a diagram explaining an example in which sticker candidates are presented according to the user's attributes (e.g., relationship). FIG. 4 is a diagram explaining another example in which sticker candidates are presented according to the user's attributes (e.g., relationship). FIG. 5 is a diagram explaining an example of generating sticker candidates using scores by index.

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. The embodiments described below are merely examples of modes for implementing the present disclosure, and the embodiments of the present disclosure are not limited to the exemplary embodiments described below. Therefore, the technical scope of the present disclosure is not limited to the scope described in the embodiments described below. For example, various modifications or improvements to the contents described in the embodiments are also included in the technical scope of the present disclosure. Note that the various functional units described below are realized through the execution of programs by processors such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or other processors.

[0010] <Terminology> First, the terms used in the embodiments will be explained. "Program" is used as a general term for an OS (= Operating System) and application programs. "Image" is used as a general term for still images and moving images. Still images include not only the aforementioned photographs, but also illustrations and other designs. "Image sharing service" refers to a service that enables the sharing of images uploaded to the cloud (hereinafter also referred to as "uploaded images"). "Sharing" refers to a state in which one image is owned by multiple users. Users who share an image can freely use the shared image. "Use" refers to, for example, viewing, downloading, or posting an image to a blog or SNS (= Social Networking Service).

[0011] An "album" is a unit for managing uploaded images. Users associated with an album share uploaded images managed as an album. However, even if associated with an album, sharing may be restricted for some users by setting. A "group" is a collection of users registered in an album (i.e., a user group). A group includes, for example, an administrator user and invited users. Therefore, the administrator user and invited users are included as members of the group (i.e., group members). An example of a group is a family. An album linked to a family is, for example, a "family album." Groups also include circles and classes whose members are identified.

[0012] An "administrative user" is a user who has the authority to manage an album. In other words, an administrative user is a user who has the administrator attribute for the album to be managed. Generally, the user who created the album is the administrative user. For example, in the case of a family album, the parent of a child (e.g., "Dad," "Mom," or both "Dad and Mom") is the administrative user. The administrative user has the authority to set the visibility of uploaded images, as well as the authority to determine whether other users can upload images and download uploaded images. An "invited user" is a user who is invited to an album by the administrative user. Note that a user invited by the administrative user as an "administrative user" is an "administrative user," and a user invited as a "non-administrative user" is a "general user." An invited user may be any user invited by the administrative user, and is not limited to family members, but may also be an acquaintance or friend. A "participating user" is a user who is participating in an album. Specifically, participating users include administrative users and general users. Hereinafter, participating users in a family album will also be referred to as "family users."

[0013] An "image sharing app" refers to an app used to access an image sharing service. Generally, a dedicated image sharing app is used for each image sharing service. By running an image sharing app, a user can access the associated album or receive notifications from the album. A "messaging app" refers to an app used to exchange messages with other users. Message exchange is also called chat. A messaging app displays messages in speech bubbles and displays messages in the order they were posted. "Messages" include profile images, text, stickers, audio, images, etc. Profile images include photos and illustrations that a user has registered in the messaging app.

[0014] "Stickers" include images prepared for posting via a click operation and images prepared for reactions via a click operation. Stickers can be images only, or images that combine text and images. For text, fixed phrases that express emotions, such as "cute," "excited," "yay," and "amazing," are used. Images for stickers are partial images or thumbnail images cut out from uploaded images. For partial images, for example, face images, upper body images, and full-body images of group members are used. Stickers include images for posting and images for reactions.

[0015] In the following, a distinction will be made between stickers before posting and stickers after posting. Stickers before posting that are presented to the user so that they can select are included as an example of "candidate stickers for posting." Candidate stickers for posting are included in candidate image data for posting. Similarly, a distinction will be made between stickers before a reaction and stickers after a reaction. Stickers before a reaction that are presented to the user so that they can select are included as an example of "candidate stickers for reactions." Candidate stickers for reactions are included in candidate image data for reactions. "Financial value" refers to information that can be exchanged on a network, such as electronic money, crypto assets, in-game currency, legal currency, points, etc.

[0016] <First Embodiment> <System Configuration> Fig. 1 is a diagram showing an example of the configuration of an information processing system 1 assumed in the first embodiment. The information processing system 1 shown in the first embodiment is used to provide an image sharing service in which images of children and the like are shared among family members. In the following, the image sharing service in the present embodiment is taken as an example of a "family album service." The information processing system 1 shown in Fig. 1 includes a server 10 that provides the family album service, a user terminal 20 operated by a user who uses the family album service, and a network N that connects these so that they can communicate with each other.

[0017] The server 10 is one or more computers. When the server 10 is operated by multiple computers, the multiple computers cooperate with each other via a network N. The server 10 may be a server specialized for image sharing services, but may also be used to provide other services. The server 10 may be an on-premise server or a cloud server. Examples of cloud servers include IaaS (Infrastructure as a Service), PaaS (Platform as a Service), and SaaS (Software as a Service). The server 10 is included in an information processing device.

[0018] Examples of the user terminal 20 include a smartphone, a tablet computer, a laptop or desktop computer, a game console, a head-mounted terminal (a so-called headset), and an eyeglass-type terminal (a so-called smart glass). Incidentally, smart glass includes an eyeglass-type device equipped with a small display and a light-guiding component that focuses an image displayed on the display on the retina. In the example of FIG. 1 , there are three user terminals 20, but there may be four or more. One user is associated with one user terminal 20. In other words, one user account is associated with one user terminal 20.

[0019] In the example of FIG. 1 , users A1 and A2 belong to family A, and user B1 belongs to family B. That is, users A1 and A2 are included in the group members of "family A," and user B1 is included in the group members of "family B." Network N is assumed to be, for example, the Internet, a LAN (Local Area Network), or a mobile communication system such as 4G or 5G. Network N may be a wired network or a wireless network, or may be a combination of a wired network and a wireless network.

[0020] <Server Hardware Configuration> The server 10 includes a processor 11 that controls the overall operation of the terminal, a memory 12, an auxiliary storage device 13, and a communication interface 14. The processor 11 is, for example, a CPU. The memory 12 includes a ROM (Read Only Memory) that stores a BIOS (Basic Input Output System) and the like, and a RAM (Random Access Memory) that is used as a work area for the processor 11. The auxiliary storage device 13 is, for example, a hard disk drive or semiconductor storage. The auxiliary storage device 13 stores various information necessary for providing stickers. The communication interface 14 is a device that enables communication with external terminals such as the user terminal 20. The communication interface 14 is required to have communication functions compatible with the network N used for communication.

[0021] <Hardware Configuration of User Terminal> The user terminal 20 includes a processor 21 that controls the overall operation of the terminal, a memory 22, an auxiliary storage device 23, a communication interface 24, and a display 25. The processor 21 is, for example, a CPU. The memory 22 includes a ROM that stores the BIOS and the like, and a RAM that is used as a work area for the processor 21.

[0022] The auxiliary storage device 23 is, for example, a hard disk drive or semiconductor storage. The communication interface 24 is a device that enables communication with external terminals such as the server 10. The communication interface 24 is required to have a communication function that is compatible with the network N used for communication. The display 25 is, for example, a liquid crystal display or an organic EL (Electro Luminescence) display.

[0023] <Functional Configuration of Server> Fig. 2 is a diagram illustrating an example of the functional configuration of the server 10. Note that the functional configuration shown in Fig. 2 is an example of a functional unit realized through the execution of a program. The server 10 has a generation unit 101, a presentation unit 102, a control unit 103, and a storage unit 110. Of these, the storage unit 110 is realized by the memory 12 (see Fig. 1) and the auxiliary storage device 13 (see Fig. 1).

[0024] <Information Stored in Storage Unit> First, a description will be given of an example of information stored in the storage unit 110. The storage unit 110 shown in Fig. 2 stores album information 111, participating user information 112, uploaded image information 113, image usage history 114, sticker candidate generation rules 115, sticker candidate presentation rules 116, and sticker candidate submission rules 117.

[0025] <Album Information 111> The album information 111 records various information related to albums managed by the server 10. Fig. 3 is a diagram illustrating an example of the album information 111. The album information 111 shown in Fig. 3 includes a management ID 111A, an album name 111B, a disclosure range 111C, upload setting information 111D, and additional service subscription information 111E. Note that the information shown in Fig. 3 is an example of the album information 111, and other data structures are not excluded.

[0026] The management ID 111A is a code or other information used to identify multiple albums. As shown in Fig. 3, one album is assigned one management ID 111A. In the case of Fig. 3, the album with the album name "Family A" is assigned the management ID 111A of "10001". The album name 111B is the name of the family album created by the administrative user. For example, the name of a registered child is automatically entered into the album name 111B. However, the administrative user may also be allowed to enter any name.

[0027] The disclosure range 111C is information that specifies the users to whom uploaded images are made public or who can view them. The disclosure range 111C is created by the administrative user. Examples of the disclosure range 111C include "administrator user only" and "all family members." All family members refer to family users who are participating in the family album. As mentioned above, family users include the administrative user and invited users. The settings for the disclosure range 111C for an album apply to all uploaded images belonging to the album. It is also possible to individually set whether uploaded images are made public to general users. In this case, only general users who are permitted to make uploaded images public are allowed to make uploaded images public.

[0028] The upload setting information 111D is setting information related to image uploading for participating users. In this embodiment, the administrative user is unconditionally permitted to upload images to the album. For this reason, the upload setting information 111D records information on whether or not individual general users are permitted to upload images. The administrative user sets whether or not individual general users are permitted to upload images. For example, it is possible to allow a grandmother as a general user to upload images, but not allow a grandfather as a general user to upload images. Of course, the opposite setting is also possible, and it is also possible to set it so that image uploading is not permitted for both grandparents.

[0029] The additional service subscription information 111E is information indicating whether or not additional services are available, which are available on the condition that financial value is consumed. In the example of Fig. 3, the album names 111B for "Family A" and "Family B" are recorded as "Subscription" to the additional service. The additional services include, for example, extending the length of videos that can be uploaded, increasing the image quality of uploaded images, and expanding the scope of publication.

[0030] <Participating User Information 112> The participating user information 112 records various information related to the participating users of each album. FIG. 4 is a diagram illustrating an example of the participating user information 112. The participating user information 112 shown in FIG. 4 includes a user account 112A, a display name 112B, an administrative user 112C, child information 112D, relationship 112E, upload permission information 112F, viewing settings 112G, sticker posting permission information 112H, and sticker candidate ratio information 112I. Note that the information shown in FIG. 4 is an example of the participating user information 112, and other data structures are not excluded. Furthermore, the participating user information 112 shown in FIG. 4 is assumed to be a family album in which the album name 111B (see FIG. 3) is indicated as "Family A."

[0031] The user account 112A is information used to log in to the family album service. The user account 112A includes, for example, an administration ID, an account name, a user name, etc. The administration ID is assigned by the family album service. The user account 112A is linked to a family album. The display name 112B is the name of the participating user that is displayed in the comment section of the family album, etc. The display name 112B is registered by the administration user. The administration user 112C is information indicating a user who has an administration user attribute. In the case of Figure 4, "Mom" and "Dad" have the administrator attribute, while "Grandma" and "Grandpa" do not have the administrator attribute.

[0032] The child information 112D is information about the admin user's children. The child information 112D records the child's name (e.g., Hanako), gender, birthday, etc. If there are multiple children, the child information 112D is recorded for each of them. In the case of FIG. 4 , the child information 112D is linked to the admin users "Mom" and "Dad." The relationship 112E is information about the relationship to the child. In the case of FIG. 4 , the relationship 112E is "Mother," "Father," "Grandmother," and "Grandfather." As shown in FIG. 4 , the relationship 112E may include blood ties to the child's mother or father, or may not distinguish between them. Furthermore, the relationship 112E may record "mom friends," "dad friends," "relatives," etc.

[0033] Upload permission information 112F is information that indicates individual settings for whether or not images can be uploaded to the family album for each participating user. In the case of Figure 4, only "Mom" and "Dad" can upload images, and "Grandma" and "Grandpa" cannot upload images. Whether or not general users can upload images is set by the administrative user. Viewing settings 112G is information that indicates individual settings for whether or not uploaded images can be viewed for each participating user. In the case of Figure 4, all participating users can view uploaded images. However, it is also possible to individually register general users who can view uploaded images.

[0034] Sticker posting permission information 112H is information regarding whether stickers can be posted. In this embodiment, all participating users are permitted to post stickers. However, sticker posting may be limited to the admin user only, and sticker posting by general users may require subscription to an additional service. Sticker candidate ratio information 112I is information that individually sets the ratio of subjects that appear in sticker candidates for each user. For example, this information sets the ratio of the number of sticker candidates with children as the subject to the number of sticker candidates with parents as 8:2. This setting is set, for example, by the admin user.

[0035] In the case of "Mom" in FIG. 4, the proportion of sticker candidates with "child" as the subject is set to be greater than the proportion of sticker candidates with "Mom" as the subject. Similarly, in the case of "Grandma" in FIG. 4, the proportion of sticker candidates with "child (grandchild)" as the subject is set to be greater than the proportion of sticker candidates with her own child, "Mom," as the subject, and the proportion of sticker candidates with her son-in-law, "Dad," as the subject is set to be smaller than the proportion of sticker candidates with her son-in-law, "Dad," as the subject. Similarly, in the case of "Grandpa" in FIG. 4, the proportion of sticker candidates with "child (grandchild)" as the subject is set to be greater than the proportion of sticker candidates with her own child, "Dad," as the subject, and the proportion of sticker candidates with her daughter-in-law, "Mom," as the subject is set to be smaller than the proportion of sticker candidates with "Dad" as the subject. Note that in this embodiment, the content of the sticker candidates presented to participating users is the same for all participating users.

[0036] <Uploaded Image Information 113> The uploaded image information 113 records various information related to uploaded images. FIG. 5 is a diagram illustrating an example of the uploaded image information 113. The uploaded image information 113 shown in FIG. 5 includes a management ID 113A, an image capture date and time 113B, a file name 113C, a public setting 113D, and attribute information 113E. Note that the information shown in FIG. 5 is an example of the uploaded image information 113, and other data structures are not excluded. The uploaded image information 113 shown in FIG. 5 is assumed to be a family album in which the album name 111B (see FIG. 3) is indicated as "Family A."

[0037] The management ID 113A is a code or other information used to identify an uploaded image. As shown in Fig. 5, one uploaded image is assigned one management ID 113A. The image capture date and time 113B is information indicating the date and time when the uploaded image was captured. The file name 113C is a name assigned to the data corresponding to the uploaded image.

[0038] The public setting 113D is information indicating an individual setting regarding whether or not an uploaded image can be viewed. In the example of FIG. 5 , only the administrative user (e.g., "Mom" and "Dad") can view the uploaded image with the file name 113C "F2001". The uploaded image with the file name 113C "F2002" can be viewed by all family members (i.e., the administrative user and general users). Note that there is no individual setting regarding whether or not an uploaded image with the file name 113C "F2003" can be viewed. Therefore, the viewing range of this uploaded image follows the setting of the public range 111C of the album (see FIG. 3 ). The public setting 113D can be set or changed not only when uploading an image, but also after the image has been uploaded. For example, the user who uploaded the image is permitted to set or change the public setting 113D.

[0039] The users who are permitted to view the uploaded images are determined by the upload image public setting 113D and the album public range 111C (see FIG. 3). For example, if the upload image public setting 113D is "admin user only," even if the album public range 111C is "all family," viewing of the corresponding uploaded images is limited to the admin user. For example, if the upload image public setting 113D and the album public range 111C are both "all family," viewing of the corresponding uploaded images is limited to all family members (i.e., the admin user and invited users). However, even if the upload image public setting 113D is "all family," if the album public range 111C is "admin user only," viewing of the corresponding uploaded images is limited to only the admin user.

[0040] The attribute information 113E includes information recorded when the image was captured, information added by the user, and information extracted from the image through image processing. Information recorded when the image was captured includes, for example, Exif (Exchangeable Image File Format) information. Information added by the user includes, for example, information about the subject, the circumstances at the time of capture, and notes and comments made during capture or editing. Information extracted from the image through image processing includes, for example, an estimation result of the subject. In the example of FIG. 5, "child," "birthday," "park," "smile," etc. are recorded as the attribute information 113E.

[0041] <Image Usage History 114> The image usage history 114 records the usage history of uploaded images by each user. FIG. 6 is a diagram illustrating an example of the image usage history 114. The image usage history 114 shown in FIG. 6 includes a user account 114A, a display name 114B, a relationship 114C, a browsing history of uploaded images 114D, and a posting history of stickers 114E. Note that the information shown in FIG. 6 is an example of the image usage history 114, and does not exclude other data structures. Furthermore, the image usage history 114 shown in FIG. 6 is assumed to be a family album in which the album name 111B (see FIG. 3) is indicated as "Family A."

[0042] User account 114A is information used to log in to the family album service, and its content is the same as user account 112A shown in Fig. 4. Display name 114B is the name of the participating user that is displayed in the comment field of the family album, etc., and its content is the same as display name 114B shown in Fig. 4. Relationship 114C is information indicating a user who has the administrative user attribute, and its content is the same as relationship 112E shown in Fig. 4.

[0043] The uploaded image viewing history 114D is a history of the viewing of uploaded images for each user. The uploaded image viewing history 114D records, for example, the viewing date and time, and information identifying the viewed uploaded image (for example, the management ID 113A (see FIG. 5)). The sticker posting history 114E is a history of sticker postings by each user. The sticker posting history 114E records, for example, the posting date and time of the sticker, information identifying the uploaded image used to generate the sticker, and information related to the subject of the sticker.

[0044] <Sticker Candidate Generation Rules 115> The sticker candidate generation rules 115 are rules for generating sticker candidates from uploaded images. The sticker candidate generation rules 115 include, for example, rules regarding the timing for generating sticker candidates, rules regarding the range of uploaded images used to generate sticker candidates, rules regarding the number of uploaded images used to generate sticker candidates, rules regarding the number of sticker candidates to generate, rules regarding the selection of uploaded images to use for generation, and rules for generating different sticker candidates for each user. The rules regarding the timing for generating sticker candidates include, for example, the passage of a unit period or the arrival of a predetermined date. Examples of unit periods include one week, one month, three months, six months, and one year. Examples of predetermined dates include the beginning of the month, the end of the month, the beginning of the week, the weekend, a specific day of the week (for example, Monday), a specific date (for example, the 10th of each month), and a specific event date.

[0045] The rules regarding the range of uploaded images used to generate sticker candidates include, for example, rules based on the image capture date and time. The rules based on the image capture date and time include, for example, one or more unit periods prior to the unit period to which the current date and time belongs. The rules regarding the number of uploaded images used to generate sticker candidates include, for example, an upper limit on the number of uploaded images used per time. The rules regarding the number of sticker candidates to be generated include, for example, the number of sticker candidates generated per time (e.g., eight), the total number of sticker candidates generated within a unit period, and the number of sticker candidates that can be generated from one uploaded image.

[0046] Rules for selecting uploaded images to be used for generation include, for example, subject-based rules and event-based rules. Subject-based rules include rules that specify subjects such as only "child," only "mom," or only "dad." Event-based rules include, for example, rules that prioritize uploaded images captured on birthdays or anniversaries. Rules for generating different sticker candidates for each user include, for example, referencing sticker candidate ratio information 112I (see FIG. 4 ) set for each user, applying subject priorities previously set for each user, and providing benefits to users who subscribe to additional services. Benefits here include an increase in the number of sticker candidates generated compared to the number of sticker candidates generated when users do not subscribe to additional services.

[0047] In addition, rules based on whether or not an additional service is subscribed to include, for example, rule switching depending on whether or not an additional service is subscribed to. That is, there is rule switching when two types of rules (rules for when an additional service is subscribed to and rules for when an additional service is not subscribed to) are prepared for each of the aforementioned rules. Basically, rules that apply when an additional service is subscribed to are more advantageous to the user than rules that apply when an additional service is not subscribed to. Examples of advantages to the user include more opportunities to generate sticker candidates, a wider range of uploaded images used to generate sticker candidates, an increased number of uploaded images used to generate sticker candidates, and an increased number of generated sticker candidates.

[0048] <Sticker candidate presentation rules 116> The sticker candidate presentation rules 116 are rules that are applied when the generated sticker candidates are presented to the user. The sticker candidate presentation rules 116 include, for example, rules regarding the number of sticker candidates to be presented, rules regarding the timing of presenting the sticker candidates, rules for determining which users will be presented with sticker candidates, and rules for setting the sticker candidates to be presented for each user. The rules regarding the number of sticker candidates to be presented stipulate the number of sticker candidates to be presented to each user. This rule is used to set an upper limit on the number of sticker candidates to be presented to the user, regardless of the number of sticker candidates generated. In the present embodiment, eight sticker candidates are presented each time. Of course, eight is just an example.

[0049] The rules regarding the timing of sticker candidate presentation stipulate the timing at which sticker candidates are presented to a user. This presentation timing is stipulated independently of the timing at which sticker candidates are generated. The presentation timing may occur, for example, when a unit period is updated or when predetermined conditions are met after the unit period is updated. Predetermined conditions include, for example, the passage of a predetermined amount of time or the arrival of a predetermined date. Predetermined dates include, for example, the beginning of the month, the end of the month, the beginning of the week, the weekend, a specific day of the week (e.g., Monday), a specific day (e.g., the 10th of each month), a birthday, or a specific event date. An example of a birthday is a child's birthday. Examples of specific events include New Year's Day, Halloween, and Christmas. The rules for determining users to whom sticker candidates are presented include, for example, a rule for matching the album's visibility range 111C (see FIG. 3 ) and a rule for matching the visibility setting 113D (see FIG. 5 ) of the album image used to generate the sticker candidate.

[0050] The rules for setting sticker candidates to be presented for each user include, for example, a rule that determines the presentation destination based on whether the user is an administrative user, a rule that determines the presentation destination based on the user's relationship 112E (see FIG. 4), a rule that determines the presentation destination based on sticker candidate ratio information 112I (see FIG. 4), a rule that determines the presentation destination based on the subject that appears in the sticker candidate, a rule that determines the presentation destination based on the user's usage history (e.g., browsing history or posting history), and a rule that determines the presentation destination based on the subject specified by the user. Additionally, the sticker candidate presentation rules 116 include a rule that changes the rules to be applied based on whether or not the user has subscribed to an additional service. For example, the number of sticker candidates presented to users who subscribe to an additional service may be increased compared to non-subscribers, or the number of times the candidates are presented may be increased.

[0051] <Sticker candidate posting rules 117> The sticker candidate posting rules 117 are rules regarding the posting of sticker candidates. The rules regarding the posting of sticker candidates include, for example, rules for controlling the posting of sticker candidates depending on whether the user is an administrative user when sticker candidates are presented to all participating users. Under these rules, administrative users are permitted to post stickers, but general users (family users other than the administrative user) are not permitted to post stickers. However, even general users are permitted to post stickers if they subscribe to an additional service that exceptionally permits the posting of sticker candidates. In addition, the rules regarding the posting of sticker candidates include rules for controlling the posting of sticker candidates to users other than participating users. However, sticker posting is permitted if they subscribe to an additional service that exceptionally permits the posting of sticker candidates to users other than participating users.

[0052] <Processing Executed by Functional Units> The following describes basic processing functions executed by the generation unit 101 (see FIG. 2), the presentation unit 102 (see FIG. 2), and the control unit 103 (see FIG. 2). Detailed processing functions provided in each functional unit will be described in association with expected processing operation examples.

[0053] The generation unit 101 is a functional unit that generates sticker candidates from uploaded images that include a person associated with a group (e.g., Family A) among one or more uploaded images associated with a group to which the user belongs. Here, "persons associated with the group" is not limited to participating users whose user accounts 112A (see FIG. 4) are registered in participating user information 112 (see FIG. 4), but also includes family members other than the participating users. In this embodiment, a child registered in child information 112D (see FIG. 4) is considered as a family member other than the participating user. However, a child who has reached the age to own a user terminal 20 (see FIG. 1) and has a registered user account 112A is treated as a participating user.

[0054] Incidentally, the display size of sticker candidates is smaller than the display size of uploaded images. For this reason, sticker candidates in this embodiment are basically composed of an image of the face of one person. However, it is not intended to exclude other compositions. Therefore, sticker candidates may include facial images of two people, or may include parts other than the face (for example, the upper body or the whole body). Two people include not only two children, such as brothers and sisters, but also combinations of parents and children, such as "mom" and child, and "dad" and child.

[0055] In this embodiment, the generation unit 101 generates sticker candidates using, for example, uploaded images in which the display size of the subject's face exceeds a reference value. In other words, uploaded images in which the display size of the subject's face is less than a reference value are not used to generate sticker candidates. FIG. 7 is a diagram illustrating an example of generating sticker candidates. In the case of FIG. 7, the sticker candidate is generated by combining a face image extracted from the uploaded image with a prepared synthesis design. In the case of FIG. 7, the synthesis design includes a figure and text. However, the design shown in FIG. 7 is an example, and either the text or the figure may be omitted.

[0056] The presentation unit 102 is an example of a functional unit that presents sticker candidates to participating users who belong to a group (e.g., a family). FIG. 8 is a flowchart illustrating an example of the processing operation of the generation unit 101 and the presentation unit 102 in the first embodiment. Note that the symbol S in the figure indicates a step. First, the generation unit 101 determines whether it is time to generate a sticker candidate (step 1). The generation unit 101 determines whether the current time satisfies the generation timing, for example, based on the sticker candidate generation rules 115 (see FIG. 2). Note that the generation timing may be determined for each group, or may be common to all groups.

[0057] If the timing for generation does not apply, the generation unit 101 obtains a negative result in step 1. In this case, the generation unit 101 repeats the determination in step 1. On the other hand, if the timing for generation applies, the generation unit 101 obtains a positive result in step 1. In this case, the generation unit 101 generates a predetermined number of sticker candidates from the corresponding uploaded image (step 2). Once the generation of the sticker candidates is complete, the presentation unit 102 presents the sticker candidates to the target user (step 3). The presentation of the sticker candidates is performed based on the sticker candidate presentation rules 116 (see FIG. 2). In this embodiment, the sticker candidates are presented to all participating users whose user accounts 112A are registered in the participating user information 112 (see FIG. 4).

[0058] In the case of FIG. 8 , the presentation of sticker candidates is automatically performed by the presentation unit 102. However, a method of presenting generated sticker candidates when an instruction from the user is received may also be adopted. The target group refers to a group (e.g., Family A) to which the uploaded image used to generate the sticker candidate belongs. FIG. 9 is a diagram illustrating an example of a presentation screen 250 for sticker candidates in the first embodiment. The presentation screen 250 shown in FIG. 9 presents eight sticker candidates generated for October. The presentation screen 250 is displayed as a pop-up on the display 25 of the user terminal 20.

[0059] The presentation screen 250 in Fig. 9 displays a message to the user saying, "Your memories from last month have become stickers." In other words, the sticker candidates shown in Fig. 9 are generated based on uploaded images captured in September. Needless to say, this message is just an example, and a message such as "A new sticker has been generated" may also be used. A close mark 251 is located in the upper right corner of the presentation screen 250 shown in Fig. 9. When the close mark 251 is operated, the presentation screen 250 is closed.

[0060] FIG. 10 is a diagram illustrating another example of presentation of sticker candidates. The presentation example shown in FIG. 10 assumes a case in which a user viewing uploaded images is notified of the generation of a new sticker candidate. In FIG. 10, a sticker candidate generation notification field 253 is displayed outside the uploaded image display field 252. In the case of FIG. 10, the generation notification field 253 displays a message to the user saying, "A new sticker has appeared!" Of course, this message is only an example. The generation notification field 253 in FIG. 10 includes a "Display" button 254. When the "Display" button 254 is operated, the display switches to, for example, presentation screen 250 (see FIG. 9).

[0061] The control unit 103 is an example of a functional unit that controls the posting of sticker candidates selected by users belonging to a group (e.g., Family A). For example, the control unit 103 displays a button on the display 25 (see FIG. 1) for reading out the sticker candidates for posting. FIG. 11 is a flowchart illustrating an example of the processing operation of the control unit 103 in the first embodiment. Note that the processing operation shown in FIG. 11 assumes a case where the posting of the sticker candidates is realized in association with an uploaded image.

[0062] Therefore, the control unit 103 determines whether an uploaded image to be viewed has been selected (step 11). If an uploaded image to be viewed has not been selected, a negative result is obtained in step 11. In this case, the control unit 103 repeats the determination in step 11. On the other hand, if an uploaded image to be viewed has been selected, a positive result is obtained in step 11. In this case, the control unit 103 displays a viewing screen for the selected uploaded image (with a display button for sticker candidates) on the user terminal 20 (step 12). Figure 12 is a diagram illustrating an example of a viewing screen for uploaded images with a display button for sticker candidates. In Figure 12, corresponding parts to those in Figure 10 are assigned reference numerals corresponding to those in Figure 10.

[0063] In the case of Fig. 12, a comment input field 255 is displayed outside the display field 252 for the uploaded image. Also, a face mark 256 is displayed near the right end of the comment input field 255. This face mark 256 is included as an example of a display button for sticker candidates. Returning to the explanation of Fig. 11. Following the display of the viewing screen shown in Fig. 12, the control unit 103 determines whether or not to display a sticker candidate selection screen on the user terminal 20 (step 13).

[0064] In this embodiment, acceptance of an operation on the face mark 256 (see FIG. 12 ) triggers the display of a sticker candidate selection screen. If an operation on the face mark 256 is not accepted, a negative result is obtained in step 13. In this case, the control unit 103 repeats the determination in step 13. On the other hand, if an operation on the face mark 256 is accepted, a positive result is obtained in step 13. In this case, the control unit 103 presents sticker candidates generated from uploaded images of the group to which the target user belongs (step 14). In this embodiment, the presented sticker candidates are not limited to sticker candidates generated from uploaded images currently being viewed, but include all sticker candidates generated from uploaded images of the group to which the target user belongs.

[0065] FIG. 13 is a diagram illustrating an example of sticker candidate presentations intended for posting. In FIG. 13, the same reference numerals are used to denote corresponding parts to those in FIG. 12 . In FIG. 13, a display content switching button 257 and a selection screen field 258 are displayed below a comment input field 255. Here, eight sticker candidates are displayed in the selection screen field 258. Note that in FIG. 13, due to display space limitations, only a portion of the selection screen field 258 is displayed. For this reason, a scroll bar 258A is displayed on the right side of the selection screen field 258. The display content switching button 257 shown in FIG. 13 includes a “History” button 257A for displaying sticker candidates selected (or posted) in the past, a “Monthly” button 257B for displaying sticker candidates by month, and an icon button 257C for displaying sticker candidates originating from illustrations (not uploaded images).

[0066] When a user presses and holds a specific sticker candidate, the selection of the sticker candidate is confirmed and posted as a comment. In FIG. 13, the sticker candidate in the center of the top row of six sticker candidates displayed in two rows is pressed and held. Returning to the description of FIG. 11, the control unit 103 then determines whether or not the selection of the sticker candidate to be posted has been accepted (step 15). As described above, in this embodiment, it is determined whether or not a specific sticker candidate has been pressed and held. If a long press of a specific sticker candidate is not detected, a negative result is obtained in step 15. In this case, the control unit 103 determines that no sticker candidate has been posted and ends the series of processes.

[0067] On the other hand, if a long press on a specific sticker candidate is detected, a positive result is obtained in step 15. In this case, the control unit 103 adds the selected sticker candidate to the comment section of the group to which the user belongs (step 16). FIG. 14 is a diagram illustrating an example of a display screen after the sticker candidate has been posted. In FIG. 14, the same reference numerals are used to denote corresponding parts to those in FIG. 12. In FIG. 14, a comment display section 259 and a comment input section 255 are displayed below the display section 252 for the uploaded image. Note that the comment display section 259 shown in FIG. 14 displays a sticker 259A posted by the user, poster information 259B, and posting time 259C. Incidentally, the poster is "Mom." The posting time is "just now."

[0068] <Summary> By using the information processing system 1 (see FIG. 1) according to the present embodiment, uploaded images shared within a group (e.g., within a family) can be used as stickers. In other words, opportunities to use uploaded images can be increased.

[0069] <Embodiment 2> In this embodiment, a description will be given of one form of the information processing system 1 (see FIG. 1) described in Embodiment 1. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in Embodiment 1.

[0070] In this embodiment, the presentation unit 102 (see FIG. 2 ) is provided with a sub-function that presents sticker candidates to participating users who belong to the public range of the uploaded image used to generate the sticker candidate, but does not present the sticker candidates to participating users who do not belong to the public range of the uploaded image used to generate the sticker candidate. That is, in this embodiment, the presentation range of the sticker candidates is linked to the public range of the uploaded image used to generate the sticker candidate. For example, a sticker candidate generated from an uploaded image whose public range is "Mom" and "Dad" is presented only to "Mom" and "Dad," and is not presented to "Grandmother" or "Grandfather."

[0071] Fig. 15 is a flowchart illustrating an example of the processing operation of the presentation unit 102 in the second embodiment. In Fig. 15, parts corresponding to those in Fig. 8 are assigned the same reference numerals. The processing operation of the presentation unit 102 will be described below. When sticker candidates are generated by the generation unit 101, the presentation unit 102 determines whether the uploaded image used to generate the sticker candidate is open to the entire family (step 21). Note that the determination in step 21 is performed for each sticker candidate. Therefore, if there are eight sticker candidates, the determination in step 21 is performed eight times.

[0072] If the visibility range of the uploaded image used to generate the sticker candidate is the entire family, a positive result is obtained in step 21. In this case, the presentation unit 102 presents the sticker candidate to the target user (i.e., the entire family) (step 22). On the other hand, if the visibility range of the uploaded image used to generate the sticker candidate is not the entire family (for example, limited to the administrative user), a negative result is obtained in step 21. In this case, the presentation unit 102 determines whether the target user is within the visibility range of the corresponding uploaded image (step 23). If the target user is within the visibility range, a positive result is obtained in step 23. In this case, the presentation unit 102 presents the sticker candidate to the target user (step 22). On the other hand, if the target user is not within the visibility range, a negative result is obtained in step 23. In this case, the presentation unit 102 ends the processing without presenting the sticker candidate to the target user.

[0073] FIG. 16 is a diagram illustrating an example of sticker candidate presentation. In the case of FIG. 16, it is assumed that eight sticker candidates are generated. In the case of FIG. 16, three of the uploaded images used to generate the sticker candidates have a visibility range of "All Family Members," and five have a visibility range of "Administrative User Only." Therefore, all eight sticker candidates are presented to administrative users (e.g., "Mom" and "Dad"), while only three sticker candidates are presented to non-administrative users (e.g., "Grandma" and "Grandpa").

[0074] <Summary> By using the information processing system 1 (see FIG. 1) according to this embodiment, it is possible to match the range of users to whom sticker candidates are presented with the range of users to whom the uploaded images used to generate the sticker candidates are made public.

[0075] Third Embodiment In the present embodiment, a description will be given of one form of the information processing system 1 (see FIG. 1 ) described in the first embodiment. Therefore, the present embodiment also assumes the system configuration and processing operation of the information processing system 1 described in the first embodiment.

[0076] In this embodiment, the presentation unit 102 (see FIG. 2) is added with a sub-function that presents more sticker candidates that include children as subjects than sticker candidates that include adults as subjects. In this embodiment, the presentation unit 102 determines whether the subject included in the sticker candidate is a child or an adult based on, for example, information about the subject and comments described in the attribute information 113E (see FIG. 5) of the uploaded image used to generate the sticker candidate. For example, if the attribute information 113E contains a description such as "Hanako, 8th birthday," the subject of the uploaded image is determined to be a child. The age threshold used to determine whether the subject is a child or an adult is set in advance. However, the age threshold may be changeable by the administrative user.

[0077] Furthermore, if the name of a child registered in the child information 112D (see FIG. 4) of the participating user information 112 (see FIG. 4) appears in information about the subject or comments described in the attribute information 113E, rather than the age, the subject of the corresponding uploaded image may be determined to be a child. Alternatively, a method may be employed in which the age of a subject is estimated by performing image processing (including AI processing) on ​​the subjects constituting the sticker candidate or the subjects of the uploaded image used to generate the sticker candidate. FIG. 17 is a diagram illustrating an example of a sticker candidate presentation screen 250 in embodiment 3. In FIG. 17, parts corresponding to those in FIG. 9 are assigned reference numerals.

[0078] In the example of FIG. 17 , there are six sticker candidates with children as the subject, one sticker candidate with "Mom" as the subject, and one sticker candidate with "Dad" as the subject. In other words, the number of sticker candidates with children as the subject is greater than the number of sticker candidates with adults as the subject. The family album service on which this embodiment is based has as its primary objective the sharing of photos of children among family members. Therefore, by presenting more sticker candidates with children as the subject than sticker candidates with adults as the subject, the needs of users using the service are met, and the sticker candidates are more likely to be posted.

[0079] <Summary> By using the information processing system 1 (see FIG. 1) according to this embodiment, it is possible to increase the chances that the presented sticker candidates will actually be posted.

[0080] Fourth Embodiment This embodiment also describes one form of the information processing system 1 (see FIG. 1 ) described in Embodiment 1. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in Embodiment 1.

[0081] In this embodiment, the presentation unit 102 (see FIG. 2 ) adds a sub-function for changing the sticker candidates presented to each user based on the usage history of uploaded images by each user belonging to a group (e.g., Family A). The usage history here includes, for example, the number of times an uploaded image has been viewed and the number of times a sticker candidate related to the uploaded image has been posted. In this embodiment, it is possible to change the contents of the sticker candidates presented to "Mom," "Dad," "Grandma," and "Grandpa," for example.

[0082] FIG. 18 is a flowchart illustrating an example of the processing operation of the presentation unit 102 in the fourth embodiment. In FIG. 18, the same reference numerals are used to denote parts corresponding to those in FIG. 8. FIG. 18 illustrates the internal processing of step 3, which is specific to this embodiment. In the case of FIG. 18, the presentation unit 102 first acquires the usage history of uploaded images for each user to whom the images are to be presented (step 31). The usage history here does not need to be limited to the uploaded images used to generate the sticker candidates. Next, the presentation unit 102 changes the content of the sticker candidates to be presented for each user in accordance with the acquired usage history (step 32).

[0083] FIG. 19 is a diagram illustrating an example of a sticker candidate presentation screen 250 in embodiment 4. In FIG. 19, corresponding parts to those in FIG. 9 are denoted by the same reference numerals. FIG. 19 illustrates a sticker candidate presentation screen 250 presented to a user who frequently views uploaded images featuring child A as the subject, and a sticker candidate presentation screen 250 presented to a user whose uploaded images viewed by the user have little variation in the subjects. In the example of FIG. 19, eight sticker candidates featuring child A as the subject are presented to a user whose uploaded images viewed by the user have little variation in the subjects. On the other hand, three sticker candidates featuring child A as the subject, three sticker candidates featuring child B as the subject, one sticker candidate featuring mom as the subject, and one sticker candidate featuring dad as the subject are presented to a user whose uploaded images viewed by the user have little variation in the subjects.

[0084] <Summary> By using the information processing system 1 (see FIG. 1) according to this embodiment, the content of the sticker candidates presented can be changed for each user. Note that in the above description, the existence of sticker candidates generated by the generation unit 101 is assumed, and a case has been described in which the presentation unit 102 changes the content of the sticker candidates for each user to whom they are presented. However, a method in which the generation unit 101 generates sticker candidates for each user may also be employed. Even when this method is employed, different sticker candidates can be presented to each user.

[0085] Fifth Embodiment This embodiment also describes one form of the information processing system 1 (see FIG. 1) described in Embodiment 1. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in Embodiment 1.

[0086] In this embodiment, the presentation unit 102 (see FIG. 2 ) adds a sub-function that changes the proportion of subjects appearing in multiple sticker candidates presented to each user based on the attributes of users in the group (e.g., family). In the fourth embodiment described above, the content of the presented sticker candidates is customized based on differences in the usage history of each user's uploaded images. In this embodiment, however, the content of the presented sticker candidates is customized with a focus on user attributes. Examples of user attributes include a display name 112B (see FIG. 4 ), an administrative user 112C (see FIG. 4 ), and a relationship 112E (see FIG. 4 ). The presentation unit 102 changes the proportion of subjects presented using one or more of these pieces of information. The proportion of subjects also includes, for example, the ratio of children to adults, as well as the ratio between multiple children.

[0087] FIG. 20 is a flowchart illustrating an example of the processing operation of the presentation unit 102 in the fifth embodiment. In FIG. 20, the same reference numerals are used to denote parts corresponding to those in FIG. 8. FIG. 20 illustrates the internal processing of step 3 specific to this embodiment. In the case of FIG. 20, the presentation unit 102 acquires user attributes for each user to whom the stickers are to be presented (step 33). Next, the presentation unit 102 changes the contents of the sticker candidates based on the priority of the subjects prepared according to the acquired user attributes (step 34). The priority of the subjects is registered in the participating user information 112 (see FIG. 4), for example, as sticker candidate ratio information 112I (see FIG. 4).

[0088] For example, in the case of Figure 4, sticker candidates presented to "Mom" are determined so that a higher proportion of sticker candidates have "children" as the subject than sticker candidates have "Mom" herself as the subject. Also, in the case of Figure 4, sticker candidates presented to "Mom's" grandmother (Mom's mother) are determined so that a higher proportion of sticker candidates have "children" as the subject than sticker candidates have "Mom" or "Dad" as the subject. Furthermore, sticker candidates having "Mom" as her own child as the subject are determined to be presented more frequently than sticker candidates having "Dad" as her son-in-law as the subject.

[0089] FIG. 21 is a diagram illustrating an example of a sticker candidate presentation screen 250 in embodiment 5. In FIG. 21, corresponding parts to those in FIG. 9 are denoted by the same reference numerals. FIG. 21 illustrates a sticker candidate presentation screen 250 presented to a user whose relationship to "Mom" is "Mom" and a sticker candidate presentation screen 250 presented to a user whose relationship to "Mom" is "Mom's" grandmother. The presentation screen 250 in FIG. 21 is based on the sticker candidate ratio information 112I shown in FIG. 4. In the example shown in FIG. 21, more sticker candidates with children (including Child A and Child B) as the subject are presented to "Mom" than sticker candidates with herself as the subject. Furthermore, more sticker candidates with children (including Child A and Child B) as the subject are presented to "Mom's" grandmother than sticker candidates with "Mom" as the subject, who is her grandmother's child, and more sticker candidates with "Mom" as the subject are presented than sticker candidates with "Dad" as the subject, who is her son-in-law.

[0090] <Summary> By using the information processing system 1 (see FIG. 1 ) according to this embodiment, the proportion of subjects appearing in the presented sticker candidates can be changed for each user. In the above explanation, the presenting unit 102 changes the proportion of subjects appearing in the sticker candidates for each user to whom the candidates are presented, assuming the existence of sticker candidates generated by the generating unit 101. However, a method in which the generating unit 101 generates sticker candidates in which the proportion of subjects is changed for each user may also be employed. Even when this method is employed, sticker candidates with different proportions of subjects can be presented for each user.

[0091] Sixth Embodiment In this embodiment, a description will be given of one form of the information processing system 1 (see FIG. 1) described in the fifth embodiment. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in the fifth embodiment.

[0092] In this embodiment, the presentation unit 102 (see FIG. 2) is provided with a sub-function for changing the proportion of subjects of sticker candidates presented to a user whose user attribute is grandfather or grandmother, so that more people who are grandchildren of the grandfather or grandmother are included than other people. While in the fifth embodiment the proportion of subjects is changed based on the sticker candidate proportion information 112I (see FIG. 4) registered for each user, in this embodiment the proportion of subjects is automatically changed based on the relationship 112E (see FIG. 4). In this embodiment, "other people" are assumed to be people other than children. Therefore, "other people" include "mom," "dad," "grandmother," "grandfather," etc.

[0093] For example, if individuals are used as the ratio criterion, the ratio is changed to four sticker candidates with Grandchild A as the subject, two sticker candidates with "Mom" as the subject, and two sticker candidates with "Dad" as the subject. However, it is also possible to use a ratio criterion other than grandchildren and grandchildren. In this case, a ratio of three sticker candidates with Grandchild A as the subject, two sticker candidates with Grandchild B as the subject, two sticker candidates with "Mom" as the subject, and one sticker candidate with "Dad" as the subject is also allowed.

[0094] <Summary> By using the information processing system 1 (see FIG. 1) according to this embodiment, it is possible to increase the proportion of sticker candidates with grandchildren as subjects for users who have the attribute of grandfather or grandmother. Note that, even in this embodiment, a method may be adopted in which the generation unit 101 generates sticker candidates with different proportions of subjects for each user.

[0095] Seventh Embodiment In this embodiment, a description will be given of one form of the information processing system 1 (see FIG. 1) described in the fifth embodiment. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in the fifth embodiment.

[0096] In this embodiment, the presentation unit 102 (see FIG. 2 ) is added with a sub-function that changes the proportion of subjects so that, as subjects of sticker candidates to be presented to a user whose user attribute is grandfather or grandmother, more people who are blood relatives of the grandfather or grandmother and whose user attribute is father or mother are included than people who are stepchildren of the grandfather or grandmother and whose user attribute is father or mother. This embodiment also relates to an example of presenting sticker candidates to a grandfather or grandmother. In the sixth embodiment described above, the proportion of grandchildren and other people is automatically controlled, but in this embodiment, a case will be described in which the proportion of subjects is changed depending on whether the person is a biological child or a stepchild.

[0097] FIG. 22 is a diagram illustrating an example of a sticker candidate presentation screen 250 in the seventh embodiment. In FIG. 22, corresponding parts to those in FIG. 9 are denoted by the same reference numerals. FIG. 22 illustrates a sticker candidate presentation screen 250 presented to a user who is related to "Dad"'s grandfather, and a sticker candidate presentation screen 250 presented to a user who is related to "Mom"'s grandfather. Note that, like in the sixth embodiment, the number of sticker candidates including children A and B, who are grandchildren, as subjects is greater than the number of sticker candidates having "Dad" or "Mom" as the subject. For example, in the relationship with "Dad"'s grandfather, "Dad" is a biological child and "Mom" is a stepchild. Therefore, for "Dad"'s grandfather, the number of sticker candidates having "Dad" as the subject is greater than the number of sticker candidates having "Mom" as the subject. On the other hand, in the relationship with "Mom"'s grandfather, "Mom" is a biological child and "Dad" is a stepchild. Therefore, for "Mom"'s grandfather, the number of sticker candidates having "Mom" as the subject is greater than the number of sticker candidates having "Dad" as the subject.

[0098] <Summary> By using the information processing system 1 (see FIG. 1) according to this embodiment, it is possible to increase the proportion of sticker candidates that feature a child of a user who has the attribute of a grandfather or grandmother. Note that, in this embodiment as well, a method may be adopted in which the generation unit 101 generates sticker candidates with a different proportion of subjects for each user.

[0099] Eighth Embodiment This embodiment also describes one form of the information processing system 1 (see FIG. 1) described in Embodiment 1. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in Embodiment 1.

[0100] In this embodiment, the presentation unit 102 (see FIG. 2 ) is added with a sub-function that, when the current day switches from a first period to a second period, presents sticker candidates generated from uploaded images whose capture dates and times belong to the first period. In this embodiment, the first period is assumed to be the "previous month" and the second period is assumed to be the "current month." Therefore, if the "current month" is October, the "previous month" is September. In this case, the period transition occurs at midnight on October 1st. Therefore, the presentation unit 102 in this embodiment presents to the user sticker candidates generated from uploaded images captured in September during the month of October. The "period" may be in units of one month, two months, or three months. The "period" may also be in units of a week or a predetermined number of days (e.g., 10 days).

[0101] FIG. 23 is a flowchart illustrating an example of the processing operation of the presentation unit 102 in the eighth embodiment. In FIG. 23, the parts corresponding to those in FIG. 8 are assigned the same reference numerals. FIG. 23 shows the internal processing of step 3 specific to this embodiment. In the case of FIG. 23, the presentation unit 102 first determines whether a new unit period has started (step 35). As described above, in this embodiment, one month is the unit period. If a change to a new month is not detected, a negative result is obtained in step 35. In this case, the presentation unit 102 repeats the determination in step 35.

[0102] On the other hand, if a change to a new month is detected, a positive result is obtained in step 35. In this case, the presentation unit 102 extracts a predetermined number of sticker candidates from the uploaded images captured in the previous unit period and presents them to the user (step 36). In this embodiment, the presentation unit 102 extracts a maximum of eight sticker candidates. For example, if the number of uploaded images is less than eight, or if the number of uploaded images suitable for generating sticker candidates is less than eight, all of the sticker candidates generated by the generation unit 101 are presented to the user.

[0103] <Summary> By using the information processing system 1 (see FIG. 1 ) according to this embodiment, it is possible to present to a user sticker candidates generated from uploaded images captured in the immediately preceding period. Note that in this embodiment, sticker candidates generated from uploaded images whose image capture dates and times belong to a first period are presented, but instead of the image capture dates and times, sticker candidates generated from uploaded images whose upload dates and times belong to the first period may also be presented. Incidentally, in this embodiment as well, a technique may be adopted in which the generation unit 101 generates a predetermined number of sticker candidates from uploaded images captured in the immediately preceding period.

[0104] Ninth Embodiment In this embodiment, a description will be given of one form of the information processing system 1 (see FIG. 1) described in the eighth embodiment. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in the eighth embodiment.

[0105] In this embodiment, the presentation unit 102 (see FIG. 2 ) is provided with a sub-function that, if the number of sticker candidates generated from uploaded images captured during a first period is less than a threshold, extends the capture date and time of uploaded images used to generate the sticker candidates to be presented to a period earlier than the first period. In this embodiment, the unit period is also one month. In this embodiment, the threshold is set to "8." This number is the same as the number of sticker candidates that make up the presentation screen 250 illustrated in FIG. 9 . In this embodiment, "8" is used as the reference value for the number of sticker candidates to be presented.

[0106] The presenting unit 102 in this embodiment switches the expansion of the range of image capture dates and times of uploaded images used to generate sticker candidates, based on whether the number of sticker candidates generated from uploaded images captured in the previous unit period is equal to or greater than a threshold. The expansion period may be in units of one month, or may be expanded little by little in units of one week. This is to generate sticker candidates from uploaded images whose image capture dates and times are as close as possible to the current date and time.

[0107] FIG. 24 is a flowchart illustrating an example of the processing operation of the presentation unit 102 in the ninth embodiment. In FIG. 24, the same reference numerals are used to denote parts corresponding to those in FIG. 8. FIG. 24 illustrates the internal processing of step 3 specific to this embodiment. In the case of FIG. 24, the presentation unit 102 counts the number of sticker candidates generated from uploaded images captured in the previous unit period (step 37). As mentioned above, the number of uploaded images does not necessarily match the number of sticker candidates generated. Next, the presentation unit 102 determines whether the count is greater than a threshold value (step 38).

[0108] If the count value is greater than the threshold, a positive result is obtained in step 38. In this case, the presentation unit 102 extracts sticker candidates equal to the reference value and presents them to the user (step 39). On the other hand, if the count value is equal to or less than the threshold, a negative result is obtained in step 38. In this case, the presentation unit 102 extends the target period for generating sticker candidates and presents the reference value number of sticker candidates to the user (step 40). In this embodiment, the range of the period used to generate sticker candidates is extended until the number of generated sticker candidates exceeds the threshold. The extension unit is, for example, two weeks. However, the extension unit may also be one month. Thus, in this embodiment, even if the number of sticker candidates generated from uploaded images captured in the previous unit period does not meet the reference value, the number of sticker candidates ultimately presented to the user can be unified to the reference value. In other words, it is possible to present a constant number of sticker candidates each time.

[0109] <Summary> By using the information processing system 1 (see FIG. 1) according to this embodiment, a fixed number of sticker candidates can be presented to the user each time. Note that in the above description, the threshold value for determination is set to the same as the reference value for presentation, but a value smaller than the reference value may also be used as the threshold value for determination.

[0110] For example, the threshold value may be set to "6." In this case, even if the number of sticker candidates generated in the previous unit period is seven (i.e., even if the number of sticker candidates is less than the reference value), the presentation unit 102 executes a process that does not extend the target period. As a result, seven or eight sticker candidates are presented to the user. However, even if the number of presented sticker candidates is less than the reference value, the presented sticker candidates are all generated only from uploaded images captured within the previous unit period, thereby reducing the possibility of overlapping subject images with the previously presented sticker candidates.

[0111] Tenth Embodiment In this embodiment, a description will be given of one form of the information processing system 1 (see FIG. 1) described in the eighth embodiment. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in the eighth embodiment.

[0112] In this embodiment, the presentation unit 102 (see FIG. 2 ) is provided with a sub-function that, when the number of sticker candidates generated from uploaded images captured in a first period is greater than a threshold, presents a larger number of sticker candidates to the user than when the number of sticker candidates generated from uploaded images captured in a first period is equal to or less than the threshold. In this embodiment, the unit period is also one month, and the threshold is "8." Furthermore, the reference value for the number of sticker candidates to present is "8." This premise is the same as in the ninth embodiment.

[0113] FIG. 25 is a flowchart showing the internal processing of step 3 specific to the tenth embodiment. In FIG. 25, the parts corresponding to those in FIG. 24 are denoted by the same reference numerals. In the case of FIG. 25 as well, the presentation unit 102 counts the number of sticker candidates generated from uploaded images captured in the previous unit period (step 37). Next, the presentation unit 102 determines whether the count is greater than a threshold value (step 41). Here, the threshold value is set to a number greater than a reference value. For example, the threshold value is set to "20."

[0114] If the count value is greater than the threshold, a positive result is obtained in step 41. In this case, the presentation unit 102 extracts a predetermined number (>reference value) of sticker candidates and presents them to the user (step 42). Here, the predetermined number is, for example, "12." In other words, four more sticker candidates than the reference value are presented to the user. Therefore, the user can be presented with more sticker candidates than usual in the period following a unit period in which many images were uploaded. Note that if the count value is less than the threshold, a negative result is obtained in step 41. In this case, the presentation unit 102 extracts the reference value number of sticker candidates and presents them to the user (step 43).

[0115] <Summary> By using the information processing system 1 (see FIG. 1) according to this embodiment, it is possible to present more sticker candidates to the user than the reference value during a period when many images are captured. Note that this embodiment may also be combined with the sub-functions described in the ninth embodiment. For example, if a negative result is obtained in step 41, the determination in step 38 (see FIG. 24) may be performed, and depending on the determination result, the processing in step 39 or step 40 may be performed.

[0116] Eleventh Embodiment This embodiment also describes one form of the information processing system 1 (see FIG. 1) described in Embodiment 1. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in Embodiment 1.

[0117] The presentation unit 102 (see FIG. 2) in this embodiment is added with a sub-function of presenting more sticker candidates featuring a child who has just celebrated a birthday to the subject than to other users if the subject has just celebrated a birthday. FIG. 26 is a flowchart illustrating an example of the processing operation of the presentation unit 102 in embodiment 11. In FIG. 26, parts corresponding to those in FIG. 8 are assigned reference numerals. FIG. 26 shows the internal processing of step 3 specific to this embodiment. In the case of FIG. 26, the presentation unit 102 first determines whether the subject has a child whose birthday is just celebrated (step 44).

[0118] If a matching child is found, a positive result is obtained in step 44. In this case, the presentation unit 102 presents more sticker candidates featuring the birthday child as the subject than sticker candidates featuring other users as the subject (step 45). Note that if there are multiple matching children, the total number of sticker candidates for each child may be adjusted to be greater than the number of sticker candidates for other users, or the number of sticker candidates for each child may be adjusted to be greater than the number of sticker candidates for other users. On the other hand, if there is no matching child, a negative result is obtained in step 44. In this case, the presentation unit 102 presents a reference value number of sticker candidates to the user (step 46).

[0119] <Summary> By using the information processing system 1 (see FIG. 1 ) according to this embodiment, it is possible to present more sticker candidates featuring a child having a birthday than other users. By presenting more sticker candidates related to the child, it is possible to increase the number of posts celebrating the birthday. Note that if an uploaded image featuring a child whose birthday is the subject is found, a temporary sticker candidate may be generated and presented without waiting for a unit period to elapse. Furthermore, for birthday sticker candidates, content celebrating the birthday may be selected as text or an image to be combined with the subject. Furthermore, temporary sticker candidates for uploaded images related to events other than birthdays (e.g., New Year's Day, Halloween) may be presented.

[0120] <Twelfth Embodiment> This embodiment also describes one form of the information processing system 1 (see FIG. 1) described in Embodiment 1. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in Embodiment 1.

[0121] In this embodiment, the presentation unit 102 (see FIG. 2) is provided with a sub-function that adjusts the proportion of sticker candidates presented for each child in a group when multiple children are registered, depending on the proportion of uploaded images. FIG. 27 is a flowchart illustrating an example of the processing operation of the presentation unit 102 in embodiment 12. In FIG. 27, parts corresponding to those in FIG. 8 are assigned reference numerals. FIG. 27 illustrates the internal processing of step 3 specific to this embodiment. In the case of FIG. 27, the presentation unit 102 first determines whether multiple children are registered (step 47). This determination is made using the participating user information 112 (see FIG. 4).

[0122] If two or more children are registered, a positive result is obtained in step 47. In this case, the presentation unit 102 calculates the ratio of the number of uploaded images between the children (step 48). The ratio is calculated for the uploaded images used to generate sticker candidates. Next, the presentation unit 102 adjusts the number of sticker candidates between the children so that it matches the ratio calculated in step 48 (step 49). For example, if there are eight uploaded images that include child A as a subject and four uploaded images that include child B as a subject, the ratio of sticker candidates with child A as a subject to sticker candidates with child B as a subject is set to 2:1.

[0123] For example, if there are four sticker candidates featuring child A as the subject, then there will be two sticker candidates featuring child B as the subject. Note that the number of sticker candidates can be increased or decreased in increments of one. Therefore, the ratio calculated in step 48 is merely a guideline. On the other hand, if there is one or fewer registered children, a negative result is obtained in step 47. In this case, the presentation unit 102 presents the number of sticker candidates equal to the reference value to the user (step 50).

[0124] Summary: When multiple children are registered, the information processing system 1 (see FIG. 1 ) according to this embodiment can determine the ratio of sticker candidates among the children presented to a user based on the ratio of the children among the uploaded images used to generate the sticker candidates. For example, during events such as birthdays, the number of images featuring a specific child increases. In such cases, presenting more sticker candidates featuring that child than other children is likely to meet the needs of the user receiving the sticker candidates. Note that, although the ratio calculated in step 48 is used as a guide in the above description, the ratio of the number of sticker candidates among the children may also be adjusted to be equal. In this case, the same number of sticker candidates can be presented regardless of the ratio of uploaded images featuring each child, thereby reducing the sense of unfairness among the children.

[0125] <Embodiment 13> In this embodiment, a form of the information processing system 1 (see FIG. 1) described in Embodiment 1 will be described. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in Embodiment 1. In this embodiment, a sub-function is added to the presentation unit 102 (see FIG. 2) to replace at least one of the sticker candidates presented to the user with a new sticker candidate when an instruction to change the sticker candidate is received from the user. This sub-function is provided from the perspective of increasing opportunities to post sticker candidates.

[0126] FIG. 28 is a flowchart illustrating an example of the processing operation of the presentation unit 102 in embodiment 13. In FIG. 28, the parts corresponding to those in FIG. 11 are assigned with the same reference numerals. That is, the processing operation illustrated in FIG. 28 is executed when a negative result is obtained in step 15. First, the presentation unit 102 determines whether or not an editing operation for a sticker candidate has been accepted (step 51). The editing operation is input via the user terminal 20 (see FIG. 1). FIG. 29 is a diagram illustrating an example of a screen corresponding to the editing function for a sticker candidate. In FIG. 29, the parts corresponding to those in FIG. 13 are assigned with the same reference numerals. In the case of FIG. 29, an "Edit" button 260 is displayed in the upper right corner of the selection screen field 258.

[0127] Returning to the description of FIG. 28 , in step 51, it is determined whether or not the "Edit" button 260 has been operated. If the "Edit" button 260 has not been operated, a negative result is obtained in step 51. In this case, the presentation unit 102 assumes that no sticker candidate has been posted, and ends the series of processes. On the other hand, if the "Edit" button 260 has been operated, a positive result is obtained in step 51. In this case, the presentation unit 102 identifies the sticker candidate to be edited (step 52). FIG. 30 is a diagram illustrating an example of a screen for editing sticker candidates. In FIG. 30, the same reference numerals are assigned to parts corresponding to those in FIG. 9 .

[0128] An edit screen 270 shown in Fig. 30 is displayed on the display 25 when the "Edit" button 260 (see Fig. 29) is operated. Eight sticker candidates are displayed on the edit screen 270 shown in Fig. 30. A "Close" button 271 is also displayed at the bottom of the display screen. Operating the "Close" button 271 will return to the previous screen. In Fig. 30, the sticker candidate displayed in the center of the top row has been selected for editing.

[0129] Returning to the explanation of Fig. 28 , when the editing target is specified, the presentation unit 102 presents a selection screen in which the specified sticker candidate has been replaced with another sticker candidate (step 53). However, the replaced sticker candidate is selected so as not to overlap with other sticker candidates that are not the replacement target. In the present embodiment, the newly presented sticker candidate is automatically selected by the presentation unit 102. Fig. 31 is a diagram illustrating an example of a screen after editing the sticker candidate. In Fig. 31 , the parts corresponding to those in Fig. 29 are assigned the same reference numerals.

[0130] In Fig. 31, the sticker candidate displayed in the center of the top row is different from the sticker candidate in the same position in Fig. 29. Note that even after the specified sticker candidate has been replaced, it is possible to edit it again by operating the "Edit" button 260. After executing step 53, the presenting unit 102 returns to step 15 (see Fig. 11) again.

[0131] Summary: By using the information processing system 1 (see FIG. 1) according to this embodiment, it is possible to edit the presented sticker candidates. As a result, the number of sticker candidates that users want to post increases, and the posting of sticker candidates is encouraged.

[0132] <Embodiment 14> In this embodiment, a modification of embodiment 13 will be described. Therefore, this embodiment also assumes the system configuration and processing operations of the information processing system 1 (see FIG. 1) described in embodiment 1. In this embodiment, the user selects sticker candidates to be displayed after the replacement. FIG. 32 is a flowchart illustrating an example of the processing operation of the presentation unit 102 in embodiment 14. In FIG. 32, parts corresponding to those in FIG. 28 are assigned reference numerals. In this embodiment, the processing operations up to step 52 are the same as those in embodiment 13. Next, the presentation unit 102 displays the suggested candidates on the user terminal 20 (see FIG. 1) (step 54).

[0133] FIG. 33 is a diagram illustrating an example of the display of suggested candidates. In FIG. 33, the same reference numerals are used to denote corresponding parts to those in FIG. 30 . In FIG. 33, a suggestion screen 280 is displayed as a pop-up. The suggestion screen 280 shown in FIG. 33 includes a title field 281, a suggested candidate field 282, and an “OK” button 283. In the example of FIG. 33, the title field 281 includes the heading “Replace Photos” followed by the description “You can choose from automatically suggested options.” In the example of FIG. 33, the suggested candidate field 282 includes three candidates and radio buttons associated with each candidate. In the example of FIG. 33, the middle candidate is selected. When the “OK” button 283 is operated with one of the candidates selected, the candidate selection is confirmed.

[0134] Returning to the description of FIG. 32 , when the proposal screen 280 (see FIG. 33 ) is displayed, the presentation unit 102 determines whether a selection has been accepted (step 55). If a selection has not been accepted (for example, if an “NG” button (not shown) is operated or if the selection has not been confirmed even after a certain time has passed since the display), a negative result is obtained in step 55. In this case, the presentation unit 102 closes the proposal screen 280 and returns to the previous screen (selection screen field 258 (see FIG. 31 )) (step 56). Thereafter, the presentation unit 102 returns to step 15. On the other hand, if a selection has been accepted (if the “OK” button 283 (see FIG. 33 ) is operated), a positive result is obtained in step 55. In this case, the presentation unit 102 presents the selection screen field 258 in which the identified sticker candidate has been replaced with the other sticker candidate selected in step 55 (step 57). Thereafter, the presentation unit 102 returns to step 15.

[0135] Fig. 34 is a diagram illustrating an example of a screen after editing sticker candidates. In Fig. 34, the parts corresponding to those in Fig. 31 are assigned the same reference numerals. In Fig. 34, the design of the sticker candidate located in the center of the top row, surrounded by a dashed line, is different from the design of the sticker candidate in the same position before editing (see Fig. 31). Note that the design of the sticker candidate after editing is the same as the design of the sticker candidate selected on the proposal screen 280 (see Fig. 33).

[0136] <Summary> By using the information processing system 1 (see FIG. 1 ) according to this embodiment, some of the presented sticker candidates can be replaced with sticker candidates specified by the user. As a result, the number of sticker candidates that users want to post increases, and the posting of sticker candidates is encouraged. Note that in this embodiment, three candidates are presented as suggested candidates, but the number of suggested candidates is not limited to three and may be one, two, or four or more. The number of suggested candidates presented may be varied based on the number of images uploaded. For example, if the number of uploaded images captured in the first period is greater than a threshold, the number of suggested candidates may be greater than when the number is equal to or less than the threshold.

[0137] <Embodiment 15> This embodiment also describes a modification of Embodiment 13. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 (see FIG. 1) described in Embodiment 13. In this embodiment, the presentation unit 102 (see FIG. 2) is added with a sub-function of determining a person to be used as the subject of a new sticker candidate in accordance with a person (e.g., a child) who is the subject of the uploaded image to be viewed, when uploaded images associated with a group (e.g., Family A) are displayed as the subject of the uploaded image to be viewed in a second column (e.g., uploaded image display column 252) different from the first column (i.e., selection screen column 258) in which sticker candidates are presented.

[0138] In this embodiment, the user selects sticker candidates to be displayed after the replacement. Fig. 35 is a flowchart illustrating an example of the processing operation of the presentation unit 102 in embodiment 15. In Fig. 35, parts corresponding to those in Fig. 32 are assigned the same reference numerals. In this embodiment, the processing operation up to step 52 is the same as in embodiment 13.

[0139] Next, the presentation unit 102 identifies the subject of the uploaded image currently displayed in the uploaded image display field 252 (step 61). The subject information is detected based on information about the subject, comments, and the like described in the uploaded image attribute information 113E (see FIG. 5), and the subject is included in the sticker candidates. Next, the presentation unit 102 selects replacement sticker candidates based on the uploaded image related to the identified subject (step 62). In this embodiment, the sticker candidate that includes the subject currently being viewed by the user is selected as the replacement candidate. Thereafter, the same processing operations as in embodiment 14 (i.e., steps 54 to 57) are executed.

[0140] The screen transitions according to this embodiment will be described below with reference to Figures 36 to 39. Figures 36 and 37 correspond to screen transitions when the subject of the uploaded image being viewed is different from the subject of the presented sticker candidates. On the other hand, Figures 38 and 39 correspond to screen transitions when the subject of the uploaded image being viewed is the same as the subject of the presented sticker candidates.

[0141] <When the Subject of the Uploaded Image Being Viewed is Different from the Subject of the Presented Sticker Candidates> FIG. 36 is a diagram illustrating the transition of screens corresponding to steps 51 and 52. In FIG. 36, the same reference numerals are used to denote corresponding parts to those in FIGS. 29 and 30 . The screen at time T1 is an example screen corresponding to step 51 (see FIG. 35 ). In FIG. 36 , a photo of "Child B" is displayed in the uploaded image display field 252. Note that sticker candidates with "Child A" as the subject are displayed in the selection screen field 258. Operating the "Edit" button 260 on this screen transitions to the screen at time T2. The screen at time T2 is an example screen corresponding to step 52 (see FIG. 35 ). In FIG. 36 , the sticker candidate for Child A located at the top left corner of the editing screen 270 is selected for editing.

[0142] FIG. 37 is a diagram illustrating screen transitions corresponding to steps 61, 62, 54, 55, and 57. In FIG. 37, the corresponding parts to those in FIGS. 33 and 34 are denoted by corresponding reference numerals. The screen at time T3 is an example screen corresponding to steps 61, 62, and 54 (see FIG. 35). The subject of the uploaded image shown in the display field 252 in FIG. 36 was Child B. Therefore, three sticker candidates with Child B as the subject are displayed on the proposal screen 280. The screen at time T4 is an example screen corresponding to step 57 (see FIG. 35). That is, the screen at time T4 is an example screen when one of the three sticker candidates is selected on the proposal screen 280 and the "OK" button 283 is operated. In the case of FIG. 37, the subject of the sticker candidate at the top left of the selection screen field 258 has changed from "Child A" to "Child B." As a result, the user can post a sticker candidate related to "Child B," the subject of the uploaded image being viewed.

[0143] <When the Subject of the Uploaded Image Being Viewed is the Same as the Subject of the Presented Sticker Candidates> FIG. 38 is a diagram illustrating the transition of screens corresponding to steps 51 and 52. In FIG. 38, the same reference numerals are used to denote portions corresponding to those in FIG. 36. In the case of FIG. 38, a photo of "Child A" is displayed in the display field 252 at time T1, and sticker candidates with "Child A" as the subject are displayed in the selection screen field 258. This is a difference from FIG. 36. When the "Edit" button 260 is operated on this screen, the screen transitions to the screen at time T2. The screen at time T2 is an example screen corresponding to step 52 (see FIG. 35). In the case of FIG. 38 as well, the sticker candidate for "Child A" located at the top left corner of the editing screen 270 is selected for editing.

[0144] FIG. 39 is a diagram illustrating screen transitions corresponding to steps 61, 62, 54, 55, and 57. In FIG. 39, the same reference numerals are used to denote corresponding parts to those in FIG. 37. The screen at time T3 is an example screen corresponding to steps 61, 62, and 54 (see FIG. 35). The subject of the uploaded image shown in the display field 252 in FIG. 38 was "Child A." Therefore, three sticker candidates with "Child A" as the subject are displayed on the proposal screen 280. This is the difference from FIG. 37. The screen at time T4 is an example screen corresponding to step 57 (see FIG. 35). In FIG. 39, the subject of the sticker candidate at the top left of the selection screen field 258 is "Child A" both before and after the swap. However, the content of the sticker candidate is different from that before the swap.

[0145] <Summary> By using the information processing system 1 (see FIG. 1 ) according to the present embodiment, it is possible to present sticker candidates that include the subject of the uploaded image that the user is viewing as replacement candidates. As a result, the number of sticker candidates that the user wants to post increases, and the posting of sticker candidates is encouraged.

[0146] Sixteenth Embodiment This embodiment also describes one form of the information processing system 1 (see FIG. 1) described in Embodiment 1. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in Embodiment 1.

[0147] The presentation unit 102 (see FIG. 2 ) in this embodiment adds a sub-function that, when a user specifies attributes of sticker candidates, selects and presents one or more sticker candidates generated from uploaded images that satisfy the specified attributes. Furthermore, the presentation unit 102 in this embodiment adds a sub-function that presents sticker candidates extracted based on the attributes in chronological order of capture date. Examples of attributes include the words and lines contained in the characters and images that make up the sticker candidates, the subject of the sticker candidate (e.g., a child), the subject's facial expression and emotion, and the subject's age. The facial expression of the subject includes features that express emotions, such as smiling eyes and a smiling mouth. Examples of emotions include "happy," "sad," and "angry."

[0148] In each of the above-described embodiments, the content of the sticker candidates presented to the user depends on the generation rules and presentation rules of the server 10. However, a mismatch between the presented sticker candidates and the user's preferences may occur. Therefore, this embodiment employs a mechanism that allows the user to specify the content of the presented sticker candidates. Figure 40 is a flowchart illustrating an example of the processing operation of the presentation unit 102 in embodiment 16. In Figure 40, parts corresponding to those in Figure 8 are assigned the same reference numerals.

[0149] The following description begins with the processing operation of the presentation unit 102. When the generation unit 101 generates sticker candidates, the presentation unit 102 determines whether or not the sticker candidates have required attribute settings (step 71). In this embodiment, it is assumed that the conditions required for the presentation of sticker candidates are set in advance in the participating user information 112 (see FIG. 2). However, a mechanism may be adopted in which a screen or button for accepting attribute settings is displayed each time the timing for presenting sticker candidates arrives, either prior to the presentation of the sticker candidates or after the display of the presentation screen 250 (see FIG. 9). Incidentally, the determination in step 71 is performed for each user.

[0150] If attributes are set, a positive result is obtained in step 71. In this case, the presentation unit 102 selects a predetermined number of sticker candidates generated from uploaded images that satisfy the attributes set for each user (step 72). Next, the presentation unit 102 presents the selected sticker candidates to the target user in order of image capture date and time (step 73). On the other hand, if attributes are not set, a negative result is obtained in step 71. In this case, the presentation unit 102 selects a predetermined number of sticker candidates from the uploaded images based on a common rule (step 74). Here, the common rule is assumed to be, for example, the rule described in embodiment 1. Next, the presentation unit 102 presents the selected sticker candidates to the target user (step 75). Note that the sticker candidates in step 75 may also be presented in order of image capture date and time.

[0151] <Summary> By using the information processing system 1 (see FIG. 1) according to this embodiment, sticker candidates that meet the user's needs can be presented. In addition, by arranging the presented sticker candidates in chronological order of image capture date and time, the user can easily select a sticker candidate.

[0152] Seventeenth Embodiment This embodiment also describes one form of the information processing system 1 (see FIG. 1) described in Embodiment 1. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in Embodiment 1.

[0153] In this embodiment, the presentation unit 102 is additionally provided with a sub-function that changes the content of the presented sticker candidates depending on whether the user to whom the post is made is a first user (a user registered in the family album) who belongs to the same group as the user who posted the sticker candidate, or a second user (a user not registered in the family album) who does not belong to the same group as the user who posted the sticker candidate. Furthermore, the presentation unit 102 in this embodiment is additionally provided with a sub-function that preferentially presents, as sticker candidates to be presented to the second user, sticker candidates generated from uploaded images whose disclosure range is set to include outside the group.

[0154] In the above-described embodiment, it is assumed that the scope of disclosure of uploaded images is limited to the same group (family), but in this embodiment, a mechanism for distinguishing the contents of the sticker candidates presented in a case where a user's settings allow the disclosure of uploaded images to users outside the group will be described. Figure 41 is a diagram illustrating an example of uploaded image information 113 employed in embodiment 17. In Figure 41, the parts corresponding to those in Figure 5 are assigned reference numerals. In the case of Figure 41, the file name 113C is "F2004" and the disclosure setting 113D is "unrestricted."

[0155] FIG. 42 is a flowchart illustrating an example of the processing operation of the presentation unit 102 (see FIG. 2) and the control unit 103 (see FIG. 2) in embodiment 17. Note that in FIG. 42, parts corresponding to those in FIG. 11 are assigned with reference numerals. The processing operation shown in FIG. 42 is executed after the processing operation of step 2 (see FIG. 8) is completed. First, the presentation unit 102 determines whether the posting destination is a user outside the family (step 81). This determination is made, for example, based on whether or not a button dedicated to posting to the posting destination has been operated. FIG. 43 is a diagram illustrating an example of a viewing screen for uploaded images with a display button for sticker candidates. In FIG. 43, parts corresponding to those in FIG. 12 are assigned with reference numerals.

[0156] In the case of FIG. 43 , a dedicated button 261 has been added to the comment input field 255. The dedicated button 261 shown in FIG. 43 is labeled "Post sticker outside family." A face mark 256 is also provided in the comment input field 255. As described in the first embodiment, the face mark 256 is a button used to instruct the display of a selection screen for sticker candidates addressed to family members. Return to the description of FIG. 42 . If the posting destination is a user within the family (if the face mark 256 is operated), a negative result is obtained in step 81. In this case, the presentation unit 102 passes the processing operation to step 15 (see FIG. 11 ).

[0157] On the other hand, if the posting destination is a user outside the family (if the dedicated button 261 is operated), a positive result is obtained in step 81. In this case, the presentation unit 102 determines whether the uploaded images corresponding to the sticker candidates generated in step 2 include uploaded images that can be made public to people outside the family (step 82). If uploaded images that can be made public to people outside the family are included (i.e., if uploaded images with an "unrestricted" visibility range are included), the presentation unit 102 presents sticker candidates generated from uploaded images with no visibility range limit over other sticker candidates (step 83). On the other hand, if uploaded images that can be made public to people outside the family are not included (i.e., if only uploaded images with an "unrestricted" visibility range are included), the presentation unit 102 presents sticker candidates (step 84).

[0158] FIG. 44 illustrates display examples of a selection screen 258B corresponding to a posting instruction to outside the family and a selection screen 258C corresponding to a posting instruction to within the family. As described above, the selection screen 258B presents six sticker candidates with an unlimited visibility range and two sticker candidates with a family-only visibility range. Note that the selection screen 258B may present only sticker candidates generated from uploaded images with an "unlimited" visibility range. On the other hand, the selection screen 258C presents more sticker candidates featuring children as subjects than sticker candidates featuring "Mom" or "Dad" as subjects. Note that the selection screen 258C is displayed when a negative result is obtained in step 81 (see FIG. 42 ).

[0159] Returning to the description of FIG. 42 , after step 83 or step 84, the control unit 103 determines whether or not a selection of a sticker candidate to be posted has been accepted (step 85). In this embodiment, it is determined whether or not a specific sticker candidate has been pressed and held down. If a long press on a specific sticker candidate is not detected, a negative result is obtained in step 85. In this case, the control unit 103 assumes that no sticker candidate has been posted, and ends the series of processes. On the other hand, if a long press on a specific sticker candidate is detected, a positive result is obtained in step 85. In this case, the control unit 103 determines whether or not a sticker candidate with no restrictions on the scope of disclosure has been selected (step 86).

[0160] If the selected sticker candidate has no restrictions on the scope of disclosure, a positive result is obtained in step 86. In this case, the control unit 103 adds the selected sticker candidate to the comment display section of the posting destination (step 87). On the other hand, if the selected sticker candidate has restrictions on the scope of disclosure, a negative result is obtained in step 86. In this case, the control unit 103 cancels the posting operation and outputs a warning (step 88). FIG. 45 is a diagram illustrating an example of the warning 262 output when a sticker candidate generated from an uploaded image restricted to family members is selected. The screen at time T11 shows the state in which the sticker candidate located at the left end of the bottom row is selected. As described in FIG. 44, the scope of disclosure of the uploaded image used to generate the selected sticker candidate is restricted to family members. Therefore, a warning 262 is displayed as a pop-up on the screen at time T12. The warning 262 shown in FIG. 45 displays the title "Caution!" and the explanation "The selected sticker cannot be posted. Please select another sticker."

[0161] <Summary> By using the information processing system 1 (see FIG. 1) according to this embodiment, it is possible to change the content of the sticker candidates presented depending on the relationship between the user to whom the post is to be made and the group to which the user from whom the post is to be made belongs. Furthermore, if the user to whom the post is to be made does not belong to a group, it is possible to preferentially present sticker candidates that can be posted to the user.

[0162] <Embodiment 18> In this embodiment, a form of the information processing system 1 (see FIG. 1) described in Embodiment 1 will be described. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in Embodiment 1. However, a function of presenting reactions using stickers is added to the presenting unit 102 (see FIG. 2) in this embodiment.

[0163] The following functions a to j are added to the presentation unit 102 in this embodiment. Function a Function a accepts operations on a predetermined operator (e.g., a reaction button) arranged on a viewing screen for uploaded images (image data) associated with a user group (e.g., a family group). In this embodiment, the predetermined operator (e.g., a reaction button) is displayed even when the comment function is turned off.

[0164] Function b Function b presents a set of reaction sticker candidates (i.e., candidate image data) to be presented on a client device (i.e., user terminal 20) operated by a user belonging to a user group (e.g., a family group). In the present embodiment, one set consists of a maximum of eight sticker candidates. Note that the number of sticker candidates displayed simultaneously is not limited to the maximum number. For example, the eight sticker candidates may be divided into two groups of four, and the stickers may be displayed by switching between groups.

[0165] The generation of reaction sticker candidates (i.e., candidate image data) may be performed by operating a predetermined operator, or may be performed at any time after the upload image (image data) being viewed is uploaded. In this embodiment, the above-mentioned sticker candidate generation rules 115 (see FIG. 2) are used to generate reaction sticker candidates. However, sticker candidate generation rules specifically for reactions may also be prepared.

[0166] For example, sticker candidates are generated from the uploaded image to be viewed. In this case, sticker candidates are generated for one or more facial images (i.e., for each person) included in the uploaded image to be viewed. For example, if the uploaded image includes a facial image of "Mr. A" and a facial image of "Mr. B," sticker candidates with the facial image of Mr. A as the original image and sticker candidates with the facial image of Mr. B as the original image are generated.

[0167] For example, sticker candidates are generated from one or more uploaded images that share the same personal information recorded in attribute information 113E (see FIG. 5) of the uploaded image that was the subject of the reaction. For example, if a child's name is recorded in attribute information 113E of the uploaded image, one or more uploaded images with the same name recorded are used to generate sticker candidates to be presented to the user. Alternatively, sticker images generated from one or more uploaded images with the same name recorded are searched for as presentation candidates from among pre-generated sticker images.

[0168] The search criteria may also include other attributes recorded as attribute information 113E. For example, "smile" or other facial expressions, "birthday" or other anniversaries or events, "park" or other shooting locations, etc. may be used to search for original images. For example, it is possible to present a list of sticker candidates generated from original images with the same or similar facial expressions. This makes it possible to present sticker candidates with similar facial expressions.

[0169] For example, it will be possible to present a list of sticker candidates generated from original images that share a common anniversary or event. This will allow users to review changes in the facial features of people included in uploaded images through the presentation of sticker candidates. For example, it will be possible to present a list of sticker candidates generated from original images that share a common shooting location. This will allow users to review differences in the appearance of people photographed at a common shooting location through the presentation of sticker candidates.

[0170] The search criteria may also include the image capture date and time 113B (see FIG. 5). For example, uploaded images captured in the same month as the current date and time may be targeted, or uploaded images captured within 30 days of the current date and time may be targeted. The search criteria may be individually set or changeable by the user. Furthermore, the search criteria may be specified following a reaction operation, or may be specified after sticker candidates are presented. In the former case, one or more sticker candidates that meet the specified search criteria are presented as a set. In the latter case, one or more sticker candidates that are regenerated using an uploaded image that matches the specified search criteria as the original image are presented as a set.

[0171] For example, sticker candidates are generated from one or more uploaded images that contain a facial image that is the same as or similar to a facial image contained in an uploaded image that is the target of a reaction. Note that the original image of the generated sticker candidate may or may not include the uploaded image that is the target of viewing.

[0172] There is no limit to the number of reaction sticker candidates that can be generated. However, if there are too many sticker candidates, it may be a burden on the user. It also increases the computational burden on the server 10 (see FIG. 1) and the user terminal 20 (see FIG. 1). For this reason, an upper limit may be set on the number of sticker candidates that can be generated for one reaction operation. For example, the upper limit on the number of sticker candidates that can be generated may be set to the upper limit on the number of sticker candidates that can be presented to the user for one reaction operation. In this embodiment, eight is used as an example of the upper limit.

[0173] Note that if the number of update images that can be used as original images is small, the number of sticker candidates generated may not reach the set upper limit. In this embodiment, three sets of sticker candidates (i.e., eight x three) = 24 candidates are generated. One of the three sets may be randomly selected as the target for presentation, or eight sticker candidates to be presented to the user may be determined based on a priority order set among the sets.

[0174] For example, if "Set 1" has the highest priority, "Set 2" has the second highest priority, and "Set 3" has the third highest priority, the eight sticker candidates included in "Set 1" may be presented to the user. However, if a sticker editing command is issued using function g (described later), the sticker candidates included in "Set 2" and "Set 3" may be presented to the user. This concept may be the same as the three sticker candidates shown in the suggested candidate field 282 (see FIG. 33). In this case, the leftmost sticker candidate corresponds to "Set 1," the middle sticker candidate corresponds to "Set 2," and the rightmost sticker candidate corresponds to "Set 3." Each set may be assigned a priority level classified by the difference in score, as described in a nineteenth embodiment (described later).

[0175] Function c: Function c receives an instruction from the user regarding the selection of a reaction sticker candidate (i.e., candidate image data). The selection is made using, for example, a tap operation, a double tap operation, or a long press operation.

[0176] Function d Function d displays the selected sticker (i.e., the selected candidate image data) on the viewing screen. In this embodiment, the sticker is displayed separately from the reaction button. Note that if multiple reaction operations are recorded for the same uploaded image, for example, only the sticker corresponding to the most recent reaction may be displayed on the viewing screen, or multiple stickers corresponding to each reaction may be displayed in chronological order.

[0177] The time axis may be, for example, from left to right (i.e., the right is the latest) or from bottom to top (i.e., the top is the latest). When displaying multiple stickers in chronological order, an upper limit may be set on the number of stickers displayed on the viewing screen. The upper limit on the number of stickers may be, for example, four, or may be up to the edge of the viewing screen.

[0178] Function e: When a user other than the person who posted the sticker operates a sticker (i.e., selected candidate image data) on the viewing screen, function e displays information about the user who posted the sticker. For example, when a user other than the user who operated the reaction button finds a sticker displayed on the viewing screen, the user may want to know who made the reaction. By providing function e, the user can know who made the reaction. The posting date and time of the sticker may also be displayed at the same time.

[0179] The user information may be the name of the user who posted the sticker in association with the currently displayed sticker, or may be displayed in a separate window. Only the information of the user who posted the sticker that is the target of the operation may be displayed, or user information corresponding to all reactions (i.e., all stickers) recorded in association with the currently viewed uploaded image may be displayed simultaneously. For example, if multiple reactions are recorded for the currently viewed uploaded image, the stickers and user names may be displayed in a list in a separate window.

[0180] Function f Function f cancels a reaction when the poster operates (e.g., taps) a sticker (i.e., selected candidate image data). When a reaction is canceled, the corresponding sticker disappears from the viewing screen. Note that the operation log may contain both a record of the reaction operation and a record of the reaction cancellation operation.

[0181] While the user who canceled the reaction is using the image sharing service (for example, a family album service), the user can post stickers by operating the reaction button any number of times. In this embodiment, the cancellation of the reaction using function f is also permitted for users who are not using the image sharing service at the time of cancellation. However, the reaction button may not be displayed for users who are not using the image sharing service, or operation of the reaction button may be disabled.

[0182] Function g: Function g edits the design of the sticker through operations on the editing screen when the person who reacted instructs editing of the sticker (i.e., the candidate image data after posting) (for example, when operating the "Edit" button). After reacting, there may be times when the design of the sticker posted becomes unsatisfactory. In this case, the design can be changed by canceling the reaction (function f) and reacting again (functions a to d). Function g is provided for cases where you want to change the design without canceling the reaction.

[0183] For example, an "Edit" button dedicated to stickers posted as reactions may be provided. In the case of function g, similar to when editing a sticker candidate to be posted as a comment (see FIG. 28), an editing screen is presented to the user, allowing them to change to a sticker candidate with a different design. When a change in design is accepted, function g replaces the design of the corresponding sticker with the changed design. The sticker before the change may or may not be saved as a log image, for example.

[0184] If the display name 112B (see FIG. 4) registered for the user who edited the sticker is different at the time of the reaction and the time of the change, the user name displayed by function e may be changed retroactively to the user name at the time of editing, or it may not be changed. In this embodiment, the user name associated with the sticker is changed only when the sticker is edited. Therefore, unless the sticker is edited, the user name displayed at the time of posting is maintained even if the user's display name 112B is changed after the reaction.

[0185] Function h Function h allows the display of reaction buttons in the uploaded image display field 252 (see FIG. 12 ) when certain conditions are met. For example, the reaction button is always displayed for users who have subscribed to the reaction service, but the reaction button is not displayed for users who have not subscribed. However, the reaction button may also be displayed for non-subscribed users on specific days (e.g., the 1st, 2nd, or end of the month), specific days of the week (e.g., Saturdays), and during campaign periods (e.g., New Year's Day, public holidays, Halloween, and Christmas).

[0186] Another example of a specific condition is whether or not reactions are permitted. For example, users who are permitted to react and users who are not permitted to react are added to the information managed in the album information 111 (see FIG. 3), participating user information (see FIG. 4), and uploaded image information 113 (see FIG. 5). This mechanism also allows the administrative user to individually set whether or not to accept reaction operations for uploaded images.

[0187] Function i: Function i changes the type of design of the sticker candidates posted as reactions depending on the conditions met by the user. For example, when a user who has subscribed to the reaction service operates the reaction button, sticker candidates generated from the faces and images of people included in the uploaded image being viewed are presented to the user. However, when a user who is not a subscriber operates the reaction button, pre-prepared generic stickers are presented to the user.

[0188] The generic sticker may be a heart mark, a star mark, or the like, as long as it allows the user to recognize the presence of a reaction. From the viewpoint of promoting the use of the image sharing service, it is preferable that the design of the generic sticker contains less information than the stickers that service users can post. The generic sticker may also be displayed in grayed-out or black and white. Note that users of the image sharing service may be able to select generic stickers in addition to stickers generated from uploaded images.

[0189] Function j: Function j identifies the user who performed the reaction operation and determines at least one of the content and order of sticker candidates to be presented depending on the identified user. For example, it refers to one or more attributes of the user account 112A (see FIG. 4), the administrative user 112C (see FIG. 4), the relationship 112E (see FIG. 4), and the upload permission information 112F (see FIG. 4).

[0190] For example, if the user who performed the reaction operation is an administrative user or a user who uploaded the uploaded image to be reacted to, function j prioritizes sticker candidates in which the content of the words included in the composite image (see FIG. 7) that constitutes the sticker candidate is the content of a speech to another user (e.g., "It was fun" or "You've grown up"). Alternatively, function j prioritizes sticker candidates that express the emotions or feelings of a person (e.g., a child) included in the uploaded image.

[0191] Specifically, when there are prioritized sticker candidates and non-priority sticker candidates, the prioritized sticker candidates are preferentially included as sticker candidates to be presented to the user. Note that if the number of prioritized sticker candidates exceeds the upper limit of the sticker candidates to be presented, the non-priority sticker candidates are not included as candidates to be presented.

[0192] Among the sticker candidates to be prioritized, for example, a sticker candidate with a newer image capture date or upload date may be prioritized. Note that the priority relationship illustrated is merely an example, and a priority relationship may be established based on the content of the wording, or a user's tendency may be identified from past usage history or selection history, and the priority among the sticker candidates may be set according to the identified tendency. Note that the tendency identified from usage history or selection history may change.

[0193] It is desirable that the criteria and priority relationships for determining priority targets reflect current trends. For example, trends are determined using the history for the same month or week as the current time or the history for the past 30 days. For example, sticker candidates that have been posted more frequently are given a higher priority than sticker candidates that have been posted less frequently. Priority sticker candidates are displayed in a more prominent position (for example, at the top of the display area) than non-priority stickers.

[0194] On the other hand, for example, if the user who performed the reaction operation is a non-administrative user, function i will prioritize sticker candidates in which the content of the text contained in the composite image (see Figure 7) that makes up the sticker candidate is the content of the speech (e.g., "cute" or "like") in response to the uploaded image that is the target of the reaction.

[0195] An example of a viewing screen realized by the above-mentioned functions a to k will be described below. FIG. 46 is a diagram illustrating an example of an upload image viewing screen on which a reaction button 256A is arranged. In FIG. 46, parts corresponding to those in FIG. 12 are assigned the same reference numerals. The reaction button 256A shown in FIG. 46 is displayed in the upload image display column 252. In other words, the reaction button 256A is superimposed on the upload image. The operation in the above-mentioned function a is accepted, for example, through an operation on the reaction button 256A.

[0196] The upload image viewing screen shown in Figure 46 is before reactions. In Figure 46, the design of the reaction button 256A is the same as the display button (face mark 256) on the selection screen for sticker candidates for posting. However, the design of the reaction button 256A may also be, for example, a good button or a like button.

[0197] FIG. 47 is a diagram illustrating an example of a display screen 256B for selecting reaction sticker candidates that is displayed after operating the reaction button 256A. In FIG. 47, the same reference numerals are used to denote corresponding parts to those in FIG. 46 . The display of the selection screen 256B shown in FIG. 47 is an example of presenting a set of sticker candidates in function b. In the case of FIG. 47 , four of the eight generated sticker candidates are displayed on the selection screen 256B. By swiping left or right, it is possible to switch to displaying the four sticker candidates that are not displayed. However, the displayed sticker candidates may be replaced one at a time or two at a time.

[0198] Fig. 48 is a diagram illustrating an example of a display for confirming a sticker candidate 256C selected by the user. In Fig. 48, the same reference numerals are used to denote parts corresponding to those in Fig. 46. The display of the sticker candidate 256C shown in Fig. 48 is executed in response to an instruction regarding selection in function c.

[0199] The display size of the sticker candidates displayed on the selection screen 256B (see FIG. 47) is larger than the display size of the sticker that will ultimately be displayed. On the other hand, there is a possibility that the user may mistakenly select the wrong sticker candidate. Therefore, in this embodiment, as shown in FIG. 48, an enlarged image of the selected sticker candidate 256C is temporarily displayed. In the example of FIG. 48, the sticker candidate that is displayed second from the left on the selection screen 256B (see FIG. 47) and contains the phrase "Yay!" is displayed in front of the uploaded image.

[0200] Fig. 49 is a diagram illustrating a display example of posted sticker 256E. In Fig. 49, the same reference numerals as in Fig. 46 are used. The display of sticker 256E shown in Fig. 49 is realized by function d. In the case of this embodiment, sticker 256E corresponding to sticker candidate 256C (see Fig. 48) selected by the user is displayed in speech bubble 256D associated with reaction button 256A.

[0201] By displaying this sticker 256E, the user who operated the reaction button 256A can confirm on the screen that their reaction has been accepted. On the other hand, a user who is viewing an uploaded image can confirm whether or not a reaction operation has been performed by checking whether or not the sticker 256E is present in the display field 252 for the uploaded image. In the case of FIG. 49, the user can be aware of the presence of a user who has performed a reaction operation on the uploaded image being viewed. Note that although only one sticker 256E is displayed in FIG. 49, multiple stickers 256E may be displayed.

[0202] FIG. 50 is a diagram illustrating an example of a screen displaying a plurality of stickers 256E. In FIG. 50, the same reference numerals are used to denote the corresponding parts to those in FIG. 49. In the case of FIG. 50, the sticker 256E posted later is displayed in a position higher than the sticker 256E posted earlier. Incidentally, the sticker 256E posted later includes the characters "I love you." This sticker 256E corresponds to the sticker candidate displayed third from the left on the selection screen 256B (see FIG. 47).

[0203] FIG. 51 is a diagram illustrating an example of the display of the posting user information field 256F that is displayed when a user other than the person who posted the reaction taps on a sticker 256E. In FIG. 51, the parts corresponding to those in FIG. 49 are denoted with corresponding reference numerals. The display of the posting user information field 256F is realized by function e. In the example of FIG. 51, it is shown that two stickers 256E were posted as reactions, that the sticker 256E with the phrase "Yay!" was posted by "Mom," and that the sticker 256E with the phrase "I love you" was posted by "Grandma." The display of the posting user information field 256F makes it possible to check the number of reactions, the designs of the stickers 256E posted to date, and the names of the users who posted each sticker 256E.

[0204] FIG. 52 is a diagram illustrating the changes in the screen that occur when the poster operates sticker 256E. In FIG. 52, the same symbols are used to denote parts corresponding to those in FIG. 49. In the case of FIG. 52, sticker 256E, which was displayed in display field 252 for the uploaded image, disappears from the screen after the person who posted the reaction taps it. In other words, the reaction is canceled. Cancellation of a reaction is achieved by function f.

[0205] FIG. 53 is a diagram illustrating another example of a change in the screen that occurs when the poster operates sticker 256E. In FIG. 53, the parts corresponding to those in FIG. 49 are denoted by the same reference numerals. In the case of FIG. 53, the reaction corresponding to sticker 256E (a sticker with "Yay") that was displayed in display field 252 of the uploaded image is canceled, and the display is switched to sticker 256E (a sticker with "I love you") that was not displayed. Note that the poster's reaction may also be canceled by tapping speech bubble 256D instead of sticker 256E, for example.

[0206] Fig. 54 is a diagram illustrating another example of changes in the screen that occur when the poster operates sticker 256E. In Fig. 54, the same reference numerals are used to denote parts corresponding to those in Fig. 49. Fig. 54 illustrates a case where multiple stickers 256E are displayed in display field 252 for uploaded images, and the "Good job" sticker is cancelled.

[0207] Incidentally, even when multiple reactions have been accepted, only the sticker 256E corresponding to the most recent reaction may be displayed in the uploaded image display field 252, and one or more stickers 256E corresponding to previous reactions may not be displayed. For example, see the case shown in Figure 51. In Figure 51, the presence of two reactions can be confirmed from the display in the poster user information field 256F, but only one sticker 256E is displayed in the uploaded image display field 252.

[0208] Even in this case, if the user who tapped the displayed sticker 256E has a history of reactions to the uploaded image being viewed, the user's reaction will be canceled. However, even if a reaction that is not displayed in the uploaded image display field 252 is canceled, no change will occur in the screen display. Note that it may also be possible to cancel reactions from the posting user information field 256F (see FIG. 51 ).

[0209] FIG. 55 is a diagram illustrating an example of a screen on which a sticker 256E posted as a reaction can be edited. In FIG. 55, the same reference numerals are used to denote corresponding parts to those in FIG. 49 . An "Edit" button 256G has been added to the display field 252 for uploaded images shown in FIG. 55 . The display of the "Edit" button 256G is realized by function g. In the case of FIG. 55 , the "Edit" button 256G is displayed above the sticker 256E in the display field 252 for uploaded images. By displaying the "Edit" button 256G around the sticker 256E, it is indicated that the "Edit" button 256G is for editing the sticker 256E.

[0210] Fig. 56 is a diagram illustrating an example of a proposal screen 290 that pops up after operating the "Edit" button 256G. In Fig. 56, the parts corresponding to those in Fig. 55 are assigned the same reference numerals. The proposal screen 290 shown in Fig. 56 has a title field 291, a proposal candidate field 292, and an "OK" button 293. In the case of Fig. 56, the title field 291 has the heading "Replace Photos" followed by the explanation "You can choose from the automatically suggested options."

[0211] In the case of Fig. 56, the suggested candidate column 292 has three candidates and radio buttons corresponding to each candidate. For example, the candidate on the far left shows the design of the current sticker. This design corresponds to "Set 1." The middle candidate corresponds to the design of "Set 2," and the candidate on the far right corresponds to the design of "Set 3." In the case of Fig. 56, the "design to be combined" portion of the three candidates is the same, and only the facial expressions in the photographs are different. In the example of Fig. 56, the candidate in the middle is in a selected state.

[0212] When the "OK" button 293 is operated with any candidate selected, the selection of the candidate is confirmed. When the selection of the candidate is confirmed, the proposal screen 290 is closed. FIG. 57 is a diagram illustrating an example of a display screen after the design of the sticker 256E has been changed. In FIG. 57, the parts corresponding to those in FIG. 55 are assigned the same reference numerals. It can be seen that the design of the sticker 256E has been changed.

[0213] FIG. 58 is a diagram illustrating the cases in which the reaction button 256A is displayed and the cases in which it is not displayed depending on the user. In FIG. 58, the parts corresponding to those in FIG. 52 are assigned the same reference numerals. The display shown in FIG. 58 is realized through function h. The upper diagram shows the display field 252 for uploaded images presented to users who have subscribed to the reaction service. The lower diagram shows the display field 252 for uploaded images presented to users who have not subscribed to the reaction service.

[0214] As mentioned above, even users who have not subscribed to the reaction service may be presented with the same screen as users who have subscribed to the reaction service on specific days, etc. Alternatively, the upper diagram may be a display field 252 for uploaded images presented to users who are permitted to react. The lower diagram may be a display field 252 for uploaded images presented to users who are not permitted to react.

[0215] FIG. 59 is a diagram illustrating an example in which the designs of sticker candidates presented vary depending on the conditions satisfied by the user. In FIG. 59, the parts corresponding to those in FIG. 47 are assigned the same reference numerals. The display shown in FIG. 59 is realized through function i. The upper diagram shows sticker candidates presented to users who have subscribed to the reaction service. As in the case of FIG. 47, four candidates generated from facial images of people included in uploaded images are displayed. The lower diagram shows sticker candidates presented to users who have not subscribed to the reaction service. In the case of FIG. 59, three generic stickers are displayed. The number of candidates displayed is small, and the designs are simple.

[0216] FIG. 60 is a diagram illustrating an example of sticker candidate presentation according to user attributes (e.g., relationship 112E (see FIG. 4)). In FIG. 60, the parts corresponding to those in FIG. 47 are assigned the same reference numerals. The display shown in FIG. 60 is realized through function j. The upper diagram shows an example of a display screen 256B for selecting reaction sticker candidates to be presented to "Mom." The lower diagram shows an example of a display screen 256B for selecting reaction sticker candidates to be presented to "Grandma."

[0217] In the case of Fig. 60, the sticker candidates presented to "Mom" and the sticker candidates presented to "Grandma" are all different, but sticker candidates common to both may be included. Fig. 61 is a diagram illustrating another example of presenting sticker candidates according to user attributes (e.g., relationship 112E (see Fig. 4)). In Fig. 61, the parts corresponding to those in Fig. 47 are denoted by the same reference numerals.

[0218] In the example of Figure 61, of the four sticker candidates presented to "Mom" and "Grandma," the two on the right are common. Note that sticker candidates exclusive to "Mom" and "Grandma" are given priority over sticker candidates common to both "Mom" and "Grandma." For this reason, sticker candidates exclusive to each user are placed at the top (left side).

[0219] <Summary> By using the information processing system 1 (see FIG. 1) according to this embodiment, a user can post a reaction to an uploaded image being viewed as a sticker 256E (see FIG. 49). Reactions using stickers 256E can be posted more easily than posting comments. In addition, posting stickers 256E related to a face image or the like of a person included in an uploaded image being viewed allows the user to add their own emotions, unlike reactions using general-purpose stickers that only contain text, etc.

[0220] <Embodiment 19> In this embodiment, one form of the information processing system 1 (see FIG. 1) described in Embodiment 1 will be described. Therefore, this embodiment also assumes the system configuration and processing operation of the information processing system 1 described in Embodiment 1. In this embodiment, a function for generating candidates for sticker 259A (see FIG. 14) posted as a comment will be described. However, the function described in this embodiment can also be applied to generating candidates for sticker 256E (see FIG. 49) posted as a reaction.

[0221] The following functions k to l are added to the presentation unit 102 in this embodiment. Function k Function k calculates an emotion score for each face image included in a sticker candidate (candidate image data) using a predetermined algorithm. Function k is executed every time a user uploads image data. When it detects that image data has been uploaded, function k executes an image analysis pipeline. In the analysis pipeline, processing is executed to detect the face of a person included in the uploaded image (image data). When a face is detected, a rectangle is set to surround the face, and the area enclosed by the rectangle is saved as a face image. If the uploaded image (image data) includes the faces of multiple people, face images for multiple people are saved.

[0222] When a facial image is acquired, an emotion score is calculated for each facial image. The calculated value is used as an estimate of the emotion of the person included in the facial image. The emotion score includes a score s for each index. The index may be, for example, anger, disgust, fear, happiness, neutral, sadness, or surprise. Each index score is calculated as a numerical value between 0.0 and 1.0. In this embodiment, the anger score is s1, the disgust score is s2, the fear score is s3, the happiness score is s4, the neutral score is s5, the sadness score is s6, and the surprise score is s7.

[0223] In addition, the emotion-related scores include an emotion score S. The emotion score S is calculated, for example, using the following algorithm. Note that the algorithm shown below is merely an example. Emotion score S = Σsi (where i = 1 to 7) Note that face images with a happiness score S4 of 0.8 or higher may be assigned positive points, and face images with a neutral score S5 of 0.8 or higher may be assigned negative points. This allows a priority relationship to be established between face images even if the magnitude of the emotion score S, which does not take points into consideration, is the same. A total score T, obtained by adding and subtracting positive points to and from the emotion score S, may be used as an estimation result of emotion. The total score T is also included in the emotion-related scores.

[0224] Function k stores the calculated emotion score S and total score T in association with the uploaded image. Note that function k may be realized as a trained model that has been trained to output, for example, the emotion score S or the total score T when a face image is input. Note that a trained model that outputs the aforementioned index-specific score s instead of the emotion score S etc. may be prepared, and the emotion score S etc. may be calculated using the index-specific score s output from the trained model.

[0225] Function 1 Function 1 controls the presentation of sticker candidates (candidate image data) according to the magnitude of the emotion score. The emotion score here may be the aforementioned index-specific score S, the emotion score S, or the overall score T. Note that the emotion score may include scores corrected based on the posture of each person in the uploaded image, the image size, and the like. For example, the score of a sticker candidate generated from a face image facing forward will be higher than the score of a sticker candidate generated from a face image facing sideways. For example, the score of a sticker candidate generated from a face image with a large image size will be higher than the score of a sticker candidate generated from a face image with a small image size.

[0226] Furthermore, the controlled presentation may include not only the presentation of sticker candidates individually, but also the presentation of sticker candidates as a set. For example, function 1 may present the top eight sticker candidates by score as "Set 1." In this case, the top nine through sixteen sticker candidates by score are presented as "Set 2," and the top seventeen through twenty-four sticker candidates by score are presented as "Set 3."

[0227] Furthermore, function l may synthesize a design of words corresponding to the index-specific score s onto the facial image. FIG. 62 is a diagram illustrating an example of generating a sticker candidate using the index-specific score s. As described above, when a facial image is cut out from an uploaded image, the index-specific score s is calculated using a predetermined algorithm. In the example of FIG. 62, the happiness score s4 is high. Therefore, a design including words such as "excited" is selected from the designs for synthesis (see FIG. 7) and synthesized onto the facial image. This makes it possible to synthesize a design that matches the facial expression of the facial image used to generate the sticker candidate.

[0228] Function 1 may also be provided with a sub-function that allows the user to select the facial tone of the sticker candidate. This sub-function can be realized, for example, by adding a scroll bar to the sticker candidate presentation screen 250 (see FIG. 9 ). One end of the scroll bar may be designated as "positive" and the other end as "negative," allowing the presented content to be switched to a set of sticker candidates with facial expressions corresponding to the position of the slider.

[0229] The number of scroll bars may be multiple depending on the combination of indicators. Also, an indicator may be assigned to each vertex of the radar chart, and when the numerical value for each indicator is specified by the position of a slider in the chart, the presented content may be switched to a set of sticker candidates that meet the conditions of the indicator. Similarly, the presented sticker candidates may be switched by changing the position of the slider on the scroll bar assigned to the emotion score S or the overall score T. Each score may be input as a numerical value.

[0230] In addition, function 1 may identify trends in the emotional scores of sticker candidates posted by the user (for example, the combination of scores s for each indicator, the magnitude of the emotional score S, and the magnitude of the overall score T) from the posting history, or may learn trends in the emotional scores of sticker candidates posted by the user and select sticker candidates to present in accordance with the user's preferences.

[0231] <Summary> By using the information processing system 1 (see FIG. 1) according to this embodiment, sticker candidates (candidate image data) presented to a user can be controlled according to a score related to an emotion estimated from a corresponding face image.

[0232] Other Embodiments The disclosed embodiments are not limited to the above-described embodiments. For example, elements of the respective embodiments can be combined as appropriate. The combinations here include omitting elements of the respective embodiments. For example, in the above-described embodiments, the presenting unit 102 (see FIG. 2) executes the processing operations for realizing the presentation of sticker candidates described in the respective embodiments. However, the generation operation of the sticker candidates by the generating unit 101 (see FIG. 2) may be controlled so as to realize the presentation of sticker candidates in the respective embodiments.

[0233] <Summary> The main features of the information processing device, information processing method, recording medium, and information processing system described in the embodiments are listed below. [General Problem] One of the objectives of the present disclosure is to increase opportunities to use shared images.

[0234] Problems Corresponding to [Supplementary Note 1] One of the objectives of the present disclosure is to make image data related to a user group available for posting. [Supplementary Note 1] An information processing device according to this embodiment includes: one or more processors; and a non-transitory computer-readable memory connected to the one or more processors and executing instructions, which, when executed by the one or more processors, perform the following: storing a plurality of image data and information about a user group associated with the image data in one or more storage devices; generating candidate image data for posting from image data including an image of a person associated with the user group, from among one or more image data related to the user group; presenting a set of the candidate image data for posting on a client device operated by a user belonging to the user group; and receiving an instruction from the user regarding the selection of the candidate image data for posting. The above information processing device makes it possible to make image data related to a user group available for posting.

[0235] [Supplementary Note 2] One of the objectives of the present disclosure is to match the range of users to whom candidate image data for posting is presented with the range of users to whom image data used to generate the candidate image data for posting is made public. [Supplementary Note 2] The information processing device described in Supplementary Note 1 further includes the following: presenting the candidate image data for posting to users who belong to the public range of the image data used to generate the candidate image data for posting; not presenting the candidate image data for posting to users who do not belong to the public range of the image data used to generate the candidate image data for posting. This makes it possible to match the range of users to whom candidate image data for posting is presented with the range of users to whom image data used to generate the candidate image data for posting is made public.

[0236] [Supplementary Note 3] One of the objectives of the present disclosure is to increase the chances that the presented candidate image data for posting will actually be posted. [Supplementary Note 3] The information processing device described in Supplementary Note 1 further includes the following: presenting more candidate image data for posting that include images of children than candidate image data for posting that include images of adults. This increases the chances that the presented candidate image data for posting will actually be posted.

[0237] [Supplementary Note 4] One of the objectives of the present disclosure is to change the content of the candidate image data for posting that is presented to each user. [Supplementary Note 4] The information processing device described in Supplementary Note 1 further includes the following: changing the candidate image data for posting that is presented to each user based on the usage history of the image data by each user belonging to the user group. This allows the content of the candidate image data for posting that is presented to each user to be changed.

[0238] Problems corresponding to [Supplementary Note 5] One of the objectives of the present disclosure is to change the proportion of subjects appearing in the presented candidate image data for posting for each user. [Supplementary Note 5] The information processing device described in Supplementary Note 1 further includes: changing the proportion of a user's image appearing in the plurality of candidate image data presented to each user based on user attributes within the user group. This makes it possible to change the proportion of subjects appearing in the presented candidate image data for posting for each user.

[0239] Problems corresponding to [Supplementary Note 6] One of the objectives of the present disclosure is to increase the proportion of candidate image data for posting that includes images of grandchildren for users who have the attribute of grandfather or grandmother. [Supplementary Note 6] The information processing device described in Supplementary Note 5 further includes the following: when the user group is defined as a family, changing the proportion so that the candidate image data for posting presented to users whose user attribute is grandfather or grandmother includes more images of people who are grandchildren of the grandfather or grandmother than images of other people. This makes it possible to increase the proportion of candidate image data for posting that includes images of grandchildren for users who have the attribute of grandfather or grandmother.

[0240] [Supplementary Note 7] One of the objectives of the present disclosure is to present to a user candidate image data for posting generated from images captured in the immediately previous period. [Supplementary Note 7] The information processing device described in Supplementary Note 1 further includes the following: when the current date switches from a first period to a second period, presenting the candidate image data for posting generated from the image data whose image capture date and time belongs to the first period. This makes it possible to present to a user candidate image data for posting generated from images captured in the immediately previous period.

[0241] [Supplementary Note 8] One of the objectives of the present disclosure is to present a fixed number of candidate image data for posting to a user each time. [Supplementary Note 8] The information processing device described in Supplementary Note 7 further includes the following: if the number of candidate image data for posting generated from the image data captured in the first period is less than a threshold, extending the capture date and time of the image data used to generate the candidate image data for posting to be presented to a period earlier than the first period. This makes it possible to present a fixed number of candidate image data for posting to a user each time.

[0242] [Supplementary Note 9] One of the objectives of the present disclosure is to present a user with more candidate image data for posting than a reference value during a period when a large number of images are captured. [Supplementary Note 9] The information processing device described in Supplementary Note 7 further includes the following: when the number of candidate image data for posting generated from the image data captured during the first period is greater than a threshold, presenting a larger number of candidate image data for posting to the user than when the number of candidate image data for posting generated from the image data captured during the first period is equal to or less than the threshold. This makes it possible to present a user with more candidate image data for posting than a reference value during a period when a large number of images are captured.

[0243] [Supplementary Note 10] One of the objectives of the present disclosure is to enable editing of presented candidate image data for posting. [Supplementary Note 10] The information processing device described in Supplementary Note 1 further includes the following: when receiving an instruction from a user to change the candidate image data for posting, replacing at least one of the candidate image data for posting presented to the user with new candidate image data. This makes it possible to edit the presented candidate image data for posting.

[0244] [Supplementary Note 11] One of the objectives of the present disclosure is to present candidate image data for posting that includes a person of interest as a subject as new candidate image data. [Supplementary Note 11] The information processing device described in Supplementary Note 10 further includes the following: when image data related to the user group is displayed as a subject for viewing in a second column different from a first column in which the candidate image data for posting is presented, determining an image of a person included in the new candidate image data according to an image of the person included in the image data to be viewed. This makes it possible to present candidate image data for posting that includes a person of interest as a subject as a new candidate.

[0245] [Supplementary Note 12] One of the objectives of the present disclosure is to present candidate image data for posting that meets the user's wishes. [Supplementary Note 12] The information processing device described in Supplementary Note 1 further includes the following: when receiving a specification of attributes of the candidate image data for posting from a user, selecting and presenting the candidate image data for posting from image data that meets the specified attributes among one or more of the candidate image data for posting. This makes it possible to present candidate image data for posting that meets the user's wishes.

[0246] [Supplementary Note 13] One of the objectives of the present disclosure is to facilitate the user's selection of candidate image data for posting. [Supplementary Note 13] The information processing device described in Supplementary Note 12 further includes the following: presenting the candidate image data for posting extracted based on the attributes in order of capture date. This makes it easier for the user to select candidate image data for posting.

[0247] Problems corresponding to [Supplementary Note 14] One of the objectives of the present disclosure is to change the presented content of candidate image data for posting depending on the relationship between the user group to which the user to which the posting destination user belongs and the user group to which the user to which the posting source user belongs. [Supplementary Note 14] The information processing device described in Supplementary Note 1 further includes the following: changing the content of the presented candidate image data for posting when the user to which the posting destination user is a first user who belongs to the user group and when the user to which the posting destination user is a second user who does not belong to the user group. This makes it possible to change the presented content of candidate image data for posting depending on the relationship between the user group to which the user to which the posting destination user belongs and the user group to which the user to which the posting source user belongs.

[0248] [Supplementary Note 15] One of the objectives of the present disclosure is to preferentially present candidate image data for posting that can be posted to the second user when the posting destination is a second user who does not belong to the user group. [Supplementary Note 15] The information processing device described in Supplementary Note 14 further includes the following: preferentially presenting, as the candidate image data for posting to be presented to the second user, the candidate image data for posting that is generated from image data whose public range is set to include outside the user group. As a result, when the posting destination is a second user who does not belong to the user group, it is possible to preferentially present candidate image data for posting that can be posted to the second user.

[0249] [Supplementary Note 16] One of the objectives of the present disclosure is to present to a user a set of candidate image data for reactions from image data being viewed. [Supplementary Note 16] The information processing device described in Supplementary Note 1 further includes: accepting an operation on a predetermined operator arranged on a viewing screen for the image data associated with the user group; presenting a set of candidate image data for reactions to be presented on a client device operated by a user belonging to the user group; receiving an instruction from the user regarding selection of the candidate image data for reactions; and displaying the selected candidate image data for reactions on the viewing screen. This makes it possible to present to the user a set of candidate image data for reactions from the image data being viewed.

[0250] Problems corresponding to [Supplementary Note 17] One of the objectives of the present disclosure is to make it possible to control candidate image data presented to a user according to a score related to an emotion estimated from a corresponding facial image. [Supplementary Note 17] The information processing device described in Supplementary Note 1 further includes: calculating an emotion score for each facial image included in the candidate image data using a predetermined algorithm; and controlling the presentation of the candidate image data according to the magnitude of the emotion score. This makes it possible to control the candidate image data presented to a user according to the emotion score estimated from the corresponding facial image.

[0251] Problems corresponding to [Supplementary Note 18] One of the objectives of the present disclosure is to make image data related to a user group available for posting. [Supplementary Note 18] An information processing method according to this embodiment includes the following: storing a plurality of image data and information about a user group related to the image data in one or more storage devices; generating candidate image data for posting from image data including images of people associated with the user group, from among one or more image data related to the user group; presenting a set of the candidate image data for posting for presentation on a client device operated by a user belonging to the user group; and receiving an instruction from the user regarding the selection of the candidate image data for posting. According to the above information processing method, image data related to a user group can be made available for posting.

[0252] Problems corresponding to [Supplementary Note 19] One of the objectives of the present disclosure is to make image data related to a user group available for posting. [Supplementary Note 19] A computer-readable recording medium storing a program for causing a computer according to the present embodiment to execute the following processes: storing a plurality of image data and information on a user group related to the image data in one or more storage devices; generating candidate image data for posting from image data including images of people associated with the user group, from among one or more image data related to the user group; presenting a set of candidate image data for posting for presentation on a client device operated by a user belonging to the user group; and receiving an instruction from the user regarding the selection of the candidate image data for posting. According to the computer-readable recording medium described above, image data related to a user group can be made available for posting.

[0253] [Supplementary Note 20] One of the objectives of the present disclosure is to make image data related to a user group available for posting. [Supplementary Note 20] An information processing system according to this embodiment includes: one or more terminal devices; and a server connected to the one or more terminal devices via a network; the server includes: one or more processors; and a non-transitory computer-readable memory connected to the one or more processors and executing instructions, which, when executed by the one or more processors, perform the following: storing a plurality of image data and information about a user group associated with the image data in one or more storage devices; generating candidate image data for posting from image data including an image of a person associated with the user group, from among one or more image data related to the user group; presenting the set of candidate image data for posting on a terminal device operated by a user belonging to the user group; and receiving an instruction from the user regarding the selection of the candidate image data for posting. The above information processing system makes it possible to make image data related to a user group available for posting.

[0254] 1...information processing system, 10...server, 11, 21...processor, 12, 22...memory, 13, 23...auxiliary storage device, 14, 24...communication interface, 20...user terminal, 25...display, 101...generation unit, 102...presentation unit, 103...control unit, 110...storage unit

Claims

1. An information processing device includes: one or more processors; and a non-transitory computer-readable memory connected to the one or more processors and executing instructions that, when executed by the one or more processors, perform the following: store a plurality of image data and information on a user group associated with the image data in one or more storage devices; generate candidate image data for posting from image data including images of people associated with the user group, from among one or more image data related to the user group; present a set of the candidate image data for posting for presentation on a client device operated by a user belonging to the user group; and receive instructions from the user regarding the selection of the candidate image data for posting.

2. The information processing device of claim 1 further includes the following: presenting the candidate image data for posting to users who belong to the public range of the image data used to generate the candidate image data for posting; not presenting the candidate image data for posting to users who do not belong to the public range of the image data used to generate the candidate image data for posting.

3. The information processing device according to claim 1 further includes the following: presenting more of the candidate image data for posting that includes images of children than the candidate image data for posting that includes images of adults.

4. The information processing device according to claim 1 further includes the following: changing the candidate image data for posting presented to each user based on the usage history of the image data by each user belonging to the user group.

5. The information processing device according to claim 1 further includes: changing the ratio of user images appearing in the plurality of candidate image data for posting presented to each user based on the attributes of users within the user group.

6. The information processing device according to claim 5 further includes the following: when the user group is defined by a family, changing the ratio so that the candidate image data for posting presented to a user whose user attribute is a grandfather or grandmother includes more images of persons who are grandchildren of the grandfather or grandmother than images of other persons.

7. The information processing device according to claim 1 further includes the following: when the current date switches from a first period to a second period, presenting the candidate image data for posting generated from the image data whose image date and time belong to the first period.

8. The information processing device of claim 7 further includes the following: when the number of the candidate image data for posting generated from the image data captured during the first period is less than a threshold value, extending the capture date and time of the image data used to generate the candidate image data for posting to be presented to a period earlier than the first period.

9. The information processing device of claim 7 further includes the following: when the number of the candidate image data for posting generated from the image data captured during the first period is greater than a threshold value, the number of the candidate image data for posting presented to the user is greater than when the number of the candidate image data for posting generated from the image data captured during the first period is equal to or less than the threshold value.

10. The information processing device according to claim 1 further includes: when an instruction to change the candidate image data for posting is received from a user, replacing at least one of the candidate image data for posting presented to the user with new candidate image data.

11. The information processing device of claim 10 further includes the following: when image data related to the user group is displayed for viewing in a second column different from a first column in which the candidate image data for posting is presented, determining an image of a person included in the new candidate image data according to an image of a person included in the image data to be viewed.

12. The information processing device of claim 1 further includes the following: when a specification of attributes of the candidate image data for posting is received from a user, selecting and presenting the candidate image data for posting from image data that satisfies the specified attributes among one or more of the candidate image data for posting.

13. The information processing device according to claim 12 further includes the following: presenting the candidate image data for posting extracted based on the attributes in order of capture date.

14. The information processing device of claim 1 further includes: changing the content of the candidate image data for posting presented depending on whether the user to whom the posting is to be made is a first user belonging to the user group or a second user not belonging to the user group.

15. The information processing device of claim 14 further includes the following: preferentially presenting, as the candidate image data for posting to be presented to the second user, the candidate image data for posting generated from the image data whose public range is set to include outside the user group.

16. The information processing device of claim 1 further includes: accepting operations on predetermined controls arranged on a viewing screen for the image data associated with the user group; presenting a set of candidate image data for reactions to be presented on a client device operated by a user belonging to the user group; receiving instructions from the user regarding the selection of the candidate image data for reactions; and displaying the selected candidate image data for reactions on the viewing screen.

17. The information processing device of claim 1 further includes: calculating an emotion score for each facial image included in the candidate image data for posting using a predetermined algorithm; and controlling the presentation of the candidate image data for posting in accordance with the magnitude of the emotion score.

18. An information processing method includes: storing a plurality of image data and information on a user group related to the image data in one or more storage devices; generating candidate image data for posting from image data including images of people associated with the user group among one or more image data related to the user group; presenting a set of the candidate image data for posting for presentation on a client device operated by a user belonging to the user group; and receiving instructions from the user regarding the selection of the candidate image data for posting.

19. A computer-readable recording medium storing a program for causing a computer to perform the following processes: storing multiple image data and information on user groups related to the image data in one or more storage devices; generating candidate image data for posting from image data including images of people associated with the user group, from among one or more image data related to the user group; presenting a set of the candidate image data for posting for presentation on a client device operated by a user belonging to the user group; receiving instructions from the user regarding the selection of the candidate image data for posting.

20. An information processing system includes: one or more terminal devices; and a server connected to the one or more terminal devices via a network; the server includes: one or more processors; and a non-transitory computer-readable memory connected to the one or more processors and executing instructions, which, when executed by the one or more processors, perform the following: storing multiple image data and information on user groups associated with the image data in one or more storage devices; generating candidate image data for posting from image data including images of people associated with the user group, from among one or more image data related to the user group; presenting a set of the candidate image data for posting for presentation on a terminal device operated by a user belonging to the user group; and receiving instructions from the user regarding the selection of the candidate image data for posting.

Images