Information processing system, information processing method, and program

Abstract

To allow a user to easily grasp what kind of an image fits to which subject category in setting a transmission rule.SOLUTION: An information processing system comprises: receiving means (CPU 151) that receives setting of a transmission rule created by a user via a setting screen that manages setting for transmitting images; selection means (CPU 151) that selects an image to be paired with the transmission rule from images associated with the user; association means (209; CPU 151) that associates the image selected by the selection means and the transmission rule with each other; and display control means (CPU 151) that displays the image selected by the selection means and the transmission rule on the setting screen as associated information associated by the association means.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to a technique for setting rules for transmitting images. [Background technology]

[0002] In recent years, with the development of the Internet, many people have begun to use cloud services available via the Internet. One such cloud service is a storage service that stores images sent from a camera. Regarding this storage service, Patent Document 1 discloses a technique for selecting images to be sent from among multiple images stored in a camera according to conditions (transmission rules) specified by a user for each subject category that characterizes the subjects appearing in the images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-45352 Summary of the Invention [Problem to be solved by the invention]

[0004] For example, consider a scenario in which a transmission rule is set up to transmit images of photographs taken at a BMX (Bicycle Motocross) race. Here, assume that "sports" and "vehicles" are available as subject categories. BMX falls under the "sports" category, and the photo also contains a bicycle, which is a "vehicle." Therefore, users may have difficulty determining which subject category the image should be classified into before being sent and saved. [Means for solving the problem]

[0005] An information processing device according to one aspect of the present disclosure is characterized by comprising: a receiving means for receiving a user's setting of a transmission rule via a setting screen for managing settings for transmitting images; a selection means for selecting an image to be paired with the transmission rule from images associated with the user; an association means for associating the image selected by the selection means with the transmission rule; and a display control means for displaying the image selected by the selection means and the transmission rule on the setting screen as related information associated by the association means. [Effects of the Invention]

[0006] According to the present disclosure, when a user sets a transmission rule, the user can easily understand what kind of image fits into which subject category. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 illustrates an example of the configuration of an information processing system. [Figure 2] FIG. 2 is a diagram illustrating an example of a functional configuration of the information processing apparatus in FIG. [Figure 3] 10 is a flowchart illustrating an example of an operation of the information processing device. [Figure 4] 10 is a flowchart illustrating an example of an operation of the information processing device. [Figure 5] 10 is a flowchart illustrating an example of an operation of the information processing device. [Figure 6] 10 is an example of a data structure of data used in a process of generating a transmission rule setting screen. [Figure 7] 10 is an example of a display screen. [Figure 8] 10 is an example of a display screen. [Figure 9] 10 is a flowchart illustrating an example of an operation of the information processing device. [Figure 10] 10 is an example of a data structure of data used in a process of generating a transmission rule setting screen. [Figure 11] 10 is an example of a display screen. [Figure 12]10 is a flowchart illustrating an example of an operation of the information processing device. [Figure 13] 10 is a flowchart illustrating an example of an operation of the information processing device. [Figure 14] 10 shows an example of a data structure and an example of a display screen. [Figure 15] 10 is another example of a transmission rule setting screen. DETAILED DESCRIPTION OF THE INVENTION

[0008] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the present disclosure, and the combinations of features described in the following embodiments are not necessarily essential to the solutions of the present disclosure. Note that the same components are given the same reference numerals. In this embodiment, an image forming apparatus is used as an example of an information processing apparatus, but the present disclosure is not limited to this.

[0009] <<First Embodiment>> [overview] There are cloud services that automatically transfer or provide images that match transmission rules to various services. When using such cloud services, appropriately setting transmission rules ensures that expected images are automatically transferred to various services. However, it can be difficult for users to determine what transmission rules will ensure that expected images are selected from a large number of images and automatically transferred or shared. Therefore, in this embodiment, an operation is performed in which an image paired with a transmission rule is selected from images associated with the user, the selected image is associated with the transmission rule, and the associated image and transmission rule are displayed on a setting screen. This operation allows the user to confirm the image paired with the transmission rule. Since the image paired with the transmission rule is an image selected from images associated with the user, the image displayed on the setting screen is an image associated with the user and the transmission rule. Therefore, the image displayed on the setting screen can provide the user with hints for setting transmission rules. This makes it possible to support the setting of transmission rules. In other words, the user can intuitively understand the transmission rules by visually checking the images displayed on the setting screen. This allows the user to easily understand which images fit which subject categories when setting transmission rules. The various services include, for example, a social networking service (SNS), a cloud storage service for images, a cloud storage service for various files, etc. The various services may also include a cloud service that provides a creative environment over the Internet, such as for video editing.

[0010] [Overall configuration] FIG. 1 is a diagram showing an example of the configuration of an information processing system. FIG. 1(a) is a diagram showing an example of the network configuration of the information processing system. FIG. 1(b) is a diagram showing an example of network components included in the network configuration of FIG. 1(a). FIG. 1(c) is a diagram showing an example of components of an information processing device 101 of FIG. 1(b). The information processing system includes at least two network components. Each network component is connectable via the Internet 100. The network components include, for example, the information processing device 101, a terminal 102, image management services 103_1 and 103_2, and an imaging device 109. In the following description, the image management services 103_1 and 103_2 will be collectively referred to as the image management service 103.

[0011] The information processing system in FIG. 1(a) provides a cloud service that can be used via the Internet 100. This cloud service automatically transfers or shares images that match conditions included in the settings of transmission rules to various services. FIG. 1(a) shows an example in which an image cloud storage service is realized by an image management service 103 as one of the various services. FIG. 1(a) also shows an example in which images that are automatically transferred to the various services are captured by an imaging device 109. FIG. 1(a) also assumes that the transmission rules are set by a terminal 102, but devices that can set transmission rules are not limited to the terminal 102.

[0012] (imaging device 109) The imaging device 109 captures an image. The imaging device 109 can transmit the captured image to an image cloud storage service via the Internet 100 based on transmission rules. The imaging device 109 may be any device having a function of capturing an image and a function of transmitting the image via the Internet 100. For example, the imaging device 109 may be configured as a digital camera. Alternatively, the imaging device 109 may be configured as a smartphone equipped with an imaging element. Note that the function of transmitting images via the Internet 100 does not necessarily have to be provided in the imaging device 109 itself. For example, the function of transmitting images via the Internet 100 may be realized by storing data of captured images and implementing a communication function in a semiconductor memory that is detachable from the imaging device 109 itself.

[0013] (Terminal 102) The terminal 102 has an input / output function and a communication function. The input / output function of the terminal 102 is configured, for example, by a liquid crystal display with a touch panel. The communication function of the terminal 102 includes, for example, a wireless communication function. The wireless communication function can be realized, for example, by at least one of Wi-Fi (registered trademark), Bluetooth (registered trademark), and NFC (registered trademark; Near Field Communication). The terminal 102 is configured, for example, by a smartphone. Alternatively, the terminal 102 may be configured by a tablet. The terminal 102 transmits and receives various information via the Internet 100. When a transmission rule setting is input using the input / output function of the terminal 102, a cloud service realized by the network components of the information processing system can perform the following operations. That is, the cloud service can transmit images captured by the imaging device 109 to the image management service 103 based on the transmission rule setting. Note that if the terminal 102 is configured as a smartphone, the cloud service can connect to the Internet 100 via a mobile phone line by using a base station and a switching center.

[0014] (Image Management Service 103) The image management service 103 is configured as a device different from the information processing device 101. Alternatively, the image management service 103 may be realized, for example, as a web service. The web service realized by the image management service 103 may function as part of a service provided by a cloud service. In this way, the image management service 103 can function as one of the network components that realize the cloud service.

[0015] In the following description of the present embodiment, the image will be mainly described as a still image, but is not limited to this. The image may also be a moving image. That is, the information processing system can process both still images and moving images. In the following description, unless otherwise specified, the term "image" will be described as including the concepts of both moving images and still images.

[0016] (information processing device 101) The information processing device 101 has a communication unit 111, a storage unit 112, and a calculation unit 113. The communication unit 111 is a unit that realizes the communication function of the information processing device 101. The communication unit 111 is configured, for example, by a network card or the like. The communication unit 111 is a unit that transmits and receives various information via the Internet 100. For example, the communication unit 111 transmits and receives various information to and from the terminal 102. The various information in communication with the terminal 102 is information input to the terminal 102. Alternatively, the various information in communication with the terminal 102 may be information to be displayed on a display screen of the terminal 102. Furthermore, for example, the communication unit 111 transmits and receives various information to and from the image management service 103. The various information in communication with the image management service 103 is, for example, image information of an image to be transmitted. The image information may include Exif (Exchangeable image file format) information. The Exif information includes, for example, the date and time of shooting, the location of shooting (when the GPS function is ON), the model name of the imaging device, the aperture value, the ISO sensitivity, the exposure correction value, etc. The information processing device 101 may be configured as an image forming device. If the information processing device 101 is configured as an image forming device, it can perform various printing operations in accordance with print instructions. The information processing device 101 may also have a mail server. If the information processing device 101 has a mail server, it can send and receive e-mails. The image forming device and mail server may be provided outside the information processing system.

[0017] The storage unit 112 is a unit that stores various data such as images and various programs. The storage unit 112 is realized by, for example, a random access memory (RAM), a read only memory (ROM), and a hard disk drive (HDD). The storage unit 112 may be implemented by a solid state drive (SSD) instead of an HDD.

[0018] The calculation unit 113 is a unit that executes various programs for transmitting and receiving various data, storing data, and the like. The calculation unit 113 is realized by, for example, a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The cloud service in this embodiment may be realized by the calculation unit 113 executing a program stored in the storage unit 112. Alternatively, the cloud service in this embodiment may be realized by the terminal 102. Alternatively, the cloud service in this embodiment may be realized by the image management service 103. Alternatively, the cloud service in this embodiment may be realized via the Internet 100 by virtualizing at least one of the information processing device 101, the terminal 102, and the image management service 103. In this way, the information processing device 101 can function as one of the network components that realize the cloud service.

[0019] [Hardware configuration] FIG. 1(d) is a diagram showing an example of the configuration of a computer system used in the information processing device 101 of FIG. 1(c). A CPU 151, a ROM 152, a RAM 153, an interface 156, and a network 161 are connected to a bus 154 in FIG. 1(d). The network 161 includes, in addition to the Internet 100 in FIG. 1(a), at least one of a WAN (Wide Area Network), a LAN (Local Area Network), and an intranet. The ROM 152 and RAM 153 are connected to the CPU 151 via the bus 154. The ROM 152 stores programs executed by the CPU 151 and fixed data among parameters for calculations. The RAM 153 provides a working area for the CPU 151 and a temporary storage area for data. An external storage device 155 is connected to the bus 154 via an interface 156. Therefore, the external storage device 155 is connected to the CPU 151 via the interface 156 and the bus 154. The external storage device 155 is composed of, for example, a hard disk drive. Alternatively, the external storage device 155 may be configured as an MO (magneto-optical disk). Alternatively, the external storage device 155 may be configured as a CD-ROM. With the above connection configuration via the bus 154, the CPU 151 can execute an OS (Operating System) and various application programs and perform various controls.

[0020] [Software configuration] FIG. 2 is a diagram illustrating an example of the functional configuration of the information processing device 101 of FIG. 1. FIG. 2(a) illustrates an example of the software configuration of the information processing device 101. The CPU 151 of FIG. 1(d) executes a program according to this embodiment, thereby realizing various software programs of the information processing device 101 as functional blocks. The various software programs include, for example, a storage unit 201, a screen generation unit 202, a transmission unit 203, a reception unit 204, a transmission rule setting unit 205, and a recognition unit 206. The various software programs may also include an associated image management unit 207, an execution unit 208, and an association unit 209. The various software programs illustrated in FIG. 2(a) may be implemented as one of the cloud services implemented via the Internet 100. Therefore, the various software programs according to this embodiment may be implemented by cloud computing, which allows on-demand access to resources including not only the information processing device 101 but also other network components via the Internet 100. In other words, the various programs according to this embodiment may also be implemented as a cloud computing configuration in which multiple resources share and jointly process a single function via the Internet 100. For convenience of explanation, the following description will be given assuming that the CPU 151 executes the various processes of this embodiment, but the various processes may also be executed in a cloud computing configuration.

[0021] The storage means 201 has a function of storing images in the storage unit 112. Note that the storage means 201 may store images in a cloud storage service. The screen generation means 202 has a function of generating a screen for setting image transmission rules and transmitting the screen to the terminal 102 via the communication unit 111 of FIG. 1(c). The transmission means 203 has a function of transmitting images stored in the storage means 201 to the image management service 103 via the communication unit 111 of FIG. 1(c). The reception means 204 has a function of receiving, via the terminal 102, a user instruction operated on a screen displayed on the terminal 102 via the communication unit 111 of FIG. 1(c). The transmission rule setting means 205 has a function of storing, in the storage unit 112, a transmission rule that determines whether or not to transmit an image, based on the user instruction received by the reception means 204. The recognition means 206 has a function of performing image recognition processing on images stored in the storage unit 112 and storing the execution result in the storage unit 112. In this embodiment, the recognition unit 206 has a function to recognize the category of a subject appearing in an image. In this embodiment, there are four types of subject categories: "food," "animals," "vehicles," and "landscapes." The recognition unit 206 has a function to recognize any number of subject categories for a single image. Specifically, the recognition unit 206 may recognize zero subject categories (i.e., no subject categories), a single subject category, or multiple subject categories. Here, zero subject categories indicates that the subject in the image does not fall into any of "food," "animals," "vehicles," or "landscapes." The associated image management unit 207 has a function to store images associated by the association unit 209 in the storage unit 112. The execution unit 208 has a function to execute an action on an image stored in the storage unit 112 based on a user instruction received by the receiving unit 204. In this embodiment, an action refers to at least one of printing an image using an image forming apparatus and sending an image via email via a mail server. Here, the image forming apparatus may be located outside the information processing system and accessible via the Internet 100.The mail server may also be implemented outside the information processing system and available via the Internet 100. The associating means 209 has a function of associating images stored in the storage unit 112 with conditions included in the transmission rule settings. The screen generating means 202 has a function of displaying images associated with each condition when displaying the conditions on the transmission rule setting screen. In this embodiment, the subject category is used as a condition included in the transmission rule settings. In other words, if the subject category as a condition matches the subject category appearing in the image, the condition included in the transmission rule settings is deemed to be met. Details of the subject category will be described later. Note that the conditions included in the transmission rule settings may include other elements in addition to the subject category. Details will be described later, but the other elements include, for example, image blur or image exposure.

[0022] [Sending rule setting screen presentation processing] In the following description, each process will first be described individually, and then an example in which the processes cooperate to implement this embodiment will be described. Specifically, a process in which a transmission rule is set via a transmission rule setting screen will be described using FIGS. 2(b) and 2(c). FIG. 2(b) is a flowchart showing an example of a process for displaying a transmission rule setting screen executed by the information processing device 101. The process shown in FIG. 2(b) is implemented by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The process shown in FIG. 2(b) is executed when the screen generation means 202 generates a transmission rule management screen. That is, the process shown in FIG. 2(b) is implemented by the CPU 151. Note that some or all of the functions of the steps in FIG. 2(b) may be implemented by hardware such as an ASIC or an electronic circuit. The symbol "S" in the description of each process indicates a step in the flowchart. The process shown in FIG. 2(b) can also be implemented as a cloud computing configuration in which a single function is shared and processed collaboratively by multiple resources via the Internet 100. The above timing may also mean the trigger for processing. Therefore, the above content may also mean that "the execution is triggered by the screen generation means 202 generating a transmission rule management screen." Hereinafter, in this embodiment, the word "timing" will be used with the same meaning.

[0023] In S211, the CPU 151, functioning as the receiving means 204, receives an instruction to start setting a transmission rule via a transmission rule management screen. Here, a transmission rule is a rule for transmitting an image to be transmitted to an image cloud storage service or storage when a specific condition is met. A specific condition, for example, is whether or not an object belonging to a certain object category is included in the image. Here, a subject category is an index characterizing the object in the image. For example, examples of objects include "apple," "bear," "bus," and "sun and mountains." The index characterizing these objects can be extracted by abstracting the object. For example, an apple becomes a fruit when abstracted, but a more abstract version becomes "food." A bear becomes an animal when abstracted. A bus becomes a vehicle when abstracted. A sun and mountains becomes a landscape when abstracted. In other words, if the objects are "apple," "bear," "bus," and "sun and mountains," the index characterizing the objects in the image corresponds to "food," "animal," "vehicle," and "landscape," respectively. The image to be transmitted is, for example, a transmission candidate image captured by the imaging device 109. The candidate category is an index that characterizes the candidate subject appearing in the transmission candidate image. Therefore, when the subject category matches the candidate category, the setting of the transmission process for transmitting the transmission candidate image can be set as a transmission rule. In other words, when a specific condition that the subject category matches the candidate category is met, the transmission process is executed. The image cloud storage service is a service realized by the image management service 103. The management screen is a screen for managing the transmission rules and functions as an interface that accepts user operations related to the management of the transmission rules. The management screen is displayed on, for example, the terminal 102. Details of the management screen will be described later with reference to FIGS. 7(a) and 8(a). In S212, the CPU 151, functioning as the screen generation means 202, generates a setting screen for the transmission rules. Here, the setting screen is a screen that accepts settings for transmitting images and functions as an interface that accepts user operations related to the setting of the transmission rules.The details of the setting screen will be described later with reference to FIGS. 7(b) and 7(c). The details of the processing of S212 will be described later with reference to FIG. 4. In S213, the CPU 151, functioning as the screen generating means 202, transmits the setting screen generated in the processing of S212 to the terminal 102 via the communication unit 111. This operation causes the transmission rule setting screen to be displayed on the terminal 102. Specifically, the screen generating means 202 generates information for the transmission rule setting screen, and transmits the generated information for the transmission rule setting screen to the terminal 102 via the communication unit 111. The terminal 102 renders the information for the transmission rule setting screen transmitted from the communication unit 111 and displays it on a screen (not shown). After completing the processing of S213, the CPU 151 terminates this flowchart consisting of the processing of S211 to S213. According to this operation, the transmission rule setting screen is displayed on the terminal 102, making it possible to set the transmission rules from the terminal 102. Note that the destination of the transmission rule setting screen is not limited to the terminal 102. Any device that can use the image cloud storage service according to this embodiment can be set as a destination on the transmission rule setting screen.

[0024] [Settings for sending rules] FIG. 2(c) is a flowchart showing an example of a process for setting a transmission rule executed by the information processing device 101. The process shown in FIG. 2(c) is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The process shown in FIG. 2(c) is executed when the screen generation means 202 generates a transmission rule setting screen. That is, the process shown in FIG. 2(c) is realized by the CPU 151. Note that some or all of the functions of the steps in FIG. 2(c) may be realized by hardware such as an ASIC or an electronic circuit. The symbol "S" in the explanation of each process indicates a step in the flowchart. The process shown in FIG. 2(c) can also be realized as a cloud computing configuration in which a single function is shared and processed collaboratively by multiple resources via the Internet 100.

[0025] In S221, the CPU 151 functioning as the receiving means 204 receives a transmission rule setting completion instruction. The transmission rule setting completion instruction is realized by an operation on the transmission rule setting screen. Details of the transmission rule setting completion instruction will be described later with reference to FIG. 7B. In S222, the CPU 151 functioning as the transmission rule setting means 205 determines whether one or more object categories have been selected. If one or more object categories have been selected, the CPU 151 advances the process of S222 to S223. If zero object categories have been selected, the CPU 151 ends this flowchart consisting of the processes of S221 to S223. In other words, if at least one object category has been selected, the CPU 151 advances the process of S222 to S223. In S223, the CPU 151 functioning as the transmission rule setting means 205 stores the transmission rule specified by the user in the storage unit 112 as a process for setting the specified transmission rule. After completing the process of S223, the CPU 151 ends this flowchart consisting of the processes of S221 to S223.

[0026] [Image transmission process] Next, a process for transmitting an image to be transmitted using the transmission rules set by the processes of FIGS. 2(b) and 2(c) will be described with reference to FIG. 3(a). FIG. 3 is a flowchart showing an example of the operation of the information processing device 101. FIG. 3(a) is a flowchart showing an example of the image transmission process executed by the information processing device 101. The process shown in FIG. 3(a) is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The process shown in FIG. 3(a) is executed when the storage means 201 stores a new image in the storage unit 112. That is, the process shown in FIG. 3(a) is realized by the CPU 151. Note that some or all of the functions of the steps in FIG. 3(a) may be realized by hardware such as an ASIC or an electronic circuit. The symbol "S" in the description of each process indicates a step in the flowchart. The process shown in FIG. 3(a) can also be realized as a cloud computing configuration in which a single function is shared and processed collaboratively by multiple resources via the Internet 100. Note that the process shown in FIG. 3(a) is not limited to being executed when a new image is stored. In other words, it does not have to be executed every time a new image is stored. For example, the process shown in FIG. 3(a) may be executed all at once after multiple new images are stored. Such an operation reduces the number of times the information processing device 101 accesses the image management service 103, thereby reducing the power consumption of the information processing device 101. Furthermore, if the number of times the information processing device 101 accesses the image management service 103 is reduced, the resources of the image management service 103 that were reserved for processing by the information processing device 101 can be freed up for other network components (not shown). This makes it possible to improve convenience for all service users.

[0027] In S301, the CPU 151, functioning as the recognition means 206, performs recognition processing on an image stored in the storage unit 112. The image on which the recognition processing is performed does not have to be an image stored in the storage unit 112. The image on which the recognition processing is performed may be an image available for retrieval from a storage service. The recognition processing is a process of extracting an object category to which a subject in an image belongs. For example, the recognition processing may be performed using pattern recognition. Pattern recognition is a process of extracting specific rules or features from an image. Examples of pattern recognition algorithms include neural networks and support vector machines. Using any of these algorithms, it is possible to extract a subject in an image and determine the object category to which the extracted subject belongs. Furthermore, the pattern recognition algorithm may be deep learning, which adds an intermediate layer to a neural network. Deep learning can extract subject features more accurately than neural networks, allowing for more precise object category definition. Furthermore, the pattern recognition algorithm may be a large-scale language model, which trains on a large dataset, in contrast to deep learning. A large-scale language model can extract subject features more precisely than deep learning, allowing for more precise subject category setting. In any case, it is sufficient to be able to identify to which subject category a subject in an image belongs using an algorithm that extracts features, etc., contained in the image. In S302, the CPU 151 functioning as the transmitting means 203 acquires a transmission rule stored in the storage unit 112. In S303, the CPU 151 functioning as the transmitting means 203 determines whether the result of the image recognition process obtained in S301 satisfies the transmission rule obtained in S302. Satisfying the transmission rule means that a condition included in the setting of the transmission rule is established. For example, if the subject category matches a candidate category that characterizes a candidate subject appearing in a transmission candidate image, the CPU 151 determines that the transmission rule is satisfied. If the transmission rule is satisfied, the CPU 151 advances the process of S303 to S304.If the transmission rules are not satisfied, CPU 151 ends this flowchart consisting of the processes of S301 to S304. In S304, CPU 151 functioning as transmission means 203 transmits the image to image management service 103, and then ends this flowchart consisting of the processes of S301 to S304. In other words, if the transmission rules are satisfied, CPU 151 transmits the transmission candidate image to the image management service.

[0028] [Action execution process] The result of the processing shown in FIG. 3(b) is the processing referenced during the execution of S212 included in the processing shown in FIG. 2(b). As will be described in detail later, the processing of S406 included in the processing shown in FIG. 4 is executed during the processing of S212, and during the processing of S406, the processing of extracting the image used in the action is executed. In other words, when the processing of extracting the image used in the action is executed, the image on which the action has been executed by the processing shown in FIG. 3(b) is referenced from among multiple images. FIG. 3(b) is a flowchart showing an example of the processing of transmitting an action to be executed by the information processing device 101. The processing shown in FIG. 3(b) is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The processing shown in FIG. 3(b) is executed when the receiving means 204 receives an instruction to execute the action. In other words, the processing shown in FIG. 3(b) is realized by the CPU 151. Note that some or all of the functions of the steps in FIG. 3(b) may be implemented by hardware such as an ASIC or an electronic circuit. The symbol "S" in the explanation of each process indicates a step in the flowchart. The process shown in Figure 3(b) can also be realized as a cloud computing configuration in which a single function is shared among multiple resources and processed collaboratively via the Internet 100.

[0029] In S311, CPU 151 functioning as receiving means 204 receives an instruction to execute an action from a user. Details of the instruction to execute an action will be described later with reference to FIG. 8(c). In S312, CPU 151 functioning as executing means 208 determines whether the instruction to execute the action received in S311 is a print instruction. If it is a print instruction, CPU 151 advances the process of S312 to S313. If it is not a print instruction, CPU 151 advances the process of S312 to S315. In S313, CPU 151 functioning as executing means 208 transmits the print instruction to an external image forming apparatus via communication unit 111. In S314, CPU 151 functioning as executing means 208 stores an image ID, which serves as an identifier that can uniquely specify the image on which the action has been executed, in storage unit 112 as an action-executed image. That is, the image on which the action of printing has been executed and the image ID corresponding to the image on which the action has been executed may be stored in the storage unit 112 in a state in which the image ID is associated with the image. In S315, the CPU 151 functioning as the execution means 208 determines whether the instruction to execute the action received in S311 is an instruction to send email. If it is an instruction to send email, the CPU 151 advances the process of S315 to S316. If it is not an instruction to send email, the CPU 151 terminates this flowchart consisting of the processes of S311 to S317. In S316, the CPU 151 functioning as the execution means 208 transmits an instruction to send email to an external email server via the communication unit 111. In S317, the CPU 151 functioning as the execution means 208 stores the ID of the image on which the action has been executed in the storage unit 112 as an image on which the action has been executed. That is, the image on which the action of sending email has been executed and the image ID corresponding to the image on which the action has been executed may be stored in the storage unit 112 in a state in which the image ID is associated with the image. This flowchart, which is made up of the processes from S311 to S317, ends.

[0030] [Detailed instructions for generating the sending rule setting screen] FIG. 4 is a flowchart showing an example of the operation of the information processing device 101. FIG. 4 shows details of the process of S212. Specifically, the processes of S401 to S410 in FIG. 4 are processes for generating a transmission rule setting screen. The process shown in FIG. 4 is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The process shown in FIG. 4 is executed when the process of S212 in FIG. 2(b) is called. That is, the process shown in FIG. 4 is realized by the CPU 151. Note that some or all of the functions of the steps in FIG. 4 may be realized by hardware such as an ASIC or an electronic circuit. The symbol "S" in the description of each process indicates the step in the flowchart. The process shown in FIG. 4 can also be realized as a cloud computing configuration in which one function is shared among multiple resources and processed collaboratively via the Internet 100. Note that in this embodiment, a subject category is used as a condition included in the setting of the transmission rule. Therefore, the process shown in Fig. 4 is a process for selecting an image to be displayed on the transmission rule setting screen as a representative image representing a subject category. If there are multiple options for the representative image, one image is selected from the multiple images by the process shown in Fig. 5, which will be described later.

[0031] In S401, the CPU 151 functioning as the associating means 209 acquires an image from the storage unit 112. Here, the acquired image does not have to be an image stored in the storage unit 112. The acquired image may be an image that can be retrieved from a storage service. In S402, the CPU 151 functioning as the recognizing means 206 analyzes the object category of the image acquired in S401. Here, analyzing the object category of the image refers to an operation of identifying to which object category the object appearing in the image acquired in S401 belongs. In S403, the CPU 151 functioning as the associating means 209 executes the processes shown in S404 to S408 as many times as the number of object categories. For example, assume that there are four object categories. In this assumption, the CPU 151 executes the processes of S404 to S408 for each of the first object category, the second object category, the third object category, and the fourth object category. In this case, the processes of S404 to S408 are executed for each object category. That is, since the processes of S404 to S408 are executed for each specified object category, if there are four object categories, the processes of S404 to S408 are executed a total of four times. In S404, the CPU 151 functioning as the associating means 209 acquires images that match the object category specified in S403 from the images acquired in S401 based on the object category of the image acquired in S402. In S405, the CPU 151 functioning as the associating means 209 determines whether there are multiple images acquired in S404. If there are multiple images, the CPU 151 advances the process of S405 to S406. If there are not multiple images, the CPU 151 advances the process of S405 to S407. Here, "there are multiple images" means that there are multiple images that match a specific object category. For example, this corresponds to the case where there are multiple images whose object category matches "food." In S406, the CPU 151 functioning as the associating means 209 selects one image from the multiple images. The details of the process in S406 will be described later with reference to FIG.In S407, if the number of images acquired in S404 is one, the CPU 151, functioning as the associating means 209, associates the image with the object category specified in S403. If the number of images acquired in S404 is multiple, the CPU 151 associates the image selected in S406 with the object category specified in S403. In S408, the CPU 151, functioning as the associated image management means 207, stores the image ID of the image associated in S407 as an associated image in the storage unit 112. In S409, if the processing for all object categories has been completed, the CPU 151 advances the processing of S409 to processing of S410. On the other hand, if the processing for all object categories has not been completed, the CPU 151 returns the processing of S409 to processing of S403. In S410, the CPU 151, functioning as the screen generating means 202, generates a transmission rule setting screen using the associated image, and ends this flowchart consisting of the processing of S401 to S410. The CPU 151 functioning as the screen generating means 202 uses the images associated with each subject category by the CPU 151 functioning as the associating means 209 in S407 to generate a setting screen for the transmission rules.

[0032] [How to select the image to display] FIG. 5 is a flowchart showing an example of the operation of the information processing device 101. FIG. 5 shows details of the process of S406. Specifically, the processes of S501 to S508 in FIG. 5 are processes for selecting one image from multiple images. The process shown in FIG. 5 is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The process shown in FIG. 5 is executed when the process of S406 in FIG. 4 is called. That is, the process shown in FIG. 5 is realized by the CPU 151. Note that some or all of the functions of the steps in FIG. 5 may be realized by hardware such as an ASIC or an electronic circuit. The symbol "S" in the description of each process indicates the step in the flowchart. The process shown in FIG. 5 can also be realized as a cloud computing configuration in which one function is shared among multiple resources and processed collaboratively via the Internet 100.

[0033] In S501, the CPU 151, functioning as the associating means 209, extracts images that match a single object category from among multiple images. Here, extracting images that match a single object category means extracting an image that contains only one object, because the object category is an index that characterizes the object. Therefore, since an image containing one object is extracted, multiple images containing one object may also be extracted. Note that if no matching image exists, the CPU 151 extracts all images. Here, "no matching image exists" means that there are multiple objects contained in a single image. In such a case, since the object category cannot narrow down the images to one, the CPU 151 narrows down the images based on a different perspective in the processing from S503 onward. In S502, the CPU 151, functioning as the associating means 209, determines whether the number of images has been narrowed down to one as a result of the processing in S501. If the number of images has been narrowed down to one, the CPU 151 advances the processing in S502 to the processing in S508. If the number of images has not been narrowed down to one, the CPU 151 advances the process of S502 to S503. In S503, the CPU 151 functioning as the associating means 209 extracts the image ID of an image stored as a displayed image from among the images extracted in S501. If no corresponding image exists, the CPU 151 extracts all of the images extracted in S501. In S504, the CPU 151 functioning as the associating means 209 determines whether the number of images has been narrowed down to one as a result of the process of S503. If the number of images has been narrowed down to one, the CPU 151 advances the process of S504 to S508. If the number of images has not been narrowed down to one, the CPU 151 advances the process of S504 to S505. In S505, the CPU 151 functioning as the associating means 209 extracts, from among the images extracted in S503, an image whose ID has been stored in the storage unit 112 as an image for which an action has been executed. If there is no corresponding image, the CPU 151 extracts all of the images extracted in S503. In S506, the CPU 151 functioning as the associating means 209 determines whether or not the number of images has been narrowed down to one as a result of the processing in S505.If the number of images has been narrowed down to one, CPU 151 advances the process of S506 to S508. If the number of images has not been narrowed down to one, CPU 151 advances the process of S506 to S507. In S507, if there are multiple images extracted in S505, CPU 151 functioning as the associating means 209 narrows down the images to the image with the oldest shooting date and time information assigned to the image. Note that if there are multiple images assigned the same shooting date and time information, CPU 151 may narrow down the images to any one of them. Alternatively, if no shooting date and time information is assigned to the image, CPU 151 may narrow down the images to any one of the images extracted in S505. In S508, CPU 151 functioning as the associating means 209 selects the narrowed down image as the image to be displayed on the transmission rule setting screen, and ends this flowchart consisting of S501 to S508.

[0034] [Example data] FIG. 6 shows an example of the data structure of data used in the process of generating a transmission rule setting screen. FIG. 6(a) shows the results of the analysis process of S402. That is, FIG. 6(a) shows the object category for each image obtained by the recognition unit 206 analyzing each image. The image ID column shows image ID information as an identifier that can uniquely identify each image. The object category column shows the object category to which the object appearing in each image belongs. That is, FIG. 6(a) shows a dataset in which images and object categories are associated with each other. Note that the object category column may contain unique object category IDs that can uniquely identify each object category, but for ease of explanation, intuitively understandable words such as "food" are used in FIG. 6(a). The dataset in which images and object categories are associated with each other is specifically as follows: The image ID column 601 contains information "IMG_001." In the object category column 602 adjacent to the image ID column 601, information indicating "food" is arranged as the object category of the subject appearing in the image identified by "IMG_001." In the image ID column 603, information "IMG_002" is arranged. In the object category column 604 adjacent to the image ID column 603, information indicating "animals" is arranged as the object category of the subject appearing in the image identified by "IMG_002." In the object category column 606 adjacent to the image ID column 605, information indicating "animals" and "vehicles" is arranged as the object categories of the subject appearing in the image identified by "IMG_003." In the object category column 608 adjacent to the image ID column 607, information indicating "vehicles" is arranged as the object category of the subject appearing in the image identified by "IMG_004." In the object category column 610 adjacent to the image ID column 609, information indicating "vehicle" as the object category of the object appearing in the image identified by "IMG_005" is arranged. In the object category column 612 adjacent to the image ID column 611, information indicating "landscape" as the object category of the object appearing in the image identified by "IMG_006" is arranged.In the object category column 614 adjacent to the image ID column 613, information indicating "landscape" as the object category of the object appearing in the image identified by "IMG_007" is arranged. Therefore, of IMG_001 to IMG_007, only two different object categories are confirmed for the object appearing in the image identified by IMG_003. This means that it has been analyzed that two different objects appear in the image identified by IMG_003.

[0035] FIG. 6(b) shows data used in the processing of S408. That is, FIG. 6(b) shows information on pairs of image IDs and object categories that the associated image management unit 207 plans to store in the storage unit 112. Therefore, FIG. 6(b) shows information on pairs of image IDs and object categories obtained by the processing of S403 to S407. However, as described above with reference to FIG. 5, FIG. 6(b) assumes that the rule for selecting images in the processing of S406 is a previously displayed image. Therefore, the column adjacent to the image ID column is a "displayed object category." That is, FIG. 6(b) shows the data set that has been used to display the object category from the associated data set obtained by the processing of S402. For example, the image ID column 631 contains information "IMG_001." The object category column 632 adjacent to the image ID column 631 contains information indicating "food" as the object category of the subject appearing in the image identified by "IMG_001." The image ID column 633 contains information "IMG_002." The object category column 634 adjacent to the image ID column 633 contains information indicating "animals" as the object category of the object appearing in the image identified by "IMG_002." The image ID column 635 contains information "IMG_005." The object category column 636 adjacent to the image ID column 635 contains information indicating "vehicles" as the object category of the object appearing in the image identified by "IMG_005." Note that instead of the data set in FIG. 6(b), a column already used for displaying object categories may be added next to the object category column in FIG. 6(a). Even with this data configuration, data similar to that in FIG. 6(b) can be extracted.

[0036] FIG. 6(c) shows data used in the processing of S314. That is, FIG. 6(c) shows information on pairs of image IDs and executed actions that the execution means 208 plans to store in the storage unit 112. Therefore, FIG. 6(c) shows information on pairs of image IDs and executed actions obtained by the processing of S311 to S313. For example, information "IMG_007" is arranged in the image ID column 641. Information "print" is arranged in the executed action column 642 adjacent to the image ID column 641, indicating that the image identified by "IMG_007" was used to execute the "print" action. Note that it is sufficient that the image ID is associated with an executed action. Therefore, the data configuration may be such that the executed action column can be referenced from the image ID column in FIG. 6(a). Alternatively, the executed action column may be arranged next to the image ID column in FIG. 6(a). On the other hand, if the data is to be used in the processing of S317, the information "send email" may be arranged in the performed action column. Note that the performed action column may be referenced when extracting images used in the action as a rule for selecting images in the processing of S406, as described above with reference to FIG. 5.

[0037] FIG. 6(d) shows the results of the recognition processing in S301. That is, FIG. 6(d) shows the object category for each image obtained by the recognition means 206 analyzing each image. These images are images that the storage means 201 newly stores in the storage unit 112. For example, they are images that the CPU 151 functioning as the storage means 201 receives from the terminal 102, the image management service 103, or other devices via the communication unit 111. The results of the recognition processing are specifically as follows: The information "IMG_101" is arranged in the image ID column 651. The object category column 652 adjacent to the image ID column 651 contains information indicating "vehicle" as the object category appearing in the image identified by "IMG_101." The information "IMG_102" is arranged in the image ID column 653. In the object category column 654 adjacent to the image ID column 653, information indicating "landscape" is arranged as the object category that appears in the image identified by "IMG_102". In the image ID column 655, information "IMG_103" is arranged. In the object category column 656 adjacent to the image ID column 655, nothing is arranged as the object category that appears in the image identified by "IMG_103", and it is blank. This means that since no object was recognized in the image with the image ID "IMG_103", the object category to which the subject belongs was also not recognized.

[0038] Fig. 6(e) shows data used in the processing of S223. That is, Fig. 6(e) shows the transmission rules that are generated by the transmission rule setting means 205 and are to be stored in the storage unit 112. Information indicating "animals" as the subject category is arranged in the subject category column 661. Information indicating "vehicles" as the subject category is arranged in the subject category column 662. The transmission rule shown in Fig. 6(e) indicates that if the subject category of an image matches either "vehicles" shown in column 661 or "animals" shown in column 662, the image is to be transmitted to the image management service 103.

[0039] [Screen example] FIG. 7 shows an example of a display screen. FIG. 7(a) shows an example of a transmission rule management screen. As shown in FIG. 7(a), a button 701 is located in the center of the bottom of the transmission rule management screen. The button 701 has a function of instructing the user to set a new transmission rule. When the user operates the button 701, the transmission rule management screen transitions to a transmission rule setting screen, which will be described later with reference to FIG. 7(b). This operation allows the user to set a new transmission rule. A screen title "Transmission Rule Management" is located in the center of the top of the transmission rule management screen. A message reading "There are no transmission rules. Please create a new one" is displayed between the button 701 and the screen title. This message allows the user to understand that no "transmission rules" have been set in this information processing system. Furthermore, by operating the button 701, the user can transition to the transmission rule setting screen. Next, the screen that appears after the user operates the button 701 will be described with reference to FIG. 7(b).

[0040] FIG. 7(b) shows an example of a transmission rule setting screen. As shown in FIG. 7(b), buttons 711, 712, 714, 716, and 718 are displayed on the transmission rule setting screen. Button 711 is located at the bottom center of the transmission rule setting screen. Button 711 has a function of instructing completion of the transmission rule setting. Therefore, the user can complete the transmission rule setting by operating button 711. Button 712 is located at the left center of the transmission rule setting screen. Button 712 has a function of instructing that the object category "food" be included in the conditions of the transmission rule. Therefore, by operating button 712, the user can include the object category "food" in the conditions of the transmission rule. A representative image 713 is displayed on button 712. The representative image 713 is an image that represents the object category corresponding to button 712. In the example of FIG. 7(b), an image with an image ID of "IMG_001" is used as the representative image 713. Button 714 is located to the right of button 712. Button 714 has a function of instructing that the object category be "animals" be included in the conditions of the transmission rule. Therefore, by the user operating button 714, the object category be "animals" can be included in the conditions of the transmission rule. A representative image 715 is displayed on button 714. The representative image 715 is an image that represents the object category corresponding to button 714. In the example of FIG. 7( b ), an image with an image ID of "IMG_002" is used as the representative image 715. Button 716 is located to the right of button 714. Button 716 has a function of instructing that the object category be "vehicles" be included in the conditions of the transmission rule. Therefore, by the user operating button 716, the object category be "vehicles" can be included in the conditions of the transmission rule. A representative image 717 is displayed on button 716. The representative image 717 is an image that represents the object category corresponding to button 716. In the example of FIG. 7(b), an image with an image ID of "IMG_005" is used as the representative image 717.Button 718 is located in the center right of the transmission rule setting screen. Button 718 has a function of instructing that the case where the subject category is "Landscape" be included in the conditions of the transmission rule. Therefore, by the user operating button 718, the case where the subject category is "Landscape" can be included in the conditions of the transmission rule. Button 718 displays a representative image 719. The representative image 719 is an image representative of the subject category corresponding to button 718. In the example of FIG. 7( b), an image with an image ID of "IMG_007" is used as the representative image 719. In this way, representative images 713, 715, 717, and 719 representing the subject categories and transmission rules specified for each subject category are displayed on the same display surface of the transmission rule setting screen. With this display configuration, the user can grasp the images and transmission rules on the same display surface, making it easier for the user to grasp which images fit which subject categories when setting transmission rules. Next, an example in which the user operates buttons 714 and 716 and a transmission rule is set will be described with reference to FIG. 7(c).

[0041] FIG. 7(c) shows an example of a transmission rule setting screen. FIG. 7(c) shows an example in which icons 721 and 722 are further arranged compared to FIG. 7(b). Icon 721 is arranged within the frame of button 714. Icon 721 indicates that the subject category being "animal" is to be included as one of the conditions included in the setting of the transmission rule. Icon 722 indicates that the subject category being "vehicle" is to be included as one of the conditions included in the setting of the transmission rule. In the state of FIG. 7(c), operating button 711 shown in FIG. 7(b) completes the setting of the transmission rule. This establishes that the subject category being "animal" or "vehicle" is to be included as a condition included in the setting of the transmission rule.

[0042] FIG. 8 shows an example of a display screen. FIG. 8(a) shows an example of a transmission rule management screen. The transmission rule management screen of FIG. 8(a) differs from the transmission rule management screen of FIG. 7(a) in that the transmission rule has already been set as "Transmission Rule 1." As shown in FIG. 8(a), a button 701 is located in the center of the bottom of the transmission rule management screen. The function of the button 701 is the same as that of FIG. 7(a), so its description will be omitted. The screen title "Transmission Rule Management" is located in the center of the top of the transmission rule management screen. In the left area between the button 701 and the screen title, an outlineless icon displaying the character string "Transmission Rule 1" is displayed. This outlineless icon is selectable by the user. In the right area between the button 701 and the screen title, a button 801 displaying the character string "Delete" is displayed. The button 801 is selectable by the user. The button 801 has the function of instructing the deletion of a set transmission rule. Therefore, the user can delete "transmission rule 1" by selecting button 801. For example, when the receiving means 204 receives an input indicating that button 801 has been tapped, the transmission rule setting means 205 deletes the transmission rule stored in the storage unit 112.

[0043] FIG. 8(b) shows an example of an image list screen displaying a list of images stored in the storage unit 112. As shown in FIG. 8(b), thumbnails 811 to 814 are arranged at regular intervals at the top of the image list screen. Furthermore, thumbnails 815 to 817 are arranged at regular intervals at the bottom of the image list screen. Each of the thumbnails 811 to 817 represents a reduced image corresponding to an image stored in the storage unit 112. In the example shown in FIG. 8(b), each of the thumbnails 811 to 817 has a function of calling up an image indicated by the corresponding image ID in FIG. 6(a). For example, when thumbnail 811 is operated, the image corresponding to "IMG_001" can be called up. Therefore, when the receiving means 204 receives a tap instruction on any of the thumbnails 811 to 817, the screen generating means 202 generates an action selection screen shown in FIG. 8(c), which will be described later. Next, a screen that appears when the thumbnail 811 in FIG. 8(b) is tapped by a user operation will be described with reference to FIG. 8(c).

[0044] FIG. 8(c) is an action selection screen for selecting an action for an image. As shown in FIG. 8(c), a preview image 821 is displayed in the left area of ​​the action selection screen. The preview image 821 is an image for pre-output confirmation of the image corresponding to the image ID "IMG_001" that can be referenced from the thumbnail 811 in FIG. 8(b). A print button 822 is arranged in the upper right area of ​​the action selection screen. When the print button 822 is operated by the user, an instruction to print the image is issued. A send email button 823 is arranged in the lower right area of ​​the action selection screen. When the send email button 823 is operated, an instruction to send the image by email is issued.

[0045] [Flow of display process for the sending rule setting screen] The following describes the process flow for the information processing device 101 to display a transmission rule setting screen, using the flowcharts shown in Figures 2(b), 4, and 5, the data examples in Figures 6(a), 6(b), and 6(c), and the screen examples shown in Figures 7(a) and 7(b). Note that the process for displaying the transmission rule setting screen described below can also be implemented as a cloud service that does not specify resources.

[0046] Hereinafter, a use case will be assumed in which the storage unit 112 stores a total of seven images corresponding to the image IDs indicated in columns 601, 603, 605, 607, 609, 611, and 613 in FIG. 6(a), and a display process of a transmission rule setting screen is performed. The flowchart shown in FIG. 2(b) is executed when the CPU 151 functioning as the screen generating means 202 displays the transmission rule management screen shown in FIG. 7(a). In S211, the CPU 151 functioning as the receiving means 204 detects pressing of the button 701 and receives the detection result as input information from the user. In S212, the CPU 151 functioning as the screen generating means 202 executes the process of the flowchart shown in FIG. 4 to generate a transmission rule setting screen.

[0047] (Details of S212; flowchart in Figure 4) In S401, the CPU 151 functioning as the associating means 209 acquires a total of seven images indicated by columns 601, 603, 605, 607, 609, 611, and 613 in FIG. 6(a) from the storage unit 112. In S402, the CPU 151 functioning as the recognizing means 206 analyzes the object categories of the images acquired in S401. The analysis results are shown as object categories arranged in columns 602, 604, 606, 608, 601, 612, and 614 in FIG. 6(a), respectively.

[0048] (Subject category: "Food") In S403, the CPU 151 functioning as the associating means 209 executes the processes shown in S404 to S408 for the number of object categories. First, the processes are executed for the case where the object category is "food." In S404, the CPU 151 functioning as the associating means 209 acquires an image with an image ID of "IMG_001" from among the images identified by the image IDs in FIG. 6A as an image that matches the case where the object category is "food." In S405, since the image acquired in S404 is the single image with "IMG_001," the CPU 151 advances the process of S405 to the process of S407. In S407, the CPU 151 functioning as the associating means 209 associates the image with the image ID of "IMG_001" with the object category "food." In S408, the CPU 151 functioning as the associated image management means 207 stores in the storage unit 112 that the image with the image ID of "IMG_001" is associated with the object category "food." In S409, since the processing for all object categories has not been completed, the CPU 151 returns the processing of S409 to the processing of S403.

[0049] (Subject category: "Animals") In S403, the process is next executed for the object category "Animals". In S404, CPU 151 functioning as the associating means 209 acquires images with image IDs "IMG_002" and "IMG_003" from the images in FIG. 6(a) as images that match the object category "Animals". In S405, since the images acquired in S404 are two, "IMG_002" and "IMG_003", CPU 151 advances the process of S405 to process S406. In S406, CPU 151 functioning as the associating means 209 executes the process of the flowchart shown in FIG. 5 to select one image from the plurality of images.

[0050] (Details of S406; flowchart in Figure 5) In S501, the CPU 151 functioning as the associating means 209 extracts images that match a single object category. An image with an image ID of "IMG_002" matches when the object category is "animals," as shown in column 604. An image with an image ID of "IMG_003" matches when the object category is "animals" and "vehicles," as shown in column 606. Therefore, the CPU 151 functioning as the associating means 209 extracts an image with an image ID of "IMG_002" as an image that matches a single object category. In S502, as a result of the processing of S501, the images have been narrowed down to one, "IMG_002," so the CPU 151 advances the processing of S502 to the processing of S508. In S508, CPU 151 functioning as the associating means 209 selects the image with the image ID "IMG_002" as the image to be displayed on the transmission rule setting screen, and causes the processing of S508 to proceed to processing of S407 in FIG. 4. In S407, CPU 151 functioning as the associating means 209 associates the image with the image ID "IMG_002" with the object category "animals." In S408, CPU 151 functioning as the associated image managing means 207 stores in storage unit 112 that the image with the image ID "IMG_002" is associated with the object category "animals." In S409, because processing for all object categories has not been completed, CPU 151 returns processing of S409 to processing of S403.

[0051] (Subject category: "Vehicles") In S403, the process is next executed for the object category "vehicle." In S404, the CPU 151 functioning as the associating means 209 acquires, from the images in FIG. 6(a), images with image IDs "IMG_003," "IMG_004," and "IMG_005" as images that match the object category "vehicle." In S405, since the images acquired in S404 are the three images "IMG_003," "IMG_004," and "IMG_005," the CPU 151 advances the process of S405 to the process of S406. In S406, the CPU 151 functioning as the associating means 209 executes the process of the flowchart shown in FIG. 5 to select one image from the plurality of images.

[0052] (Details of S406; flowchart in Figure 5) In S501, the CPU 151 functioning as the associating means 209 extracts images that match a single object category. An image with an image ID of "IMG_003" matches the object categories of "animals" and "vehicles," as shown in column 606. An image with an image ID of "IMG_004" matches the object category of "vehicles," as shown in column 608. An image with an image ID of "IMG_005" matches the object category of "vehicles," as shown in column 610. Therefore, the CPU 151 functioning as the associating means 209 extracts images with image IDs of "IMG_004" and "IMG_005." In S502, as a result of the processing of S501, the images have been narrowed down to two, "IMG_004" and "IMG_005," but have not been narrowed down to one, so the CPU 151 advances the processing of S502 to the processing of S503. In S503, the CPU 151 functioning as the associating means 209 extracts images whose image IDs are stored as displayed images shown in FIG. 6(b). First, the image ID "IMG_004" does not match any of the image IDs shown in columns 631, 633, and 635, and is therefore not stored as a displayed image. Next, the image ID "IMG_005" matches the image ID shown in column 635, and is therefore stored as a displayed image. Therefore, the CPU 151 functioning as the associating means 209 extracts an image whose image ID is "IMG_005." In S504, as a result of the processing of S503, the images have been narrowed down to one, "IMG_005," and therefore the CPU 151 advances the processing of S504 to the processing of S508. In S508, CPU 151 functioning as the associating means 209 selects "IMG_005" as the image to be displayed on the transmission rule setting screen, and causes the process of S508 to proceed to S407. In S407, CPU 151 functioning as the associating means 209 associates the image having the image ID "IMG_005" with the object category "vehicle." In S408, CPU 151 functioning as the associated image managing means 207 stores in the storage means 201 that the image having the image ID "IMG_005" is associated with the object category "vehicle."In S409, since the processing for all object categories has not been completed, the CPU 151 returns the processing of S409 to the processing of S403.

[0053] (Subject category: "Landscape") In S403, the process is next performed for the object category "landscape." In S404, CPU 151 functioning as associating means 209 acquires images with image IDs "IMG_006" and "IMG_007" from the images in FIG. 6(a) as images that match the object category "landscape." In S405, since the images acquired in S404 are two, "IMG_006" and "IMG_007," CPU 151 advances the process of S405 to process S406. In S406, CPU 151 functioning as associating means 209 executes the process of the flowchart shown in FIG. 5 to select one image from the plurality of images.

[0054] (Details of S406; flowchart in Figure 5) In S501, the CPU 151 functioning as the associating means 209 extracts images that match a single object category. An image with an image ID of "IMG_006" matches when the object category is "landscape," as shown in column 612. An image with an image ID of "IMG_007" matches when the object category is "landscape," as shown in column 614. Therefore, the CPU 151 functioning as the associating means 209 extracts images with image IDs of "IMG_006" and "IMG_007." In S502, as a result of the processing in S501, the images have been narrowed down to two, "IMG_006" and "IMG_007," but the images have not been narrowed down to one, so the CPU 151 advances the processing in S502 to processing in S503. In S503, the CPU 151 functioning as the associating means 209 extracts images whose image IDs are stored as displayed images shown in FIG. 6(b). The image IDs "IMG_006" and "IMG_007" do not match any of the image IDs shown in columns 631, 633, and 635. Therefore, the CPU 151 functioning as the associating means 209 extracts all images, i.e., the image IDs "IMG_006" and "IMG_007." In S504, as a result of the processing in S503, the images have been narrowed down to two, "IMG_006" and "IMG_007," but not to one, so the CPU 151 advances the processing in S504 to the processing in S505. In S505, the CPU 151 functioning as the associating means 209 extracts images whose image IDs are stored as action-executed images shown in FIG. 6(c). The image ID "IMG_006" does not match the image ID shown in column 641. The image ID "IMG_007" matches the image ID shown in column 641. Therefore, CPU 151 functioning as associating means 209 extracts an image having an image ID of "IMG_007." In S506, as a result of the processing of S505, the images have been narrowed down to one, "IMG_007," so CPU 151 advances the processing of S506 to processing of S508. In S508, CPU 151 functioning as associating means 209 selects the image having an image ID of "IMG_007" as the image to be displayed on the transmission rule setting screen, and advances the processing of S508 to processing of S407.In S407, the CPU 151 functioning as the associating means 209 associates the image having the image ID "IMG_007" with the object category "Landscape." In S408, the CPU 151 functioning as the associated image management means 207 stores in the storage unit 112 that the image having the image ID "IMG_007" is associated with the object category "Landscape." In S409, since the processing for all object categories has been completed, the CPU 151 advances the processing of S409 to processing of S410. In S410, the CPU 151 functioning as the screen generating means 202 generates the transmission rule setting screen shown in FIG. 7(b), and advances the processing of S410 to processing of S213. In S213, the CPU 151 functioning as the screen generating means 202 presents the transmission rule setting screen to the user, and ends this processing, which is the display processing of the transmission rule setting screen.

[0055] Through the processing up to this point, in S407, the CPU 151 functioning as the associating means 209 associates the image with the image ID "IMG_001" with the object category "food." Therefore, the CPU 151 functioning as the screen generating means 202 uses the image with the image ID "IMG_001" as the representative image 713 of the button 712 that specifies the object category "food" in the transmission rule. Also, in S407, the CPU 151 functioning as the associating means 209 associates the image with the image ID "IMG_002" with the object category "animals." Therefore, the CPU 151 functioning as the screen generating means 202 uses the image with the image ID "IMG_002" as the representative image 715 of the button 714 that specifies the object category "animals" in the transmission rule. Also, in S407, the CPU 151 functioning as the associating means 209 associates the image with the image ID "IMG_005" with the object category "vehicles." Therefore, CPU 151 functioning as screen generating means 202 uses the image with image ID "IMG_005" as the representative image 717 of button 716 that specifies the object category "vehicle" in the transmission rule. Also, in S407, CPU 151 functioning as associating means 209 associated the image with image ID "IMG_007" with the object category "landscape." Therefore, CPU 151 functioning as screen generating means 202 uses the image with image ID "IMG_007" as the representative image 719 of button 718 that specifies the object category "landscape" in the transmission rule.

[0056] As explained above, the CPU 151 accepts a user's setting of a transmission rule via a setting screen that manages settings for transmitting images. The CPU 151 selects an image to be paired with a transmission rule from among images associated with the user. The CPU 151 associates the selected image with the transmission rule. The CPU 151 displays the selected image and the transmission rule on the setting screen as associated related information. This operation allows the user to confirm the image paired with the transmission rule. Since the image paired with the transmission rule is an image selected from among images associated with the user, the image displayed on the setting screen is an image related to the user and the transmission rule. Therefore, the image displayed on the setting screen can provide the user with hints for setting the transmission rule. This makes it possible to support the setting of the transmission rule. In other words, the user can intuitively understand the transmission rule by visually checking the image displayed on the setting screen. This allows the user to easily understand which image matches which subject category when setting the transmission rule.

[0057] Furthermore, CPU 151 may acquire an image associated with the user from among images that have been displayed on the setting screen based on the transmission rule. According to this operation, the image that has already been used is associated with the display, making it easy for the user to know which image will be sent.

[0058] Furthermore, if there are multiple images associated with the user that meet the conditions included in the transmission rule settings, the CPU 151 may select an image that has been associated with the transmission rule in the past. This operation allows an image previously selected from multiple images to be used as a representative image to be displayed on the settings screen. This allows for an interface that is easy for the user to understand.

[0059] Furthermore, when there are multiple images associated with the user that meet the conditions included in the transmission rule settings, the CPU 151 may select the image with the oldest capture date and time. According to this operation, the image with the oldest capture date and time is selected. Since the image with the oldest capture date and time remains undeleted, it is possible that the image has been frequently used, and therefore by selecting this image, it is possible to set a more practical transmission rule.

[0060] Furthermore, when there are multiple images associated with the user that match the conditions included in the transmission rule settings, CPU 151 may select images with fewer subject categories. This operation allows the user to narrow down the representative images, making it easier for the user to understand which images match which subject categories when setting the transmission rule.

[0061] Furthermore, when there are multiple images associated with the user that meet the conditions included in the transmission rule settings, the CPU 151 may select an image for which a preset action has been performed. This operation allows the representative images to be narrowed down to images for which an action has been performed, making it possible to set a more practical transmission rule.

[0062] Furthermore, CPU 151 may arrange the image locations and the transmission rules on the same surface of the transmission rule setting screen. This operation allows the user to grasp the images and the transmission rules on the same surface, making it easier for the user to grasp which images fit which subject categories when setting the transmission rules.

[0063] [Flow of sending rule settings] The following describes the flow of processing by the information processing device 101 to set transmission rules, using examples of the setting screens shown in Figures 7(b) and 7(c). This processing is executed when the CPU 151, functioning as the screen generating means 202, displays the setting screen shown in Figure 7(b). Note that the processing for displaying the setting screen for transmission rules described below can also be implemented as a cloud service that does not specify resources.

[0064] When CPU 151 functioning as receiving means 204 receives an input instruction to tap button 714 from terminal 102, it performs the following operation. That is, CPU 151 functioning as screen generating means 202 displays icon 721 as shown in FIG. 7(c). This indicates that the subject category "animal" has been selected as the transmission rule. Furthermore, when CPU 151 functioning as receiving means 204 receives an input instruction to tap button 716 from terminal 102, it performs the following operation. That is, CPU 151 functioning as screen generating means 202 displays icon 722. This indicates that the subject category "vehicle" has been selected as the transmission rule.

[0065] [Flow of process to complete sending rule settings] The following describes the flow of processing by the information processing device 101 to complete the setting of a transmission rule, using the flowchart shown in Fig. 2(c), the example data in Fig. 6(e), and the example screen shown in Fig. 7(c). This processing is executed when the CPU 151, functioning as the screen generating means 202, displays the screen shown in Fig. 7(c). Note that the processing to complete the setting of a transmission rule described below can also be implemented as a cloud service that does not specify resources.

[0066] In S221, the CPU 151 functioning as the receiving means 204 receives an input instruction to tap the button 711 from the terminal 102. In S222, the CPU 151 functioning as the transmission rule setting means 205 determines that "Animals" and "Vehicles" have been selected as the object categories when the button 711 is operated. Therefore, the CPU 151 determines that one or more object categories have been selected, and advances the process from S222 to S223. In S223, the CPU 151 functioning as the transmission rule setting means 205 stores in the storage unit 112 a transmission rule indicating that images matching the object category "Animals" or "Vehicles" are to be transmitted, and ends this process. FIG. 6(e) shows the transmission rule stored in this step. Note that in S221, when the CPU 151 functioning as the receiving means 204 receives an input instruction to tap the button 711 in the state of the screen shown in FIG. 7(b), i.e., when no object categories are selected, it performs the following operation. That is, in S222, the CPU 151 functioning as the transmission rule setting means 205 ends this process because no subject category has been selected.

[0067] [Image transmission process flow] The following describes the flow of processing by the information processing device 101 to transmit images, using the flowchart shown in FIG. 3(a) and the data examples in FIGS. 6(d) and 6(e). Here, the flow of execution of the transmission processing for the three images shown in FIG. 6(d) is described in order. Here, the transmission processing refers to the processing of transmitting a transmission candidate image if the information obtained from the transmission candidate image meets the conditions of the transmission rule. Therefore, if the information obtained from the transmission candidate image does not meet the conditions included in the transmission rule settings, the transmission candidate image will not be transmitted. Note that the processing of displaying the transmission rule setting screen described below can also be implemented as a cloud service that does not specify resources.

[0068] Hereinafter, a use case will be assumed in which the storage unit 112 stores the subject categories indicated in the fields 661 and 662 in FIG. 6(e) as transmission rules.

[0069] (Sending process of the image "IMG_101") First, the flow of transmission processing for an image whose image ID in column 651 is "IMG_101" is shown. In S301, the CPU 151 functioning as the recognition means 206 analyzes the object category of an image newly stored in the storage unit 112. The analysis result is the object category "vehicle" shown in column 652 of FIG. 6(d). In S302, the CPU 151 functioning as the transmission means 203 acquires the transmission rule shown in FIG. 6(e). As shown in columns 661 and 662, the acquired transmission rule includes the object categories "animal" and "vehicle." In S303, the CPU 151 functioning as the transmission means 203 determines that the object category "vehicle" analyzed in S301 is included in the transmission rule acquired in S302. The CPU 151 advances the processing of S303 to processing of S304. In S304, the CPU 151 functioning as the transmission means 203 transmits the image with the image ID "IMG_101" to the image management service 103. In this way, if the analyzed subject category is included in the transmission rule, an image containing a subject characterized by that subject category is transmitted. In other words, if the candidate category characterizing the candidate subject appearing in the transmission candidate image matches the subject category, and the information obtained from the transmission candidate image satisfies the conditions included in the settings of the transmission rule, the transmission candidate image is transmitted.

[0070] (Sending process of the image "IMG_102") Next, the flow of transmission processing for an image whose image ID in column 653 is "IMG_102" is shown. In S301, CPU 151 functioning as recognition means 206 analyzes the object category of an image newly stored in storage unit 112. The analysis result is the object category "landscape" shown in column 654 of FIG. 6(d). In S302, CPU 151 functioning as transmission means 203 acquires the transmission rule shown in FIG. 6(e). As shown in columns 661 and 662, the acquired transmission rule includes the object categories "animals" and "vehicles." In S303, CPU 151 functioning as transmission means 203 determines that the object category "landscape" analyzed in S301 is not included in the transmission rule acquired in S302. CPU 151 ends the processing of S303 and terminates this process. In this way, if the analyzed object category is not included in the transmission rule, an image containing an object characterized by that object category is not transmitted. In other words, if the candidate category characterizing the candidate subject appearing in the transmission candidate image does not match the subject category, and the information obtained from the transmission candidate image does not conform to the conditions included in the transmission rule settings, the transmission candidate image will not be transmitted.

[0071] (Sending process of the image "IMG_103") Next, the flow of transmission processing for an image whose image ID in column 655 is "IMG_103" is shown. In S301, the CPU 151 functioning as the recognition means 206 analyzes the object category of an image newly stored in the storage unit 112. As shown in column 656 in FIG. 6(d), the analysis results in a result that the image does not fall into any of the object categories. In S302, the CPU 151 functioning as the transmission means 203 acquires the transmission rule shown in FIG. 6(e). As shown in columns 661 and 662, the acquired transmission rule includes "animals" and "vehicles" as object categories. In S303, since no applicable object category was obtained in S301, the CPU 151 functioning as the transmission means 203 determines that the image is not included in the transmission rule acquired in S302 and terminates this processing. In this way, if the analyzed object category is not included in the transmission rule, an image containing an object characterized by that object category is not transmitted. In other words, if the candidate category characterizing the candidate subject appearing in the transmission candidate image does not match the subject category, and the information obtained from the transmission candidate image does not conform to the conditions included in the transmission rule settings, the transmission candidate image will not be transmitted.

[0072] From the above explanation, the CPU 151 may accept, as a transmission rule setting, a setting for a transmission process to transmit a transmission candidate image when a subject category characterizing a subject appearing in an image matches a candidate category characterizing a candidate subject appearing in a transmission candidate image. Such an operation enables transmission of a transmission candidate image in which a candidate subject characterized by a candidate category matching the subject category characterizing the subject appearing in the image is depicted. This allows the transmission process to be set with a more intuitive operation. Furthermore, the CPU 151 may display an image that is part of the related information associated with each subject category that is part of the transmission rule. Such an operation allows the transmission process to be set with a more intuitive operation because the images displayed on the setting screen are associated with each subject category.

[0073] [Action execution process flow] The following describes the flow of processing in which the information processing device 101 executes an action, using the flowchart shown in Fig. 3(b), the example data shown in Fig. 6(a), and the example screen shown in Fig. 8(c). This processing is executed when the CPU 151 functioning as the screen generating means 202 displays the screen shown in Fig. 8(c). Note that the action execution processing described below can also be implemented as a cloud service that does not specify resources.

[0074] Hereinafter, a use case will be assumed in which the storage unit 112 stores a total of seven images corresponding to the image IDs shown in columns 601, 603, 605, 607, 609, 611, and 613 in FIG. 6(a), and an action execution process is performed.

[0075] (Print action) First, the flow of processing for executing the “print” action will be described. In S311, the CPU 151 functioning as the receiving means 204 receives an execution instruction indicating that the print button 822 has been tapped. In S312, since the received execution instruction is “print,” the CPU 151 advances the processing of S312 to processing of S313. In S313, the CPU 151 functioning as the executing means 208 transmits an image corresponding to the preview image 821, the image having the image ID “IMG_001,” to the image forming apparatus via the communication unit 111. Here, the image forming apparatus may be a device included in the information processing system, or may be a device disposed externally to the information processing system. In S314, the CPU 151 functioning as the executing means 208 stores in the storage unit 112 that the action “print” has been executed on the image corresponding to the image ID “IMG_001.” For example, as shown in FIG. 6C, the image ID and the executed action are stored in association with each other. In S315, since the received execution instruction is "printing", the CPU 151 ends this process.

[0076] ("Send email" action) Next, the flow of processing for executing the "send email" action will be described. In S311, CPU 151 functioning as receiving means 204 receives an execution instruction indicating that send email button 823 has been tapped. In S312, since the received execution instruction is "send email," CPU 151 advances the processing of S312 to processing of S315. In S315, since the received execution instruction is "send email," CPU 151 advances the processing of S315 to processing of S316. In S316, CPU 151 functioning as executing means 208 transmits an image corresponding to preview image 821, whose image ID is "IMG_001," to the email server via communication unit 111. Here, the email server may be a email server included in the information processing system, a email server located outside the information processing system, or an email server implemented as a cloud service that does not specify resources. In S317, CPU 151 functioning as execution means 208 stores in storage unit 112 that the action "send email" has been executed on the image corresponding to image ID "IMG_001," and then CPU 151 ends this process.

[0077] From the above explanation, when there are multiple images associated with the user and that meet the conditions included in the transmission rule settings, CPU 151 may mark the images that have been printed as having undergone a preset action. This operation narrows down the images to those that have been requested to be output on paper media, making it possible to set more practical transmission rules.

[0078] Furthermore, when there are multiple images associated with a user that meet the conditions included in the transmission rule settings, CPU 151 may treat images that have been sent by email as having undergone a pre-set action. This operation narrows down the images to those that the user has requested to be sent by email, allowing for the setting of more practical transmission rules.

[0079] As described above, in this embodiment, based on the results of recognizing images owned by the user, those images are displayed on the transmission rule setting screen. Here, the images owned by the user may be images associated with the user. For example, images associated with the user may be images captured by the imaging device 109 and stored within the imaging device 109. Images stored by the user in a cloud storage service are also images associated with the user. In other words, images associated with the user may be images in which the user is directly or indirectly involved. Furthermore, the transmission rule in this embodiment is to transmit a transmission candidate image when a subject category characterizing a subject depicted in the image matches a candidate category characterizing a candidate subject depicted in the transmission candidate image. Furthermore, the images displayed on the transmission rule setting screen are images that depict a subject characterized by a subject category and are owned by the user. In other words, user convenience can be improved by presenting the characteristics of images that match each subject category, which is a condition of the transmission rule, using images owned by the user. Furthermore, here, "match" does not necessarily mean a perfect match. For example, as a result of classification using an algorithm such as a support vector machine, it is sufficient that an element indicating a candidate category is included within the area that identifies the subject category, and that the subject category and the candidate category can be considered to match.

[0080] The information processing device 101 may communicate with multiple image management services 103. The CPU 151 functioning as the screen generation means 202 may generate a screen for specifying, for a transmission rule, to which image management service 103 an image that matches the transmission rule should be transmitted. The CPU 151 functioning as the transmission means 203 may transmit the image that matches the transmission rule to the specified image management service 103.

[0081] Alternatively, if none of the images stored in the storage unit 112 match a specific subject category, a previously prepared image may be used as a representative image. Alternatively, the image transmission process may be executed at a time other than when the storage unit 112 stores a new image. For example, if the information processing device 101 has a photographing unit, the image transmission process may be executed when the photographing unit photographs an image. Furthermore, if the information processing device 101 has an image generating unit, the image transmission process may be executed when the generating unit generates an image. Alternatively, the CPU 151 functioning as the screen generating unit 202 may generate an editing screen for editing the content of the created transmission rule. Alternatively, the CPU 151 functioning as the screen generating unit 202 may generate a screen for setting multiple transmission rules. Alternatively, the CPU 151 functioning as the screen generating unit 202 may generate a screen for setting the name of the transmission rule. Alternatively, the CPU 151 functioning as the screen generating unit 202 may generate a screen for deleting an image stored in the storage unit 112. When the CPU 151 functioning as the receiving means 204 receives an input indicating image deletion, the storage unit 112 may delete the corresponding image and delete the image ID of the image from the displayed images and the images for which an action has been performed. Alternatively, the object category recognized by the CPU 151 functioning as the recognizing means 206 may be other than "food," "animal," "vehicle," or "landscape." Alternatively, the CPU 151 functioning as the recognizing means 206 may cache the results of the recognition process in the storage unit 112. When a certain image is requested to be recognized again, the cached results may be returned instead of executing the recognition process and returning the results. While the cache has been described above assuming the HTTP protocol, the protocol used is not limited to this. For example, the CAN (Controller Area Network) protocol used in vehicle-mounted devices for vehicle-to-vehicle communication may be used. Alternatively, the CCSDS (Consultative Committee for Space Data Systems)-TC protocol used in satellite communication may be used. Alternatively, the action executed by the CPU 151 functioning as the executing means 208 may be other than "print" or "send email."Alternatively, the CPU 151 functioning as the screen generating means 202 may generate a screen for specifying the destination of the image forming device and the destination to which the email is to be sent. Alternatively, if all subject categories are not selected on the transmission rule setting screens shown in FIGS. 7(b) and 7(c), the CPU 151 functioning as the screen generating means 202 may display an error. Alternatively, if all subject categories are not selected on the transmission rule setting screens shown in FIGS. 7(b) and 7(c), the CPU 151 functioning as the screen generating means 202 may deactivate the button 711. This makes it possible to make the button 711 unresponsive to operations such as tapping.

[0082] <<Modification of the First Embodiment>> As a modification of this embodiment, the CPU 151 functioning as the screen generating means 202 may not display a representative image showing each subject category on the transmission rule setting screen. Instead, the CPU 151 functioning as the screen generating means 202 may display a representative image of each subject category when a help button corresponding to each subject category is tapped.

[0083] FIG. 15 shows another example of a transmission rule setting screen. FIG. 15(a) shows an example of a transmission rule setting screen in a modified example of this embodiment. As shown in this example of the setting screen, the transmission rule setting screen does not display representative images representing each object category. Instead, help buttons 1501 to 1504 are displayed. FIG. 15(b) shows an example of a screen displayed when the CPU 151 functioning as the receiving means 204 receives information indicating that the help button 1503 has been tapped on the transmission rule setting screen of FIG. 15(a). The example screen of FIG. 15(a) is generated by the CPU 151 functioning as the screen generating means 202. FIG. 15(b) shows a preview image 1511 and a change button 1512. The preview image 1511 is located on the right side of the screen. The preview image 1511 is a representative image corresponding to the object category "vehicle." The preview image 1511 corresponds to a pre-output confirmation image of an image with an image ID of "IMG_005." The change button 1512 is located at the bottom center of the screen. The change button 1512 is a button for changing the representative image. When the CPU 151 functioning as the receiving means 204 receives information indicating that the change button 1512 has been tapped, the CPU 151 functioning as the screen generating means 202 generates a screen displaying candidate representative images. In a modified example of this embodiment, the candidate representative images are images included in an image group that matches the object category "vehicle." FIG. 15(c) shows an example of the candidate representative images. The preview images 1521 to 1523 are images that match the object category "vehicle" and correspond to the image IDs "IMG_003," "IMG_004," and "IMG_005," respectively. When the CPU 151 functioning as the receiving means 204 receives information indicating that the preview images 1521 to 1523 have been tapped, the CPU 151 functioning as the screen generating means 202 changes the representative image to the tapped image.

[0084] In this modified example, the CPU 151 functioning as the screen generating means 202 may display some of the images included in the image group that match the object category as candidates for the representative image. In particular, if the images included in the image group are similar to images in the object category before the change, some of these images may be displayed as candidates. For example, assume that there are 100 images that match the object category "animals," and 90 of them are similar to images in the object category before the change. In this case, one of the 90 images may be selected, and together with the remaining 10 images, a total of 11 images may be displayed as candidates for the representative image.

[0085] From the above explanation, the setting screen may be configured with a plurality of layers, and among the layers, the transmission rules may be displayed in a layer lower than the image associated with the user.

[0086] <<Second embodiment>> In the first embodiment, the CPU 151 functioning as the recognition means 206 recognized the category of the subject appearing in the image. In the present embodiment, the CPU 151 functioning as the recognition means 206 recognizes a blur evaluation value indicating the magnitude of blur included in the image. In other words, whereas the first embodiment used the subject category as the transmission rule, the second embodiment uses the blur evaluation value as the transmission rule.

[0087] [Overall configuration] The configuration of the information processing system in this embodiment is the same as that in the first embodiment shown in Figures 1(a) to 1(d), and therefore a description thereof will be omitted. That is, each network component included in the information processing system can be connected via the Internet 100. In this embodiment, the network components include, for example, an information processing device 101, a terminal 102, image management services 103_1 and 103_2, and an imaging device 109.

[0088] [Software configuration] The software configuration in this embodiment is as shown in Fig. 2(a). That is, the CPU 151 executes the program according to this embodiment, thereby realizing various software programs of the information processing device 101 as functional blocks. Alternatively, the various programs according to this embodiment can also be realized as a cloud computing configuration in which one function is shared by multiple resources via the Internet 100 and processed collaboratively.

[0089] [Sending rule setting screen presentation processing] The process of presenting the transmission rule setting screen in this embodiment is as shown in Fig. 2(b). That is, a transmission rule setting screen is generated via the transmission rule setting screen, and the generated transmission rule setting screen is displayed on, for example, the terminal 102, whereby the transmission rule setting screen is presented to the user operating the terminal 102.

[0090] [Settings for sending rules] FIG. 12 is a flowchart showing an example of the operation of the information processing device 101. FIG. 12(b) is a flowchart showing an example of a process for setting a transmission rule executed by the information processing device 101. The process shown in FIG. 12(b) is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The process shown in FIG. 12(b) is executed when the screen generation means 202 generates a transmission rule setting screen. Note that the process shown in FIG. 12(b) differs from the process shown in FIG. 2(c) in the process at S1212. Here, the process at S1212 will be described. At S1212, the CPU 151 functioning as the transmission rule setting means 205 determines whether a blur evaluation value has been selected. If a blur evaluation value has been selected, the CPU 151 advances the process at S1212 to S223. If a blur evaluation value has not been selected, the CPU 151 ends this flowchart consisting of the processes at S221, S1212, and S223. The shake evaluation value will be described in detail later.

[0091] [Image transmission process] 3A, the image transmission process in this embodiment is as shown in FIG. 3A. That is, when the CPU 151 determines that the transmission candidate image satisfies the transmission rule, it transmits the transmission candidate image to the image management service 103.

[0092] [Action execution process] The action execution process in this embodiment is as shown in Fig. 3(b). That is, when an action such as printing or email sending is performed, the CPU 151 stores the image ID corresponding to the image for which the action was performed.

[0093] [Detailed instructions for generating the sending rule setting screen] FIG. 9 is a flowchart showing an example of the operation of the information processing device 101. FIG. 9 shows details of the process of S212. Specifically, the processes of S901 to S910 in FIG. 9 are processes for generating a transmission rule setting screen. The process shown in FIG. 9 is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The process shown in FIG. 9 is executed when the process of S212 in FIG. 2B is called. That is, the process shown in FIG. 9 is realized by the CPU 151. Note that some or all of the functions of the steps in FIG. 9 may be realized by hardware such as an ASIC or an electronic circuit. The symbol "S" in the description of each process indicates the step in the flowchart. Furthermore, the process shown in FIG. 9 can also be realized as a cloud computing configuration in which a single function is shared and processed collaboratively by multiple resources via the Internet 100. Note that in this embodiment, a blur evaluation value is used as a condition included in the transmission rule setting. Therefore, the process shown in FIG. 9 is a process for selecting an image to be displayed on the transmission rule setting screen based on the blur evaluation value. When there are multiple image options based on the blur evaluation value, one image is selected from the multiple images by the process shown in FIG. 12, which will be described later.

[0094] In S901, the CPU 151 functioning as the association means 209 acquires an image from the storage unit 112. The acquired image does not have to be an image stored in the storage unit 112. The acquired image may be an image available for retrieval from a storage service. In S902, the CPU 151 functioning as the recognition means 206 analyzes the blur evaluation value of the image acquired in S901. Here, analyzing the blur evaluation value refers to quantifying the blur of the image acquired in S901 into several levels and identifying which level the image falls into. For example, an edge of an object captured in the image may be detected by applying an edge detection filter such as a Laplacian filter to the image to be analyzed. Furthermore, the larger the difference in luminance values ​​between adjacent pixels, the larger the detected edge of the object. Therefore, the degree of the edge may be determined by presetting multiple thresholds proportional to the size of the edge and evaluating the detected edge using each of the set thresholds. The smaller the edge level, the greater the degree of blur. Therefore, blur in an image may be classified by a blur evaluation value by setting a blur evaluation value corresponding to each threshold and classifying the degree of edge according to the blur evaluation value. In this embodiment, the blur evaluation value takes one of the values ​​"0," "1," "2," and "3." The higher the evaluation value, the less blur the image contains. In S903, the CPU 151 functioning as the associating unit 209 executes the processes shown in S904 through S908 as many times as the number of blur evaluation values. That is, the processes of S904 through S908 are executed for each specified blur evaluation value. Therefore, if there are four blur evaluation values, as described above, the processes of S904 through S908 are executed a total of four times. In S904, the CPU 151 functioning as the associating unit 209 selects, from the images acquired in S901, an image that matches the blur evaluation value specified in S903, based on the blur evaluation value of the image acquired in S902. In S905, the CPU 151 functioning as the associating unit 209 determines whether multiple images are acquired in S904. If there is more than one, the CPU 151 advances the process from S905 to S906. If there is not more than one, the CPU 151 advances the process from S905 to S907.Here, "there are multiple images" means that there are multiple images that match a specific blur evaluation value. For example, this corresponds to the case where there are multiple images whose blur evaluation value matches "0." In S906, the CPU 151 functioning as the associating means 209 selects one image from the multiple images. Details of the process of S906 are shown in FIG. 12(a). The process shown in FIG. 12(a) is similar to the process of S503 to S508 in FIG. 5, and therefore description thereof will be omitted in this embodiment. In S907, if there is one image acquired in S904, the CPU 151 functioning as the associating means 209 associates the image with the blur evaluation value specified in S903. If there are multiple images acquired in S904, the CPU 151 associates the image selected in S906 with the blur evaluation value specified in S903. In S908, the CPU 151 functioning as the associated image management means 207 stores the image ID of the image associated in S907 as an associated image in the storage unit 112. In S909, if the processing for all blur evaluation values ​​has been completed, the CPU 151 advances the processing of S909 to S910. On the other hand, if the processing for all blur evaluation values ​​has not been completed, the CPU 151 returns the processing of S909 to S903. In S910, the CPU 151 functioning as the screen generation means 202 generates a transmission rule setting screen using the associated images, and then ends this flowchart consisting of the processing of S901 to S910. The CPU 151 functioning as the screen generation means 202 uses the images that the CPU 151 functioning as the associating means 209 associated with each blur evaluation value in S907 to generate the transmission rule setting screen.

[0095] [Example data] FIG. 10 shows an example of the data structure of data used in the process of generating a transmission rule setting screen. FIG. 10(a) shows the results of the analysis process of S902. That is, FIG. 10(a) shows the blur evaluation value for each image obtained by the recognition unit 206 analyzing each image. The image ID column shows image ID information as an identifier that can uniquely identify each image. The blur evaluation value column shows a blur evaluation value that grades the blur of each image. That is, FIG. 10(a) shows a data set in which images and blur evaluation values ​​are associated with each other. Note that the blur evaluation value column only needs to list unique blur evaluation value IDs as identifiers that can uniquely identify each blur evaluation value. In this embodiment, for convenience of explanation, in FIG. 10(a), the graded blur evaluation values ​​are arranged as intuitively understandable numbers such as "0," "1," "2," and "3." Specifically, the data set in which images and blur evaluation values ​​are associated with each other is as follows: The image ID column 1001 lists information called "IMG_201." In a blur evaluation value column 1002 adjacent to the image ID column 1001, information indicating a blur evaluation value specified by "1" is arranged. In the image ID column 1003, information "IMG_202" is arranged. In a blur evaluation value column 1004 adjacent to the image ID column 1003, information indicating a blur evaluation value specified by "2" is arranged. In the image ID column 1005, information "IMG_203" is arranged. In a blur evaluation value column 1006 adjacent to the image ID column 1005, information indicating a blur evaluation value specified by "3" is arranged. In the image ID column 1007, information "IMG_204" is arranged. In a blur evaluation value column 1008 adjacent to the image ID column 1007, information indicating a blur evaluation value specified by "3" is arranged. In the image ID column 1009, information "IMG_205" is arranged. A blur evaluation value column 1010 adjacent to the image ID column 1009 lists information indicating a blur evaluation value specified by "0." This indicates that, among IMG_201 to IMG_205, the analysis result for the blur of the images specified by IMG_203 and IMG_204 is the same blur evaluation value of "3."

[0096] FIG. 10(b) shows data used in the processing of S908. That is, FIG. 10(b) shows information on pairs of image IDs and executed actions that the execution means 208 plans to store in the storage unit 112. Therefore, FIG. 10(b) shows information on pairs of image IDs and executed actions obtained by the processing of S311 to S313. For example, information "IMG_204" is arranged in the image ID column 1011. Information "print" is arranged in the executed action column 1012 adjacent to the image ID column 1011, indicating that the image identified by "IMG_204" was used to execute the "print" action. Note that it is sufficient that the image ID is associated with an executed action. Therefore, the data configuration may be such that the executed action column can be referenced from the image ID column in FIG. 10(a). Alternatively, the executed action column may be arranged next to the image ID column in FIG. 10(a). On the other hand, if the data is to be used in the process of S317, the information "send email" may be arranged in the column of performed actions. The column of performed actions may be referenced when extracting images used in the action as a rule for selecting images in the process of S906.

[0097] FIG. 10(c) shows the results of the analysis processing of S902. That is, FIG. 10(c) shows the blur evaluation value for each image obtained by the recognition means 206 analyzing each image. These images are images that the storage means 201 newly stores in the storage unit 112. For example, they are images that the CPU 151 functioning as the storage means 201 receives from the terminal 102, the image management service 103, or other devices via the communication unit 111. The specific results of the analysis processing are as follows: The image ID column 1021 contains information "IMG_301." The blur evaluation value column 1022 adjacent to the image ID column 1021 contains information "3" as the blur evaluation value for the image identified by "IMG_301." The image ID column 1023 contains information "IMG_302." In a blur evaluation value column 1024 adjacent to the image ID column 1023, information "0" is arranged as the blur evaluation value of the image identified by "IMG_302". In an image ID column 1025, information "IMG_303" is arranged. In a blur evaluation value column 1026 adjacent to the image ID column 1025, information "2" is arranged as the blur evaluation value of the image identified by "IMG_303". Note that the two processes differ in that while the recognition process in the first embodiment was a process of determining the pattern of the subject image, the analysis process in this embodiment analyzes the blur of the image and classifies the analysis results in stages.

[0098] [Screen example] FIG. 11 shows an example of a display screen. FIG. 11(a) shows an example of a transmission rule setting screen. As shown in FIG. 11(a), buttons 711, 1101, 1103, 1105, and 1107 are displayed on the transmission rule setting screen. Button 711 is located at the bottom center of the transmission rule setting screen. As in the first embodiment, button 711 has a function of instructing completion of transmission rule setting. Button 1107 is located at the left center of the transmission rule setting screen. Button 1107 has a function of setting the transmission rule conditions to exclude conditions included in the blur evaluation value setting. Therefore, by operating button 1107, the user can prevent the blur evaluation value from being included in the transmission rule conditions. Button 1101 is located to the right of button 1107. Button 1101 has a function of setting the blur evaluation value to be included in the conditions included in the transmission rule setting to "1" or more. Therefore, by operating button 1101, the user can set the blur evaluation value to "1" or more. For button 1101, an image with image ID "IMG_201" is used as representative image 1102. Button 1103 is located immediately to the right of button 1101. Button 1103 has a function of setting the blur evaluation value included in the conditions of the transmission rule to "2" or higher. Therefore, the user can set the blur evaluation value to "2" or higher by operating button 1103. For button 1103, an image with image ID "IMG_202" is used as representative image 1104. Button 1105 is located in the center right of the transmission rule setting screen. Button 1105 has a function of setting the blur evaluation value included in the conditions of the transmission rule setting to "3" or higher. Therefore, the user can set the blur evaluation value to "3" or higher by operating button 1105. For button 1105, an image with image ID "IMG_204" is used as representative image 1106. Next, an example in which the button 1103 is operated by the user and a transmission rule is set will be described with reference to FIG. 11(b).

[0099] FIG. 11(b) shows an example of a transmission rule setting screen. FIG. 11(b) shows an example in which an icon 1111 is further arranged compared to FIG. 11(a). The icon 1111 is arranged within the frame of the button 1103. The icon 1111 indicates that a case in which the blur evaluation value is "2" is to be included as one of the conditions included in the setting of the transmission rule. In the state shown in FIG. 11(b), the setting of the transmission rule is completed by operating the button 711 shown in FIG. 11(b). This confirms that a case in which the blur evaluation value is "2" is to be included as a condition included in the setting of the transmission rule.

[0100] [Flow of display process for the sending rule setting screen] The following describes the process flow for the information processing device 101 to display a transmission rule setting screen, using the flowcharts shown in Figures 2(b), 9, and 12(a), the data examples in Figures 10(a) and 10(b), and the screen examples shown in Figures 7(a) and 11(a). Note that the process for displaying the transmission rule setting screen described below can also be implemented as a cloud service that does not specify resources.

[0101] Hereinafter, a use case will be assumed in which the storage unit 112 stores a total of five images corresponding to the image IDs indicated in columns 1001, 1003, 1005, 1007, and 1009 in FIG. 10A, and a transmission rule setting screen display process is performed. In the above use case, it will be assumed that the displayed images stored in the storage unit 112 are empty. The flowchart shown in FIG. 2B is executed when the CPU 151 functioning as the screen generating means 202 displays the transmission rule management screen shown in FIG. 7A. In S211, the CPU 151 functioning as the receiving means 204 detects pressing of the button 701 and receives the detection result as input information from the user. In S212, the CPU 151 functioning as the screen generating means 202 executes the process of the flowchart shown in FIG. 9 to generate a transmission rule setting screen.

[0102] (Details of S212; flowchart in Figure 9) In S901, the CPU 151 functioning as the associating means 209 acquires a total of five images indicated by columns 1001, 1003, 1005, 1007, and 1009 in FIG. 10(a) from the storage unit 112. In S902, the CPU 151 functioning as the recognizing means 206 analyzes the blur evaluation values ​​of the images acquired in S901. The analysis results are shown as blur evaluation values ​​arranged in columns 1002, 1004, 1006, 1008, and 1010 in FIG. 10(a), respectively.

[0103] (Blur evaluation value: "1") In S903, the CPU 151 functioning as the associating means 209 executes the processes shown in S904 to S908 for the number of blur evaluation values. First, the processes are executed for the case where the blur evaluation value is "1". In S904, the CPU 151 functioning as the associating means 209 acquires an image with an image ID of "IMG_201" from among the images identified by the image IDs in FIG. 10(a) as an image that matches the case where the blur evaluation value is "1". In S905, since the image acquired in S904 is the single image with "IMG_201", the CPU 151 advances the process of S905 to the process of S907. In S907, the CPU 151 functioning as the associating means 209 associates the image with the image ID of "IMG_201" with the blur evaluation value of "1". In S908, the CPU 151 functioning as the associated image management means 207 stores in the storage unit 112 that the image with the image ID "IMG_201" is associated with a blur evaluation value of "1." In S909, because processing for all blur evaluation values ​​has not been completed, the CPU 151 returns the processing of S909 to the processing of S903.

[0104] (Blur rating: "2") In S903, the process is next executed for the case where the blur evaluation value is "2". In S904, the CPU 151 functioning as the associating means 209 acquires an image having an image ID of "IMG_202" from among the images in FIG. 10(a) as an image that matches the case where the blur evaluation value is "2". In S905, since the image acquired in S904 is only "IMG_202", the CPU 151 advances the process of S905 to S907. In S907, the CPU 151 functioning as the associating means 209 associates the image having the image ID of "IMG_202" with the blur evaluation value of "2". In S908, the CPU 151 functioning as the associated image managing means 207 stores in the storage unit 112 that the image having the image ID of "IMG_202" is associated with the blur evaluation value of "2". In S909, since the processing for all blur evaluation values ​​has not been completed, the CPU 151 returns the processing of S909 to the processing of S903.

[0105] (Shake rating: "3") In S903, the process is next executed for the case where the blur evaluation value is "3". In S904, the CPU 151 functioning as the associating means 209 acquires images with image IDs "IMG_203" and "IMG_204" from the images in FIG. 10(a) as images that match the case where the blur evaluation value is "3". In S905, since the images acquired in S904 are two, "IMG_203" and "IMG_204", the CPU 151 advances the process of S905 to S906. In S906, the CPU 151 functioning as the associating means 209 executes the process of the flowchart shown in FIG. 12(a) to select one image from the plurality of images.

[0106] (Details of S906; flowchart in Figure 12(a)) In S503, the CPU 151 functioning as the associating means 209 extracts images whose image IDs are stored as displayed images. As assumed in the above use case, the displayed images are empty, so the image IDs "IMG_203" and "IMG_204" are not displayed images. Therefore, the CPU 151 functioning as the associating means 209 extracts all images, i.e., image IDs "IMG_203" and "IMG_204." In S504, as a result of the processing in S503, the images have been narrowed down to two, "IMG_203" and "IMG_204," but not to one. Therefore, the CPU 151 advances the processing in S504 to processing in S505. In S505, the CPU 151 functioning as the associating means 209 extracts images whose image IDs are stored as action-executed images shown in FIG. 10(b). The image ID "IMG_203" does not match the image ID shown in field 1011. The image ID "IMG_204" matches the image ID shown in field 1011. Therefore, CPU 151 functioning as the associating means 209 extracts the image having the image ID "IMG_204". In S506, as a result of the processing of S505, the images have been narrowed down to one image, "IMG_204", so CPU 151 advances the processing of S506 to processing of S508. In S508, CPU 151 functioning as the associating means 209 selects the image having the image ID "IMG_204" as the image to be displayed on the transmission rule setting screen, and advances the processing of S508 to processing of S907. In S907, CPU 151 functioning as the associating means 209 associates the image having the image ID "IMG_204" with a blur evaluation value of "1". In S908, the CPU 151 functioning as the associated image management means 207 stores in the storage unit 112 that the image with the image ID "IMG_204" is associated with a blur evaluation value of "3." In S909, since processing for all blur evaluation values ​​has been completed, the CPU 151 advances the processing of S909 to processing of S910. In S910, the CPU 151 functioning as the screen generation means 202 generates the transmission rule setting screen shown in FIG. 11(a), and advances the processing of S910 to processing of S213.In S213, the CPU 151 functioning as the screen generating means 202 presents the transmission rule setting screen to the user, and ends this processing, which is the processing for displaying the transmission rule setting screen.

[0107] Through the processing up to this point, in S907, the CPU 151 functioning as the associating means 209 associates the image having the image ID "IMG_201" with the blur evaluation value "1." Therefore, the CPU 151 functioning as the screen generating means 202 uses the image having the image ID "IMG_201" as the representative image 1102 of the button 1101 that specifies, as a condition of the transmission rule, a blur evaluation value of "1" or greater. Also, in S907, the CPU 151 functioning as the associating means 209 associates the image having the image ID "IMG_202" with the blur evaluation value "2." Therefore, the screen generating means 202 uses the image having the image ID "IMG_202" as the representative image 1104 of the button 1103 that specifies, as a condition of the transmission rule, a blur evaluation value of "2" or greater. Also, in S907, the CPU 151 functioning as the associating means 209 associates the image having the image ID "IMG_204" with the blur evaluation value "3." Therefore, the CPU 151 functioning as the screen generating means 202 uses the image with the image ID "IMG_204" as the representative image 1106 of the button 1105 that specifies a blur evaluation value of "3" or more as a condition of the transmission rule.

[0108] [Flow of sending rule settings] The following describes the flow of processing by the information processing device 101 to set transmission rules, using examples of the setting screens shown in Figures 11(a) and 11(b). This processing is executed when the CPU 151, functioning as the screen generating means 202, displays the setting screen shown in Figure 11(a). Note that the processing for displaying the setting screen for transmission rules described below can also be implemented as a cloud service that does not specify resources.

[0109] When the CPU functioning as the receiving means 204 receives an input instruction to tap the button 1103 from the terminal 102, the CPU 151 functioning as the screen generating means 202 executes the following operation. That is, the CPU 151 functioning as the screen generating means 202 displays an icon 1111 as shown in Fig. 11(b). This indicates that the condition that the image blur value is "2" or more has been selected as the transmission rule.

[0110] [Flow of process to complete sending rule settings] The following describes the flow of processing by the information processing device 101 to complete the setting of a transmission rule, using the flowchart shown in Fig. 12(b) and the example screen shown in Fig. 11(b). This processing is executed when the CPU 151, functioning as the screen generating means 202, displays the screen shown in Fig. 11(b). Note that the processing to complete the setting of a transmission rule described below can also be implemented as a cloud service that does not specify resources.

[0111] In S221, the CPU 151 functioning as the receiving means 204 receives an input instruction to tap the button 711 from the terminal 102. In S1212, the CPU 151 functioning as the transmission rule setting means 205 determines that "2" has been selected as the blur evaluation value when the button 711 is operated. Therefore, the CPU 151 determines that a blur evaluation value has been selected, and advances the process from S1212 to S223. In S223, the CPU 151 functioning as the transmission rule setting means 205 stores in the storage unit 121 a transmission rule indicating that images with a blur evaluation value of "2" or greater are to be transmitted, and then ends this process. Note that in S221, when the CPU 151 functioning as the receiving means 204 receives an input instruction to tap the button 711 in the state of the screen shown in FIG. 11(a), i.e., when a blur evaluation value has not been selected, it performs the following operation. That is, in S1212, the CPU 151 functioning as the transmission rule setting means 205 ends this process because a subject category has not been selected.

[0112] [Image transmission process flow] The following describes the flow of processing in which the information processing device 101 transmits images, using the flowchart shown in FIG. 3(a) and the example data in FIG. 10(c). Here, the flow of execution of the transmission processing for the three images shown in FIG. 10(c) is described in order. Here, the transmission processing refers to the processing of transmitting a transmission candidate image if the information obtained from the transmission candidate image meets the conditions of the transmission rule. Therefore, if the information obtained from the transmission candidate image does not meet the conditions included in the transmission rule settings, the transmission candidate image will not be transmitted. Note that the processing of displaying the transmission rule setting screen described below can also be implemented as a cloud service that does not specify resources.

[0113] Hereinafter, a use case will be assumed in which the storage unit 112 stores a transmission rule that specifies that an image with a blur evaluation value of "2" or more is to be transmitted.

[0114] (Sending process of the image "IMG_301") First, the flow of transmission processing for an image whose image ID in the column 1021 is "IMG_301" will be described. In S301, the CPU 151 functioning as the recognition means 206 analyzes the blur evaluation value of an image newly stored in the storage unit 112. The analysis result is a blur evaluation value of "3" shown in the column 1022 of FIG. 6(d). In S302, the CPU 151 functioning as the transmission means 203 acquires a transmission rule that specifies transmitting images whose blur evaluation value is "2" or greater. In S303, the CPU 151 functioning as the transmission means 203 determines that the blur evaluation value of "3" analyzed in S301 satisfies the transmission rule acquired in S302. The CPU 151 advances the processing of S303 to processing of S304. In S304, the CPU 151 functioning as the transmission means 203 transmits the image whose image ID is "IMG_301" to the image management service 103, and ends this processing. In this way, if the analyzed blur evaluation value satisfies the transmission rule, the image containing the blur is transmitted. In other words, if the blur evaluation value characterizing the blur contained in the transmission candidate image matches the reference blur evaluation value, and the information obtained from the transmission candidate image satisfies the conditions included in the transmission rule settings, the transmission candidate image is transmitted.

[0115] (Sending process of the image "IMG_302") Next, the flow of transmission processing for an image whose image ID in the column 1023 is "IMG_302" will be described. In S301, the CPU 151 functioning as the recognition unit 206 analyzes the blur evaluation value of an image newly stored in the storage unit 112. The analysis result is a blur evaluation value of "0" shown in the column 1024 of FIG. 6(d). In S302, the CPU 151 functioning as the transmission unit 203 acquires a transmission rule that specifies transmitting images whose blur evaluation value is "2" or greater. In S303, the CPU 151 functioning as the transmission unit 203 determines that the blur evaluation value of "0" analyzed in S301 does not satisfy the transmission rule acquired in S302, and terminates this processing. In this way, if the analyzed blur evaluation value does not satisfy the transmission rule, the image containing the blur is not transmitted. In other words, if the blur evaluation value characterizing the blur included in the transmission candidate image does not match the reference blur evaluation value, and thus the information obtained from the transmission candidate image does not conform to the conditions included in the transmission rule, the transmission candidate image is not transmitted.

[0116] (Sending process of the image "IMG_303") Next, the flow of transmission processing for an image whose image ID in the column 1025 is "IMG_303" will be described. In S301, the CPU 151 functioning as the recognition means 206 analyzes the blur evaluation value of an image newly stored in the storage unit 112. The analysis result is a blur evaluation value of "2" shown in the column 1026 of FIG. 6(d). In S302, the CPU 151 functioning as the transmission means 203 acquires a transmission rule that specifies transmitting images whose blur evaluation value is "2" or greater. In S303, the CPU 151 functioning as the transmission means 203 determines that the blur evaluation value of "2" analyzed in S301 satisfies the transmission rule acquired in S302, and the CPU 151 advances the processing from S303 to S304. In S304, the CPU 151 functioning as the transmission means 203 transmits the image whose image ID is "IMG_303" to the image management service 103, and ends this processing. In this way, if the analyzed blur evaluation value satisfies the transmission rule, the image containing the blur is transmitted. In other words, if the blur evaluation value characterizing the blur contained in the transmission candidate image matches the reference blur evaluation value, and the information obtained from the transmission candidate image satisfies the conditions included in the transmission rule settings, the transmission candidate image is transmitted.

[0117] From the above description, the CPU 151 may accept, as a transmission rule setting, a transmission process setting for transmitting a transmission candidate image when a reference blur evaluation value characterizing the blur contained in the image matches a blur evaluation value characterizing the blur contained in the transmission candidate image. This operation enables transmission of a transmission candidate image containing blur characterized by a blur evaluation value that matches the reference blur evaluation value characterizing the image. This allows for more intuitive operation for setting the transmission process. Furthermore, the CPU 151 may display images for each index corresponding to the reference blur evaluation value. This operation allows for more intuitive operation for setting the transmission process, since the images displayed on the setting screen are associated with each reference blur evaluation value. In other words, based on the results of recognizing images owned by the user, the images are displayed on the transmission rule setting screen. User convenience can be improved by presenting image characteristics that match each blur evaluation value, which is a condition of the transmission rule, using images owned by the user. The blur evaluation values ​​recognized by the recognition unit 206 may be values ​​other than "0," "1," "2," and "3." More types of values ​​may also be used.

[0118] <<Modification 1 of the Second Embodiment>> In this first modification, CPU 151 functioning as recognition means 206 may calculate an exposure evaluation value that indicates the degree of appropriateness of the exposure of an image. The exposure evaluation value is one of "0," "1," "2," or "3," with a larger number indicating a more appropriate exposure. In addition, the processing, data, and screen examples in this first modification are obtained by replacing the blur evaluation values ​​included in the processing, data, and screen examples in the second embodiment with the exposure evaluation value.

[0119] From the above description, the CPU 151 may perform the following operation as a transmission rule setting when a reference exposure evaluation value characterizing the reference exposure of an image matches an exposure evaluation value characterizing the exposure of a transmission candidate image. That is, the CPU 151 may accept a setting of a transmission process for transmitting a transmission candidate image. This operation enables the transmission process of a transmission candidate image characterized by an exposure evaluation value that matches the reference exposure evaluation value characterizing the exposure of the image. This makes it possible to set the transmission process with a more intuitive operation. Furthermore, the CPU 151 may display an image for each index corresponding to the reference exposure evaluation value. This operation allows the images displayed on the setting screen to be associated with each reference exposure evaluation value, making it possible to set the transmission process with a more intuitive operation.

[0120] <<Modification 2 of the Second Embodiment>> In this second modification, CPU 151 functioning as storage means 201 may classify similar images into image groups. CPU 151 functioning as screen generation means 202 may obtain blur evaluation values ​​for images included in the same image group, and if the blur evaluation values ​​match multiple images, may preferentially select those images as representative images. Similar images are displayed as representative images for each blur evaluation value, making it possible to more clearly present the user with the differences in the degree of blur.

[0121] [Detailed method for generating the sending rule setting screen] FIG. 13 is a flowchart showing an example of the operation of the information processing device 101. FIG. 13 is a flowchart showing a detailed example of the process of generating a transmission rule setting screen as the detailed process of S212 in Modification 2. The process shown in FIG. 13 is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The process shown in FIG. 13 is executed when the process of S212 in FIG. 2(b) is called. That is, the process shown in FIG. 13 is realized by the CPU 151. Note that some or all of the functions of the steps in FIG. 13 may be realized by hardware such as an ASIC or an electronic circuit. The symbol "S" in the description of each process indicates the step in the flowchart. Furthermore, the process shown in FIG. 13 can also be realized as a cloud computing configuration in which one function is shared among multiple resources via the Internet 100 and processed collaboratively. Note that in this embodiment, a blur evaluation value is used as a condition included in the setting of the transmission rule. Therefore, the process shown in FIG. 13 is a process of selecting an image to be displayed on the transmission rule setting screen based on the blur evaluation value. When there are multiple image options based on the blur evaluation value, one image is selected from the multiple images by the process shown in FIG. 13, which will be described later.

[0122] In S1301, the CPU 151 functioning as the associating means 209 defines a blur evaluation value list. The blur evaluation value list includes all blur evaluation values ​​except "0," which in this modified example includes "1," "2," and "3." In S1302, the CPU 151 functioning as the associating means 209 executes processing for all image groups. In this modified example 2, the CPU 151 functioning as the storage means 201 groups images captured at similar times into a single image group based on the capture time information included in the images. In S1303, the CPU 151 functioning as the recognition means 206 analyzes the blur evaluation values ​​of the images belonging to the image group selected in S1302. In S1304, the associating means 209 determines whether the blur evaluation value obtained in S1303 matches multiple values ​​in the blur evaluation value list. If there is a match, the CPU 151 advances the processing of S1304 to processing of S1305. If they do not match, the CPU 151 advances the process from S1304 to S1307. In S1305, the CPU 151 functioning as the associating means 209 associates the images determined in S1304 to match multiple values ​​in the blur evaluation value list as representative images for the respective blur evaluation values. In S1306, the CPU 151 functioning as the associating means 209 removes the multiple values ​​in the blur evaluation value list determined in S1304 to match the blur evaluation values ​​of the images from the blur evaluation value list. In S1307, once the process for all image groups is complete, the CPU 151 advances the process from S1307 to S1308. In S1308, the CPU 151 functioning as the screen generating means 202 selects representative images for the blur evaluation values ​​included in the blur evaluation value list, generates a transmission rule setting screen, and ends this flowchart. In this step, the CPU 151 functioning as the screen generating means 202 executes the process shown in the flowchart of FIG. 9.

[0123] [Example data] Fig. 14 shows an example of a data structure and an example of a display screen. Fig. 14(a) shows the image group to which the image belongs and the blur evaluation value of the image analyzed by the recognition means 206 in S1303 when generating the transmission rule setting screen. Here, columns 1401, 1404, 1407, 1410, 1413, and 1416 contain information indicating image IDs. Columns 1402, 1405, 1408, 1411, 1414, and 1417 contain image groups to which the images indicated by the image IDs in columns 1401, 1404, 1407, 1410, 1413, and 1416 belong, respectively. Columns 1403, 1406, 1409, 1412, 1415, and 1418 contain blur evaluation values ​​obtained by the CPU 151 functioning as the recognition means 206 analyzing the images indicated by the image IDs in columns 1401, 1404, 1407, 1410, 1413, and 1416, respectively.

[0124] [Screen example] FIG. 14(b) is a transmission rule setting screen in this modified example. Representative image 1421 is an image that indicates a blur evaluation value of "1." In this example screen, an image with an image ID of "IMG_403" is used as representative image 1421. Representative image 1422 is an image that indicates a blur evaluation value of "2." In this example screen, an image with an image ID of "IMG_404" is used as representative image 1422. Representative image 1423 is an image that indicates a blur evaluation value of "3." In this example screen, an image with an image ID of "IMG_405" is used as representative image 1423.

[0125] [Flow of display process for the sending rule setting screen] The following describes the process flow in which the information processing device 101 displays a transmission rule setting screen, using the flowcharts shown in Figures 2(b), 12(a), and 13, the example data in Figure 14(a), and the example screen shown in Figure 14(b).

[0126] Hereinafter, a use case will be assumed in which the storage unit 121 stores a total of six images corresponding to the image IDs shown in columns 1401, 1404, 1407, 1410, 1413, and 1416 in FIG. 14(a).

[0127] The flowchart shown in Fig. 2(b) is executed when the CPU 151 functioning as the screen generating means 202 displays the screen shown in Fig. 7(a). Note that the processing described below can also be implemented as a cloud service that does not specify resources.

[0128] In S211, the CPU 151 functioning as the receiving means 204 detects the pressing of the button 701 and receives the detection result as input information from the user. In S212, the CPU 151 functioning as the screen generating means 202 executes the processing of the flowchart shown in Fig. 13 to generate a transmission rule setting screen.

[0129] (Details of S212; flowchart in Figure 13) In S1301, the CPU 151 functioning as the associating means 209 defines a shake evaluation value list having "1", "2", and "3" as initial values.

[0130] (Group "Gr1") In S1302, the CPU 151 functioning as the associating means 209 first executes processing on the image group "Gr1." As shown in columns 1402 and 1405, the images indicated by the image IDs "IMG_401" and "IMG_402" belong to the image group "Gr1." In S1303, the CPU 151 functioning as the recognizing means 206 analyzes the blur evaluation values ​​of the images indicated by the image IDs "IMG_401" and "IMG_402." As shown in columns 1403 and 1406, the analysis results in blur evaluation values ​​of "0" and "1." In S1304, the CPU 151 functioning as the associating means 209 determines that, of the blur evaluation values ​​"0" and "1" obtained in S1303, only "1" matches the values ​​"1," "2," and "3" in the blur evaluation value list. Therefore, the CPU 151 advances the process of S1304 to the process of S1307. In S1307, the CPU 151 functioning as the associating means 209 returns the process of S1307 to the process of S1302 because the process has not been completed for all image groups.

[0131] (Group "Gr2") In S1302, the CPU 151 functioning as the associating means 209 next executes processing on the image group "Gr2." As shown in columns 1408 and 1411, images with image IDs "IMG_403" and "IMG_404" belong to the image group "Gr2." In S1303, the CPU 151 functioning as the recognizing means 206 analyzes the blur evaluation values ​​of the images with image IDs "IMG_403" and "IMG_404." As shown in columns 1409 and 1412, the analysis results in blur evaluation values ​​of "1" and "2." In S1304, the CPU 151 functioning as the associating means 209 determines that the blur evaluation values ​​"1" and "2" obtained in S1303 match the values ​​"1," "2," and "3" in the blur evaluation value list. Therefore, the CPU 151 advances the processing of S1304 to processing of S1305. In S1305, the CPU 151 functioning as the associating means 209 associates the image with the image ID "IMG_403" as a representative image with a blur evaluation value of "1". In addition, the CPU 151 functioning as the associating means 209 associates the image with the image ID "IMG_404" as a representative image with a blur evaluation value of "2". In S1306, the CPU 151 functioning as the associating means 209 removes the blur evaluation values ​​"1" and "2" from the blur evaluation value list. In S1307, the CPU 151 functioning as the associating means 209 advances the processing of S1307 to processing of S1308 because processing for all image groups has been completed. In S1308, the CPU 151 functioning as the screen generating means 202 selects a representative image for a blur evaluation value of "3" and then generates a transmission rule setting screen. Regarding the selection of the representative image, in S904, the CPU 151 functioning as the screen generation means 202 acquires only "IMG_405" as an image having a blur evaluation value of "3", and therefore in S907 the association means 209 associates the blur evaluation value "3" with "IMG_405".

[0132] Through the processing up to this point, first, in S1305, the CPU 151 functioning as the associating means 209 associates the image having the image ID "IMG_403" with the blur evaluation value "1." Therefore, the CPU 151 functioning as the screen generating means 202 uses the image having the image ID "IMG_403" as the representative image 1421 of the button 1101, which specifies a blur evaluation value of "1" or greater as a condition of the transmission rule. Next, in S1305, the associating means 209 associates the image having the image ID "IMG_404" with the blur evaluation value "2." Therefore, the CPU 151 functioning as the screen generating means 202 uses the image having the image ID "IMG_404" as the representative image 1422 of the button 1103, which specifies a blur evaluation value of "2" or greater as a condition of the transmission rule.

[0133] Next, in S907, the associating means 209 associates the image with the image ID "IMG_405" with the blur evaluation value "3." Therefore, the screen generating means 202 uses the image with the image ID "IMG_405" as the representative image 1423 of the button 1105 that specifies a blur evaluation value of "3" or more as a condition of the transmission rule.

[0134] As described above, in this second modification, blur evaluation values ​​for images included in the same image group are obtained, and if the blur evaluation values ​​match multiple blur evaluation values, those images are preferentially selected as representative images. Similar images are displayed as representative images for each blur evaluation value, so that the user can be more clearly shown the differences in the degree of blur. Note that if multiple images matching the same blur evaluation value exist in an image group, the associating means 209 may select one of them. To select one image from multiple images, the associating means 209 may execute the process shown in the flowchart of FIG. 5. Furthermore, the image group may use other information included in the images, such as the name of the imaging device, and imaging parameters such as shutter speed and aperture value. Alternatively, image features may be used.

[0135] From the above explanation, when there are multiple candidate images to be transmitted, the CPU 151 may accept, as a transmission rule setting, a setting for transmission processing based on whether or not the blur evaluation value for each of the same image group having similar characteristics among the multiple candidate images to be transmitted matches the reference blur evaluation value.

[0136] (Other embodiments) Although various examples and embodiments of the present disclosure have been shown and described above, the spirit and scope of the present disclosure are not limited to the specific descriptions in this specification. The present disclosure is not limited to the above-described embodiments, and various modifications may be made. In addition, the present disclosure may be realized by appropriately combining parts of the above-described embodiments.

[0137] Furthermore, in this embodiment, "food," "animals," "vehicles," and "scenery" have been described as examples of object categories, but the present invention is not limited to these. For example, "food" may be more specific and refer to a general term for certain ingredients, such as pasta. Specifically, pasta includes long pasta and short pasta. Long pasta further includes linguine, fettuccine, etc., and short pasta further includes macaroni, penne, etc. Therefore, pasta may be set as a general term in the object category, and if the desired pasta is penne, an image of penne may be displayed as a set. In this case, an image of penne captured by the user in the past may be extracted as an image associated with the user. Specifically, by displaying images of penne captured by the user in the settings screen, it is possible to automatically send only images of penne from among the pasta to online storage. As a result, images of penne are accumulated in online storage.

[0138] Alternatively, for example, by displaying images of a marathon event as a subject category on the settings screen and configuring various settings, the user can automatically send images of the marathon event to an SNS. This allows users to share images of a specific event with others via the SNS. This means that images can supplement information without having to categorize the subject categories in detail.

[0139] Alternatively, when an image is automatically sent, additional information about the image may also be sent to the destination. For example, an image of an event such as a festival or marathon may be automatically sent to an SNS, and thoughts about participating in the event may be sent from a smartphone to the same SNS as additional information, and the image and the additional information may be associated on the SNS. This operation allows additional information about the event to be shared with others via the SNS.

[0140] In addition, in this embodiment, an example has been described in which the image with the oldest capture date and time is extracted by the process of S507 in Fig. 5, but the present invention is not limited to this. For example, if it is possible to count the frequency of use of an image, images can be extracted according to the frequency of use of the image. Specifically, if the image is used most frequently, it is likely to be used in the future, so the most frequently used image may be extracted.

[0141] At least a part of the processing shown in Figures 2(b), 2(c), 3(a), 3(b), 4, 5, 9, 12(a), 12(b), and 13 may be realized by one or more dedicated hardware components different from the calculation unit 113.

[0142] The information processing device 101 may also include an authentication system, and the communication unit 111 may add a user ID and password to the content of communication with the terminal 102. The content of communication with the terminal 102 may also be encrypted before being sent and received.

[0143] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. The program may also be provided by recording it on a computer-readable storage medium.

[0144] The disclosure of the present embodiment includes configurations typified by the following information processing system, information processing method, and program.

[0145] <Configuration 1> a receiving means for receiving settings of transmission rules set by a user via a setting screen for managing settings for transmitting images; a selection means for selecting an image paired with the transmission rule from images associated with the user; associating means for associating the image selected by the selecting means with the transmission rule; a display control means for displaying, on the setting screen, the image and the transmission rule selected by the selection means as related information associated by the associating means; An information processing system comprising:

[0146] <Configuration 2> the accepting means accepts, as the setting of the transmission rule, a setting of a transmission process for transmitting the transmission candidate image when a subject category characterizing a subject appearing in the image selected by the selecting means matches a candidate category characterizing a candidate subject appearing in the transmission candidate image; 2. The information processing system according to configuration 1, wherein the display control means displays the images selected by the selection means for each of the subject categories.

[0147] <Configuration 3> the accepting means accepts, as the setting of the transmission rule, a setting of a transmission process for transmitting the transmission candidate image when a reference blur evaluation value characterizing a blur included in the image selected by the selecting means matches a blur evaluation value characterizing a blur included in the transmission candidate image; 2. The information processing system according to configuration 1, wherein the display control means displays the image selected by the selection means for each index corresponding to the reference blur evaluation value.

[0148] <Configuration 4> The information processing system according to configuration 3, wherein when there are a plurality of the candidate images to be transmitted, the accepting means accepts, as the setting of the transmission rule, a setting of the transmission process based on whether or not a blur evaluation value for each of the same image group having similar characteristics among the plurality of candidate images to be transmitted matches the reference blur evaluation value.

[0149] <Configuration 5> the accepting means accepts, as the setting of the transmission rule, a setting of a transmission process for transmitting the transmission candidate image when a reference exposure evaluation value characterizing a reference exposure of the image selected by the selecting means matches an exposure evaluation value characterizing an exposure of the transmission candidate image; 2. The information processing system according to configuration 1, wherein the display control means displays the image selected by the selection means for each index corresponding to the reference exposure evaluation value.

[0150] <Configuration 6> The information processing system according to configuration 1, wherein the selection means acquires an image associated with the user from among images that have been displayed on the setting screen based on the transmission rule.

[0151] <Configuration 7> The information processing system described in configuration 2 is characterized in that, when there are multiple images associated with the user and that meet the conditions included in the transmission rule settings, the selection means selects an image with fewer subject categories.

[0152] <Configuration 8> The information processing system described in configuration 1 is characterized in that, when there are multiple images associated with the user and that meet the conditions included in the settings of the transmission rule, the selection means selects an image that has been associated with the transmission rule.

[0153] <Configuration 9> The information processing system described in configuration 1 is characterized in that, when there are multiple images associated with the user and that meet the conditions included in the settings of the transmission rule, the selection means selects an image on which a pre-set action has been performed.

[0154] <Configuration 10> 10. The information processing system according to configuration 9, wherein the selection means selects an image for which a print has been performed as an image for which the preset action has been performed.

[0155] <Configuration 11> 10. The information processing system according to claim 9, wherein the selection means selects an image that has been sent by email as an image on which the preset action has been performed.

[0156] <Configuration 12> The information processing system described in configuration 1 is characterized in that, when there are multiple images associated with the user and that meet the conditions included in the transmission rule settings, the selection means selects the image with the oldest capture date and time.

[0157] <Configuration 13> 2. The information processing system according to configuration 1, wherein the display control means causes the image and the transmission rule to be arranged on the same surface of the setting screen.

[0158] <Configuration 14> The setting screen is composed of a plurality of layers, 2. The information processing system according to configuration 1, wherein the display control means displays the transmission rule in a layer lower than the image among the plurality of layers.

[0159] <Configuration 15> 3. The information processing system according to configuration 2, further comprising an image capturing means for capturing an image and setting the captured image as the transmission candidate image.

[0160] <Configuration 16> a receiving step of receiving a setting of a transmission rule by a user via a setting screen for managing settings for transmitting images; a selection step of selecting an image paired with the transmission rule from images associated with the user; an associating step of associating the image selected in the selecting step with the transmission rule; a display step of displaying, on the setting screen, the image and the transmission rule selected by the selection means as related information associated by the association means; An information processing method comprising:

[0161] <Configuration 17> 17. A program for causing a computer to execute each step of the information processing method according to claim 16. [Explanation of symbols]

[0162] 101 Information processing equipment 102 terminals 103 Image Management Service 201 Memory means 202 Screen generation means 203 Transmission Method 204 Receiving means 205 Transmission rule setting means 206 Recognition means 207 Associated Image Management Means 208 Means of Implementation 209 Association Methods

Claims

1. a receiving means for receiving settings of transmission rules set by a user via a setting screen for managing settings for transmitting images; a selection means for selecting an image paired with the transmission rule from images associated with the user; associating means for associating the image selected by the selecting means with the transmission rule; a display control means for displaying, on the setting screen, the image and the transmission rule selected by the selection means as related information associated by the associating means; An information processing system comprising:

2. the accepting means accepts, as the setting of the transmission rule, a setting of a transmission process for transmitting the transmission candidate image when a subject category characterizing a subject appearing in the image selected by the selecting means matches a candidate category characterizing a candidate subject appearing in the transmission candidate image; 2. The information processing system according to claim 1, wherein the display control means displays the images selected by the selection means for each of the subject categories.

3. the accepting means accepts, as the setting of the transmission rule, a setting of a transmission process for transmitting the transmission candidate image when a reference blur evaluation value characterizing a blur included in the image selected by the selecting means matches a blur evaluation value characterizing a blur included in the transmission candidate image; 2. The information processing system according to claim 1, wherein the display control means displays the image selected by the selection means for each index corresponding to the reference blur evaluation value.

4. The information processing system according to claim 3, characterized in that, when there are a plurality of the candidate images to be transmitted, the receiving means receives as the setting of the transmission rule a setting of the transmission process based on whether or not the blur evaluation value for each of the same image group having similar characteristics among the plurality of candidate images to be transmitted matches the reference blur evaluation value.

5. the accepting means accepts, as the setting of the transmission rule, a setting of a transmission process for transmitting the transmission candidate image when a reference exposure evaluation value characterizing a reference exposure of the image selected by the selecting means matches an exposure evaluation value characterizing an exposure of the transmission candidate image; 2. The information processing system according to claim 1, wherein the display control means displays the image selected by the selection means for each index corresponding to the reference exposure evaluation value.

6. 2. The information processing system according to claim 1, wherein the selection means acquires an image associated with the user from among images that have been displayed on the setting screen based on the transmission rule.

7. The information processing system according to claim 2, characterized in that, when there are multiple images associated with the user and that meet the conditions included in the transmission rule settings, the selection means selects an image with fewer subject categories.

8. The information processing system according to claim 1, characterized in that, when there are multiple images associated with the user and that meet the conditions included in the settings of the transmission rule, the selection means selects an image that has been associated with the transmission rule.

9. The information processing system according to claim 1, characterized in that, when there are multiple images associated with the user and that meet the conditions included in the transmission rule settings, the selection means selects an image for which a pre-set action has been performed.

10. 10. The information processing system according to claim 9, wherein the selection unit selects an image that has been printed as an image on which the preset action has been performed.

11. 10. The information processing system according to claim 9, wherein the selection means selects an image that has been sent by email as an image on which the preset action has been performed.

12. The information processing system according to claim 1, characterized in that, when there are multiple images associated with the user and that meet the conditions included in the transmission rule settings, the selection means selects the image with the oldest capture date and time.

13. 2. The information processing system according to claim 1, wherein the display control means causes the image and the transmission rule to be arranged on the same surface of the setting screen.

14. The setting screen is composed of a plurality of layers, 2. The information processing system according to claim 1, wherein the display control means displays the transmission rule in a layer lower than the image among the plurality of layers.

15. 3. The information processing system according to claim 2, further comprising an image capturing unit that captures an image and sets the captured image as the transmission candidate image.

16. a receiving step of receiving a setting of a transmission rule by a user via a setting screen for managing settings for transmitting images; a selection step of selecting an image paired with the transmission rule from images associated with the user; an associating step of associating the image selected in the selecting step with the transmission rule; a display step of displaying, on the setting screen, the image and the transmission rule selected by the selection means as related information associated by the association means; An information processing method comprising:

17. A program for causing a computer to execute each step of the information processing method according to claim 16.

Images