Information processing device

Abstract

The objective is to improve user convenience in an information processing device that transmits images to an external web service by appropriately displaying multiple transmission conditions. [Solution] An information processing device that stores multiple images and transmits an image to be transmitted, comprising: recognition means for performing recognition processing on the multiple images; display control means for displaying a setting screen including multiple transmission conditions on a user terminal; selection means for selecting a transmission condition from the multiple transmission conditions based on a selection instruction from the user terminal; and transmission means for transmitting the image to be transmitted to an external web service using the selected transmission condition, wherein the display control means differs in the display format of the multiple transmission conditions based on the recognition result of the recognition means.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus that transmits an image to be transmitted to an external web service.

Background Art

[0002] Conventionally, there are cloud services that perform recognition processing on an image and, when the result matches a specific condition, transmit the image to an external web service. These cloud services provide a user with an input screen for setting an image transmission rule (specific condition). For example, the transmission rule is the category of the subject obtained as a result of the recognition processing, and includes items such as "person", "animal", and "food". When the user selects a subject category from these items, the cloud service transmits an image whose recognition result matches the selected subject category to an external web service.

[0003] Patent Document 1 discloses that, among the transmission rules set by a rule setting means, information regarding the image is sent to a corresponding external web service according to a transmission rule having a condition that matches the image.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, when there are many candidates for subject categories that can be selected by the user in the input screen, it may take time to find a desired subject category, which may reduce the convenience of the cloud service. Patent Document 1 discloses providing means for selecting a subject category, but does not disclose the above reduction in convenience.

[0006] This invention has been made in view of the above problems, and aims to improve user convenience in an information processing device that transmits images to be transmitted to an external web service by appropriately displaying multiple transmission conditions. [Means for solving the problem]

[0007] To solve the above problems, an information processing device for storing multiple images and transmitting an image to be transmitted comprises: recognition means for performing recognition processing on the multiple images; display control means for displaying a setting screen including multiple transmission conditions on a user terminal; selection means for selecting a transmission condition from the multiple transmission conditions based on a selection instruction from the user terminal; and transmission means for transmitting the image to be transmitted to an external web service using the selected transmission condition, wherein the display control means differs in the display format of the multiple transmission conditions based on the recognition result of the recognition means. [Effects of the Invention]

[0008] According to the present invention, in an information processing device that transmits an image to be transmitted to an external web service, user convenience can be improved by appropriately displaying multiple transmission conditions. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows an example of the hardware configuration of the information processing device in Example 1, and an example of the software configuration. [Figure 2] This is a flowchart illustrating an example of the operation of the information processing device in Example 1. [Figure 3] This is a flowchart illustrating an example of the operation of the information processing device in Example 1. [Figure 4] This is a flowchart illustrating an example of the operation of the information processing device in Example 1. [Figure 5] This is a flowchart illustrating an example of the operation of the information processing device in Example 1. [Figure 6] This is an example of a data structure in Example 1. [Figure 7] Examples of data structures in Example 1 and Example 2 are shown. [Figure 8] This is an example of the display screen in Example 1. [Figure 9] This is an example of the display screen in Example 1. [Figure 10] This is a flowchart illustrating an example of the operation of the information processing device in Example 2. [Figure 11] This is a flowchart illustrating an example of the operation of the information processing device in Example 2. [Figure 12] This is an example of the display screen in Example 2. [Figure 13] This is an example of the display screen in Example 1. [Modes for carrying out the invention]

[0010] (Example 1) [Hardware configuration] Figure 1(a) shows the configuration of the information processing device 101. The information processing device 101 has the function of storing images, the function of receiving input from terminal 102, the function of sending a screen to terminal 102, and the function of sending images to the image management service 103. The information processing device 101 is composed of various units (111 to 114) and is implemented, for example, as a server on the cloud. Terminal 102 is a user terminal with input / output devices such as a touch panel and is implemented as a different device from the information processing device 101, for example, as a smartphone or tablet. The image management service 103 is implemented as a different device from the information processing device 101, or as a server on the cloud, for example, as an external web service.

[0011] Figure 1(b) is a diagram showing the configuration of the computer system used in the information processing device 101 of this embodiment.

[0012] The communication unit 111 of the information processing apparatus 101 is a unit that connects to a network and transmits and receives information with the terminal 102 and the image management service 103. For example, it is realized by a network card or the like.

[0013] The storage unit 112 is a unit that stores images, transmission rules, programs executed by the arithmetic unit 113, and contents received from the terminal 102 via the communication unit 111. For example, it is realized by a RAM (Random Access Memory), a ROM (Read Only Memory), a HDD (Hard Disk Drive), or the like.

[0014] The arithmetic unit 113 is a unit that executes data transmission / reception and storage processing. For example, it is realized by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like. In this image processing service, it is assumed that the arithmetic unit 113 executes the programs stored in the storage unit 112. Also, it is assumed that the arithmetic unit 113 uses the storage unit 112 as a temporary storage area for data.

[0015] The bus 114 connects the communication unit 111, the storage unit 112, and the arithmetic unit 113.

[0016] Hereinafter, in this embodiment, the case where the image is a still image will be mainly described, but the image may be a moving image. That is, the information processing apparatus 101 can process both still images and moving images. In the following description, unless otherwise specified, the term "image" will be described as including both the concepts of moving images and still images.

[0017] [Software Configuration] FIG. 1(c) shows an example of the software configuration of the information processing apparatus 101. The storage means 121 stores images, transmission rules, and settings of the image management service 103 in the storage unit 112. Also, it acquires these information from the storage unit 112.

[0018] The display control means 122 generates a screen for listing transmission rules and a screen for adding transmission rules, and transmits them to the terminal 102 via the communication unit 111. The transmission means 123 transmits the image stored in the storage means 121 to the image management service 103 via the communication unit 111. The receiving means 124 receives user instructions for the screen from the terminal 102 via the communication unit 111.

[0019] The recognition means 125 performs image recognition on the images stored in the storage means 121. In this embodiment, the recognition means 125 recognizes the categories of subjects in the images. In this embodiment, there are eight types of subject categories 621: "outdoors," "people," "buildings," "vehicles," "railways," "food," "night views," and "sea." The recognition means 125 recognizes either zero or one subject category 621 for a single image. Zero subject categories 621 indicates that the subjects in the image do not belong to any of the eight subject categories 621.

[0020] [Adding sending rules] Figure 2(a) is a flowchart showing an example of the process of displaying the transmission rule addition screen executed by the information processing device 101. The process shown in Figure 2(a) is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The process shown in Figure 2(a) is executed when the receiving means 124 receives an instruction to add a transmission rule.

[0021] In S201, the display control means 122 generates a screen for adding transmission rules. The display control means 122 displays an instruction UI on the screen for selecting image type 602. Initially, image type 602 is not selected.

[0022] In S202, the display control means 122 places an instruction UI on the transmission rule addition screen that prompts the user to select a subject category 621. In the initial state, the subject category 621 is not selected.

[0023] In S203, the display control means 122 terminates this flowchart after sending the transmission rule addition screen to the terminal 102.

[0024] [Deleting sending rules] Figure 2(b) is a flowchart showing an example of the deletion process for transmission rules executed by the information processing device 101. The process shown in Figure 2(b) is realized when the arithmetic unit 113 of the information processing device 101 executes a program stored in the storage unit 112. The process shown in Figure 2(b) is executed when the receiving means 124 receives an instruction to delete a transmission rule.

[0025] In S211, the storage means 121 deletes the transmission rule ID 611, the transmission rule name 612, and the transmission condition 613 from the storage unit 112 based on the transmission rule ID 611 included in the deletion instruction received by the receiving means 124.

[0026] In S212, the display control means 122 hides the transmission rule name 612, which was deleted in S211, on the transmission rule list screen.

[0027] In S213, the display control means 122 terminates this flowchart after sending the transmission rule list screen to the terminal 102.

[0028] [Inputting the name of the sending rule] Figure 2(c) is a flowchart showing an example of the input process for the transmission rule name executed by the information processing device 101. The process shown in Figure 2(c) is realized when the arithmetic unit 113 of the information processing device 101 executes a program stored in the storage unit 112. The process shown in Figure 2(c) is executed when the receiving means 124 receives an instruction to input a transmission rule name.

[0029] In S221, the display control means 122 displays the transmission rule name 612 included in the received input instruction on the transmission rule addition screen.

[0030] In S222, the display control means 122 terminates this flowchart after sending the transmission rule addition screen to terminal 102.

[0031] [Subject category selection process] Figure 3(a) is a flowchart showing an example of the subject category 621 selection process performed by the information processing device 101. The process shown in Figure 3(a) is realized when the arithmetic unit 113 of the information processing device 101 executes a program stored in the storage unit 112. The process shown in Figure 3(a) is executed when the receiving means 124 receives a selection instruction or deselection instruction for the subject category 621.

[0032] In S301, the receiving means 124 determines whether or not it has received an instruction to select a subject category 621 from the terminal 102 via the transmission rule addition screen. If it has received the instruction, it proceeds to S302. If it has not received the instruction, it proceeds to S303.

[0033] In S302, the display control means 122 selects the subject category 621 that was instructed to be selected in S301 on the transmission rule addition screen.

[0034] In S303, the receiving means 124 determines whether or not it has received an instruction to deselect subject category 621 from terminal 102 via the transmission rule addition screen. If it has received the instruction, it proceeds to S304. If it has not received the instruction, this flowchart ends.

[0035] In S304, the display control means 122 deselects the subject category 621 that was instructed to be deselected in S303 on the transmission rule addition screen.

[0036] In S305, the display control means 122 terminates this flowchart after sending the transmission rule addition screen to the terminal 102.

[0037] [Image type selection process] Figure 3(b) is a flowchart showing an example of the image type 602 selection process executed by the information processing device 101. The process shown in Figure 3(b) is realized when the arithmetic unit 113 of the information processing device 101 executes a program stored in the storage unit 112. The process shown in Figure 3(b) is executed when the receiving means 124 receives a selection instruction or deselection instruction for image type 602.

[0038] In this embodiment, there are two types of image type 602: "JPG" and "RAW". These indicate the image data format.

[0039] In S311, the receiving means 124 determines whether or not it has received an instruction to select image type 602 from terminal 102 via the transmission rule addition screen. If it has received the instruction, it proceeds to S312. If it has not received the instruction, it proceeds to S313.

[0040] In S312, the display control means 122 selects the image type 602 that was instructed to be selected in S311 on the transmission rule addition screen. In S313, the receiving means 124 determines whether or not it has received an instruction to deselect image type 602 from terminal 102 via the transmission rule addition screen. If it has received the instruction, it proceeds to S314. If it has not received the instruction, this flowchart ends.

[0041] In S314, the display control means 122 deselects the image type 602 that was instructed to be deselected in S313 on the transmission rule addition screen. In S315, the display control means 122 updates the display of the subject category 621 on the transmission rule addition screen. In S316, the display control means 122 terminates this flowchart after sending the transmission rule addition screen to the terminal 102.

[0042] [Display processing for subject categories] Figure 4(a) is a flowchart showing a detailed example of the display processing of subject category 621 performed by the information processing device 101, indicated by S202 and S315. The processing shown in Figure 4(a) is realized by the arithmetic unit 113 of the information processing device 101 executing a program stored in the storage unit 112.

[0043] In S401, the display control means 122 determines the subject category 621 to be prioritized for display. In S402, the display control means 122 places the subject categories 621 that were designated for priority display in S401 into the priority display area 825 on the transmission rule addition screen. The order in which the subject categories 621 are placed in the priority display area 825 is determined by the number of images that match each subject category 621, from most to least.

[0044] In S403, the display control means 122 places the subject categories 621 that were excluded from priority display in S401 into the non-priority display area 826 on the transmission rule addition screen, and then terminates this flowchart. The order in which the subject categories 621 are placed in the non-priority display area 826 is determined by the number of images that match each subject category 621, from most to least.

[0045] [Process for determining the subject category to be prioritized] Figure 4(b) is a flowchart showing a detailed example of the process for determining the subject category 621 to be prioritized for display, as indicated by S401. The process shown in Figure 4(b) is realized when the arithmetic unit 113 of the information processing device 101 executes a program stored in the storage unit 112.

[0046] In S411, the display control means 122 determines whether image type 602 is selected on the transmission rule addition screen. If it is selected, proceed to S413. If it is not selected, proceed to S412. In S412, the storage means 121 retrieves the image stored in the storage unit 112.

[0047] In S413, the storage means 121 extracts and acquires an image from among the images stored in the storage unit 112 that matches the selected image type 602. In S414, the recognition means 125 analyzes the subject category 603 of the image acquired in S412 or S413.

[0048] In S415, the display control means 122 executes S416 to S419 for all subject categories 621. In S416, the display control means 122 obtains the number of images that match the subject category 621 based on the analysis results obtained in S414.

[0049] In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. If it is greater than or equal to the first threshold and less than or equal to the second threshold, the process proceeds to S419. Otherwise, the process proceeds to S418. In this embodiment, the first threshold is 5% of the number of images acquired in S412 or S413. The second threshold is 95% of the number of images acquired in S412 or S413.

[0050] In S418, the display control means 122 excludes subject category 621 from priority display. In S419, the display control means 122 prioritizes displaying the subject category 621. In S420, the display control means 122 terminates this flowchart when it has finished processing for all subject categories 621.

[0051] [Processing to complete adding sending rule] Figure 5(a) is a flowchart showing an example of the process by which the information processing device 101 completes adding a transmission rule. The process shown in Figure 5(a) is realized when the arithmetic unit 113 of the information processing device 101 executes a program stored in the storage unit 112. The process shown in Figure 5(a) is executed when the receiving means 124 receives an instruction that the addition of the transmission rule is complete.

[0052] In S501, the display control means 122 determines whether a selected subject category 621 or a selected image type 602 exists on the transmission rule addition screen. If it exists, the process proceeds to S502. If it does not exist, this flowchart is terminated.

[0053] In S502, the transmission rule setting means 126 generates transmission conditions 613 based on the selected subject category 621 and the selected image type 602. The transmission rule setting means 126 stores the transmission rule name 612 and the generated transmission conditions 613 in the storage unit 112 via the storage means 121. The transmission rule setting means 126 also generates a transmission rule ID 611 for each additional transmission rule to distinguish it and stores it in the storage unit 112.

[0054] In S503, the display control means 122 terminates this flowchart after sending the transmission rule list screen to the terminal 102.

[0055] [Image transmission process] Figure 5(b) is a flowchart illustrating an example of the process performed by the information processing device 101 to transmit an image stored in the storage unit 112 to the image management service 103. The process shown in Figure 5(b) is realized when the arithmetic unit 113 of the information processing device 101 executes a program stored in the storage unit 112. The process shown in Figure 5(b) is executed when the storage unit 112 stores a new image.

[0056] In S511, the transmission means 123 acquires the image to be transmitted from the storage unit 112 via the storage means 121. In S512, the recognition means 125 analyzes the subject category 603 of the image acquired in S511.

[0057] In S513, the transmission rule setting means 126 determines whether a transmission rule exists. If it exists, the process proceeds to S514. If it does not exist, this flowchart is terminated. In S514, the transmission means 123 acquires the transmission rule.

[0058] In S515, the transmission means 123 obtains the subject categories 621 included in the transmission conditions 613 of the transmission rule and determines whether any one of the subject categories 621 matches any one of the subject categories 603 of the image obtained in S512. If they match, the process proceeds to S516. If they do not match, this flowchart is terminated. If the transmission conditions 613 do not include any subject categories 621, it is determined that any subject category 621 is acceptable, and the process proceeds to S516 regardless of the subject categories 603 of the image obtained in S512.

[0059] In S516, the transmission means 123 retrieves the image types 602 included in the transmission conditions 613 of the transmission rule and determines whether any one of the image types 602 matches the image type 602 of the image obtained in S511. If they match, the process proceeds to S517. If they do not match, this flowchart is terminated. If the transmission conditions 613 do not include any image types 602, it is determined that the transmission rule allows any image type 602, and the process proceeds to S517 regardless of the image type 602 of the image obtained in S511.

[0060] In S517, the transmission means 123 transmits the image obtained in S511 to the image management service 103, and then this flowchart is terminated.

[0061] [Example Data] Figure 6(a) shows the image information stored in the storage unit 112. In this embodiment, the storage unit 112 is assumed to store 1000 images. Figure 6(a) shows a portion of them. Of the images stored in the storage unit 112, 800 are JPG images and 200 are RAW images.

[0062] 601 is an image ID used to identify the image. 602 is the image type of the image. 603 is the subject category of the image output by the recognition means 125 as a result of recognizing the image.

[0063] Figure 6(b) shows the transmission rule information stored in the storage means 121 in S502. 611 is the transmission rule ID, which is generated by the transmission rule setting means 126 to distinguish transmission rules. 612 is the name of the transmission rule. 613 is a transmission condition. Transmission condition 613 includes either or both of the image type 602 and the subject category 621. 614 shows an example of a stored transmission rule.

[0064] Figure 6(c) shows the results of the recognition means 125 analyzing the subject categories 603 of the 1000 images shown in Figure 6(a). 621 indicates the subject category 621 that the recognition means 125 analyzes in this embodiment. 622 indicates the number of images in Figure 6(a) that match subject category 621.

[0065] Figure 6(d) shows the results of the recognition means 125's analysis of the subject category 603 of 200 images out of the 1000 images shown in Figure 6(a), where the image type 602 is RAW. 631 indicates the number of images with image type 602 being RAW that match each subject category 621.

[0066] Figure 7(a) shows the image information newly stored by the storage unit 112, and in this embodiment, it is the image that is the target of the transmission process shown in Figure 5(b).

[0067] [Screen example] Figures 8(a) to (d) and 9(a) to (c) show examples of screens generated by the display control means 122 and transmitted to the terminal 102. Screens 801 and 811 show the list of transmission rules. Button 802 is the "Add Transmission Rule" button. This screen is a settings screen for configuring the conditions of the transmission rule. When this button is pressed, terminal 102 sends an instruction to the information processing device 101 to add a transmission rule.

[0068] 812 is a label that indicates the existence of the transmission rule indicated by 614. The label 812 displays the name of the transmission rule 612, "Railway Photos," which is the transmission rule indicated by 614. Button 813 is for deleting the transmission rule indicated by 614. When this button is pressed, terminal 102 sends a command to information processing device 101 to delete the transmission rule whose transmission rule ID 611 is "R_01".

[0069] Screens 821, 831, 901, 911, and 912 are screens for adding transmission rules. These screens display multiple image types (602) and subject categories (621). 822 is the input label for transmission rule name 612. When a string is entered in this label, terminal 102 sends an input instruction for transmission rule name 612 to information processing device 101. The input instruction includes information about the entered string.

[0070] 823 is the JPG image type checkbox, which selects image type 602 "JPG". 824 is the Image Type RAW checkbox, which selects Image Type 602 "RAW".

[0071] If 823 or 824 is pressed and selected, terminal 102 sends an instruction to information processing device 101 to select image type 602. If 823 or 824 is pressed and deselected, terminal 102 sends an instruction to information processing device 101 to deselect image type 602.

[0072] Area 825 is the priority display area for subject category 621. Priority display area 825 displays a list of subjects in subject category 621. Area 826 is a non-priority display area for subject category 621. The non-priority display area 826 displays a list of subjects in subject category 621.

[0073] The display control means 122 makes the display format of the subject categories 621 located in the priority display area 825 different from the display format of the subject categories 621 located in the non-priority display area 826. Specifically, the priority display area 825 is displayed above the non-priority display area 826. The display control means 122 initially hides the subject categories 621 located in the non-priority display area.

[0074] 827 is the "Show All" button, which displays subject category 621, located in the non-priority display area. Button 828 is a completion button that completes the addition of a transmission rule. When this button is pressed, terminal 102 sends a transmission rule addition completion instruction to information processing device 101. 841 is the subject category outdoor checkbox, which selects subject category 621 "Outdoor". 842 is the subject category checkbox for "People," which selects subject category 621 "People." 843 is the subject category "Buildings" checkbox, which selects subject category 621 "Buildings". 844 is the subject category vehicle checkbox, which selects subject category 621 "vehicles".

[0075] 845 is the subject category checkbox for "Railway," which selects subject category 621. 846 is a checkbox for the subject category "Food," which selects subject category 621 "Food." 847 is the subject category night view checkbox, which selects subject category 621 "night view". 848 is the subject category checkbox for "Sea," which selects subject category 621.

[0076] If any of buttons 841 to 848 is pressed and selected, terminal 102 sends an instruction to the information processing device 101 to select subject category 621. If any of buttons 841 to 848 is pressed and deselected, terminal 102 sends an instruction to the information processing device 101 to deselect subject category 621.

[0077] [Process flow for displaying the screen for adding sending rules] The following describes the process flow in which the information processing device 101 displays the transmission rule addition screen, using the flowcharts shown in Figures 2(a), 4(a), and 4(b), the data examples in Figures 6(a) and 6(c), and the screen examples in Figures 8(a) and 8(c). At the start of this process, the display control means 122 is assumed to be displaying the transmission rule list screen shown by 801. It is also assumed that the storage means 121 has 0 transmission rules stored.

[0078] First, the user presses the Add Sending Rule button 802 displayed on terminal 102. The receiving means 124 receives information from terminal 102 instructing it to add a sending rule.

[0079] In S201, the display control means 122 generates a screen for adding transmission rules. The display control means 122 places the instruction UI indicated by 822 to 828 on the screen for adding transmission rules. The checkboxes indicated by 823 and 824 are unselected. In S202, the display control means 122 places the subject category 621 on the transmission rule addition screen.

[0080] In S401, the display control means 122 determines the subject category 621 to be prioritized for display. In S411, the display control means 122 proceeds to S412 because image type 602 is not selected on the transmission rule addition screen. In S412, the storage means 121 acquires the image shown in Figure 6(a). In S414, the recognition means 125 analyzes the subject category 603 of the images shown in Figure 6(a). As a result of the analysis, the number of images matching each subject category 621 is as shown in Figure 6(c).

[0081] In S415, the display control means 122 performs processing on subject categories 621 "outdoors", "people", "buildings", "vehicles", "railways", "food", "night view", and "sea". First, processing is performed on subject category 621 "outdoors".

[0082] In S416, the display control means 122 obtains 991 images as the number of images that match subject category 621 "outdoor" from the analysis results of subject category 621 shown in Figure 6(c).

[0083] In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. The first threshold is 5% of the number of images obtained in S412, i.e., 50 images. The second threshold is 95% of the number of images obtained in S412, i.e., 950 images. The number of images obtained in S416 is 991, which exceeds the second threshold, so the process proceeds to S418.

[0084] In S418, the display control means 122 excludes subject category 621 "outdoor" from priority display. In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621.

[0085] In S415, the display control means 122 performs processing for the subject category 621 "person". In S416, the display control means 122 obtains 417 images as the number of images that match the subject category 621 "person" from the analysis results of the subject category 621 shown in Figure 6(c).

[0086] In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to the first threshold and less than or equal to the second threshold. The number of images obtained in S416 is 417, which is greater than or equal to the first threshold and less than or equal to the second threshold, so the process proceeds to S419.

[0087] In S419, the display control means 122 prioritizes displaying subject category 621 "person". In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621. In S415, the display control means 122 performs processing for the subject category 621 "building".

[0088] In S416, the display control means 122 obtains 289 images as the number of images that match the subject category 621 "building" from the analysis results of the subject category 621 shown in Figure 6(c). In S417, the display control means 122 determines whether the number of images obtained in S416 is above the first threshold and below the second threshold. The number of images obtained in S416 is 289, which is above the first threshold and below the second threshold, so the process proceeds to S419.

[0089] In S419, the display control means 122 prioritizes displaying subject category 621 "buildings". In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621.

[0090] In S415, the display control means 122 performs processing for the subject category 621 "vehicle".

[0091] In S416, the display control means 122 obtains 124 images as the number of images that match the subject category 621 "vehicles" from the analysis results of the subject category 621 shown in Figure 6(c).

[0092] In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to the first threshold and less than or equal to the second threshold. The number of images obtained in S416 is 124, which is greater than or equal to the first threshold and less than or equal to the second threshold, so the process proceeds to S419.

[0093] In S419, the display control means 122 prioritizes displaying subject category 621 "vehicles". In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621. In S415, the display control means 122 performs processing for the subject category 621 "railway".

[0094] In S416, the display control means 122 obtains 63 images as the number of images that match the subject category 621 "railway" from the analysis results of the subject category 621 shown in Figure 6(c).

[0095] In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to the first threshold and less than or equal to the second threshold. The number of images obtained in S416 is 63, which is greater than or equal to the first threshold and less than or equal to the second threshold, so the process proceeds to S419.

[0096] In S419, the display control means 122 prioritizes displaying subject category 621 "railway". In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621.

[0097] In S415, the display control means 122 performs processing for the subject category 621 "food". In S416, the display control means 122 obtains 34 images as the number of images that match the subject category 621 "food" from the analysis results of the subject category 621 shown in Figure 6(c).

[0098] In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. The number of images obtained in S416 is 34, which is less than the first threshold, so the process proceeds to S418.

[0099] In S418, the display control means 122 excludes subject category 621 "food" from priority display. In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621. In S415, the display control means 122 performs processing for the subject category 621 "night view".

[0100] In S416, the display control means 122 obtains 16 images as the number of images that match the subject category 621 "night view" from the analysis results of the subject category 621 shown in Figure 6(c). In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. The number of images obtained in S416 is 16, which is less than the first threshold, so the process proceeds to S418.

[0101] In S418, the display control means 122 excludes subject category 621 "night view" from priority display. In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621. In S415, the display control means 122 performs processing for the subject category 621 "sea".

[0102] In S416, the display control means 122 obtains 11 images as the number of images that match the subject category 621 "sea" from the analysis results of the subject category 621 shown in Figure 6(c). In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. The number of images obtained in S416 is 11, which is less than the first threshold, so the process proceeds to S418.

[0103] In S418, the display control means 122 excludes subject category 621 "sea" from priority display. In S420, the display control means 122 proceeds to S402 because it has completed processing for all subject categories 621.

[0104] In S402, the display control means 122 rearranges the subject categories 621 that were designated as priority display targets in S419 in descending order of the number of matching images, i.e., in the order of "people", "buildings", "vehicles", and "railways". The display control means 122 places checkboxes 842 to 845 corresponding to each subject category 621 in the priority display area 825.

[0105] In S403, the display control means 122 rearranges the subject categories 621 that were excluded from priority display in S418 in descending order of the number of matching images, i.e., in the order of "Outdoor," "Food," "Night View," and "Sea." The display control means 122 places checkboxes 841, 846 to 848 corresponding to each subject category 621 in the non-priority display area 826. The checkboxes placed in the non-priority display area 826 are initially hidden.

[0106] In S203, the display control means 122 terminates this process after sending the transmission rule addition screen to the terminal 102. 821 shows the transmitted transmission rule addition screen.

[0107] [Flowchart for deleting sending rules] The following describes the process by which the information processing device 101 deletes a transmission rule, using the flowchart shown in Figure 2(b), the data example in Figure 6(b), and the screen examples shown in Figures 8(a) and 8(b). At the start of this process, the display control means 122 generates the transmission rule list screen shown by 811 and sends it to the terminal 102. The storage means 121 is assumed to have stored the transmission rule shown in Figure 6(b).

[0108] First, the user presses the delete button 813 on terminal 102 for the transmission rule with transmission rule ID "R_01". The receiving means 124 receives information instructing the deletion of the transmission rule with transmission rule ID "R_01".

[0109] In S211, the storage means 121 deletes the transmission rule with transmission rule ID "R_01" from the storage unit 112. At this point, the storage unit 112 stores 0 transmission rules. In S212, the display control means 122 hides the transmission rule with transmission rule ID "R_01" on the transmission rule list screen. In S213, the display control means 122 terminates this flowchart after transmitting the screen to terminal 102. The screen transmitted to terminal 102 at this time is 801.

[0110] [Process flow for entering the sending rule name] The following diagram illustrates the process by which the information processing device 101 sets the transmission rule name received from terminal 102, using the flowchart shown in Figure 2(c) and the example screens shown in Figures 8(c) and 8(d). At the start of this process, the display control means 122 generates the transmission rule addition screen shown in 821 and sends it to terminal 102.

[0111] First, the user selects the transmission rule input label 822 displayed on terminal 102 and enters the string "railway photos". Terminal 102 then sends an instruction to the information processing device 101 to input the transmission rule name. Receiving means 124 receives the instruction to input the transmission rule name 612.

[0112] In S221, the display control means 122 displays the input transmission rule name 612 "Railway Photos" on the transmission rule addition screen.

[0113] In S222, the display control means 122 terminates this flowchart after sending the screen to the terminal 102. The screen sent to the terminal 102 at this time is 831.

[0114] [Flow of image type selection process] The following diagram illustrates the process by which the information processing device 101 selects image type 602, using the flowcharts shown in Figures 3(b), 4(a), and 4(b), the data examples in Figures 6(a) and 6(d), and the screen examples in Figures 8(d) and 9(a). At the start of this process, the display control means 122 generates the transmission rule addition screen shown by 831 and sends it to the terminal 102.

[0115] First, the user presses the RAW image type checkbox 824 displayed on terminal 102. Terminal 102 then sends a selection instruction for image type 602 to information processing device 101. In S311, the receiving means 124 determines that it has received an input instruction for image type 602 and proceeds to S312. In S312, the display control means 122 selects the image type RAW checkbox 824 on the transmission rule addition screen. In S315, the display control means 122 updates the display of the subject category 621 on the transmission rule addition screen.

[0116] In S401, the display control means 122 determines the subject category 621 to be prioritized for display. In S411, the display control means 122 proceeds to S413 because image type 602 is selected on the transmission rule addition screen. In S413, the storage means 121 acquires the images shown in Figure 6(a) whose image type 602 is "RAW". There are 200 images whose image type 602 is "RAW".

[0117] In S414, the recognition means 125 analyzes the subject category 603 of the images acquired in S413. As a result of the analysis, the number of images matching each subject category 621 is as shown in Figure 6(d). In S415, the display control means 122 performs processing for the subject category 621 "outdoor".

[0118] In S416, the display control means 122 obtains 196 images as the number of images that match subject category 621 "outdoor" from the analysis results of subject category 621 shown in Figure 6(c). In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. The first threshold is 5% of the number of images obtained in S412, i.e., 10 images. The second threshold is 95% of the number of images obtained in S412, i.e., 190 images. The number of images obtained in S416 is 196, which exceeds the second threshold, so the process proceeds to S418.

[0119] In S418, the display control means 122 excludes subject category 621 "outdoor" from priority display. In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621.

[0120] In S415, the display control means 122 performs processing for the subject category 621 "person". In S416, the display control means 122 obtains 26 images as the number of images that match the subject category 621 "person" from the analysis results of the subject category 621 shown in Figure 6(c).

[0121] In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to the first threshold and less than or equal to the second threshold. The number of images obtained in S416 is 26, which is greater than or equal to the first threshold and less than or equal to the second threshold, so the process proceeds to S419. In S419, the display control means 122 prioritizes displaying subject category 621 "person".

[0122] In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621. In S415, the display control means 122 performs processing for the subject category 621 "building".

[0123] In S416, the display control means 122 obtains 8 images as the number of images that match the subject category 621 "building" from the analysis results of the subject category 621 shown in Figure 6(c). In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. The number of images obtained in S416 is 8, which is less than or equal to the first threshold, so the process proceeds to S418.

[0124] In S418, the display control means 122 excludes subject category 621 "buildings" from priority display. In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621.

[0125] In S415, the display control means 122 performs processing for the subject category 621 "vehicle". In S416, the display control means 122 obtains 112 images as the number of images that match the subject category 621 "vehicles" from the analysis results of the subject category 621 shown in Figure 6(c).

[0126] In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to the first threshold and less than or equal to the second threshold. The number of images obtained in S416 is 112, which is greater than or equal to the first threshold and less than or equal to the second threshold, so the process proceeds to S419. In S419, the display control means 122 prioritizes displaying subject category 621 "vehicles".

[0127] In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621.

[0128] In S415, the display control means 122 performs processing for the subject category 621 "railway". In S416, the display control means 122 obtains 56 images as the number of images that match the subject category 621 "railway" from the analysis results of the subject category 621 shown in Figure 6(c).

[0129] In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to the first threshold and less than or equal to the second threshold. The number of images obtained in S416 is 56, which is greater than or equal to the first threshold and less than or equal to the second threshold, so the process proceeds to S419. In S419, the display control means 122 prioritizes displaying subject category 621 "railway".

[0130] In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621. In S415, the display control means 122 performs processing for the subject category 621 "food".

[0131] In S416, the display control means 122 obtains 2 images as the number of images that match the subject category 621 "food" from the analysis results of the subject category 621 shown in Figure 6(c). In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. The number of images obtained in S416 is 2, which is less than the first threshold, so the process proceeds to S418.

[0132] In S418, the display control means 122 excludes subject category 621 "food" from priority display. In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621. In S415, the display control means 122 performs processing for the subject category 621 "night view".

[0133] In S416, the display control means 122 obtains 1 image as the number of images that match the subject category 621 "night view" from the analysis results of the subject category 621 shown in Figure 6(c). In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. Since the number of images obtained in S416 is 1, which is less than the first threshold, the process proceeds to S418.

[0134] In S418, the display control means 122 excludes subject category 621 "night view" from priority display.

[0135] In S420, the display control means 122 proceeds to S415 because processing has not been completed for all subject categories 621.

[0136] In S415, the display control means 122 performs processing for the subject category 621 "sea".

[0137] In S416, the display control means 122 obtains 0 images as the number of images matching subject category 621 "sea" from the analysis results of subject category 621 shown in Figure 6(c).

[0138] In S417, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. The number of images obtained in S416 is 0, which is less than the first threshold, so the process proceeds to S418.

[0139] In S418, the display control means 122 excludes subject category 621 "sea" from priority display.

[0140] In S420, the display control means 122 proceeds to S402 because it has completed processing for all subject categories 621.

[0141] In S402, the display control means 122 rearranges the subject categories 621 that were designated as priority display targets in S419 in descending order of the number of matching images, i.e., in the order of "vehicles," "railways," and "people." The display control means 122 places checkboxes 844, 845, and 842 corresponding to each subject category 621 in the priority display area 825.

[0142] In S403, the display control means 122 rearranges the subject categories 621 that were excluded from priority display in S418 in descending order of the number of matching images, i.e., in the order of "Outdoor," "People," "Food," "Night View," and "Sea." The display control means 122 places checkboxes 841, 843, 846 to 848 corresponding to each subject category 621 in the non-priority display area 826. The checkboxes placed in the non-priority display area 826 are initially hidden.

[0143] In S316, the display control means 122 terminates this process after sending the transmission rule addition screen to the terminal 102. 901 shows the transmitted transmission rule addition screen.

[0144] [Process for selecting subject categories] The following diagram illustrates the process by which the information processing device 101 selects the subject category 621, using the flowchart shown in Figure 3(a) and the example screens shown in Figures 9(a) and 9(b). At the start of this process, the display control means 122 generates the transmission rule addition screen shown in 901 and sends it to the terminal 102.

[0145] First, the user presses the railway subject category checkbox 845 displayed on terminal 102. Terminal 102 then sends a selection instruction for subject category 621 to information processing device 101.

[0146] In S301, the receiving means 124 determines that it has received an instruction to select subject category 621, and proceeds to S302. In S302, the display control means 122 selects the subject category railway checkbox 845. In S315, the display control means 122 terminates this process after sending the transmission rule addition screen to the terminal 102. 911 shows the transmitted transmission rule addition screen.

[0147] [Process flow for displaying subject categories in non-priority display areas] The following diagram illustrates the process flow by which the information processing device 101 displays the subject category 621 in the non-priority display area 826, using the screen examples shown in Figures 9(b) and 9(c).

[0148] First, when the user presses the "Show All" button 827 on the "Add Transmission Rule" screen shown by 911, terminal 102 sends an instruction to information processing device 101 to display subject category 621 located in non-priority display area 826.

[0149] The display control means 122 displays checkboxes 841, 843, 846, 847, and 848, which are for the subject category 621 located in the non-priority display area 826, and terminates this process when it sends the transmission rule addition screen to the terminal 102. 921 shows the transmitted transmission rule addition screen.

[0150] [Process flow for completing the addition of sending rules] The following diagram illustrates the process by which the information processing device 101 completes the addition of a transmission rule, using the flowchart shown in Figure 5(a), the data example shown in Figure 6(b), and the screen example shown in Figure 9(c). At the start of this process, the display control means 122 generates the transmission rule addition screen shown in 921 and sends it to the terminal 102.

[0151] First, when the user presses the complete button 828 displayed on terminal 102, terminal 102 sends a notification to the information processing device 101 indicating that the addition of the transmission rule is complete.

[0152] In S501, the display control means 122 proceeds to S502 because "railway" exists as the selected subject category 621 and "RAW" exists as the selected image type 602.

[0153] In S502, the transmission rule setting means 126 generates transmission conditions 613 based on the selected subject category 621 "railway" and the selected image type 602 "RAW".

[0154] The transmission rule setting means 126 stores the transmission rule name 612 "Railway Photographs" and the transmission conditions 613 in the storage unit 112 via the storage means 121. The transmission rule setting means 126 also generates "R_01" as the transmission rule ID 611 and stores it in the storage unit 112. 614 indicates the information stored in the storage unit 112 at this time.

[0155] In S503, the display control means 122 terminates the display of the transmission rule addition screen indicated by 921 and sends the transmission rule list screen indicated by 811 to the terminal 102, thereby ending this process. 812 indicates the transmission rule added by this process.

[0156] [Process flow for sending images that meet the sending rules] The following diagram illustrates the process flow in which the information processing device 101 transmits an image that satisfies the transmission rules, using the flowchart shown in Figure 5(b) and the data examples shown in Figures 6(b) and 7(a). The following diagram shows the process flow for transmitting an image that satisfies the transmission rules shown in 614 from among three images whose image ID 601 is "IMG_AAA", "IMG_AAA", and "IMG_AAA".

[0157] First, we will show the processing flow for the image with image ID 601, which is "IMG_AAA". In S511, the transmission means 123 acquires an image whose image ID 601 is "IMG_AAA". The image type 602 of this image is "RAW". In S512, the recognition means 125 analyzes that the subject category 603 of the image whose image ID 601 is "IMG_AAA" is "railway".

[0158] In S513, the transmission rule setting means 126 proceeds to S514 because a transmission rule indicated by 614 exists. In S514, the transmission means 123 acquires the transmission rule indicated by 614. In S515, the transmission means 123 proceeds to S516 because the subject category 621 included in the transmission rule indicated by 614 is "railway," and this matches the subject category 603 "railway" of the image whose image ID 601 is "IMG_AAA."

[0159] In S516, the transmission means 123 proceeds to S517 because the image type 602 included in the transmission rule indicated by 614 is "RAW," and this matches the image type 602 "RAW" of the image with image ID 601 "IMG_AAA."

[0160] In S517, the transmission means 123 terminates this process when it sends the image with image ID 601 "IMG_AAA" to the image management service 103.

[0161] Next, we will show the processing flow for the image with image ID 601, which is "IMG_BBB". In S511, the transmission means 123 acquires an image whose image ID 601 is "IMG_BBB". The image type 602 of this image is "RAW". In S512, the recognition means 125 analyzes that the subject category 603 of the image whose image ID 601 is "IMG_BBB" is "outdoor" and "person".

[0162] In S513, the transmission rule setting means 126 proceeds to S514 because a transmission rule indicated by 614 exists. In S514, the transmission means 123 acquires the transmission rule indicated by 614.

[0163] The subject category 621 included in the transmission rule indicated by 614 is "railway," and does not match either subject category 603 "outdoor" or "person" for the image whose image ID 601 is "IMG_BBB."

[0164] Therefore, this process is terminated at S515. As a result of this process, images with image ID 601 "IMG_BBB" do not satisfy the transmission rules and are therefore not sent to the image management service 103.

[0165] Finally, the processing flow for the image with image ID 601, "IMG_CCC", is shown. In S511, the transmission means 123 acquires an image whose image ID 601 is "IMG_CCC". The image type 602 of this image is "JPG".

[0166] In S512, the recognition means 125 analyzes that the subject category 603 of the image whose image ID 601 is "IMG_CCC" is "outdoor" and "railway". In S513, the transmission rule setting means 126 proceeds to S514 because a transmission rule indicated by 614 exists.

[0167] In S514, the transmission means 123 acquires the transmission rule indicated by 614. In S515, the transmission means 123 proceeds to S516 because the subject category 621 included in the transmission rule indicated by 614 is "railway," and the subject category 603 of the image with image ID 601 "IMG_CCC" is "railway."

[0168] In S516, the transmission means 123 terminates the process because the image type 602 included in the transmission rule indicated by 614 is "RAW," and does not match the image type 602 "JPG" of the image with image ID 601 "IMG_CCC." As a result of this process, the image with image ID 601 "IMG_CCC" does not satisfy the transmission rule and is therefore not transmitted to the image management service 103.

[0169] As described above, in this embodiment, subject categories 621 with a large number of matching images are displayed in the priority display area on the screen, thereby increasing the visibility of subject categories 621 that the user is likely to select. This improves user convenience.

[0170] The image transmission process may be performed at times other than when the storage means 121 newly stores an image. For example, if the information processing device 101 has an image capture means, the transmission process may be performed when the image capture means captures an image. Alternatively, for example, if the information processing device 101 has an image generation means, the transmission process may be performed when the image generation means generates an image.

[0171] The display control means 122 may also generate a screen to delete the image stored in the storage means 121.

[0172] In this embodiment, the transmission condition 613 of the transmission rule is the subject category 621, but other information may be used. For example, whether or not an image contains the face of a specific person may be used as the transmission condition 613. In this case, the storage means 121 stores the face information in the storage unit 112, associating the face features with the person's name. The recognition means 125 determines whether or not the corresponding face is in the image based on the face features. The display control means 122 displays the person's name on the screen and determines the face information to be used for the transmission condition 613 based on user input instructions. The transmission means 123 decides whether or not to transmit the image based on whether or not the face information obtained by the recognition means 125 when recognizing the image matches the face information indicated by the transmission condition.

[0173] Alternatively, the transmission condition 613 may use the shooting information embedded in the image. For example, the time the image was taken, the shooting device used to take the image, and the location where the image was taken may be used.

[0174] Furthermore, the recognition results and shooting information described above may be combined as transmission condition 613. Furthermore, the subject category 621 recognized by the recognition means 125 does not have to be "outdoors," "people," "buildings," "vehicles," "railways," "food," "night views," or "sea."

[0175] The recognition means 125 may also cache the results of the recognition process in the storage means 121. When recognition of an image is requested again, instead of performing the recognition process and returning the result, it may return the result cached in the storage means 121.

[0176] The transmission means 123 decides in S513 not to transmit images if no transmission rules exist. Therefore, if no transmission rules exist, no images are transmitted. However, the transmission means 123 may transmit images when no transmission rules exist, i.e., execute S517. By executing S517, all images can be transmitted to the image management service 103 when no transmission rules exist. Whether or not to execute S517 when no transmission rules exist may be determined according to the system and user settings.

[0177] Furthermore, the Add Transmission Rule screen may display additional information in addition to the name of the subject category 621 as the label for the checkbox that selects the subject category 621. For example, the total number of images stored in the memory unit 112 and the number of images matching each subject category 621 may be displayed as part of the label. Figure 13(a) shows the Add Transmission Rule screen. The Add Transmission Rule screen indicated by 1301 displays the number of images matching subject category 621 "People" and "Buildings" and the total number of images as labels for the checkboxes indicated by 842 and 843, respectively. Also, when the checkbox for image type 602 is selected, the display of the number on the labels of the checkboxes indicated by 842 and 843 may be changed. For example, when image type 602 "RAW" is selected, the total number of images may be displayed as 200, which is the total number of images for which image type 602 is "RAW", rather than the total number of images, which is 1000.

[0178] In this embodiment, the screen for adding transmission rules displays a checkbox as an instruction UI for selecting subject category 621, but a different UI may be displayed.

[0179] Figure 13(b) shows an example of displaying a combo box as an instruction UI. The combo box presents candidate subject categories 621, and at the same time, it displays a priority display area 825 and a non-priority display area 826, and places the subject categories 621 in each.

[0180] Figure 13(c) shows an example of displaying a text box with a function to present candidates as an instruction UI. The text box presents candidates for subject category 621 that include the entered characters, and at that time displays a priority display area 825 and a non-priority display area 826, and places the subject category 621 in each.

[0181] (Example 2) This embodiment describes the process of determining how to display the subject category 621 on the transmission rule addition screen based on the number of images targeted by the user's actions.

[0182] In this embodiment, the action refers to sending the image selected by the user to the image management service 103. The user selects an image via the selected image transmission screen and transmits the selected image. The display control means 122 changes the display format of the subject category 621 displayed on the transmission rule addition screen based on the number of images selected and transmitted by the user.

[0183] [Hardware configuration] The hardware configuration in this embodiment is as shown in Figures 1(a) and 1(b).

[0184] [Software Configuration] The software configuration in this embodiment is shown in Figure 1(c).

[0185] [Adding sending rules] The process for displaying the screen for adding transmission rules in this embodiment is as shown in Figure 2(a).

[0186] [Image selection process] Figure 10(a) is a flowchart showing an example of image selection processing performed by the information processing device 101 in this embodiment. The processing shown in Figure 10(a) is realized when the arithmetic unit 113 of the information processing device 101 executes a program stored in the storage unit 112. The processing shown in Figure 10(a) is executed when the display control means 122 receives an image selection instruction or an image deselection instruction from the terminal 102.

[0187] In S1001, the receiving means 124 determines whether or not it has received an image selection instruction from the terminal 102 via the selected image transmission screen. If it has received the instruction, it proceeds to S1002. If it has not received the instruction, it proceeds to S1003.

[0188] In S1002, the display control means 122 selects the image that was instructed to be selected in S1001 on the image transmission screen. In S1003, the receiving means 124 determines whether or not it has received an image deselection instruction from the terminal 102 via the selected image transmission screen. If it has received the instruction, it proceeds to S1004. If it has not received the instruction, this flowchart ends.

[0189] In S1004, the display control means 122 deselects the image that was instructed to be deselected in S1003 on the selected image transmission screen. In step S1005, the display control means 122 terminates this flowchart when it sends the selected image transmission screen to the terminal 102.

[0190] [Processing to send selected images] Figure 10(b) is a flowchart showing an example of the process by which the information processing device 101 completes adding a transmission rule. The process shown in Figure 10(b) is realized when the arithmetic unit 113 of the information processing device 101 executes a program stored in the storage unit 112. The process shown in Figure 10(b) is executed when the receiving means 124 receives a transmission instruction for the selected image.

[0191] In S1011, the display control means 122 determines whether or not a selected image exists on the selected image transmission screen. If it exists, the process proceeds to S1012. If it does not exist, this flowchart is terminated.

[0192] In S1012, the transmission means 123 transmits the selected image to the image management service 103.

[0193] In S1013, the storage means 121 sets the transmission status 711 of the image transmitted in S1012 to "True" and stores it in the storage unit 112.

[0194] In S1014, the display control means 122 terminates this flowchart after sending the menu screen to the terminal 102.

[0195] [Display processing for subject categories] Figure 11 is a flowchart showing a detailed example of the display processing of subject category 621 performed by the information processing device 101, indicated by S202 and S315 in this embodiment. The processing shown in Figure 11 is realized by the arithmetic unit 113 of the information processing device 101 executing a program stored in the storage unit 112.

[0196] The processes shown in S401 to S403 are as shown in Example 1. In S1101, the display control means 122 acquires the image that is the target of the action. In this embodiment, the action is the transmission of a selected image, and the image that is the target of the action is the image for which the value of the transmission status 711 is "True".

[0197] In S1102, the recognition means 125 analyzes the subject category 603 of the image acquired in S1101.

[0198] In S1103, the display control means 122 executes S1104 to S1107 for the subject category 621 that was excluded from priority display in S418.

[0199] In S1104, the display control means 122 obtains the number of images that match the subject category 621 based on the analysis results obtained in S1102.

[0200] In S1105, the display control means 122 determines whether the number of images obtained in S1104 is greater than or equal to a first threshold and less than or equal to a second threshold. If it is greater than or equal to the first threshold and less than or equal to the second threshold, the process proceeds to S1106. Otherwise, the process proceeds to S1107. In this embodiment, the first threshold is 5% of the number of images acquired in S1101. The second threshold is 95% of the number of images acquired in S1101.

[0201] In S1106, the display control means 122 removes the subject category 621 from the list of items excluded from priority display and makes it an item included in priority display.

[0202] In S1107, the display control means 122 finishes processing for the subject category 621 that has been excluded from priority display, and then proceeds to S402. After executing S402 and S403, the display control means 122 terminates this flowchart.

[0203] [Image transmission process] The image transmission process in this embodiment is as shown in Figure 6.

[0204] [Example Data] Figure 7(b) shows the image information stored in the memory unit 112. In this embodiment, the memory unit 112 stores 1000 images. Figure 7(b) shows a portion of them.

[0205] 711 indicates whether or not the image was transmitted by the transmission means 123 in S1013. In this embodiment, of the images stored in the storage unit 112, 50 images have the transmission status 711 set to "True" and 950 images have it set to "False". When the storage unit 112 stores a new image, the initial value of the transmission status 711 for that image is set to "False".

[0206] The transmission rule information in this embodiment is shown in Figure 6(c).

[0207] Figure 6(c) shows the results of analyzing the subject categories 603 of all images stored in the memory unit 112 in this embodiment.

[0208] Figure 7(c) shows the results of the recognition means 125's analysis of the subject category 603 of 50 images out of the 1000 images shown in Figure 7(b) for which the transmission status 711 is "True".

[0209] [Screen example] Figures 12(a) to (d) show examples of screens generated by the display control means 122 and transmitted to the terminal 102 in this embodiment. Screens 1201 and 1211 are screens for selecting and sending images. Numbers 1202 to 1205 are part of the image stored in the memory unit 112. 1206 to 1209 are image checkboxes used to select the images indicated by 1202 to 1205, respectively. When 1206 to 1209 is pressed and selected, terminal 102 sends an instruction to the information processing device 101 to select the image. When 1206 to 1209 is pressed and deselected, terminal 102 sends an instruction to the information processing device 101 to deselect the image.

[0210] 1210 is the send button. When this button is pressed, terminal 102 sends a transmission instruction to information processing device 101 for the image selected by the image checkboxes indicated by 1206 to 1209.

[0211] 1221 is the screen for adding transmission rules in this embodiment. 1231 is the menu screen. 1232 is a button to display the transmission rule list screen. When this button is pressed, terminal 102 sends a command to the information processing device 101 to display the transmission rule list screen.

[0212] 1233 is a button to display the selected image transmission screen. When this button is pressed, terminal 102 sends an instruction to the information processing device 101 to display the selected image transmission screen.

[0213] [Process flow for displaying the screen for adding sending rules] The following describes the process flow in which the information processing device 101 displays the transmission rule addition screen, using the flowcharts shown in Figures 2(a) and 11, the data examples in Figures 6(c), 7(a), and 7(c), and the screen examples in Figures 8(a) and 12(c). At the start of this process, the display control means 122 is assumed to be displaying the transmission rule list screen shown by 801. It is also assumed that the storage means 121 has 0 transmission rules stored.

[0214] First, the user presses the Add Sending Rule button 802 displayed on terminal 102. The receiving means 124 receives information from terminal 102 instructing it to add a sending rule.

[0215] In S201, the display control means 122 generates a screen for adding transmission rules. The display control means 122 places the instruction UI indicated by 822 to 828 on the screen for adding transmission rules. The checkboxes indicated by 823 and 824 are unselected.

[0216] In S202, the display control means 122 places the subject category 621 on the transmission rule addition screen.

[0217] In S401, the display control means 122 determines the subject category 621 to be prioritized for display. The detailed processing flow in this step is the same as in Embodiment 1 and is therefore omitted. As a result of executing this step, the display control means 122 prioritizes the display of subject category 621 "People," "Buildings," "Vehicles," and "Railways" based on the analysis results of subject category 621 shown in Figure 6(c). In addition, it excludes the display of subject category 621 "Outdoors," "Food," "Nightscapes," and "Sea."

[0218] In S1101, the storage means 121 acquires 50 images from the images shown in Figure 7(a) for which the transmission status 711 is "True".

[0219] In S1102, the recognition means 125 analyzes the subject category 603 of the image acquired in S1101. As a result of the analysis, the number of images matching each subject category 621 is as shown in Figure 7(c).

[0220] In S1103, the display control means 122 performs processing on "Outdoor" among the subject categories 621 "Outdoor," "Food," "Night View," and "Sea," which are not subject to priority display.

[0221] In S1104, the display control means 122 obtains 49 images as the number of images that match subject category 621 "outdoor" from the analysis results of subject category 621 shown in Figure 7(c).

[0222] In S1105, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. The first threshold is 5% of the number of images obtained in S412, i.e., 2.5 images. The second threshold is 95% of the number of images obtained in S412, i.e., 47.5 images. The number of images obtained in S416 is 49, which exceeds the second threshold, so the process proceeds to S1107.

[0223] In S1107, the display control means 122 proceeds to S1103 because processing has not been completed for all subject categories 621.

[0224] In S1103, the display control means 122 performs processing for the subject category 621 "food".

[0225] In S1104, the display control means 122 obtains 16 images as the number of images that match the subject category 621 "food" from the analysis results of the subject category 621 shown in Figure 7(c).

[0226] In S1105, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to the first threshold and less than or equal to the second threshold. The number of images obtained in S416 is 16, which is greater than or equal to the first threshold and less than or equal to the second threshold, so the process proceeds to S1106.

[0227] In S1106, the display control means 122 removes the subject category 621 "food" from the list of items excluded from priority display and makes it an item included in priority display.

[0228] In S1107, the display control means 122 proceeds to S1103 because processing has not been completed for all subject categories 621.

[0229] In S1103, the display control means 122 performs processing for the subject category 621 "night view".

[0230] In S1104, the display control means 122 obtains 1 image as the number of images that match subject category 621 "night view" from the analysis results of subject category 621 shown in Figure 7(c).

[0231] In S1105, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. Since the number of images obtained in S416 is 1, which is less than the first threshold, the process proceeds to S1107.

[0232] In S1107, the display control means 122 proceeds to S1103 because processing has not been completed for all subject categories 621.

[0233] In S1103, the display control means 122 performs processing for the subject category 621 "sea".

[0234] In S1104, the display control means 122 obtains 0 images as the number of images matching subject category 621 "sea" from the analysis results of subject category 621 shown in Figure 7(c).

[0235] In S1105, the display control means 122 determines whether the number of images obtained in S416 is greater than or equal to a first threshold and less than or equal to a second threshold. The number of images obtained in S416 is 0, which is less than the first threshold, so the process proceeds to S1107.

[0236] In S1107, the display control means 122 proceeds to S402 because processing has been completed for all subject categories 621.

[0237] In S402, the display control means 122 rearranges the subject categories 621 that were designated as priority display targets in S419 or 1106 in descending order of the number of matching images, i.e., in the order of "people", "buildings", "vehicles", "railways", and "food". The display control means 122 places checkboxes 842 to 846 corresponding to each subject category 621 in the priority display area 825.

[0238] In S403, the display control means 122 rearranges in descending order of the number of images that match the subject category 621 that was excluded from the priority display in S418, that is, in the order of "outdoor", "night view", and "sea". The display control means 122 arranges the check boxes 841, 847, and 848 corresponding to each subject category 621 in the non-priority display area 826. The check boxes arranged in the non-priority display area 826 are not displayed in the initial state.

[0239] In S316, when the display control means 122 transmits the transmission rule addition screen to the terminal 102, this process ends. 1221 shows the transmitted transmission rule addition screen.

[0240] As described above, in this embodiment, based on the subject category 603 of the image transmitted by the user to the image management service 103, the display method of the subject category 621 is determined. By preferentially displaying the subject category 621 that has a small proportion in the entire image but a large proportion in the images transmitted to the image management service 103, convenience can be improved.

[0241] (Other Embodiments) Above, examples of the processing of the information processing apparatus 101 have been described. However, the present invention is not limited to the above-described embodiments, and various modifications may be made. Also, some of the above-described embodiments may be appropriately combined.

[0242] Note that at least a part of the processing shown in FIGS. 2(a) to (c), FIGS. 3(a) to (b), FIGS. 4(a) to (b), FIGS. 5(a) to (b), FIGS. 10(a) to (b), and FIG. 11 may be realized by one or more dedicated hardware different from the arithmetic unit 113.

[0243] Note that the information processing apparatus 101 may include an authentication system, and the communication unit 111 may add the user ID and password to the communication content with the terminal 102. Also, the communication content with the terminal may be encrypted for transmission and reception.

[0244] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions. Furthermore, the program may be recorded on a recording medium readable by a computer and provided. [Explanation of symbols]

[0245] 101 Information Processing Device 102 terminals 103 Image Management Service 111 Communications Department 112 Storage section 113 Arithmetic section 121 Memory means 122 Display control means 123 Transmission method 124 Receiving means 125 Recognition means 126 Transmission Rule Setting Method

Claims

1. An information processing device that stores multiple images and transmits the image to be transmitted, Recognition means that performs recognition processing on the aforementioned plurality of images, A display control means that displays a settings screen containing multiple transmission conditions on the user terminal, A selection means for selecting a transmission condition from the plurality of transmission conditions based on a selection instruction from the user terminal, The system includes a transmission means for transmitting the image to be transmitted to an external web service using the selected transmission conditions, The display control means is characterized by causing the display format of the plurality of transmission conditions to differ based on the recognition result of the recognition means.

2. The information processing apparatus according to claim 1, characterized in that the display control means makes the display format of the plurality of transmission conditions different based on the number of images that match each of the plurality of transmission conditions.

3. The information processing apparatus according to claim 2, characterized in that the display control means changes the display format of the plurality of transmission conditions when the proportion of images that match the transmission conditions included in the plurality of transmission conditions is greater than or equal to a threshold.

4. The recognition means analyzes the subject category that indicates the subject included in the plurality of images, The aforementioned settings screen displays the multiple subject categories, The selection means selects a subject category from the plurality of subject categories, The transmission means transmits images matching the selected subject category to an external web service. The information processing apparatus according to claim 1, characterized in that the settings screen displays the multiple subject categories in different formats based on the number of images that match each of the multiple subject categories.

5. The aforementioned settings screen displays a list of the subject categories. The information processing apparatus according to claim 4, characterized in that if the proportion of images matching a subject category included in the plurality of subject categories is greater than or equal to a threshold, the subject category is displayed higher in the list.

6. The information processing apparatus according to claim 3, characterized in that the display control means makes the display format of the plurality of transmission conditions different when the ratio of the number of images that match the transmission conditions included in the plurality of transmission conditions is greater than or equal to a first threshold and less than or equal to a second threshold.

7. The aforementioned settings screen displays the aforementioned multiple transmission conditions and a second set of transmission conditions that are different from the aforementioned multiple transmission conditions. The selection means selects a second transmission condition from the plurality of second transmission conditions based on a selection instruction from the user terminal. The transmission means transmits the images included in the plurality of images to an external web service using the selected transmission conditions and the selected second transmission conditions. The display control means extracts an image from the plurality of images based on a second transmission condition, The information processing apparatus according to claim 1, characterized in that the display control means makes the display format of the plurality of transmission conditions different based on the recognition result of the extracted image.

8. An execution means for performing an action on the aforementioned image, The display control means extracts the image on which the Action was performed from among the plurality of images, The information processing apparatus according to claim 1, characterized in that the display control means makes the display format of the plurality of transmission conditions different based on the recognition result of the extracted image.

Images