Information processing apparatus, control method therefor, and program

Abstract

To improve user-friendliness by presenting an image output function to be executed by a user in a notification about image deletion.SOLUTION: An information processing apparatus that stores a plurality of images is configured to: store a storage time-limit of each of the plurality of images; delete an image with the storage time-limit having expired in the plurality of images; determine an output method for the image to be deleted; transmit a notification indicating that the image is to be deleted and the output method to a user; receive a selection based on a user operation on the output method; and determine an output method for the image to be deleted based on an output method for an image associated with the image to be deleted.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a method for storing images using an information processing device, and more particularly to a method for notifying a user that there is an image whose storage period is approaching. [Background technology]

[0002] Conventionally, a method of storing images captured by an imaging device using an information processing device has been widespread. When an imaging device having a function of capturing images is connected to a network, the imaging device transmits the images stored in the imaging device to an information processing device. The information processing device stores the received images and provides the user with an output function to the outside, such as printing the images or transmitting them to another user. Providing such a function can encourage the user to make use of the captured images. This leads to an increase in opportunities to capture images using the imaging device, and enhances the appeal of photography.

[0003] There are various image output functions that information processing devices have. One function is outputting onto paper media, such as printing photos using a printer or using a photo book creation service. Another function is sending to another information processing device, such as downloading, sending images by e-mail, using a file sharing service, and posting to a social networking service (SNS). Users use these functions differently depending on the content of the captured image.

[0004] On the other hand, there is an upper limit to the amount of images that can be stored in an information processing device, and this is determined by the capacity of a storage device in the information processing device, such as a hard disk. When the amount of images to be stored reaches the upper limit, images transmitted from the imaging device cannot be stored in the information processing device. The management device described in Patent Document 1 increases the amount of images that can be stored by setting a storage limit for images and automatically deleting images that have reached the storage limit. In addition, the management device notifies the user that there are images whose storage limit is approaching, preventing images that the user needs from being deleted without their knowledge. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2018-005921 A Summary of the Invention [Problem to be solved by the invention]

[0006] When a user receives a notification that an image will be deleted, the user must check the image to be deleted, decide how to output the image from the information processing device, and then execute that method. However, when an information processing device provides many image output functions, the user must select a method and make settings for each method, which is cumbersome for the user.

[0007] Therefore, one of the objects of the present invention is to improve user convenience by presenting an image output function that the user should execute in a notification informing the user of image deletion. [Means for solving the problem]

[0008] In order to achieve the above-mentioned object, an information processing device according to one embodiment of the present invention is an information processing device capable of storing a plurality of images, and comprises: a storage means for storing a storage period for the plurality of images; a deletion means for deleting images from the plurality of images whose storage period has expired; a determination means for determining an output method for the images deleted by the deletion means; a notification means for notifying a user that an image will be deleted by the deletion means and the output method determined by the determination means; and a reception means for accepting a selection based on a user operation for the output method after notification by the notification means, wherein the determination means determines the output method for the images deleted by the deletion means based on the output method for images associated with the images deleted by the deletion means. Effect of the Invention

[0009] By presenting the image output function that the user should execute in the notification of image deletion, it is possible to improve user convenience. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 illustrates an example of a hardware configuration of an information processing device. [Diagram 2] 11A and 11B are diagrams illustrating an example of a software configuration of an information processing device and an example of a flowchart of operations of the information processing device relating to image storage processing, deletion processing, and action execution processing. [Diagram 3] 10 is an example of a flowchart illustrating an operation of an information processing device related to notification transmission. [Figure 4] 11 is an example of a flowchart showing an operation of an information processing device related to grouping of images and determining an action to be notified. [Diagram 5] 11 is a flowchart showing an example of an operation of an information processing device related to determining a notification time, and an example of a screen related to an action execution process. [Figure 6] 11A and 11B are diagrams showing an example of a screen related to a notification process and an example of a data structure related to an image and tag information. [Figure 7] 11A and 11B are diagrams showing an example of a screen related to a notification process, an example of a set of an action and tag information, and an example of a data structure related to a storage period of an image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the present embodiment will be described in detail with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples, and the present invention is not limited to the configurations shown in the drawings.

[0012] Example 1 [Hardware configuration] 1(a) shows an example of the configuration of an information processing device 101. The information processing device 101 has a function of storing images and a function of deleting images. The information processing device 101 is composed of various units (111 to 115). The information processing device 101 is a device capable of storing multiple images, and is realized as, for example, a server on a cloud.

[0013] The communication unit 111 of the information processing device 101 is a unit that transmits and receives information to and from the imaging device 102. For example, it is realized by a network card or the like.

[0014] The storage unit 112 is a storage unit for storing a plurality of images and the contents of user operations received via the input unit 115. For example, the storage unit 112 is realized by a RAM (Random Access Memory), a ROM (Read Only Memory), a HDD (Hard Disk Drive), or the like.

[0015] The calculation unit 113 is a unit that executes data transmission / reception and storage processing. For example, it is realized by a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). In this embodiment, the calculation unit 113 executes a program stored in the storage unit 112.

[0016] The display unit 114 is a display unit that displays various information to a user who operates the information processing device 101. For example, it is realized by a display or the like.

[0017] The input unit 115 is a reception unit that receives various user operations by a user who operates the information processing device 101. For example, the input unit 115 is realized by a touch panel or the like.

[0018] In the following, in this embodiment, the case where the image is a still image will be mainly described, but the image may be a moving image. That is, the information processing device 101 can store a plurality of still images and a plurality of moving images, and can process both still images and moving images. In the following description, unless otherwise specified, the term "image" will be described as including the concept of both moving images and still images.

[0019] FIG. 1(b) shows an example of a configuration diagram of a computer system used in the information processing device 101 of this embodiment. The CPU 151 executes an OS (Operating System) and various application programs, and controls each part of the computer device. The ROM 152 stores fixed data among the programs executed by the CPU 151 and parameters for calculation. The RAM 153 provides a working area for the CPU 151 and a temporary storage area for data. The ROM 152 and the RAM 153 are connected to the CPU 151 via a bus 154. An input device 155 such as a keyboard, a display device 156 such as a CRT or a liquid crystal display, and an external storage device 157 such as a hard disk device, an MO (magneto-optical disk), or a CD-ROM are connected to the bus 154 via an interface 158. The bus 154 is also connected to a network.

[0020] [Software configuration] FIG. 2A shows an example of the software configuration of the information processing device 101.

[0021] In this embodiment, each software functional block is stored as a program in the storage unit 112, and the function is implemented by executing the program by the calculation unit 113. The calculation unit 113 executes the program to control each piece of hardware and to perform calculations and processing of information to realize each function. Note that some or all of the functional blocks may be implemented as hardware. In this case, some or all of the functional blocks are configured by, for example, an ACIC (Application Specific Integrated Circuit).

[0022] In this embodiment, the information processing device 101 includes a storage unit 201 , an execution unit 202 , a deletion unit 203 , an analysis unit 204 , and a notification unit 205 .

[0023] The storage means 201 stores an image and a storage period for the image in the storage unit 112. The storage means 201 stores tag information output by the analysis means 204 in the storage unit 112. The storage means 201 stores in the storage unit 112 a set of an action executed by the execution means 202 and tag information for the image that was the target of the action.

[0024] The execution means 202 executes an action on the image stored in the storage means 201. The user designates, via the input unit 115, the action to be executed by the execution means 202.

[0025] The deletion means 203 deletes, from among the images stored in the storage means 201, images whose storage period has expired.

[0026] The analysis means 204 analyzes the image stored in the storage means 201, and outputs tag information as feature information indicating the features of the image based on the analysis result. The storage means 201 stores the tag information output by the analysis means 204 in association with the analyzed image. The analysis means 204 has an analysis engine configured, for example, by a convolutional neural network, and analyzes the image using the analysis engine, and outputs tag information as feature information indicating the features of the image, such as "person" or "night view", based on the analysis result including the feature values ​​of the image.

[0027] The notification means 205 notifies the user in advance that an image will be deleted by the deletion means 203. The notification means 205 determines the timing of notification based on the image stored in the storage means 201, the storage period and tag information, and a set of an action and tag information. The notification means 205 notifies the user of the action to be performed on the image to be deleted, together with the deletion of the image.

[0028] [Image storage processing] Fig. 2(b) is a flowchart showing an example of an image storage process executed by the information processing device 101. The process shown in Fig. 2(b) is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The process shown in Fig. 2(b) is started when the imaging device 102 starts transmitting an image to the information processing device 101.

[0029] In S211, the storage unit 201 receives an image from the imaging device 102 via the communication unit 111.

[0030] In S212, the storage means 201 stores in the storage unit 112 the image received in S211.

[0031] In S213, the storage unit 201 stores the storage expiration date of the image received in S211 in the storage section 112. In this embodiment, the storage unit 201 stores 30 days from the time S213 is executed as the storage expiration date of the image.

[0032] In S214, the analysis means 204 analyzes the image stored in the storage means 201 in S212, and outputs tag information.

[0033] In S215, the storage means 201 stores the tag information output by the analysis means 204 in S214 in association with the image stored by the storage means 201 in S212, and then ends this flowchart.

[0034] [Image deletion process] Fig. 2(c) is a flowchart showing an example of an image deletion process executed by the information processing device 101. The process shown in Fig. 2(c) is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112. The process shown in Fig. 2(c) is executed periodically.

[0035] In S221, the deletion means 203 executes the processes from S302 to S306 on the image stored in the storage means 201.

[0036] In S222, the deletion means 203 acquires the storage period of the image from the storage means 201.

[0037] In S223, the deletion means 203 judges whether or not the storage time limit for the image has arrived. If the storage time limit has arrived, the process proceeds to S224. If the storage time limit has not arrived, the process proceeds to S225.

[0038] In S224, the deletion means 203 deletes the image.

[0039] In S225, if the process for all images has been completed, the deletion means 203 ends this flowchart. If the process for all images has not been completed, the process proceeds to S221, and the unprocessed images are processed.

[0040] [Action execution process] Fig. 2(d) is a flowchart showing an example of an action execution process executed by the information processing device 101. The process shown in Fig. 2(d) is realized by the calculation unit 113 of the information processing device 101 executing a program stored in the storage unit 112.

[0041] In S231, the execution means 202 receives a user operation from the user via the input unit 115, thereby receiving designation of an action and a target image for which the action is to be executed.

[0042] In S232, the execution means 202 executes the action accepted in S231 on the target image accepted in S231.

[0043] In S233, the storage unit 201 stores the action executed in S232 and the tag information associated with the target image received in S231 as a pair.

[0044] [Notification processing] FIG. 3 is a flowchart showing an example of a process in which the notification means 205 sends a notification to a user.

[0045] In S301, the notification means 205 acquires an image from the storage means 201.

[0046] In S302, the notification means 205 groups the images acquired in S301 based on their storage period. In this process, one or more image groups are generated. Each image group includes one or more images.

[0047] In S303, the notification means 205 selects one of the one or more image groups generated in S302, and executes the processes from S304 to S309.

[0048] In S304, the notification means 205 acquires from the storage means 201 the storage period of the images included in the image group and the tag information of the images.

[0049] In S305, the notification means 205 acquires a pair of an action and tag information from the storage means 201.

[0050] In S306, the notification means 205 determines a proposed action based on the tag information of the images included in the image group acquired in S303 and the combination of the action and tag information acquired in S304.

[0051] In S307, the notification means 205 determines the notification time for transmitting a notification to the user based on the action determined in S306.

[0052] In S308, the notification means 205 judges whether the current time has passed the notification time. If it has passed, the process proceeds to S309. If it has not passed, the process proceeds to S310.

[0053] In S309, the notification means 205 notifies the user that the storage period of the image is approaching and of the action determined in S306.

[0054] In S310, the notification means 205 executes the process for all the image groups generated in S302, and then ends this flowchart.

[0055] [Image grouping process] FIG. 4(a) is a flowchart showing the details of the process in S302 in which the notification means 205 generates one or more image groups.

[0056] In S401, the notification means 205 generates a list in which images are sorted in ascending order by storage period.

[0057] In S402, the notification means 205 executes the processes from S403 to S407 until the list generated in S401 becomes empty.

[0058] In S403, the notification means 205 extracts the top image from the list generated in S401.

[0059] In S404, the notification unit 205 acquires from the storage unit 201 the storage period for the image extracted in S403.

[0060] In S405, the notification means 205 extracts all images having a storage limit close to the storage limit obtained in S404 from the list generated in S401. In this embodiment, all images having a difference of 3 days or less from the storage limit obtained in S404 are extracted in this step from the list generated in S401.

[0061] In S406, the notification means 205 generates an image group including the image retrieved in S403 and all the images retrieved in S405.

[0062] In S407, the notification means 205 executes the processes from S403 to S407 until the list generated in S401 becomes empty, and then ends this flowchart. In the processes from S303 onwards, all image groups generated in S405 are processed.

[0063] [Decision process for the proposed action] FIG. 4B is a flowchart showing details of the process in S306 in which the notification means 205 determines the action to be proposed.

[0064] In S411, the notification means 205 acquires tag information and the number of pieces of tag information included in an image from all images included in the image group generated in S302.

[0065] In S412, the notification means 205 sorts the tag information acquired in S411 in descending order of the number of tags included in the image, and then executes S413 to S414 starting from the top tag information.

[0066] In S413, the notification means 205 judges whether the tag information selected in S412 is included in the tag information in the set of the action and tag information acquired in S305. If it is included, the process proceeds to S415. If it is not included, the process proceeds to S414.

[0067] In S414, when the notification means 205 has executed the process for all tag information, it determines that there is no action to be proposed, and ends this flowchart.

[0068] In S415, the notification means 205 acquires the action associated with the tag information selected in S412 from the pair of action and tag information acquired in S305.

[0069] In S416, the notification means 205 determines that the action to be suggested to the user is the one that is included in the pair of the action and tag information acquired in S305 and has the largest number of executions among the actions acquired in S415, and ends this flowchart.

[0070] [Notification time determination process] FIG. 5A is a flowchart showing details of the process in S307 in which the notification means 205 determines the notification time.

[0071] In S501, the notification means 205 obtains the earliest storage deadline among the storage deadlines of the images included in the image group selected in S303, and sets the notification time to five days before the date and time indicated by that storage deadline.

[0072] In S502, the notification means 205 determines whether the action determined to be proposed to the user in S306 is "printing." If it is "printing," the process proceeds to S503. If it is not "printing," the process proceeds to S504.

[0073] In S503, the notification means 205 advances the notification time by two days.

[0074] In S504, the notification means 205 determines whether the action determined to be proposed to the user in S306 is "photo book". If it is "photo book", the process proceeds to S505. If it is not "print", the process proceeds to S506.

[0075] In S505, the notification means 205 advances the notification time by five days.

[0076] In S506, the notification means 205 judges whether or not the number of images included in the image group selected in S303 is 50 or more. If the number is 50 or more, the process proceeds to S507. If the number is not 50 or more, the process ends this flowchart.

[0077] In S507, the notification means 205 advances the notification time by two days, and then ends this flowchart.

[0078] [Screen example] FIG. 5B shows an example of a screen for the execution means 202 to receive, via the input unit 115, the designation of an image for which an action is to be executed in S231 after the notification means 205 has notified the user.

[0079] Reference numerals 511 to 515 respectively denote images A to E stored in the storage means 201. These are images that can be selected as targets for an action.

[0080] An action button 516 is displayed. When the action button 516 is pressed, the execution means 202 displays an action selection screen.

[0081] Reference numeral 517 denotes a selection icon, which indicates an image selected by the user through a user operation.

[0082] FIG. 5C shows an example of an action selection screen for the execution means 202 to receive, via the input unit 115, a designation of an action to be executed in S231 after the notification means 205 notifies the user.

[0083] Reference numeral 521 denotes a download action. When the user selects and executes this action, the execution means 202 transmits the selected image via the communication unit 111 to a storage device owned by the user for downloading.

[0084] Reference numeral 522 denotes an SNS publishing action. When the user selects and executes this action, the execution means 202 uploads the selected image via the communication unit 111 to the SNS service in which the user is registered, and makes the image public.

[0085] Reference numeral 523 denotes a mail sending action. When the user selects and executes this action, the execution means 202 attaches the selected image to an e-mail via the communication unit 111 and sends the e-mail to a predetermined e-mail address registered by the user.

[0086] Reference numeral 524 denotes a print action. When the user selects and executes this action, the execution unit 202 transmits the selected image to a printing device via the communication unit 111 and causes the image to be printed.

[0087] Reference numeral 525 denotes a photo book creation action. When the user selects and executes this action, the execution means 202 creates a photo book using the selected images via the communication unit 111.

[0088] Reference numeral 526 denotes an execution button, and the execution means 202 executes the action selected by the user.

[0089] 6A and 6B show examples of screens on which the notification means 205 notifies the user in S309 that the storage period of the image is approaching and the action determined in S306.

[0090] FIG. 6(a) is a notification indicating that the storage period for image A511 and image B512 is approaching.

[0091] Reference numeral 601 denotes a print screen display button, and this screen proposes to the user to execute the print action 524 for the image A 511 and the image B 512. When the print screen display button 601 is pressed, the execution means 202 displays a print screen.

[0092] FIG. 6(b) is a notification indicating that the storage period for image B512, image C513, and image D514 is approaching.

[0093] Reference numeral 611 denotes a photobook creation screen display button, and this screen proposes to the user to execute a photobook creation action 525 for image B 512, image C 513, and image D 514. When the photobook creation screen display button 611 is pressed, the execution means 202 displays a photobook creation screen.

[0094] Reference numeral 612 denotes an all image display button, and when pressed by the user, the notification means 205 displays images D514 that are not currently being displayed on the screen.

[0095] FIG. 6C shows an example of a print screen that is displayed after the print screen display button 601 is pressed on the screen shown in FIG. 6A.

[0096] Reference numeral 621 denotes a print button, which executes a print action 524 for image A 511 and image B 512 .

[0097] FIG. 6(d) shows an example of a photo book creation screen that is displayed after the photo book creation screen display button 611 is pressed on the screen shown in FIG. 6(b).

[0098] Reference numeral 631 denotes a photo book creation button, which executes the photo book creation action 525 for the image B 512, the image C 513, and the image D 514.

[0099] [Example data] FIG. 6( e ) shows an example of the image and tag information stored in the storage unit 201 .

[0100] Reference numeral 641 indicates that the tag information "person" is stored in association with image A511.

[0101] Reference numeral 642 indicates that the tag information "person" and "night scene" are stored in association with image B512.

[0102] 643 indicates that the tag information "night view" and "nature" are stored in association with image C513.

[0103] 644 indicates that the tag information "night view" and "nature" are stored in association with image D514.

[0104] Numeral 645 indicates that the tag information "Building" is stored in association with image E515.

[0105] FIG. 7( a ) shows an example of a set of action and tag information stored in the storage unit 201 .

[0106] Reference numeral 701 indicates that there are 37 pairs of tag information “person” and print action 524 .

[0107] Reference numeral 702 indicates that there are five pairs of tag information “person” and download action 521 .

[0108] Numeral 703 indicates that there are three pairs of tag information “person” and mail sending action 523 .

[0109] Numeral 704 indicates that there are 54 pairs of tag information “nature” and photobook creation action 525 .

[0110] Numeral 705 indicates that there are 42 pairs of tag information “nature” and SNS public action 522 .

[0111] [Notification process flow 1] The flow of processing in which the information processing device 101 executes notification processing and displays the notification screen shown in FIG. 6(a) will be described below using the flowcharts shown in FIG. 3(a) and FIG. 4(a). Hereinafter, it is assumed that the storage means 201 stores the image and tag information shown in FIG. 6(e). It is assumed that the storage means 201 stores the set of action and tag information shown in FIG. 7(a). It is assumed that the storage means 201 stores the storage expiration date shown in FIG. 7(b). It is also assumed that the current time is "2022 / 4 / 25".

[0112] In S301, the notification means 205 acquires the images A511 to E515 from the storage means 201.

[0113] In S302, the notification means 205 groups images based on their storage period.

[0114] In S401, the notification means 205 generates a list in which images are sorted in ascending order based on the storage period. As a result, the elements of the generated list are, from the top, image A 511, image B 512, image C 513, image D 514, and image E 515.

[0115] In S403, the notification means 205 extracts the image A511 from the list.

[0116] In S404, the notification means 205 acquires the storage expiration date of the image A511 from the storage means 201. The acquired storage expiration date is "2022 / 5 / 1".

[0117] In S405, the notification means 205 extracts image B512 as an image whose storage period is "2022 / 5 / 1", which is within three days.

[0118] In S406, the notification means 205 generates an image group including the image A 511 and the image B 512. This image group is called image group P.

[0119] In S407, the notification means 205 returns to S402.

[0120] In S403, the notification means 205 extracts the image C513 from the list.

[0121] In S404, the notification means 205 acquires the storage expiration date of the image C513 from the storage means 201. The acquired storage expiration date is "2022 / 5 / 6".

[0122] In S405, the notification means 205 extracts image D514 and image E515 as images whose storage expiration date is "2022 / 5 / 6", which is within three days.

[0123] In S406, the notification means 205 generates an image group including the image C 513, the image D 514, and the image E 515. This image group is called image group Q.

[0124] In S303, the notification means 205 executes the following processes for the image group P.

[0125] In S304, the notification means 205 acquires from the storage means 201 the storage period and tag information of images A511 and B512 included in image group P. The storage period for image A511 is "2022 / 5 / 1", and the tag information is "people". The storage period for image B512 is "2022 / 5 / 3", and the tag information is "people" and "night view".

[0126] In S305, the notification means 205 acquires from the storage means 201 the set of action and tag information shown in FIG.

[0127] In S306, the notification means 205 determines the action to propose.

[0128] In S411, the notification unit 205 acquires the tag information and the number of images including the tag information. There are two images with the tag information "people" and one image with the tag information "night scene."

[0129] In S412, the notification means 205 executes S413 to S414 in the order of "People" and "Night Scene".

[0130] In S413, the notification means 205 determines that the tag information "person" is included in the combination of the action and the tag information in FIG. 7(a).

[0131] In S415, the notification unit 205 acquires the print action 524, the download action 521, and the email sending action 523 as actions associated with the tag information "person".

[0132] In S416, the notification unit 205 determines to propose to the user the print action 524, which has the highest number of actions (37) among those acquired in S415.

[0133] In S307, the notification means 205 determines the notification time.

[0134] In S501, the notification means 205 sets the notification time to "2022 / 4 / 26", which is five days before the storage expiration date of the image A511 whose storage expiration date will arrive earliest.

[0135] In S502, the notification means 205 determines that the proposed action is the print action 524, and proceeds to S503.

[0136] In S503, the notification means 205 advances the notification time by two days to "2022 / 4 / 24."

[0137] In S504, the notification means 205 determines that the proposed action is not the photo book creation action 525, and proceeds to S506.

[0138] In S506, the notification means 205 determines that the number of images is not 50 or more, and proceeds to S308.

[0139] In S308, since the current time "2022 / 4 / 25" exceeds the notification time "2022 / 4 / 24", the notification means 205 proceeds to S309.

[0140] In S309, the notification means 205 transmits the notification. An example of the screen of the transmitted notification is shown in FIG.

[0141] In S310, since the notification means 205 has not completed the processing for all image groups, the process proceeds to S303.

[0142] In S303, the notification means 205 executes the following process for the picture group Q.

[0143] In S304, the notification means 205 acquires the storage period and tag information of the image C 513, image D 514, and image E 515 included in the image group Q from the storage means 201.

[0144] In S305, the notification means 205 acquires from the storage means 201 the set of action and tag information shown in FIG.

[0145] In S306, the notification means 205 determines the action to propose.

[0146] In S411, the notification unit 205 acquires the tag information and the number of images including the tag information. There are two images with the tag information "nature", two with the tag information "night view", and one with the tag information "building".

[0147] In S412, the notification means 205 executes S413 to S414 in the order of "nature", "night view", and "building".

[0148] In S413, the notification unit 205 determines that the tag information "nature" is included in the combination of the action and tag information shown in FIG. 7(a).

[0149] In S415, the notification unit 205 acquires the photo book creation action 525 and the SNS publishing action 522 as actions associated with the tag information "nature".

[0150] In S416, the notification means 205 determines to propose to the user the photo book creation action 525, which has the highest number of actions (54) among those acquired in S415.

[0151] In S307, the notification means 205 determines the notification time.

[0152] In S501, the notification means 205 sets the notification time to "2022 / 5 / 1", which is five days before the storage expiration date of the image C513 whose storage expiration date will arrive earliest.

[0153] In S502, the notification unit 205 determines that the proposed action is not the print action 524, and proceeds to S504.

[0154] In S504, the notification means 205 determines that the proposed action is the photo book creation action 525, and proceeds to S505.

[0155] In S505, the notification means 205 advances the notification time by five days to "2022 / 4 / 26".

[0156] In S506, the notification means 205 determines that the number of images is not 50 or more, and proceeds to S308.

[0157] In S308, the notification means 205 proceeds to S310 because the current time "2022 / 4 / 25" does not exceed the notification time "2022 / 4 / 26".

[0158] In S310, the notification means 205 ends the process since the processing for all image groups has been completed.

[0159] [Notification process flow 2] Hereinafter, the flow of processing in which the information processing device 101 executes notification processing and displays the notification screen shown in FIG. 6(b) will be described using the flowcharts shown in FIG. 3 and FIG. 4(a). Hereinafter, it is assumed that the storage means 201 stores the image and tag information shown in FIG. 6(e). It is assumed that the storage means 201 stores the set of action and tag information shown in FIG. 7(a). It is assumed that the storage means 201 stores the storage expiration date shown in FIG. 7(c). It is also assumed that the current time is "2022 / 4 / 25".

[0160] In S301, the notification means 205 acquires the images A511 to E515 from the storage means 201.

[0161] In S302, the notification means 205 groups images based on their storage period.

[0162] In S401, the notification means 205 generates a list in which images are sorted in ascending order based on the storage period. As a result, the elements of the generated list are, from the top, image B 512, image C 513, image D 514, image E 515, and image A 511.

[0163] In S403, the notification means 205 extracts the image B 512 from the list.

[0164] In S404, the notification means 205 acquires the storage expiration date of the image B 512 from the storage means 201. The acquired storage expiration date is "2022 / 5 / 3".

[0165] In S405, the notification means 205 extracts image C513 and image D514 as images whose storage expiration date is "2022 / 5 / 3", which is within three days.

[0166] In S406, the notification means 205 generates an image group including image B 512, image C 513, and image D 514. This image group is called image group R.

[0167] In S407, the notification means 205 returns to S402.

[0168] In S403, the notification means 205 extracts the image E515 from the list.

[0169] In S404, the notification means 205 acquires the storage expiration date of the image E515 from the storage means 201. The acquired storage expiration date is "2022 / 5 / 8".

[0170] In S405, the notification means 205 extracts image A511 as an image whose storage expiration date is "2022 / 5 / 8", which is within three days.

[0171] In S406, the notification means 205 generates an image group including the image E 515 and the image A 511. This image group is called image group S.

[0172] In S303, the notification means 205 executes the following processes on the image group R.

[0173] In S304, the notification means 205 acquires from the storage means 201 the storage deadline and tag information of images B512, C513, and D514 included in image group R. The storage deadline for image B512 is "2022 / 5 / 3", and the tag information is "people" and "night scene". The storage deadline for image C513 is "2022 / 5 / 6", and the tag information is "night scene" and "nature". The storage deadline for image D514 is "2022 / 5 / 6", and the tag information is "night scene" and "nature".

[0174] In S305, the notification means 205 acquires from the storage means 201 the set of action and tag information shown in FIG.

[0175] In S306, the notification means 205 determines the action to propose.

[0176] In S411, the notification unit 205 acquires tag information and the number of images including the tag information. There are three images with the tag information "night view" and two images with the tag information "nature".

[0177] In S412, the notification means 205 executes S413 to S414 in the order of "night view" and "nature."

[0178] In S413, the notification means 205 determines that the tag information "night view" is not included in the combination of the action and tag information shown in FIG. 7(a).

[0179] In S414, since the notification means 205 has not yet completed the processing for all tag information, the process proceeds to S412.

[0180] In S413, the notification unit 205 determines that the tag information "nature" is included in the combination of the action and tag information shown in FIG. 7(a).

[0181] In S415, the notification unit 205 acquires the photo book creation action 525 and the SNS publishing action 522 as actions associated with the tag information "nature".

[0182] In S416, the notification means 205 determines to propose to the user the photo book creation action 525, which has the highest number of actions (54) among those acquired in S415.

[0183] In S307, the notification means 205 determines the notification time.

[0184] In S501, the notification means 205 sets the notification time to "2022 / 4 / 28", which is five days before the storage expiration date of the image B 512 whose storage expiration date will arrive earliest.

[0185] In S502, the notification unit 205 determines that the proposed action is not the print action 524, and proceeds to S504.

[0186] In S504, the notification means 205 determines that the proposed action is the photo book creation action 525, and proceeds to S505.

[0187] In S505, the notification means 205 advances the notification time by five days to "2022 / 4 / 23."

[0188] In S506, the notification means 205 determines that the number of images is not 50 or more, and proceeds to S308.

[0189] In S308, since the current time "2022 / 4 / 25" exceeds the notification time "2022 / 4 / 23", the notification means 205 proceeds to S309.

[0190] In S309, the notification means 205 transmits the notification. An example of the screen of the transmitted notification is shown in FIG.

[0191] In S310, since the notification means 205 has not completed the processing for all image groups, the process proceeds to S303.

[0192] In S303, the notification means 205 executes the following processes on the picture group S.

[0193] In S304, the notification means 205 acquires the storage period and tag information of the image E 515 and the image A 511 included in the image group S from the storage means 201.

[0194] In S305, the notification means 205 acquires from the storage means 201 the set of action and tag information shown in FIG.

[0195] In S306, the notification means 205 determines the action to propose.

[0196] In S411, the notification unit 205 acquires the tag information and the number of images including the tag information. There is one image with the tag information "person" and one image with the tag information "building".

[0197] In S412, the notification means 205 executes S413 to S414 in the order of "people" and "buildings".

[0198] In S413, the notification means 205 determines that the tag information "person" is included in the combination of the action and tag information shown in FIG. 7(a).

[0199] In S415, the notification unit 205 acquires the print action 524, the download action 521, and the email sending action 523 as actions associated with the tag information "person".

[0200] In S416, the notification unit 205 determines to propose to the user the print action 524, which has the highest number of actions (37) among those acquired in S415.

[0201] In S307, the notification means 205 determines the notification time.

[0202] In S501, the notification means 205 sets the notification time to "2022 / 5 / 3", which is five days before the storage expiration date of the image E515 whose storage expiration date will arrive earliest.

[0203] In S502, the notification means 205 determines that the proposed action is the print action 524, and proceeds to S503.

[0204] In S503, the notification means 205 advances the notification time by two days to "2022 / 5 / 1".

[0205] In S504, the notification means 205 determines that the proposed action is not the photo book creation action 525, and proceeds to S506.

[0206] In S506, the notification means 205 determines that the number of images is not 50 or more, and proceeds to S308.

[0207] In S308, since the current time "2022 / 4 / 25" does not exceed the notification time "2022 / 5 / 1", the notification means 205 proceeds to S310.

[0208] In S310, the notification means 205 ends the process since the processing for all image groups has been completed.

[0209] As described above, in this embodiment, when a user is notified that there are images whose storage period is about to expire, actions to be taken with respect to those images are suggested, and utilization of the images to be deleted can be encouraged.

[0210] The notification means 205 may notify the user of a plurality of actions to be presented to the user. In Fig. 7(d), the storage period of image A 511 and image B 512 is approaching, and a print screen display button 601 and a photo book creation screen display button 611 are displayed to present two actions to the user.

[0211] If tag information associated with an image whose storage limit is approaching is not included in the set of action and tag information, the notification means 205 may present the user with the execution of a default action. Fig. 7(e) shows that the storage limit of image E515 is approaching and displays an image display button 741. The image display action is a default action, and is presented because tag information associated with image E515 is not included in the set of action and tag information.

[0212] In this embodiment, the storage period and the current time are expressed in years, months, and days, but hours, minutes, seconds, and milliseconds may also be used in addition to these.

[0213] In addition, in S412, if there are multiple pieces of tag information associated with the most images, the notification unit 205 may execute the processes from S413 onwards in order starting from specific tag information. For example, if the analysis accuracy of tag information by the analysis unit 204 differs depending on each piece of tag information, the processes may be executed in order starting from tag information with the highest analysis accuracy.

[0214] In addition, in S416, if there are multiple actions with the largest number of images, the notification unit 205 may present a specific action to the user with priority. For example, printing or photo book creation may be presented to the user with priority over other actions.

[0215] The analysis means 204 may analyze the image using other neural networks or feature extraction means.

[0216] The storage means 201 may determine the storage period based on an input from the user.

[0217] [Other embodiments] Although an example of the processing of the information processing device 101 has been described above, the present invention is not limited to the above-described embodiment, and various modifications may be made. In addition, parts of the above-described embodiment may be appropriately combined.

[0218] At least a part of the processing shown in Figures 2(b), 2(c), 2(d), 3, 4(a), 4(b), and 5(a) may be realized by one or more dedicated hardware components different from the calculation unit 113.

[0219] The information processing device 101 may include an authentication system, and the imaging device 102 may add a user ID and a password to the communication content. By adding the user ID, the information processing device 101 can determine whether the image transmitted from the imaging device 102 is based on the user's permission.

[0220] The present invention can also be realized by supplying a program for implementing one or more of the functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC, etc.) that implements one or more of the functions. The program may also be provided by recording it on a computer-readable storage medium. [Explanation of symbols]

[0221] 101 Information processing device 102 Imaging device 201 Memory means 202 Means of Execution 203 Removal Method 204 Analysis Methods 205 Notification means

Claims

1. An information processing device capable of storing a plurality of images, A storage means for storing storage periods of the plurality of images; a deletion means for deleting images whose storage period has expired from among the plurality of images; a determination means for determining an output method of the image to be deleted by the deletion means; a notification means for notifying a user that the image will be deleted by the deletion means and the output method determined by the determination means; a receiving unit that receives a selection of the output method based on a user operation after the notification by the notifying unit, The determining means determines an output method of the image to be deleted by the deleting means based on an output method of an image associated with the image to be deleted by the deleting means.

23. An information processing apparatus comprising:

2. The image processing apparatus further includes an acquisition unit for acquiring feature information of the plurality of images, The storage means stores the characteristic information acquired by the acquisition means in combination with an image output method.

2. The information processing apparatus according to claim 1,

3. The determining means determines an output method of the image to be deleted by the deleting means based on characteristic information of the image to be deleted by the deleting means.

3. The information processing apparatus according to claim 2.

4. The determining means determines a notification time of the notification regarding the image based on the storage expiration date of the image, The notification means notifies the user of the notification regarding the image based on the expiration of the notification time.

2. The information processing apparatus according to claim 1,

5. the determining means determines a notification time of the notification regarding the image based on the storage period of the image and the output method of the image; The notification means notifies the user of the notification regarding the image based on the expiration of the notification time.

2. The information processing apparatus according to claim 1,

6. The notification means notifies the user of the fact that a plurality of images including the image will be deleted based on the storage period and of a method for outputting the plurality of images.

6. The information processing apparatus according to claim 1,

7. the determining means determines a notification time for the notification regarding the plurality of images based on the number of the plurality of images; The notification means notifies the user of the notification regarding the plurality of images based on the expiration of the notification time.

7. The information processing apparatus according to claim 6,

8. The output method determined by the determination means is any one of downloading the image from the information processing device, uploading the image to a social networking service, sending the image to a specified email address, printing the image, and creating a photo book including the image.

7. The information processing apparatus according to claim 6,

9. A method for controlling an information processing device capable of storing a plurality of images, comprising: a storage step of storing storage expiration dates of the plurality of images; a deleting step of deleting images whose storage period has expired from among the plurality of images; a determining step of determining an output method of the image to be deleted by the deleting means; a notification step of notifying a user that the image will be deleted in the deletion step and of the output method determined in the determination step; a receiving step of receiving a selection based on a user operation for the output method after the notification step, In the determining step, a method for outputting the image to be deleted by the deleting means is determined based on a method for outputting an image associated with the image to be deleted by the deleting means.

23. A method for controlling an information processing apparatus comprising:

10. A program for causing a computer to function as the method for controlling an information processing device according to claim 9.

Images