Image management apparatus, control method, and program

Abstract

To select a number of images as a user desires from a group.SOLUTION: An image management apparatus for managing images by account includes: grouping means which groups a plurality of images corresponding to a specific account; management means which manages conditions regarding the number of images to be selected, the conditions being associated with groups generated by the grouping means; and selection means which selects a number of images based on the conditions associated with a target group, from an image group included in the target group out of the generated groups.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to the process of filtering images. [Background technology]

[0002] A method for selecting an appropriate image from a plurality of captured images is known.

[0003] Patent Document 1 describes a method in which a plurality of images that meet a predetermined condition are treated as one group, and at least one representative image with a high evaluation value is selected for each group. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-8385 A Summary of the Invention [Problem to be solved by the invention]

[0005] When selecting images from a group generated by the technology of Patent Document 1, a user may wish to select a number of images according to the contents of the images contained in the group. For example, a user may wish to select multiple images from a group containing images of a moving scene shot in succession. A user may wish to select a larger number of images from a group containing images obtained by capturing an important scene. A user may wish to select one best shot image from a certain group. However, the method of Patent Document 1 only allowed a uniform number of images to be selected from each group. [Means for solving the problem]

[0006] The image management device disclosed herein is an image management device that manages images on an account basis, and is characterized in having a grouping means that groups multiple images corresponding to a specific account, a management means that manages conditions associated with the groups generated by the grouping means, which conditions relate to the number of images to be selected, and a selection means that selects a number of images based on the conditions associated with the target group from a group of images included in a target group among the generated groups. Effect of the Invention

[0007] According to the present disclosure, a user can select as many images from a group as desired. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an image management system. [Diagram 2] FIG. 2 is a diagram showing the hardware configuration of the imaging and viewing apparatus and a server apparatus. [Diagram 3] FIG. 2 is a block diagram showing the functional configuration of the server device. [Figure 4] FIG. 4 is a diagram showing an example of an image management table. [Diagram 5] FIG. 13 is a diagram showing an example of an image list screen. [Figure 6] 11 is a flowchart illustrating the flow of a condition setting process. [Figure 7] 11 is a flowchart showing the flow of a selection process and a transmission process. [Figure 8] FIG. 2 is a block diagram showing the functional configuration of the server device. [Figure 9] FIG. 13 is a diagram showing an example of a destination registration screen. [Figure 10] FIG. 4 is a diagram showing an example of a destination management table. [Figure 11] FIG. 4 is a diagram showing an example of an image management table. [Figure 12] 11 is a flowchart illustrating the flow of a condition setting process. [Figure 13] 11A and 11B are diagrams showing examples of a destination list screen and a transmission status screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the technology of the present disclosure will be described in detail based on the embodiments with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples, and the technology of the present disclosure is not limited to the configurations shown in the drawings.

[0010] <Embodiment 1> In this embodiment, a method is described in which conditions are set for the amount (number) of images to be selected from an image group based on operations performed on the images, images are selected based on the set conditions, and the selected images are transmitted to an external device.

[0011] [System Configuration] 1 is a diagram showing an example of the configuration of an image management system according to this embodiment. The image management system 1 of this embodiment includes an imaging and viewing apparatus 101, a server apparatus 102, and an external apparatus 103.

[0012] The imaging and viewing device 101 has a function of an imaging device that captures images to obtain images of a subject. The imaging and viewing device 101 also has a function of a viewing device that can view images such as captured images obtained by capturing images using the function of the imaging device. The imaging and viewing device 101 is, for example, a digital camera with a communication function, a PC with a camera, a tablet with a camera, a smartphone with a camera, or the like.

[0013] The imaging and viewing device 101 has a function of transferring images captured by the imaging device to the server device 102 via a network. A dedicated application such as a web application that runs on a browser is installed in the imaging and viewing device 101. A user who has an account for a cloud storage service provided by the server device 102 can view, delete, edit, and the like image files stored in the cloud storage service via the application. Furthermore, settings related to the cloud storage service can be configured via the application. The account may be a shared account for multiple users.

[0014] The imaging and viewing device 101 may be a device capable of only capturing images. In this case, a device having the function of a viewing device may be included in the image management system 1 as a device different from the imaging and viewing device 101. The above-mentioned application is installed in the device having the function of a viewing device.

[0015] The server device 102 is connected to one or more imaging viewing devices 101 via a network. The server device 102 is an information processing device that receives and stores image data transmitted from the imaging viewing device 101. The server device 102 is, for example, a server device that provides a cloud storage service. The cloud storage service is a cloud service that stores received images in a storage area assigned to each account and manages images of users who have accounts. Each user who owns the imaging viewing device 101 can use the cloud storage service provided by the server device 102 by creating an account.

[0016] Furthermore, the server apparatus 102 receives information on application operations performed by the user via the imaging and viewing apparatus 101 from the imaging and viewing apparatus 101. Furthermore, the server apparatus 102 is connected to one or more external apparatuses 103 via a network.

[0017] The external device 103 is an information processing device that provides a cloud service different from the cloud storage service provided by the server device 102. A cloud service provided by the external device 103 is called an external service. An external service is, for example, a cloud service with which each user subscribes for the purpose of storing or sharing images, or for the purpose of editing images. The number of external devices 103 that provide external services in the image management system 1 is not limited.

[0018] The server device 102 will be described as having a function of automatically sending images corresponding to the user's account at a predetermined timing to an external device 103 that provides the registered external service when the user registers the external service that he or she uses.

[0019] The imaging and viewing apparatus 101 and the server apparatus 102 may be configured as a single apparatus. That is, the imaging, viewing, and selection of images, and the transmission to the external apparatus 103 may be performed by a single apparatus.

[0020] [Hardware configuration] 2A is a diagram showing the hardware configuration of the imaging and viewing apparatus 101. The imaging and viewing apparatus 101 has a CPU 201, a ROM 202, a RAM 203, an auxiliary storage device 204, a display device 205, an input device 206, a communication device 207, an imaging device 209, and a bus 208.

[0021] The CPU 201 is a central processing unit that performs calculations and logical decisions for various processes and controls each component connected to a bus 208. The ROM (Read-Only Memory) 202 is a program memory. The ROM 202 stores programs for executing control by the CPU 201, including various processes described below. The RAM (Random Access Memory) 203 is used as a temporary storage area such as the main memory and work area of ​​the CPU 201.

[0022] The auxiliary storage device 204 is a storage device configured to store electronic data such as captured image data according to this embodiment and programs, and to prevent data loss even when the power is turned off. The auxiliary storage device 204 can be realized, for example, by a medium (recording medium) and an external storage drive for realizing access to the medium. Examples of such media include flash memory, USB memory, SSD (Solid State Drive) memory, HDD (Hard Disk Drive), flexible disk (FD), CD-ROM, DVD, and SD card. The auxiliary storage device 204 is, for example, an SSD (Solid State Drive) memory built into the main body, and may be configured not to be removable from the CPU 201.

[0023] Some or all of the functions of the auxiliary storage device 204 may be realized by a server or the like connected via a network. For example, the auxiliary storage device 204 is configured by an SSD (Solid State Drive) memory built into the main body and a server device 102 connected via a network. A program memory may be realized by loading a program stored in the auxiliary storage device 204 into the RAM 203. The CPU 201 stores the execution results of each process in the auxiliary storage device 204.

[0024] The display device 205 is, for example, a liquid crystal display, an organic EL display, or the like, and is a device that outputs images, characters, and figures on a screen that is displayed by processing of the CPU 201. The display device 205 may be an external device connected by wire or wirelessly.

[0025] The input device 206 is, for example, a touch panel, a button, or a mouse, and accepts various operations by the user. The input device 206 may be a pressure touch panel, an electrostatic touch panel, a light pen, or the like, which is attached to the display device 205 and senses the user's actions. The input device 206 may be an external device connected by wire or wirelessly, such as a mouse.

[0026] The communication device 207 performs two-way wired or wireless communication with other information processing devices, communication equipment, external storage devices, and the like using known communication techniques.

[0027] The imaging device 209 is a device for converting external light into electronic image data or electronic video data using known optical technology. The CPU 201 converts the external scenery captured by the imaging device 209 into image data and video data.

[0028] 2(b) is a diagram showing a hardware configuration of the server device 102. The server device 102 has a CPU 211, a ROM 212, a RAM 213, an auxiliary storage device 214, a communication device 217, and a bus 218. The CPU 211 is similar to the CPU 201, the ROM 212 is similar to the ROM 202, the RAM 213 is similar to the RAM 203, the auxiliary storage device 214 is similar to the auxiliary storage device 204, and the communication device 217 is similar to the communication device 207.

[0029] The auxiliary storage device 214 of the server apparatus 102 includes an area for storing images of each account transmitted from the imaging and viewing apparatus 101.

[0030] The server device 102 may be realized by a single information processing device having each unit in Fig. 2(b), or may be realized by multiple information processing devices having at least some of the units in Fig. 2(b). When the server device 102 is realized by multiple information processing devices, the multiple information processing devices are connected by a LAN or the like so as to be able to communicate with each other.

[0031] [Server device functional configuration] 3 is a block diagram showing an example of a functional configuration of the server device 102. The server device 102 includes a receiving unit 301, a managing unit 302, a grouping unit 303, a condition setting unit 304, a selecting unit 305, and a transmitting unit 306.

[0032] The receiving unit 301 receives images such as captured images transmitted from the imaging viewing apparatus 101 registered in the server apparatus 102. In addition, the receiving unit 301 receives operation information from the imaging viewing apparatus 101 indicating the content of an operation performed by a user on the imaging viewing apparatus 101.

[0033] The management unit 302 stores the images received by the receiving unit 301 in the auxiliary storage device 214 and manages them on an account basis. The management unit 302 also manages information regarding the number (quantity) of images selected from each image group by the selection unit 305. The management unit 302 manages image information using an image management table, which will be described later.

[0034] The grouping unit 303 groups images managed by the management unit 302 so that images that meet a predetermined condition are included in the same image group (sometimes simply referred to as a group). The conditions for grouping by the grouping unit 303 are not limited. For example, the grouping unit 303 compares the capture dates and times of two images, and groups the two images so that if the difference in capture dates and times is equal to or less than a predetermined threshold, the two images are included in the same image group. Alternatively, the grouping unit 303 may group the two images so that if the difference in color between the two images is equal to or less than a predetermined threshold, the two images are included in the same image group based on color information of each pixel of the two images.

[0035] The condition setting section 304 sets, for each image group, a "quantity condition" which is a condition for determining the number of images to be selected from each image group generated by the grouping section 303, based on the operation information received by the receiving section 301. The quantity condition set for each image group is managed by the management section 302.

[0036] The selection unit 305 selects, from the image group to be processed, a number of images based on the quantity condition associated with the image group to be processed, as will be described in detail later.

[0037] A transmission unit 306 transmits images selected by the selection unit 305 from among images of a specific account transmitted from the imaging and viewing apparatus 101 and managed by the management unit 302 to an external apparatus 103 that provides an external service.

[0038] Each functional unit in the server device 102 in Fig. 3 is realized by the CPU 211 expanding a program stored in the ROM 212 or the auxiliary storage device 214 into the RAM 213 and executing the processing described below. Other hardware such as a GPU or FPGA (not shown) may be used. Each functional unit may be realized by cooperation between software and hardware such as a dedicated IC, or some or all of the functions may be realized only by hardware. For example, a calculation unit or circuit corresponding to the processing of each functional unit in Fig. 3 may be configured.

[0039] [About the image management table] 4 is a diagram showing an example of an image management table that holds information on images of specific accounts managed by management unit 302. Image management table 400 is generated, for example, for each account. Each row (each record) of image management table 400 holds information on a target image in association with the image.

[0040] Column 401 holds an ID (called an image ID) for identifying an image managed by management unit 302. Column 402 holds the name (file name) of the image indicated by the image ID in column 401.

[0041] Column 403 holds an ID (called a group ID) that identifies an image group that includes an image indicated by the image ID in column 401. The group ID is an ID for identifying an image group generated by grouping unit 303, and is assigned by grouping unit 303. The same group ID is associated with the image ID of each image group that is determined by grouping unit 303 to match the same conditions and therefore be included in the same image group.

[0042] Column 404 holds "quantity conditions" that are set for the image group indicated by the group ID in column 403 and that are used to determine the number of images to be selected by the selection unit 305. In this embodiment, the quantity conditions are described as being set to any of the four conditions "small," "normal," "large," and "all," but the quantity conditions are not limited to these four. The content of each quantity condition will be described later.

[0043] In this embodiment, image management table 400 holds a value indicating a quantity condition so as to be associated only with the image ID of the image selected to set the quantity condition. For example, "large" is held as the quantity condition in column 404 of the row of image ID "3". This is because condition setting unit 304 has set conditions for the image indicated by image ID "3". In this manner, in this embodiment, the quantity conditions associated with an image group are managed by managing the quantity conditions so as to be associated with any image included in the image group.

[0044] Alternatively, the image management table 400 may be generated so that the same quantity condition is held for all image IDs associated with the same group ID. For example, assume that the condition setting unit 304 sets a condition for an image indicated by image ID "3". In this case, the value of the quantity condition may be held in column 404 in the rows of image IDs "2" and "4" associated with group ID "2" associated with image ID "3". For example, in the image management table 400 of FIG. 4, the image management table may be generated so that "high" is held in column 404 in the rows of image IDs "2" and "4".

[0045] When the server device 102 receives an image from the imaging viewing device 101, a row corresponding to the received image is added to the image management table 400 of FIG. 4 corresponding to the account of the user of the imaging viewing device 101. When an image is deleted from the server device 102, the row corresponding to the deleted image is deleted from the image management table 400.

[0046] Furthermore, when an image stored in the server device 102 and managed by the management unit 302 is transmitted to the external device 103, a transmitted flag may be added to the row in the image management table 400 in which the image ID of the transmitted image is held. Alternatively, images transmitted to an external service may be managed by generating a table for managing transmitted images for each transmission destination and holding the image ID of the transmitted image in the table.

[0047] [About the image list screen] 5 is a diagram showing an example of an image list screen which is a screen for viewing images stored in the server device 102. The image list screen 500 is a diagram showing an example of an image list screen corresponding to a user account registered with a cloud storage service provided by the server device 102. The image list screen 500 is displayed on the imaging and viewing device 101 of a user who has an account with the cloud storage service via the above-mentioned application.

[0048] The thumbnails included in the image list screen 500 indicate thumbnails of any of the images indicated by the image IDs included in the image management table 400 in Fig. 4. The thumbnails 501 to 504 are thumbnails of images determined by the grouping unit 303 as belonging to the same image group.

[0049] A user can operate the imaging viewing apparatus 101 to enlarge and view an image indicated by a thumbnail displayed on the image list screen 500. A user can operate the imaging viewing apparatus 101 to delete an image indicated by a thumbnail displayed on the image list screen 500. In this case, the corresponding image is also deleted from the server apparatus 102. A user can operate the imaging viewing apparatus 101 to edit an image indicated by a thumbnail displayed on the image list screen 500. A user can operate the imaging viewing apparatus 101 to set conditions for transmitting an image indicated by a thumbnail displayed on the image list screen 500 to the external apparatus 103.

[0050] [Condition setting processing] FIG. 6 is a flowchart explaining the flow of a condition setting process for setting the "quantity condition" for each image group. The series of processes shown in the flowchart in FIG. 6 are performed by the CPU of the server device 102 expanding program code stored in ROM into RAM and executing it. The results of each process are stored in RAM. Some or all of the functions of the steps in FIG. 6 may be realized by hardware such as ASIC or electronic circuits. Note that the symbol "S" in the explanation of each process refers to each process (step) in the flowchart, and the same applies to the subsequent flowcharts.

[0051] After the image list screen 500 of Fig. 5 is displayed on the imaging viewing apparatus 101, each time the user performs an operation on any of the thumbnails included in the image list screen 500, operation information indicating the content of the operation is transmitted to the server apparatus 102. The flowchart of Fig. 6 is started each time the imaging viewing apparatus 101 transmits operation information on the image list screen 500 to the server apparatus 102. In other words, the flowchart of Fig. 6 is started when, after the image list screen 500 of Fig. 5 is displayed on the imaging viewing apparatus 101, the user performs an operation on any of the thumbnails included in the image list screen 500.

[0052] In S601, the receiving unit 301 receives operation information transmitted from the imaging and viewing apparatus 101. The operation information includes a character string for identifying the content of the operation.

[0053] In S602, the condition setting unit 304 specifies, based on the operation information, the image ID of the image on which the user has performed an operation on the image list screen 500. If the operation information includes the image ID of the image on which the user has performed an operation, the image ID is acquired.

[0054] 5, for example, thumbnail 502 highlighted by a thick frame on image list screen 500 is shown to have been specified by a user operation. When the user performs a predetermined operation in this state, operation information including information on the image indicated by thumbnail 502 specified by the user is transmitted from the imaging and viewing apparatus 101. Therefore, condition setting unit 304 can identify the image ID of the image that is the target of the operation.

[0055] In S603, the condition setting unit 304 determines whether the operation performed by the user on the image list screen 500 is an operation for specifying a quantity condition, based on the operation information.

[0056] 5 shows an example of a user operation for specifying a quantity condition on the imaging viewing device 101. When the user performs a predetermined operation, a pop-up 510 including the above-mentioned four quantity conditions is displayed. When the user specifies a desired quantity condition from the pop-up 510, information on the specified image and operation information indicating the specified quantity condition are transmitted to the server device 102.

[0057] When the condition setting unit 304 determines that the content of the user operation indicated by the operation information is an operation for specifying a quantity condition (YES in S603), the process proceeds to S604.

[0058] In S604, the condition setting unit 304 stores a value in the column 404 of the image management table 400 so as to associate the image ID of the image on which the operation has been performed with the quantity condition designated by the user. For example, in FIG. 5, it is assumed that the designated thumbnail 502 is a thumbnail showing an image with an image ID of "3", and the user designates "large" from the pop-up 510. In this case, the operation information received indicates that the image ID is "3" and that the quantity condition is "large". In this case, the condition setting unit 304 stores "large" in the column 404 of the row in the image management table 400 in which "3" is stored as the image ID.

[0059] As shown in FIG. 4, image IDs "2," "3," and "4" are associated with the same group ID "2." Then, assume that condition setting unit 304 sets a quantity condition for image ID "3." When a quantity condition is set for one image among images belonging to the same image group, the same quantity condition is also set for other images belonging to the same image group. In other words, the quantity condition for an image group is managed in association with an image ID indicating one of the images included in the image group. In FIG. 4, the quantity condition "large" for the image group indicated by group ID "2" is associated only with image ID "3."

[0060] If a quantity condition has already been assigned to any of the image IDs associated with the same group ID, the condition setting unit 304 deletes the already-set quantity condition and sets it again. For example, assume that, in the state of the image management table 400 in FIG. 4, an image ID of "2" and a quantity condition of "small" are received as operation information. In this case, the condition setting unit 304 manages the changed quantity condition of "small" for group ID "2" by associating it with image ID "2". In this case, the quantity condition of "large" associated with image ID "3" is deleted.

[0061] On the other hand, if the condition setting unit 304 determines that the user operation indicated by the operation information is not an operation for specifying a quantity condition (NO in S603), the process proceeds to S605. In S605, the condition setting unit 304 determines whether the content of the user operation indicated by the operation information is an operation for enlarging and viewing an image. If the condition setting unit 304 determines that the content of the user operation indicated by the operation information is an operation for enlarging and viewing an image (YES in S605), the process proceeds to S606.

[0062] In S606, condition setting unit 304 stores a value in column 404 of image management table 400 so that the quantity condition "large" is associated with the image ID of the image on which the operation was performed. As a result, the quantity condition "large" is associated with the image group including the image on which the operation was performed. If the user enlarged and viewed an image, it is considered that the image group including the image viewed by the user is highly likely to contain images of important scenes. For this reason, "large" is set as the quantity condition so that many images are selected from that image group.

[0063] On the other hand, when the condition setting unit 304 determines that the operation is not an operation for enlarging and viewing the image (NO in S605), the process proceeds to S607. In S607, the condition setting unit 304 determines whether the content of the user operation indicated by the operation information is an operation for deleting an image. When the condition setting unit 304 determines that the operation is an operation for deleting an image (YES in S607), the process proceeds to S608. In S608, the condition setting unit 304 stores a value in column 404 of the image management table 400 so that the quantity condition "large" can be associated with the image ID of the deleted image. It is considered that the image was deleted as a result of the user selecting an image. Therefore, it is highly likely that the undeleted images included in the image group that contained the deleted image are important images selected by the user. Therefore, in order to allow the selection unit 305 to select many images from the image group that contains the deleted image, "large" is set as the quantity condition in this step.

[0064] When the operation indicated by the operation information is deletion, information on the image ID indicating the deleted image may not exist in the image management table 400. For this reason, in S608, the condition setting unit 304 sets "large" as the quantity condition for any image ID associated with the same group ID as the group ID of the image group that contained the deleted image. As a result, the quantity condition "large" is associated with the image group that includes the deleted image.

[0065] In addition, if the user operation indicated by the operation information is image editing such as trimming, the process may proceed to S606. After that, if operation information for canceling the editing is received, a process may be performed to return the amount condition from "large" to the original amount condition.

[0066] [Sorting process] Fig. 7 is a flowchart showing the flow of a selection process and a transmission process for selecting images from each image group based on a quantity condition set for each image group. In this embodiment, a predetermined schedule for the selection process (e.g., once a day) is set. The flowchart in Fig. 7 is started when the time indicated in the set schedule is reached.

[0067] In S701, the sorting unit 305 sets an initial value for variable i. A value indicated by the image ID of the image to be transmitted is set as the initial value for variable i. When the transmission unit 306 performs the first transmission, the sorting unit 305 sets the variable i to 1 in S701. When transmission is performed for an image that was added after the transmission process was previously performed by the transmission unit 306, a value indicating the image ID of the first image that was added is set to the variable i.

[0068] In S702, the selection unit 305 obtains a group ID associated with the image ID of the variable i in the image management table 400. For example, when the current variable i is 2 and the image management table 400 has been generated as shown in Fig. 4, the group ID "2" associated with the image ID "2" is obtained. The group ID obtained in this step is the group ID to be processed. Furthermore, the image group indicated by the group ID to be processed is the image group to be processed from which images are selected by the selection unit 305.

[0069] In S703, the selection unit 305 acquires a group of images included in the image group indicated by the group ID of the processing target acquired in S702. That is, the selection unit 305 acquires a group of images indicated by the image ID associated with the group ID of the processing target in the image management table 400. Note that although there may be only one image acquired in S703, for convenience of explanation, it will be referred to as an image group. For example, if the image management table 400 is generated as shown in FIG. 4 and the group ID of the processing target is "2", images with image IDs of "2", "3", and "4" are acquired. For convenience of explanation, it will be explained that the number of image groups included in the image group of the processing target is three, but the number of image groups included in an image group may be a large number, such as several tens.

[0070] In S704, the selection unit 305 acquires the quantity condition associated with the group ID to be processed acquired in S702 by referring to the image management table 400 in Fig. 4. Specifically, the selection unit 305 acquires the quantity condition associated with the group ID to be processed from column 404 of the image management table 400. The quantity condition is associated with one of the image IDs associated with the group ID to be processed. Therefore, if "2" is acquired as the group ID to be processed, the quantity condition "large" associated with the image ID "3" among the image IDs associated with the group ID "2" is acquired.

[0071] 7 is started, a value indicating the condition for the amount of group IDs to be processed is not held in image management table 400. In this case, the condition for the amount of group IDs to be processed is not set and the process proceeds to the next step.

[0072] In S705, the selection unit 305 selects a number of images based on the quantity condition acquired in S704 from the image group acquired in S703. For example, the selection unit 305 determines the number of images to be selected from the image group included in the image group to be processed based on the quantity condition acquired in S704 as follows.

[0073] If the quantity condition acquired in S704 is "small", the selection unit 305 selects only one image from the image group acquired in S703.

[0074] If the condition of the amount acquired in S704 is "normal", the selection unit 305 selects, from the group of images acquired in S703, one-fourth the number of images in the group of images acquired in S703.

[0075] If the condition of the amount acquired in S704 is "large", the selection unit 305 selects half the number of images from the group of images acquired in S703.

[0076] When the quantity condition acquired in S704 is "all", the selection unit 305 selects all of the images acquired in S703. These methods of determining the number of images to be selected corresponding to the quantity condition are merely examples, and are not limited to the above-mentioned methods.

[0077] Furthermore, if the quantity condition corresponding to the group ID to be processed has not been set, the selection unit 305 selects a number of images based on a predetermined condition from the image group acquired in S703. For example, if the quantity condition has not been set, the selection unit 305 selects one image from the image group with the same condition as the quantity condition of "small."

[0078] A method of selecting a number of images based on the quantity condition from the group of images acquired in S703 includes, for example, calculating an evaluation value for each of the group of images acquired in S703 and selecting a number of images based on the quantity condition from images with high evaluation values. The evaluation value is calculated based on rules based on conditions such as the degree of blurring or shaking of the image, the vividness of the color, the presence or absence of people, etc. Alternatively, the evaluation value of the image may be calculated using other known methods such as a method using machine learning.

[0079] In S706, the selection unit 305 determines whether there is a group ID following the group ID currently being processed that was acquired in S702. That is, the selection unit 305 determines whether the group ID associated with the image ID of the current variable i is the group ID indicating the last image group for which selection processing has not been performed. If there is a next image group for which selection processing has not been performed (YES in S706), the process proceeds to S707.

[0080] In S707, the selection unit 305 sets the value of the first image ID associated with the next group ID to the variable i, and updates the variable i. Then, S702 to S706 are repeated based on the updated variable i. That is, in the next step S702, the next group ID is determined as the group ID to be processed, and in S703 to S705, a number of images based on the quantity condition associated with the next group ID are selected from the group of images included in the image group indicated by the next group ID.

[0081] On the other hand, if there is no next group for which the selection process has not been performed (NO in S706), the transmission unit 306 transmits the selected images to the external device 103 in S708.

[0082] Note that the flowchart in Fig. 7 may be processed, for example, as follows. In S701, the value of the smallest group ID among the group IDs indicating image groups for which selection processing has not been performed is set to variable i. That is, initially, variable i is set to 1. S702 is skipped. In S703, the group ID of the current variable i is set as the group ID to be processed, and a group of images belonging to the image group indicated by the group ID to be processed is obtained. S704 to S706 are the same as those explained above, and in S707, the current variable i is added by 1 to update variable i.

[0083] As described above, according to this embodiment, images are selected from each image group and the selected images are transmitted, making it possible to reduce the number of images transmitted. Furthermore, according to this embodiment, the amount of images to be selected is set for each image group, making it possible to select and transmit an appropriate amount of images according to the contents of the image group.

[0084] In the above description, the flowchart in Fig. 7 has been described as being executed according to a predetermined schedule, such as once a day. Alternatively, the flowchart in Fig. 7 may be started after a predetermined time has elapsed since the server device 102 last received an image. The predetermined time is, for example, one hour. During the predetermined time from when the imaging and viewing device 101 captures an image until the server device 102 selects the images obtained by the imaging and transmits them to the external device 103, the user can perform an operation to check images (enlargement operation, deletion operation) or a condition setting operation on the image list screen 500.

[0085] Furthermore, since an operation involving condition setting has been performed on an image group that has already been selected and transmitted, it is possible that the condition setting unit 304 changes the quantity condition associated with the transmitted image group. In this case, if the quantity condition is changed so that the selection unit 305 selects a larger number of images, the selection unit 305 may select additional images from the images included in the transmitted image group, excluding the images that have already been transmitted. The transmission unit 306 may then transmit the additional selected images to the external device 103.

[0086] Although the external device 103 has been described as a device that provides an external service, the external device is not limited to this. Alternatively, the external device 103 may be a display device such as a monitor. In other words, images to be displayed on the display unit may be selected from an image group.

[0087] <Embodiment 2> In the first embodiment, the amount condition is described as being set based on information of a user operation on an image. In this embodiment, a method of setting the amount condition based on the destination of a selected image will be described. This embodiment will be described focusing on the differences from the first embodiment. The configuration and processing are the same as those of the first embodiment unless otherwise specified.

[0088] [Function configuration] FIG. 8 is a functional block diagram of the server device 102. The same components as those in FIG. 3 are given the same reference numerals and description thereof will be omitted. What differs from FIG. 3 is that it has a destination designation unit 801. The destination designation unit 801 designates, for each image group, a destination for images selected from the image group. For example, the destination designation unit 801 designates a destination selected by the user. Note that in this embodiment, the management unit 302 also manages the destination for each image group. The transmission unit 306 transmits the selected images to a destination designated for the image group in which the selected images are included.

[0089] [Registering recipients] 9 shows an example of a destination registration screen for a user to register information on an external service that is a destination of an image stored in the management unit 302. The destination registration screen 900 is displayed on the imaging and viewing device 101 of the user via the above-mentioned application.

[0090] 9 is a registration screen for registering information on an editing service C, which is one of the external services registered by the user. In this manner, in this embodiment, for each external service provided by the external device 103, a destination registration screen for registering information on the external service is generated.

[0091] Area 901 of destination registration screen 900 is an area for setting, based on a user's operation, whether to make the target external service the default destination. If a destination is not associated with an image group, images selected from that image group will be sent to the external service registered as the default. Area 902 is an area for registering, based on a user's operation, whether the purpose of sending to the external service is "storage" or "editing." Area 903 is an area for registering, based on a user's operation, the contractual capacity allocated to the user in the external service.

[0092] Fig. 10 is a diagram showing an example of a destination management table for managing external services that can be destinations when the transmitting unit 306 transmits an image. Each row (each record) of the destination management table 1000 stores information on registered external services that can be destinations in association with each other. The contents registered by the user via the destination registration screen 900 in Fig. 9 are managed in the destination management table 1000.

[0093] Column 1001 holds an ID (called a destination ID) for identifying an external service. Column 1002 holds the name of the external service indicated by the destination ID in column 1001. Column 1003 holds either "storage" or "edit" as the purpose of the external service indicated by the destination ID in column 1001. Column 1004 holds the contracted capacity of the external service indicated by the destination ID in column 1001.

[0094] 10, the row in which the destination ID is set to "3" holds information about editing service C. For example, if the information about editing service C is registered in the destination registration screen 900 in the state shown in Fig. 9, the row in the destination management table 1000 with the destination ID "3" holds the content registered in the destination registration screen 900 in Fig. 9.

[0095] In addition, if the server device 102 can obtain from the external device 103 the available capacity of the external service provided by the external device 103, the column 1003 may hold the available capacity instead of the capacity contracted by the user.

[0096] [About the image management table] Fig. 11 is a diagram for explaining an image management table used in this embodiment. An image management table 1100 of this embodiment is obtained by adding a column 1105 for holding destination IDs to the image management table 400 in Fig. 4. Columns 1101 to 1104 in Fig. 11 are the same as columns 401 to 404 in Fig. 4.

[0097] The destination IDs held in column 1105 of the image management table 1100 are destination IDs indicating destinations (external services) set by the destination designation unit 801 for the image groups indicated by the group IDs in column 1103 .

[0098] A destination ID indicating the destination of an image selected from an image group is associated with an image ID indicating any one of the images included in that image group. For example, in FIG. 11, destination ID "3" indicating the destination of the image group indicated by group ID "2" is associated only with image ID "3". For this reason, the image selected from the image group indicated by group ID "2" is controlled to be transmitted to external device 103 providing editing service C indicated by destination ID "3". In this way, in this embodiment, the destinations associated with the image groups are managed by managing the destinations in association with any one of the images included in the image groups.

[0099] Alternatively, image management table 1100 may be updated so that destination IDs are stored for all image IDs associated with the same group ID. For example, column 1105 of the rows for image IDs "2" and "4" associated with group ID "2" may store the same value as the destination ID associated with image ID "3."

[0100] [About condition setting and selection processing] 12 is a flowchart of the present embodiment for explaining the flow of the condition setting process of the present embodiment. In this embodiment, the condition setting unit 304 sets the quantity condition based on the information of the external service of the transmission destination.

[0101] For example, the user can set a destination via the image list screen 500 of Fig. 5. When the user performs an operation to specify a destination for any of the thumbnails included in the image list screen of Fig. 5, the flowchart of Fig. 12 starts.

[0102] In S1201, the receiving unit 301 receives from the imaging viewing device 101 the image ID of an image specified by the user and a destination ID indicating an external service that is a destination specified by the user. Then, the condition setting unit 304 obtains destination information associated with the received destination ID from the destination management table 1000. Specifically, the destination capacity and destination purpose associated with the received destination ID are obtained. Note that when the user specifies a destination for an image group, it is sufficient to obtain the image ID of any image included in the image group to which the destination has been specified.

[0103] In S1202, the condition setting unit 304 determines whether the purpose of the external service acquired in S1201 is "editing". If the condition setting unit 304 determines that the purpose is "editing" (YES in S1202), the process proceeds to S1203. In S1203, the condition setting unit 304 stores a value in column 1104 of the image management table 1100 so that the quantity condition "all" is associated with the image ID of the image specified by the user acquired in S1201. Since it is preferable that all images are sent to the external service if the purpose is editing, in this step, the quantity condition is set to "all".

[0104] On the other hand, if the condition setting unit 304 determines that the purpose of the external service is not "editing" (NO in S1202), the process proceeds to S1204. In S1204, the condition setting unit 304 determines a quantity condition according to the capacity of the external service acquired in S1201. For example, if the capacity is "small", the quantity condition is determined to be "small". If the capacity is "large", the quantity condition is determined to be "large". Then, the condition setting unit 304 stores a value in column 1104 of the image management table 1100 so that the determined quantity condition is associated with the image ID of the image specified by the user acquired in S1201. In this embodiment, the quantity condition is set in this manner.

[0105] The condition setting according to the flowchart of Fig. 12 is performed as an alternative process to the condition setting according to the flowchart of Fig. 6. Alternatively, both the condition setting according to the flowchart of Fig. 12 and the condition setting according to the flowchart of Fig. 6 may be executed. In that case, for example, a priority order may be set such that the condition setting in Fig. 6 takes precedence over the condition setting in Fig. 12, and when the condition setting in Fig. 6 is performed after the condition setting in Fig. 12 is performed, the quantity condition may be updated.

[0106] The selection unit 305 performs the same process as in the flowchart of Fig. 7 to select a number of images based on the quantity condition associated with the image group to be processed from the images included in the image group to be processed. In this embodiment, when the selection unit 305 acquires the quantity condition associated with the image group to be processed in S704, if the quantity condition is not set, it acquires information on the external service set as the default destination. The selection unit 305 then determines the quantity condition by performing the processes of S1202 to S1204 assuming that the information on the external service of the default destination was acquired in S1201. Furthermore, in S708, the transmission unit 306 transmits the images selected from the same image group to the external device 103 that provides the external service indicated by the destination ID associated with the group ID of the image group.

[0107] 13 shows an example of a destination list screen 1301 including a list of destination information, and a transmission status screen 1302, which are screens based on the information in the image management table 1100. A screen such as that shown in FIG. 13 may be displayed on the imaging and viewing device 101 so that the user can easily know under what conditions and in what quantity each image group has been transmitted to which external service.

[0108] A destination list screen 1301 is a screen that displays a list of external services that are destinations included in the information of the destination management table 1000. An icon 1304 is an icon that indicates an external service that is a destination, and the name of the corresponding external service is displayed next to it. A button 1303 is a button for transitioning to a transmission status screen 1302 that presents the transmission status to the user.

[0109] The transmission status screen 1302 is a screen displayed based on the information of the image management table 1100, and includes a list of image groups. If an image group contains one image, a thumbnail representing that image is displayed. If an image group contains multiple images, a thumbnail of the image with the highest evaluation value calculated by the selection unit 305 is displayed. A background 1305 is the background of the thumbnail displayed to indicate that the image group contains multiple images. An icon 1306 superimposed on the thumbnail is an icon indicating to which external service the image selected from the image group indicated by that thumbnail has been sent. A character string 1307 superimposed on the thumbnail is a character string indicating the quantity conditions used when selecting images from the image group indicated by that thumbnail. A thumbnail with no icon superimposed indicates an image group that has not been selected and sent to an external service.

[0110] As described above, according to this embodiment, it is possible to specify a destination for each image group. There are cases where a user has contracts with multiple external services, and the server device 102 and multiple external devices 103 are connected. In such cases, some users may wish to change the quantity conditions depending on the destination. For example, when the capacity of images that can be stored in the destination external device is different, there are cases where the user wishes to change the quantity of images to be sent depending on the capacity. In addition, when sending images to an external device for the purpose of editing the images, the storage of the images in the destination external device is temporary, and there are cases where the user wishes to send all images stored in the server device 102 to the external device. According to this embodiment, it is possible to specify a different destination for each image group. Furthermore, it is possible to select an appropriate amount of images according to the destination of the image group, and to send the selected images to the specified external device.

[0111] Note that multiple external services may be specified as default destinations. Also, multiple external services may be specified as destinations for an image group. In this case, multiple quantity conditions and destination IDs may be set in the image management table 1100. Also, in S705 of the flowchart in FIG. 7, images may be selected by repeating the process the number of times equal to the number of external services set as destinations.

[0112] <Other embodiments> The above-described embodiment can be implemented as, for example, a system, an apparatus, a method, a program, or a recording medium (storage medium), etc. Specifically, the present invention may be applied to a system configured from a plurality of devices (for example, a host computer, an interface device, an imaging device, a web application, etc.), or may be applied to an apparatus configured from a single device.

[0113] Needless to say, the object of the technology disclosed herein can be achieved by the following: That is, a recording medium (or storage medium) on which is recorded a program code (computer program) of software that realizes the functions of the above-mentioned embodiments is supplied to a system or device. Needless to say, such a storage medium is a computer-readable storage medium. Then, a computer (or a CPU or MPU) of the system or device reads and executes the program code stored in the recording medium. In this case, the program code itself read from the recording medium realizes the functions of the above-mentioned embodiments, and the recording medium on which the program code is recorded constitutes the present invention.

[0114] The present disclosure can also be realized by a process in which a program for implementing one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more functions.

[0115] The disclosure of the above-described embodiment includes the following configurations.

[0116] (Configuration 1) An image management device that manages images on an account basis, A grouping means for grouping a plurality of images corresponding to a particular account; a management means for managing a condition associated with the group generated by the grouping means, the condition relating to the number of images to be selected; A selection means for selecting a number of images based on the condition associated with a target group from a group of images included in the target group among the generated groups; 13. An image management device comprising:

[0117] (Configuration 2) The grouping means includes: Group images that meet certain criteria so that they are in the same group 2. The image management device according to claim 1,

[0118] (Configuration 3) The method further includes setting means for setting the conditions to be associated with each of the generated groups. 3. The image management device according to configuration 1 or 2.

[0119] (Configuration 4) The setting means is The condition based on the user's operation is associated with a group that includes an image operated by the user among the generated groups. 4. The image management device according to configuration 3.

[0120] (Configuration 5) The setting means is The condition for associating a group including an image that has been enlarged and viewed among the generated groups with the group is set to a condition that the number of images selected by the selection means is greater than other conditions. 5. The image management device according to configuration 4.

[0121] (Configuration 6) The setting means is The condition for associating the group containing the deleted image among the generated groups is set to a condition that the number of images selected by the selection means is greater than other conditions. 5. The image management device according to configuration 4.

[0122] (Configuration 7) The image forming apparatus further includes a transmitting unit for transmitting the images selected by the selecting unit from each of the generated groups. 7. The image management device according to any one of configurations 3 to 6,

[0123] (Configuration 8) a destination designation unit that designates a destination of an image to the generated group; The transmission means transmits the image selected from the target group to a destination designated by the destination designation means for the target group. 8. The image management device according to claim 7,

[0124] (Configuration 9) The setting means is As the condition for associating a group with a destination designated by the destination designation means, a condition based on information of the destination designated for the group is set. 9. The image management device according to configuration 8.

[0125] (Configuration 10) The setting means is When the purpose of the destination designated by the destination designation means for a group is editing, a condition for selecting all images is set as the condition to be associated with the group. 10. The image management device according to configuration 9.

[0126] (Configuration 11) The setting means is As the condition to be associated with a group, the destination designation means sets a condition according to the capacity of the destination designated to the group. 10. The image management device according to configuration 9.

[0127] (Configuration 12) A server device that provides a cloud service that manages captured images sent from an imaging device on an account-by-account basis. 2. The image management device according to configuration 1.

[0128] (Configuration 13) A method for controlling an image management device that manages images on an account basis, comprising: a grouping step for grouping a number of images corresponding to a particular account; a management step of managing a condition associated with the group generated by the grouping step, the condition being related to the number of images to be selected; a selection step of selecting, from a group of images included in a target group among the generated groups, a number of images based on the condition associated with the target group; A control method comprising the steps of:

[0129] (Configuration 14) 12. A program for causing a computer to execute each of the means of the image management device according to any one of configurations 1 to 11. [Explanation of symbols]

[0130] 302 Management Department 303 Grouping Department 305 Sorting Department 306 Transmitter 102 Server device

Claims

1. An image management device that manages images on an account basis, A grouping means for grouping a plurality of images corresponding to a particular account; a management means for managing a condition associated with the group generated by the grouping means, the condition being related to the number of images to be selected; a selection means for selecting a number of images based on the condition associated with a target group from a group of images included in the target group among the generated groups; 13. An image management device comprising:

2. The grouping means includes: Group images that meet certain criteria so that they are in the same group 2. The image management device according to claim 1, wherein:

3. The method further includes setting means for setting the conditions to be associated with each of the generated groups.

2. The image management device according to claim 1.

4. The setting means is The condition based on the user's operation is associated with a group that includes an image operated by the user among the generated groups.

4. The image management device according to claim 3.

5. The setting means is The condition for associating a group including an image that has been enlarged and viewed among the generated groups with the group is set to a condition that the number of images selected by the selection means is greater than other conditions.

5. The image management device according to claim 4.

6. The setting means is The condition for associating the group containing the deleted image among the generated groups is set to a condition that the number of images selected by the selection means is greater than other conditions.

5. The image management device according to claim 4.

7. The image processing apparatus further includes a transmitting unit for transmitting the images selected by the selecting unit from each of the generated groups.

4. The image management device according to claim 3.

8. a destination designation unit that designates a destination of an image to the generated group; The transmission means transmits the image selected from the target group to a destination designated by the destination designation means for the target group.

8. The image management device according to claim 7.

9. The setting means is As the condition for associating a group with a destination designated by the destination designation means, a condition based on information of the destination designated for the group is set.

9. The image management device according to claim 8.

10. The setting means is When the purpose of the destination designated by the destination designation means for a group is editing, a condition for selecting all images is set as the condition to be associated with the group.

10. The image management device according to claim 9.

11. The setting means is As the condition to be associated with a group, the destination designation means sets a condition according to the capacity of the destination designated to the group.

10. The image management device according to claim 9.

12. A server device that provides a cloud service that manages captured images sent from an imaging device on an account-by-account basis.

2. The image management device according to claim 1.

13. A method for controlling an image management device that manages images on an account basis, comprising: a grouping step for grouping a number of images corresponding to a particular account; a management step of managing a condition associated with the group generated by the grouping step, the condition being related to the number of images to be selected; a selection step of selecting, from a group of images included in a target group among the generated groups, a number of images based on the condition associated with the target group; A control method comprising the steps of:

14. A program for causing a computer to execute each of the means of the image management apparatus according to any one of claims 1 to 11.

Images