Information processing apparatus, information processing method, and program

The information processing device addresses user burden in complex image sorting systems by allowing type selection first, then displaying a tailored screen with prioritized input areas for sorting conditions, enhancing user experience.

JP2026020769APending Publication Date: 2026-02-10CANON KK
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2024122305
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-29
Publication Date
2026-02-10

AI Technical Summary

Technical Problem

Existing image sorting systems burden users with complex screens that require inputting values for multiple items, making it difficult to manage sorting conditions effectively.

Method used

An information processing device that associates types with sorting items, allowing users to select a type first, which then displays a tailored screen for inputting values, prioritizing certain items and hiding others to reduce user burden.

Benefits of technology

Reduces user burden in generating sorting conditions by presenting a focused screen with prioritized input areas, making it easier to manage and input sorting criteria.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026020769000001_ABST
    Figure 2026020769000001_ABST
Patent Text Reader

Abstract

To reduce a burden on a user when generating a sorting condition.SOLUTION: The information processing apparatus includes a management unit configured to manage each of a plurality of types and an item for sorting an image in association with each other, an acquisition unit configured to acquire a type selected by a user from the plurality of types, and a display control unit configured to perform control to display a screen for generating a sorting condition for sorting an image, the screen allowing the user to designate a value of the item associated with the type selected by the user.SELECTED DRAWING: Figure 7
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a process for managing images. [Background technology]

[0002] There is a method for selecting photographed images that match specific conditions by referencing the attribute information of the photographed images. These specific conditions are called "sorting conditions." The sorting conditions may consist of multiple items. In this case, if the attribute information of the photographed image matches all the values ​​of the multiple items, the photographed image is selected as meeting the sorting conditions.

[0003] Patent Document 1 describes a setting screen that allows a user to set the conditions for selecting specific content. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-210872 Summary of the Invention [Problem to be solved by the invention]

[0005] It is conceivable to present a screen for generating sorting conditions, such as the setting screen in Patent Document 1, to the user, and allow the user to generate sorting conditions themselves by inputting values ​​for required items from among multiple items via that screen. However, the setting screen in Patent Document 1 includes input fields for all items into which the user can input values, so if there are a large number of items, the screen becomes difficult to read and it becomes difficult to see how many items can be input in total. For this reason, presenting a screen like the setting screen in Patent Document 1 to the user to enable the user to generate sorting conditions themselves may increase the burden on the user when generating sorting conditions. [Means for solving the problem]

[0006] The information processing device disclosed herein is characterized by having a management means for associating and managing each of a plurality of types with an item for sorting images, an acquisition means for acquiring a type selected by a user from the plurality of types, and a display control means for controlling the display of a screen for generating sorting conditions for sorting images, on which the user can specify the value of the item associated with the type selected by the user. [Effects of the Invention]

[0007] According to the technology of the present disclosure, the burden on the user when generating sorting conditions can be reduced. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration. [Figure 2] FIG. 2 is a diagram showing an example of the hardware configuration of an image management apparatus. [Figure 3] FIG. 2 is a diagram showing an example of the functional configuration of an image management apparatus. [Figure 4] 10 is a flowchart for explaining the flow of the entire process of the image management device. [Figure 5] FIG. 10 is a diagram showing a comparative example of a sorting condition generation screen. [Figure 6] FIG. 10 is a diagram showing an example of a sorting condition type management table. [Figure 7] 10 is a flowchart illustrating a sorting condition generation process. [Figure 8] 10 is a flowchart for explaining a sorting condition generation screen display process. [Figure 9] 10A and 10B are diagrams showing examples of a sorting condition type selection screen and a sorting condition generation screen. [Figure 10] FIG. 10 is a diagram showing an example of a sorting condition generation screen. [Figure 11] FIG. 10 is a diagram showing an example of a sorting condition table. [Figure 12] FIG. 10 is a diagram showing an example of an image management table. [Figure 13]10 is a flowchart illustrating an image classification process. [Figure 14] FIG. 10 is a diagram showing an example of an image management table. [Figure 15] 10 is a flowchart for explaining the flow of the entire process of the image management device. [Figure 16] 10 is a flowchart showing the flow of a sorting condition generation or editing process. [Figure 17] 10 is a flowchart for explaining a sorting condition editing screen display process. [Figure 18] FIG. 10 is a diagram showing an example of a sorting condition editing screen. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, the technology of the present disclosure will be described in detail based on embodiments with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples, and the technology of the present disclosure is not limited to the configurations shown in the drawings.

[0010] <Embodiment 1> [System Configuration] 1 is a diagram showing an example of the configuration of an image management system according to this embodiment. The image management system includes an image management device 101, a terminal 102, and an external device 103. The image management device 101 is connected to one or more external devices 103 and one or more user terminals 102 via a network.

[0011] The image management device 101 is an information processing device that provides a service of receiving image data sent from a camera or terminal of a user who has an account and storing the received image data. The service provided by the image management device 101 is, for example, a cloud service that uploads and stores images taken with a digital camera in real time using a network such as Wi-Fi. The image management device 101 also provides a service of transmitting stored images to an external device 103. By automatically transferring images to the external device 103 in this way, pressure on storage capacity can be reduced. Furthermore, the image management device 101 will be described as having a function of sorting stored images. By sorting images by the image management device 101, the user's effort of selecting a desired image from a large number of images can be reduced.

[0012] In this embodiment, a user is a user who has an account for a service provided by the image management device 101. A user can create an account via a terminal 102 owned by the user and connected to a network. The terminal 102 is a device having a display unit such as a touch panel and an operation unit, and is, for example, a PC, a tablet, a smartphone, a camera, or the like. The terminal 102 is assumed to be a terminal that transmits images to the image management device 101, but the user may also transmit images to the image management device 101 from a terminal other than the terminal 102.

[0013] Image management device 101 can display a screen on the display unit of terminal 102. A user can issue various instructions to image management device 101 via this screen. Image management device 101 has a function to receive input operations performed by a user via terminal 102. For example, a user can view images of users managed by image management device 101, delete images, and so on. In addition, a user can change settings related to services running on image management device 101 via this screen.

[0014] The external device 103 is, for example, an information processing device or a server on the cloud that provides a service such as a cloud storage service subscribed to by a user for the purpose of storing, sharing, and editing images. The services provided by the external device 103 are sometimes called external services to distinguish them from the services provided by the image management device 101. The number of external devices 103, i.e., the number of external services, is not limited. The image management device 101 transmits a specified image to the external device 103.

[0015] The network is, for example, a LAN (Local Area Network), the Internet, etc. The image management device 101, the external device 103, and the user terminal 102 are connected via the network, and are configured to enable mutual communication between these devices.

[0016] [Hardware configuration] FIG. 2 is a diagram illustrating the hardware configuration of the image management device 101, which is an information processing device according to this embodiment.

[0017] The CPU 201 is a central processing unit that performs calculations and logical decisions for various processes and controls each component connected to a system bus 208 .

[0018] A ROM (Read-Only Memory) 202 is a program memory that stores programs for control by the CPU 201, including various processing procedures described below.

[0019] The RAM (Random Access Memory) 203 is a storage unit used as a temporary storage area such as the main memory or work area of ​​the CPU 201. The CPU 201 reads and executes programs stored in the ROM 202 to execute processes in accordance with the flowcharts described below. The ROM 202 may be realized as a program memory by loading the programs stored in the ROM 202 into the RAM 203. The CPU 201 writes the execution results of each process into the RAM 203.

[0020] The auxiliary storage device 204 is a storage device that stores electronic data and programs according to this embodiment and stores the data so that it is not lost even when the power is turned off. The auxiliary storage device 204 can be realized, for example, by a medium (recording medium) and an external storage drive for accessing the medium. Examples of such media include a flash memory, a USB memory, a solid-state drive (SSD) memory, a hard disk drive (HDD), a flexible disk (FD), a CD-ROM, a DVD, and an SD card. The auxiliary storage device 204 may also be a server device connected via a network. The auxiliary storage device 204 may be built into the main body and not removable from the CPU 201, such as a solid-state drive (SSD) memory. In this embodiment, the auxiliary storage device 204 will be described as being a solid-state drive (SSD) memory built into the main body. The auxiliary storage device 204 may also be realized as a program memory by loading programs stored in the auxiliary storage device 204 into the RAM 203. The CPU 201 saves the execution results of each process in the auxiliary storage device 204.

[0021] The display device 205 is, for example, a display unit such as a liquid crystal display, an organic EL display, etc. The CPU 201 functions as a display control unit, and causes the display device 205 to display a screen containing images, characters, figures, etc.

[0022] The input device 206 is, for example, an operation unit such as a touch panel, a button, or a mouse, and accepts various operations by the user. The input device 206 may be an input unit that is attached to the display device 205 and senses the user's actions. For example, the input device 206 may be a pressure touch panel, an electrostatic touch panel, a light pen, or the like.

[0023] At least one of the display device 205 and the input device 206 may exist as an external device connected to the image management device 101 by wire or wirelessly.

[0024] The communication device 207 performs wired or wireless two-way communication with other information processing devices, communication equipment, external storage devices, etc. using known communication techniques.

[0025] In this embodiment, the image management device 101 is described as a device for the sake of convenience, but the image management device 101 may be a system in which a plurality of information processing devices behave as a single image management device 101 .

[0026] [Function Configuration] FIG. 3 is a diagram showing an example of the functional configuration of the image management device 101 of this embodiment.

[0027] The input unit 301 receives data such as a user's operation input via the terminal 102. The input unit 301 may receive the user's operation input via the input device 206.

[0028] The output unit 306 transmits the data to the terminal 102 .

[0029] The transmitting / receiving unit 307 transmits and receives data to and from the external device 103 on the Internet.

[0030] The sorting condition type management unit 302 manages the types of sorting conditions and information on the sorting items that can be set according to the types of sorting conditions.

[0031] The screen display control unit 303 controls the display of screens such as a sorting condition generation screen for generating sorting conditions based on user instructions on the user terminal 102 .

[0032] The sorting condition management unit 304 manages the sorting conditions generated by the user through input on the sorting condition generation screen.

[0033] The image management unit 309 manages the user's images uploaded to the image management device 101 .

[0034] The image analysis unit 308 analyzes the images uploaded to the image management device 101 .

[0035] The image classification processing unit 305 sets the sorting conditions to be used for sorting the images from among the sorting conditions generated in response to user instructions, and performs the process of sorting the images.

[0036] 3 is realized by the CPU 201 reading a predetermined program stored in the ROM 202 or the like into the RAM 203 and executing it, but this is not limiting. Other hardware such as a GPU (Graphics Processing Unit) or an FPGA (Field Programmable Gate Array) for accelerating calculations may also be used. Each function may be realized by a combination of software and hardware such as a dedicated IC, or some or all of the functions may be realized solely by hardware.

[0037] [Processing flow] 4 is a flowchart showing the processing flow of the image management device 101 when it acquires an instruction given by a user via the terminal 102. The processing according to the flowchart in FIG. 4 is performed by expanding program code stored in the ROM 202 or the like into the RAM 203 and executing it with the CPU 201. Alternatively, some or all of the functions of the steps in FIG. 4 may be realized by hardware such as an ASIC or electronic circuit. The symbol "S" in the explanation of each process indicates a step in the flowchart, and this also applies to subsequent flowcharts. The flowchart in FIG. 4 starts when the image management device 101 is started.

[0038] In S401, CPU 201 executes initialization processing. In the initialization processing, initial settings of image management device 101 are performed. When the initialization processing is completed, CPU 201 waits for an event. The event may be a processing request from terminal 102, or an event such as the start of batch processing within image management device 101.

[0039] In S402, the CPU 201 acquires an event. In S403, the CPU 201 switches the subsequent processing depending on the type of the event acquired in S402.

[0040] If the CPU 201 determines in S403 that it has received an event instructing the generation of sorting conditions from the user terminal 102, it proceeds to S404 to perform sorting condition generation processing. Details of the sorting condition generation processing in S404 will be described later. When S404 ends, the CPU 201 returns to S402 to wait for an event again.

[0041] In S403, if the CPU 201 acquires an event that a user's image has been uploaded to the image management device 101, the process proceeds to S405.

[0042] In S405, the CPU 201 analyzes the uploaded image.

[0043] In step S406, the CPU 201 performs a classification process on the uploaded images. The details of the classification process will be described later.

[0044] In S407, the CPU 201 determines whether the automatic image transfer function is enabled in the image management device 101. If the CPU 201 determines that the automatic image transfer function is enabled (YES in S407), the process proceeds to S408.

[0045] In S408, the CPU 201 transfers images that meet the sorting conditions to the connected external device 103. If it is determined that the automatic image transfer function is not enabled (NO in S407), or when S408 ends, the CPU 201 returns to S402 to wait for an event again.

[0046] In S403, if the type of event is a manual image transfer or image download in response to a user instruction, the CPU 201 proceeds to S409. In S409, the CPU 201 performs the corresponding process. When S409 ends, the CPU 201 returns to S402 to wait for an event again.

[0047] If the CPU 201 receives an event to end the processing in S403, the process proceeds to S410. In S410, the CPU 201 performs an end process, and the flowchart in FIG.

[0048] [About sorting process and sorting conditions] The sorting process is a process of selecting images from a specific user that match the sorting conditions registered as a result of executing S404. For example, if sorting conditions for sorting images that include people are generated in S404, images that include people can be selected from the uploaded images of the specific user in S406. The process of selecting images that match the sorting conditions is called "sorting" or "sorting process."

[0049] A sorting condition is made up of one or more sorting items. In the sorting process, when determining whether an image to be sorted meets a certain sorting condition, the image to be sorted is determined to meet the sorting condition if the values ​​of all the sorting items that make up the sorting condition match the information of the image to be sorted. The user can create sorting conditions by specifying and setting the values ​​(item values) corresponding to each sorting item.

[0050] FIG. 5 is a diagram showing a comparative example of a sorting condition generation screen for generating sorting conditions.

[0051] In this embodiment, the sorting items are assumed to be "subject category," "blur / exposure judgment," "connected camera," "image type," "rating," and "photography date and time." The sorting items are not limited to these six items and may include other items. The sorting condition generation screen 500 in FIG. 5 is an example of a sorting condition generation screen displayed so that the user can input item values ​​for all sorting items. Displaying the sorting condition generation screen with all setting areas 501 to 506 for inputting item values ​​for the sorting items, as in FIG. 5 , increases the user's burden in finding the sorting item for which to input item values. Furthermore, the user may be unable to determine which sorting item to input item values ​​for. Therefore, in this embodiment, a method is described for reducing the user's burden when generating sorting conditions by presetting the types of sorting conditions and displaying a sorting condition generation screen for each type of sorting condition.

[0052] [About sorting condition generation process] 6 is a diagram showing an example of a sorting condition type management table for managing the types of sorting conditions managed by the sorting condition type management unit 302. In this embodiment, the user can display a sorting condition generation screen corresponding to the type of sorting condition registered in advance. The following description will be given assuming that the types of pre-registered sorting conditions are four: "subject category," "blur / exposure determination," "shooting information," and "free combination," but the types of sorting conditions are not limited to these four.

[0053] The sorting condition type management table 600 is a table for managing the sorting items to be included in the sorting condition generation screen for each of these four sorting condition types. Records (rows) in the sorting condition type management table 600 are added for each value of the condition type ID that identifies the sorting type. Priority items and sorting items associated with the value of the condition type ID are held in the same record.

[0054] The column holding the condition type ID in the sorting condition type management table 600 holds the ID values ​​for each of the four sorting types. For example, "subject_type" corresponding to "subject category," "failure_exclusion" corresponding to "blur / exposure determination," and "shooting_info" corresponding to "shooting information" are held. Also, "all" corresponding to "free combination" is held.

[0055] The sorting item column in the sorting condition type management table 600 includes columns for the item names of the six sorting items mentioned above. The item name column for sorting items that allow the user to input and set item values ​​on the sorting condition generation screen holds "Display."

[0056] In the sorting condition type management table 600, the column for priority items holds "display" for the sorting item names, and if a priority item is set, the column holds the name of the sorting item indicating the priority item. If no priority item is set, "none" is held. A priority item is a sorting item that is displayed with priority on the sorting condition generation screen.

[0057] Fig. 7 is a flowchart for explaining the details of the sorting condition generation process in S404 in Fig. 4. When the CPU 201 receives an instruction to generate sorting conditions from the terminal 102 in S403 in Fig. 4, the flowchart in Fig. 7 starts.

[0058] In S701, the CPU 201 refers to the sorting condition type management table 600 in Fig. 6 and transmits to the terminal 102 information on a screen that enables the user to select the type of sorting condition managed by the sorting condition type management table 600. As a result, the sorting condition type selection screen 901 (see Fig. 9) is displayed on the terminal 102.

[0059] In step S702 , the CPU 201 acquires the type of sorting condition selected by the user from the sorting condition type selection screen 901 .

[0060] In S703, CPU 201 refers to the sorting condition type management table 600 in Figure 6 and obtains the sorting item name for which "display" is stored from the row (record) that stores information on the type of sorting condition selected by the user.

[0061] In S704, the CPU 201 acquires the value stored in the priority item column from the row (record) that stores information about the type of sorting condition selected by the user in the sorting condition type management table 600 in Fig. 6. If no priority item is set, the item name indicating the priority item is not acquired.

[0062] In S705, the CPU 201 generates a sorting condition generation screen and displays it on the user terminal 102.

[0063] FIG. 8 is a flowchart for explaining the details of the sorting condition generation screen display process in S705 of FIG.

[0064] In S801, the CPU 201 determines whether or not a classification item name indicating a priority item has been acquired in S704.

[0065] If the CPU 201 determines that it has acquired the sorting item name indicating the priority item (YES in S801), it proceeds to S802. In S802, the CPU 201 sets the sorting item acquired in S703 to be included in the sorting condition generation screen. Furthermore, the CPU 201 sets the sorting condition generation screen to be displayed with the priority item setting area open. Then, the processing proceeds to S803.

[0066] In S803, the CPU 201 sets the sorting condition generation screen to be displayed in a state in which the setting areas for sorting items other than the priority items among the sorting items acquired in S703 are closed.

[0067] On the other hand, if the CPU 201 determines that the sorting item name indicating the priority item could not be acquired (NO in S801), the process proceeds to S804. In S804, the CPU 201 sets the sorting items acquired in S703 to be included in the sorting condition generation screen. The CPU then sets the sorting condition generation screen to be displayed with all setting areas for each sorting item open.

[0068] 9 is a screen displayed in S701 of Fig. 7, and is a screen for the user to select the type of sorting condition. The sorting condition type selection screen 901 includes buttons 902 to 904 corresponding to the types of sorting conditions. Specifically, there is a button 902 for selecting the sorting condition type "subject category," a button 903 for selecting "blur / exposure judgment," a button 904 for selecting "shooting information," and a button 905 for selecting "free combination."

[0069] For example, suppose that the user selects "object category" as the type of sorting condition by pressing button 902 on the sorting condition type selection screen 901 in Fig. 9. In this case, processing is performed to display a sorting condition generation screen 906 corresponding to the sorting condition type of "object category" in Fig. 9.

[0070] Specifically, in the sorting condition type management table 600 of FIG. 6, the CPU 201 references row 602 in which the ID value of "subject_type" for "subject category" is stored in the condition type ID column. In row 602, "display" is stored in the columns for the sorting item names "subject category" and "blur / exposure determination." No priority item is set. Therefore, in S703, the CPU 201 acquires "subject category" and "blur / exposure determination" as sorting items to be included in the sorting condition generation screen. In addition, in S704, the CPU 201 acquires that no priority item is set. In the flowchart of FIG. 8 showing details of S705, the determination in S801 is NO, and the process proceeds to S804. In S804, the CPU 201 generates a sorting condition generation screen 906 that includes setting areas 913 and 914 for the acquired sorting items "subject category" and "blur / exposure determination." At this time, the CPU 201 generates a sorting condition generation screen 906 that displays an open setting area 913 for "subject category" and an open setting area 914 for "blur / exposure determination." As a result, the sorting condition generation screen 906 shown in FIG. 9 is displayed on the user's terminal 102.

[0071] Also, suppose that the user presses button 903 on the sorting condition type selection screen 901 of FIG. 9 to select "blur / exposure determination" as the type of sorting condition. In row 603 of the sorting condition type management table 600 of FIG. 6, the condition type ID column holds "failure_exclusion," which is the ID value of the sorting condition type "blur / exposure determination." In this row 603, only the column for the sorting item name "blur / exposure determination" holds "display," and no sorting item name is held in the priority item column. Therefore, in S705, the CPU 201 generates the sorting condition generation screen 907 of FIG. 9 in which the setting area 915 for the sorting item "blur / exposure determination" is open. As a result, the sorting condition generation screen 907 of FIG. 9 is displayed on the user's terminal 102.

[0072] Also, suppose that the user presses the button 904 corresponding to the "photography information" sorting condition type on the sorting condition type selection screen 901 in Fig. 9. In this case, processing is performed to display the sorting condition generation screen 908 for "photography information" in Fig. 9.

[0073] Specifically, the CPU 201 refers to row 604 in which the ID value of the sorting condition type "shooting information" is stored in the condition type ID column in the sorting condition type management table 600 of Fig. 5. In row 604, "display" is stored in the columns of sorting item names "connected camera," "image type," "rating," and "shooting date and time," and "connected camera" is stored in the priority item column.

[0074] Therefore, in S703, the CPU 201 acquires "Connected Camera," "Image Type," "Rating," and "Photographed Date and Time" as sorting items to be included in the sorting condition generation screen. Furthermore, in S704, the CPU 201 acquires "Connected Camera" as a priority item. In the flowchart of FIG. 8 showing details of S705, the determination in S801 is YES, and the process proceeds to S802. In S802, the CPU 201 sets the sorting condition generation screen so that the setting area 916 for "Connected Camera," which is the priority item, is displayed open. Furthermore, in S803, the CPU 201 sets the sorting condition generation screen so that the setting areas for "Image Type," "Rating," and "Photographed Date and Time," which are sorting items other than the priority item, are displayed closed. As a result, the sorting condition generation screen 908 of FIG. 9 is generated, and the sorting condition generation screen 908 is displayed on the user's terminal 102.

[0075] Also, suppose that the user selects "free combination" as the type of sorting condition by pressing button 905 on sorting condition type selection screen 901 in Fig. 9. Row 605 in sorting condition type management table 600 in Fig. 6 stores "all" in the condition type ID column, and therefore stores information on the type name of the sorting condition "free combination." In row 605, "display" is stored in each of the columns for sorting item names: "subject category," "blur / exposure judgment," "connected camera," "image type," "rating," and "photograph date and time," and "subject category" is stored in the priority item column.

[0076] 8 showing the details of S705, the CPU 201 sets in S802 the setting area 917 for the sorting item "subject category," which is a priority item, to be displayed in an open state. Furthermore, in S803, the CPU 201 sets in the sorting condition generation screen the setting areas for sorting items other than the priority items, "blur / exposure judgment," "connected camera," "image type," "rating," and "photography date and time," to be displayed in a closed state. As a result, the sorting condition generation screen 909 is displayed on the user's terminal 102.

[0077] Let us compare the sorting condition generation screen 500 of the comparative example in Figure 5 with the sorting condition generation screens 906-909 of Figure 9 generated by the method of this embodiment. The sorting condition generation screens 906-908 of Figure 9 are sorting condition generation screens that do not include all sorting items for which item values ​​can be set. Also, the sorting condition generation screen 909 of Figure 9 generated by this embodiment includes all sorting items as sorting items to be set. However, the sorting condition generation screen 909 of Figure 9 can be configured to display the setting areas for sorting items other than priority items in a closed state. This presents a sorting condition generation screen that makes it easy for the user to find the sorting item for which item values ​​should be set.

[0078] In addition, in this embodiment, when a priority item is set, the setting areas for sorting items other than the priority item are displayed in a closed state. For example, when a priority item is set, the setting areas for the sorting items are each generated as an accordion menu (toggle menu), and the display and non-display of the setting area can be switched. Explaining this using the sorting condition generation screen 908 of FIG. 9, an open / close button 918 is provided in the title area 919 of the sorting item, and the open / close button 918 can be used to switch the display and non-display of the setting area for the corresponding sorting item. When the accordion menu is closed, pressing the open / close button 918 can expand the accordion menu. Conversely, when the accordion menu is expanded, pressing the open / close button 918 can close the accordion menu.

[0079] In this manner, in this embodiment, when the user selects a sorting type when generating sorting conditions, only the sorting items that can be set according to the selected type can be included in the sorting condition generation screen. Furthermore, only the setting area for the sorting item to be displayed preferentially can be displayed to the user in an open state, while the setting areas for the other sorting items can be displayed in a closed state.

[0080] 10 is a diagram showing the sorting condition generation screen after the user has input item values. The sorting condition generation screen 906 of FIG. 10 is the sorting condition generation screen after the user has input item values ​​in a setting area 913 included in the sorting condition generation screen 906 of FIG. 9. Similarly, the sorting condition generation screen 907 of FIG. 10 corresponds to the sorting condition generation screen 907 of FIG. 9, the sorting condition generation screen 908 of FIG. 10 corresponds to the sorting condition generation screen 908 of FIG. 9, and the sorting condition generation screen 909 of FIG. 10 corresponds to the sorting condition generation screen 909 of FIG. 9. Looking at the sorting condition generation screen 909 of FIG. 10, the object category setting area 917 that was open on the sorting condition generation screen 909 of FIG. 9 is now closed. On the other hand, the shooting date and time setting area 1001 that was closed on the sorting condition generation screen 909 of FIG. 9 is now open.

[0081] In this way, the setting area for sorting items is displayed as an accordion menu, so even if the setting area for sorting items other than priority items is displayed in a closed state, the user can easily open it by pressing the open / close button 918.

[0082] The description of the flowchart will continue with returning to Fig. 7. In S706, CPU 201 acquires the user's operation on the sorting condition generation screen displayed on user terminal 102 as a result of S705.

[0083] In S707, the CPU 201 determines whether the operation acquired in S706 is an operation to press the cancel button 910 or an operation to press the create button 911.

[0084] If the CPU 201 determines that the user operation is an operation to press the Create button 911, the process proceeds to S708. In S708, the CPU 201 saves the item values ​​set by the user on the sorting condition generation screens 906 to 909 displayed on the user terminal 102. Then, the flowchart in Fig. 7 ends. If the CPU 201 determines that the user operation is an operation to press the Cancel button 910, the CPU 201 skips S708 and ends the flowchart in Fig. 7.

[0085] [How to manage sorting conditions] 11 is a diagram showing a sorting condition management table 1100 used by the sorting condition management unit 304 to manage sorting conditions. Sorting conditions generated by user input on the sorting condition generation screens 906 to 909 are managed by the sorting condition management table 1100. A row (record) in the sorting condition management table 1100 is added for each value of the sorting condition ID that uniquely identifies the sorting condition. The user ID value, sorting condition name, condition type ID, and sorting item value associated with the sorting condition ID value are held in the same record.

[0086] The sorting condition name is the name of the sorting condition, and holds the text entered in the condition name input field 912 of the sorting condition generation screens 906 to 909. The condition type ID column holds an ID value indicating the type of sorting condition selected by the user when generating the sorting condition.

[0087] Rows 1102 to 1105 of the sorting condition management table 1100 hold information on sorting conditions generated by user A, whose user ID is "User001", via the sorting condition generation screens 906 to 909. Row 1102 holds information on sorting conditions generated when the Create button 911 on the sorting condition generation screen 906 of FIG. 10 is pressed. Row 1103 holds information on sorting conditions generated when the Create button 911 on the sorting condition generation screen 907 of FIG. 10 is pressed. Row 1104 holds information on sorting conditions generated when the Create button 911 on the sorting condition generation screen 909 of FIG. 10 is pressed. Row 1105 holds information on sorting conditions generated when the Create button 911 on the sorting condition generation screen 908 of FIG. 10 is pressed.

[0088] [Image analysis processing] In the analysis process for the uploaded image executed in S405 of FIG. 4, as an example, it is assumed that a subject classification process, a blur determination process, an exposure determination process, and a shooting information extraction process are executed.

[0089] Subject classification processing is processing that extracts subjects contained in the image to be analyzed and outputs the classification (category) of the extracted subjects. Exposure determination processing is processing that determines whether the exposure of the image to be analyzed is appropriate or incorrect and outputs the determination result. Blur determination processing is processing that determines whether the entire image to be analyzed is blurred or not and outputs a true / false value as the blur determination result. Shooting information extraction processing is processing that extracts tag values ​​from information such as Exif attached to the image to be analyzed and outputs the connected camera, image type, rating, and shooting date and time as the analysis result.

[0090] 12 is a diagram showing an example of an image management table used by the image management device 101 to manage images uploaded to the image management device 101 by user A, whose user ID is "User001." In the image management table 1200, the value of an image ID that uniquely identifies an image, the user ID of the image's owner, the image file name, and a value indicating the analysis result obtained by analyzing the image in S405 are stored in the same record and are associated with each other. When the analysis process in S405 is completed, a record that stores information about the analyzed image is added to the image management table 1200 in FIG. 12.

[0091] [Sorting process] FIG. 13 is a flowchart for explaining the details of the image classification process executed in S406 of FIG.

[0092] In S1301, the CPU 201 acquires the value of a user ID indicating a target user. For example, the flowchart in Fig. 13 will be described using the case where an upload event for an image with image ID "100" and information stored in row 1202 of image management table 1200 in Fig. 12 is acquired in S402. In this case, the image with image ID "100" becomes the image to be sorted in the flowchart in Fig. 13. Also, in S1301, the CPU 201 acquires "User001", which is the user ID of the user who owns the images to be sorted, as the target user ID.

[0093] In step S1302, the CPU 201 acquires attribute information for the uploaded images to be sorted. In this embodiment, the CPU 201 acquires the image file and the analysis results, such as the subject category, exposure, blur, connected camera, image type, rating, and shooting date and time, from row 1202 of the image management table 1200 in FIG.

[0094] In S1303, the CPU 201 acquires the sorting conditions associated with the target user ID "User001" from the sorting condition management table 1100 of Fig. 11. For example, the CPU 201 acquires the sorting conditions with sorting condition IDs "S001", "S002", "S049", and "S112" stored in rows 1102 to 1105 from the sorting condition management table 1100.

[0095] The next steps S1304 to S1309 are loop processes that repeat processing for the sorting condition to be processed selected from the sorting conditions acquired in S1303 while changing the sorting condition to be processed. In S1304, CPU 201 determines whether all of the sorting conditions acquired in S1303 have been selected as the sorting conditions to be processed. If CPU 201 determines that there are sorting conditions that have not been selected as the sorting conditions to be processed (NO in S1304), it proceeds to S1305.

[0096] In S1305, the CPU 201 selects a sorting condition to be processed from the unselected sorting conditions among the sorting conditions acquired in S1303.

[0097] In S1306, the CPU 201 determines whether the image to be sorted matches the sorting conditions of the current processing target. For example, assume that the sorting conditions of the processing target are those with a sorting condition ID of "S001." In this case, it is determined whether the attribute information (analysis result) of the image to be sorted, which has an image ID of "100," matches the item values ​​that make up the sorting conditions of the processing target: subject category "dog," blur "ON," and exposure "ON." Since the attribute information of the image to be sorted, which has an image ID of "100," satisfies all the item values ​​that make up the sorting condition with a sorting condition ID of "S001," the CPU 201 determines in S1307 that the image matches the sorting conditions of the processing target.

[0098] If the CPU 201 determines in S1307 that the image satisfies the sorting conditions of the image to be processed (YES in S1307), the process proceeds to S1308. In S1308, the CPU 201 adds information to the image to be sorted that the image satisfies the sorting conditions of the image to be processed.

[0099] In S1309, the CPU 201 adds the value of the sorting condition ID indicating the sorting condition to be processed to the record in the image management table 1400 (see FIG. 14) that holds the information about the image to be sorted.

[0100] When S1309 ends, the CPU 201 returns the process to S1304. If the CPU 201 determines in S1307 that the image does not match the sorting condition of the processing target (NO in S1307), it skips S1308 and S1309 and returns the process to S1304. Then, it similarly repeats S1305 to S1309 for the other sorting conditions acquired in S1303. It is determined that the image to be sorted also matches the sorting condition with the sorting condition ID "S002".

[0101] If CPU 201 determines that there is no sorting condition that has not yet been processed among the sorting conditions acquired in S1303 (YES in S1304), CPU 201 ends the flowchart of FIG.

[0102] Fig. 14 is a diagram showing an example of an image management table to which the results of the image sorting process of S406 in Fig. 4 have been added. Image management table 1400 in Fig. 14 is a table obtained by adding column 1403, which holds the value of the sorting condition ID of the matched sorting condition, to image management table 1200 in Fig. 12. If the same sorting process is performed on images with image IDs "101" to "105," the sorting conditions that matched the images to be sorted are stored, as shown in Fig. 14.

[0103] Column 1403 of row 1402, which holds information about the image with image ID "100," holds "S001" and "S002" as the sorting condition ID values ​​indicating the sorting conditions that were determined to be met. Using image management table 1400, CPU 201 can present the user with a list of images that meet specific sorting conditions, or display a list of thumbnails of images that meet specific sorting conditions.

[0104] When the image sorting process in S406 is completed, if automatic image transfer is enabled, the images to be sorted are transferred to the external device 103. At this time, the images to be sorted may be transferred to the external device 103 only if they meet specific sorting conditions.

[0105] When a user generates sorting conditions, the user sets the item values ​​of the sorting items corresponding to the image attribute information one by one while imagining the images they want to select. When there is multiple image attribute information, there may be dependencies between the attribute information, which may also result in dependencies between the sorting item settings. According to this embodiment, when a user generates sorting conditions for selecting images from multiple images, a sorting condition generation screen can be displayed in an easy-to-understand manner for each sorting type selected by the user. Therefore, according to this embodiment, the burden on the user when generating sorting conditions can be reduced.

[0106] The method of displaying priority items preferentially on the sorting condition generation screen is not limited to displaying them with an accordion menu open. Other methods, such as displaying priority items at the top of the sorting condition generation screen, changing the background color, or changing the font, may also be used. While the present embodiment describes information being managed in a table format, the method of managing information is not limited to the table format and may also be managed in other formats, such as JSON.

[0107] <Embodiment 2> In this embodiment, a method is described in which the image management device 101 displays an editing screen for editing the values ​​of the sorting items that make up the sorting conditions, thereby allowing the user to edit the saved sorting conditions. This embodiment will be described focusing on the differences from the first embodiment. Portions not specifically mentioned have the same configuration and processing as the first embodiment.

[0108] Fig. 15 is a flowchart showing the overall processing flow of the image management device 101 according to this embodiment. Fig. 15 is a diagram in which S404 in Fig. 4, which shows the overall processing of the first embodiment, is replaced with S1501. In S403, if the CPU 201 acquires an event instructing the user to generate or edit sorting conditions, the process proceeds to S1501. In S1501, the CPU 201 performs processing to generate or edit the sorting conditions.

[0109] Fig. 16 is a flowchart for explaining the details of the sorting condition generation or editing process executed in S1501 of Fig. 15. In the flowchart of Fig. 16, the same steps as those in the flowchart of Fig. 7 of the first embodiment are assigned the same numbers. Therefore, in explaining the flowchart of Fig. 16, steps that differ from the flowchart of Fig. 7 will be explained.

[0110] In S1601, the CPU 201 determines whether the event acquired in S402 of Fig. 15 is an event in which the user has instructed editing of sorting conditions or an event in which the user has instructed creation of sorting conditions. If the CPU 201 determines that an event in which the user has instructed creation of sorting conditions has been acquired, it performs the processing of S701 to S708 described above. However, it is assumed that the processing of S1607 is performed instead of the processing of S705. On the other hand, if the CPU 201 determines in S1601 that an event in which the user has instructed editing of sorting conditions has been acquired, it proceeds to S1602.

[0111] In S1602, the CPU 201 reads the sorting conditions instructed to be edited by the user. In the following steps, it is assumed that the user has instructed to edit the sorting conditions with the sorting condition ID "S112" stored in row 1105 of Fig. 11. In this case, in S1602, the CPU 201 reads the information stored in row 1105 of Fig. 11.

[0112] In step S1603, the CPU 201 acquires an ID value indicating the type of the sorting condition to be edited. For the sorting condition with the sorting condition ID "S112," the CPU 201 acquires "shooting_info" stored in the condition type ID column of row 1105 in FIG.

[0113] In S1604, the CPU 201 acquires the set sorting items and item values ​​for the sorting condition to be edited. The CPU 201 acquires the sorting item "Connected Camera" and its set item value "Cam B" from row 1105 in Fig. 11 as the set sorting item and item value for the sorting condition ID "S112". Similarly, the CPU 201 acquires "Image Type" and "RAW", and "Rating" and "1".

[0114] In S1605, the CPU 201 allows the acquired item values ​​to be assigned to the sorting condition editing screen.

[0115] In S1606, the CPU 201 obtains the value of the priority item associated with the condition type ID obtained in S1603 from the sorting condition type management table 600 of Fig. 6. The value of the condition type ID obtained in S1603 is "shooting_info". Therefore, the CPU 201 obtains "connected camera" as the priority item name from the priority item column of row 604 in which "shooting_info" is stored in the condition type ID column in the sorting condition type management table 600 of Fig. 6.

[0116] Furthermore, the CPU 201 acquires the sorting item name in which "display" is stored from the row (record) in the sorting condition type management table 600 in FIG. 6 in which the condition type ID acquired in S1603 is stored.

[0117] In S1607, the CPU 201 executes a process for displaying a sorting condition generation screen or a sorting condition editing screen.

[0118] Fig. 17 is a flowchart for explaining the details of the processing of S1607 in Fig. 16. The flowchart in Fig. 17 is a flowchart in which S1701 and S1702 are added to the flowchart in Fig. 8 of embodiment 1. Therefore, in explaining the flowchart in Fig. 17, steps that differ from the flowchart in Fig. 8 will be explained.

[0119] Because the CPU 201 acquired "Connected Camera" as the priority item name in S1606, the CPU 201 determines YES in S801 of Fig. 17 and performs processing of S802 and S803. In S802 and S803 of Fig. 17, the CPU 201 generates a sorting condition editing screen in which the setting area for the sorting item "Connected Camera," which is the priority item, is displayed open and the setting areas for the other sorting items are displayed closed. Then, processing proceeds to S1701.

[0120] In S1701, the CPU 201 determines whether there is a classification item for which an item value has been set. Since the CPU 201 has acquired the set item value in S1604, the CPU 201 determines that there is a classification item for which an item value has been set, and proceeds to S1702.

[0121] In S1702, the CPU 201 displays a setting completion mark 1803 (see FIG. 18) in the title area of ​​the sorting items "Connected Camera", "Image Type", and "Rating" for which item values ​​have been set, and ends the process.

[0122] Fig. 18 is a diagram showing an example of a sorting condition editing screen generated as a result of S1607 in Fig. 16. A sorting condition editing screen 1801 in Fig. 18 shows an example of a screen for editing the sorting condition with the sorting condition ID "S112" stored in row 1105 in Fig. 11.

[0123] As shown on the sorting condition editing screen 1801, the setting area 1802 for the priority item "Connected Camera" is displayed open. The setting areas for other sorting items that had the "Display" held in the sorting condition type management table 600 of Figure 6 are displayed closed. A set mark 1803 is displayed in the title areas of the sorting items "Connected Camera," "Image Type," and "Rating," for which item values ​​have already been set.

[0124] A sorting condition editing screen 1811 is an example of a screen that appears when the user presses the open / close button 1804 in the title area of ​​"Image Type" on the sorting condition editing screen 1801. When the "Image Type" setting area 1805 is displayed in an open state, as in the sorting condition editing screen 1811, the setting area 1805 is displayed with the already set item values ​​entered.

[0125] As described above, according to this embodiment, when editing the generated sorting conditions, the setting items corresponding to the sorting type are opened and displayed with the highest priority. Even when the window is closed, if there are any sorting items for which values ​​have been set, a mark is added, allowing the user to check the sorting items for which values ​​have been set. In this way, this embodiment can assist the user in editing the sorting conditions.

[0126] <Other embodiments> In the above-described embodiment, the case where there is one priority item has been described, but this is not limited to this. If there are multiple priority items, all of these items may be opened and displayed. Also, in the above-described embodiment, an example has been shown in which the sorting items and priority items corresponding to the type of sorting condition are managed using a sorting information management table, but this is not limited to this. The logic may also be implemented as program code for generating sorting conditions for the user.

[0127] The present disclosure can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0128] The disclosure of the above-described embodiment includes the following configurations.

[0129] (Configuration 1) a management means for managing each of the plurality of types in association with an item for sorting the images; an acquisition means for acquiring a type selected by a user from the plurality of types; a display control means for controlling the display of a screen for generating sorting conditions for sorting images, the screen allowing the user to specify values ​​of the items associated with the type selected by the user; An information processing device comprising:

[0130] (Configuration 2) There are multiple items for sorting images, The screen does not include any items other than the items associated with the type selected by the user among the plurality of items. 2. The information processing device according to configuration 1,

[0131] (Configuration 3) The management means managing priority items to be preferentially displayed on the screen among the items associated with the type, by further associating the priority items with the type; The display control means Controlling the display of the screen so that the priority items are displayed differently from items other than the priority items. 3. The information processing device according to configuration 1 or 2.

[0132] (Configuration 4) The display control means When the priority item is associated with the type selected by the user, a setting area in which the user can specify a value for the priority item among the multiple items associated with the type selected by the user is open; For items other than the priority items, the screen is controlled so that the setting area is closed. 4. The information processing device according to configuration 3.

[0133] (Configuration 5) The items included in the screen are displayed as an accordion menu, The display control means Control is performed so that the screen is displayed with the accordion menu closed for items other than the priority items among the plurality of items, and with the accordion menu open for the priority items. 5. The information processing device according to configuration 4.

[0134] (Configuration 6) The system further includes a generating unit for generating the sorting conditions configured by the items for which the user has specified values ​​via the screen. 6. The information processing device according to any one of configurations 1 to 5.

[0135] (Configuration 7) The system further includes a sorting condition management means for managing the type selected when the screen is displayed and the sorting conditions generated via the screen corresponding to the type in association with each other. 7. The information processing device according to configuration 6.

[0136] (Configuration 8) The display control means The information on the sorting conditions to be edited designated by the user is acquired, and an edit screen for editing the sorting conditions to be edited is displayed. 8. The information processing device according to configuration 7.

[0137] (Configuration 9) The display control means The type associated with the sorting condition to be edited is acquired from the sorting condition management means, and a priority item associated with the acquired type is acquired from the management means; Control is performed so that the edit screen is displayed in a state where a setting area for the priority item in which the user can specify a value is open, and in a state where the setting area for items other than the priority item is closed. 9. The information processing device according to configuration 8.

[0138] (Configuration 10) The sorting management means The sorting condition further manages values ​​designated by a user for each of the items constituting the sorting condition, The display control means Control is performed so that the edit screen is displayed with a predetermined mark added to the item for which a value has been specified. 10. The information processing device according to configuration 8 or 9.

[0139] (Configuration 11) a sorting means for sorting images that match the sorting conditions generated via the screen from among the images of a specific user; and a transfer means for transferring the sorted images to an external device. 11. The information processing device according to any one of configurations 1 to 10.

[0140] (Configuration 12) The display control means Controlling the display of the screen on a terminal via a network 12. The information processing device according to any one of configurations 1 to 11.

[0141] (Configuration 13) the display control means controls to display a second screen including areas corresponding to the plurality of types, and allowing a user to select one type from the plurality of types; The acquiring means acquires the type corresponding to the area selected by the user on the second screen. 13. The information processing device according to any one of configurations 1 to 12.

[0142] (Configuration 14) a management step of associating each of the plurality of types with an item for sorting the images and managing them; an acquisition step of acquiring a type selected by a user from the plurality of types; a display control step of controlling to display a screen for generating sorting conditions for sorting images, the screen allowing the user to specify values ​​of the items associated with the type selected by the user; An information processing method comprising:

[0143] (Configuration 15) 14. A program for causing a computer to execute each means of the information processing device according to any one of configurations 1 to 13. [Explanation of symbols]

[0144] 302 Sorting Condition Type Management Section 301 Input section 303 Screen display control unit

Claims

1. a management means for managing each of the plurality of types in association with an item for sorting the images; an acquisition means for acquiring a type selected by a user from the plurality of types; a display control means for controlling the display of a screen for generating sorting conditions for sorting images, the screen allowing the user to specify values ​​of the items associated with the type selected by the user; An information processing device comprising:

2. There are multiple items for sorting images, The screen does not include any items other than the items associated with the type selected by the user among the plurality of items.

2. The information processing apparatus according to claim 1, wherein:

3. The management means managing priority items to be preferentially displayed on the screen among the items associated with the type, by further associating the priority items with the type; The display control means Controlling the display of the screen so that the priority items are displayed differently from items other than the priority items.

2. The information processing apparatus according to claim 1, wherein:

4. The display control means When the priority item is associated with the type selected by the user, the screen is controlled so that, among the multiple items associated with the type selected by the user, a setting area in which the user can specify a value is open for the priority item, and the setting areas for items other than the priority item are closed.

4. The information processing apparatus according to claim 3,

5. The items included in the screen are displayed as an accordion menu, The display control means Control is performed so that the screen is displayed with the accordion menu closed for items other than the priority items among the plurality of items, and with the accordion menu open for the priority items.

5. The information processing apparatus according to claim 4,

6. The system further includes a generating unit for generating the sorting conditions configured by the items for which the user has specified values ​​via the screen.

2. The information processing apparatus according to claim 1, wherein:

7. The system further includes a sorting condition management means for managing the type selected when the screen is displayed and the sorting conditions generated via the screen corresponding to the type in association with each other.

7. The information processing apparatus according to claim 6,

8. The display control means Acquires information on the sorting conditions to be edited designated by the user, and controls display of an editing screen for editing the sorting conditions to be edited.

8. The information processing apparatus according to claim 7,

9. The display control means The type associated with the sorting condition to be edited is acquired from the sorting condition management means, priority items associated with the acquired type are acquired from the management means, and the editing screen is controlled so that a setting area in which a user specifies a value for the priority item is open and the setting areas for items other than the priority item are closed.

9. The information processing apparatus according to claim 8,

10. The sorting management means The sorting condition further manages values ​​designated by a user for each of the items constituting the sorting condition, The display control means Control is performed so that the edit screen is displayed with a predetermined mark added to the item for which a value has been specified.

9. The information processing apparatus according to claim 8,

11. a sorting means for sorting images that match the sorting conditions generated via the screen from among the images of a specific user; and a transfer means for transferring the sorted images to an external device.

2. The information processing apparatus according to claim 1, wherein:

12. The display control means Controlling the display of the screen on a terminal via a network 2. The information processing apparatus according to claim 1, wherein:

13. the display control means controls to display a second screen including areas corresponding to the plurality of types, and allowing a user to select one type from the plurality of types; The acquiring means acquires the type corresponding to the area selected by the user on the second screen.

2. The information processing apparatus according to claim 1, wherein:

14. a management step of associating each of the plurality of types with an item for sorting the images and managing them; an acquisition step of acquiring a type selected by a user from the plurality of types; a display control step of controlling to display a screen for generating sorting conditions for sorting images, the screen allowing the user to specify values ​​of the items associated with the type selected by the user; An information processing method comprising:

15. A program for causing a computer to execute each means of the information processing device according to any one of claims 1 to 13.

Citation Information

Patent Citations

  • Information extraction method and device, equipment and storage medium

    CN117877014A

  • Medical image display system

    JP2005085200A

  • Medical image display method and device

    JP2005251075A

  • Graphical user interface for expandable menus

    JP2006505025A

  • Device, method, and program for image arrangement

    JP2007272684A