Information processing device, information processing method, and information processing program

Abstract

According to the present invention, an information processing device that generates additional information for content managed by a content management system acquires input content and generates additional information, which is to be added to the input content, on the basis of an operation log of a user for the content management system.

Description

Information processing device, information processing method, and information processing program

[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing program.

[0002] Japanese Patent Application Laid-Open No. 2016-162423 discloses a technology for searching an image database for similar images that are similar to a target image for object recognition, and recognizing objects included in the target image based on tag information associated with the similar images obtained by the search.

[0003] In a content management system that manages content including images, videos, text data, and the like, additional information such as tag information is added to the managed content for purposes such as search and content classification. In this case, if each user adds additional information to the managed content without defining rules, variations in the additional information will occur. To suppress variations in the additional information, it is conceivable to have a limited number of users add the additional information, but this increases the workload of the users who add the additional information. It is also conceivable to define rules regarding the addition of additional information, but this would increase the burden on the users who define the rules and reduce the flexibility of the system.

[0004] The present disclosure has been made in consideration of the above circumstances, and aims to provide an information processing device, an information processing method, and an information processing program that can efficiently suppress the variation in additional information added to content.

[0005] A first aspect of the information processing device is an information processing device that has at least one processor and generates additional information for content managed by a content management system, in which the processor acquires input content and generates additional information to be added to the input content based on a user's operation log for the content management system.

[0006] In a second aspect of the information processing device, in the information processing device of the first aspect, the processor derives user information to be set for each user in the content management system based on the operation log, and generates additional information to be added to the input content based on the derived user information.

[0007] An information processing device of a third aspect is the information processing device of the second aspect, wherein the user information includes a degree of trust or proficiency of the user with respect to the content management system.

[0008] A fourth aspect of the information processing device is the information processing device of the third aspect, in which the processor extracts multiple pieces of additional information from the additional information added to content managed by the content management system based on the similarity with the input content or input information input by the user as additional information to be added to the input content, and generates additional information by selecting additional information to be added to the input content from the extracted multiple pieces of additional information based on the derived reliability or proficiency.

[0009] In the information processing device of a fifth aspect, in the information processing device of the fourth aspect, the processor presents the extracted plurality of pieces of additional information to the user, and selects additional information input by the user as additional information to be added to the input content.

[0010] An information processing device of a sixth aspect is the information processing device of the fifth aspect, wherein when presenting the extracted multiple pieces of additional information to the user, the processor varies the display manner of the multiple pieces of additional information based on the reliability or proficiency level.

[0011] An information processing device of a seventh aspect is the information processing device of the sixth aspect, wherein the processor increases or decreases the amount of additional information presented to the user as the reliability increases.

[0012] An information processing device according to an eighth aspect is the information processing device according to the sixth aspect, wherein the processor increases or decreases the amount of additional information presented to the user as the level of proficiency increases.

[0013] The information processing device of the ninth aspect is the information processing device of the sixth aspect, in which, when presenting a plurality of pieces of additional information to the user, the information processing device also presents content to which a plurality of pieces of additional information have been added.

[0014] In a tenth aspect of the information processing method, a processor of an information processing device that has at least one processor and generates additional information for content managed by a content management system acquires input content and performs a process of generating additional information to be added to the input content based on a user's operation log for the content management system.

[0015] An information processing program of an eleventh aspect has at least one processor, and causes a processor of an information processing device that generates additional information for content managed by a content management system to acquire input content and execute a process of generating additional information to be added to the input content based on a user's operation log for the content management system.

[0016] According to the present disclosure, it is possible to efficiently suppress variations in additional information added to content.

[0017] 1 is a block diagram showing an example of the configuration of a content management system; FIG. 2 is a block diagram showing an example of the hardware configuration of a server device; FIG. 3 is a diagram showing an example of user data; FIG. 4 is a diagram showing an example of additional information; FIG. 5 is a block diagram showing an example of the functional configuration of a server device; FIG. 6 is a diagram showing an example of an additional information presentation screen; FIG. 7 is a flowchart showing an example of additional information registration processing according to the first embodiment; FIG. 8 is a diagram showing an example of an additional information presentation screen according to a modified example; and FIG. 9 is a flowchart showing an example of additional information registration processing according to the second embodiment.

[0018] Hereinafter, examples of embodiments for carrying out the technology of the present disclosure will be described in detail with reference to the drawings.

[0019] First Embodiment First, with reference to FIG. 1 , the configuration of a content management system 10 according to this embodiment will be described. As shown in FIG. 1 , the content management system 10 includes a user terminal 12 used by a user and a server device 14. The user terminal 12 and the server device 14 are communicatively connected via a network. Examples of the user terminal 12 include a tablet computer and a personal computer. Examples of the server device 14 include a server computer and a cloud server. The server device 14 is an example of an information processing device according to the disclosed technology. In this embodiment, a case where images are used as an example of content managed by the content management system 10 will be described.

[0020] Next, the hardware configuration of the server device 14 according to the present embodiment will be described with reference to Fig. 2. As shown in Fig. 2, the server device 14 includes a CPU (Central Processing Unit) 20, a memory 21 as a temporary storage area, and a non-volatile storage unit 22. The server device 14 also includes a display 23 such as a liquid crystal display, an input device 24 such as a keyboard and a mouse, and a network I / F (Interface) 25 connected to a network. The CPU 20, the memory 21, the storage unit 22, the display 23, the input device 24, and the network I / F 25 are connected to a bus 27. The CPU 20 is an example of a processor according to the disclosed technology.

[0021] The storage unit 22 is realized by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or the like. The storage unit 22 serving as a storage medium stores an information processing program 30. The CPU 20 reads the information processing program 30 from the storage unit 22, loads it into the memory 21, and executes the loaded information processing program 30.

[0022] The storage unit 22 also stores user data 32, a plurality of images 34, a plurality of pieces of additional information 36, and master data 38.

[0023] The user data 32 includes information about users of the content management system 10. As shown in FIG. 3 as an example, in the user data 32, a user ID, which is an example of user identification information, is associated with a user name, reliability, etc. The reliability is the user's reliability with respect to the content management system 10. The reliability is an example of user information set for each user with respect to the content management system 10. In this embodiment, the reliability is expressed as a positive integer value in multiple stages, with the larger the value, the higher the reliability.

[0024] Each of the multiple images 34 is an image managed by the content management system 10. The multiple pieces of additional information 36 are information added to the images 34 and associated with the images 34 to which they are added. The additional information 36 is also called tag information. Examples of the additional information 36 include information describing objects appearing in the images 34, the date of shooting, the photographer, location information about the shooting location, and information about the shooting equipment. In this embodiment, the additional information 36 is information used to search for the images 34. As shown in FIG. 4 as an example, in the additional information 36 according to this embodiment, an attribute name indicating the classification of the additional information 36 is associated with an attribute value indicating the content. Note that multiple attribute values ​​may be associated with one attribute name.

[0025] The master data 38 is data that serves as a master for the additional information 36. The master data 38 includes all of the additional information 36. The additional information 36 is stored in association with the image 34 as information to be added to the image 34, but the master data 38 does not include information about which image 34 the additional information 36 is added to, and includes only the additional information 36. Note that the images 34 and the additional information 36 may also be associated with each other in the master data 38.

[0026] A user of the content management system 10 registers an image 34 and additional information 36 in the content management system 10. The user of the content management system 10 also searches for a target image from among the images 34 managed by the content management system 10. Operations performed by the user on the content management system 10 via the user terminal 12 are accumulated in the storage unit 22 as a user operation log for the content management system 10.

[0027] Next, the functional configuration of the server device 14 will be described with reference to Fig. 5. As shown in Fig. 5, the server device 14 includes an acquisition unit 40, a first derivation unit 42, an extraction unit 44, a presentation unit 46, a reception unit 48, a registration unit 50, and a second derivation unit 52. When the CPU 20 executes the information processing program 30, the server device 14 functions as the acquisition unit 40, the first derivation unit 42, the extraction unit 44, the presentation unit 46, the reception unit 48, the registration unit 50, and the second derivation unit 52.

[0028] The acquisition unit 40 acquires an input image. The user operates the user terminal 12 to upload an image stored in a storage device provided in the user terminal 12 to the server device 14 as an input image to which additional information 36 is to be added. This operation causes the input image to be transmitted from the user terminal 12 to the server device 14. The acquisition unit 40 acquires the input image transmitted from the user terminal 12 via the network I / F 25. For example, at the time of this upload, the user is logged in to the content management system 10, and the server device 14 can identify the user who uploaded the input image.

[0029] The input image may be an image 34 stored in the storage unit 22. For example, the user selects, via a content management screen, an image 34 to which additional information 36 is to be added. In this case, the acquisition unit 40 acquires the image 34 selected by the user from the storage unit 22 as an input image.

[0030] The first derivation unit 42 derives, by known processing, the similarity between the input image acquired by the acquisition unit 40 and each image 34 managed by the content management system 10. For example, the first derivation unit 42 vectorizes each of the input image and the image 34, and derives the similarity such that the shorter the distance between the vectors representing the input image and the image 34, the higher the degree of similarity.

[0031] The extraction unit 44 extracts multiple pieces of additional information 36 from the additional information 36 added to the images 34 managed by the content management system 10, based on the similarity derived by the first derivation unit 42. For example, the extraction unit 44 extracts multiple pieces of additional information 36 added to images 34 whose similarity is equal to or greater than a threshold from all of the additional information 36. The threshold in this case may be determined in advance through experiments or the like, or may be dynamically set so that the number of pieces of additional information 36 extracted is a numerical value within a target range.

[0032] The extraction unit 44 further extracts multiple pieces of additional information 36 from the extracted multiple pieces of additional information 36 by performing statistical analysis on the extracted multiple pieces of additional information 36. For example, the extraction unit 44 extracts a predetermined number of pieces of additional information 36 with high usage frequency. At this time, the extraction unit 44 may weight the additional information 36 so that the higher the similarity with the input image, the higher the usage frequency of the additional information 36 added to the image 34. At this time, the extraction unit 44 may weight the additional information 36 so that the higher the reliability of the user who added the additional information 36, the higher the usage frequency of the additional information 36 added to the image 34. At this time, the extraction unit 44 may weight the additional information 36 so that the more times the additional information 36 has been used in searches, the higher the usage frequency of the additional information 36 added to the image 34. Here, the usage frequency means, for example, the number of images 34 to which each piece of additional information 36 is added.

[0033] The presentation unit 46 presents the plurality of pieces of additional information 36 extracted by the extraction unit 44 to the user. For example, the presentation unit 46 generates display data for the plurality of pieces of additional information 36 extracted by the extraction unit 44 and transmits the data to the user terminal 12. When generating this display data, i.e., when presenting the plurality of pieces of additional information 36 to the user, the presentation unit 46 references the user data 32 and varies the display mode of the plurality of pieces of additional information 36 depending on the user's trustworthiness. Specifically, the presentation unit 46 presents fewer pieces of additional information 36 to the user as the user's trustworthiness increases. While details of the trustworthiness will be described later, a high user's trustworthiness indicates that the user is more likely to accept the additional information 36 presented by the server device 14. In other words, the presentation unit 46 presents fewer pieces of additional information 36 to the user as the user's trustworthiness increases, thereby making the additional information 36 easier for the user to view. As an example, as shown in FIG. 6 , an input image and multiple pieces of additional information 36 are displayed on the display of the user terminal 12. The presentation unit 46 may present a larger number of pieces of additional information 36 to the user as the user's trustworthiness increases. Whether the presentation unit 46 presents a larger or smaller number of pieces of additional information 36 to the user as the user's trustworthiness increases may be set by an administrator of the content management system 10 according to a policy.

[0034] The user inputs additional information 36 by selecting an item suitable for the input image from among the plurality of pieces of additional information 36 on the additional information presentation screen shown in Fig. 6. If there is no suitable item among the plurality of pieces of additional information 36, the user inputs new additional information 36 to be added to the input image.

[0035] The accepting unit 48 accepts additional information 36 input by the user. The registration unit 50 generates the additional information 36 accepted by the accepting unit 48 as additional information 36 to be added to the input image. That is, the registration unit 50 generates the additional information 36 by selecting the additional information 36 input by the user from the plurality of pieces of additional information 36 extracted by the extraction unit 44 as the additional information 36 to be added to the input image. The registration unit 50 then controls the storage unit 22 to associate the input image with the generated additional information 36, thereby registering the input image as an image 34 managed by the content management system 10. At this time, if the additional information 36 is newly input information and does not exist in the master data 38, the registration unit 50 adds the additional information 36 to the master data 38.

[0036] The second derivation unit 52 derives the user's trustworthiness with respect to the content management system 10 based on the user's operation log for the content management system 10. Specifically, when the user selects additional information 36 to be added to the input image from the plurality of pieces of additional information 36 presented by the presentation unit 46, the second derivation unit 52 refers to the user data 32 and updates the user's trustworthiness to a higher level by a predetermined degree. On the other hand, when the user inputs new additional information 36 without selecting the plurality of pieces of additional information 36 presented by the presentation unit 46, the second derivation unit 52 refers to the user data 32 and updates the user's trustworthiness to a lower level by a predetermined degree. Note that the second derivation unit 52 may update the trustworthiness every time the user inputs additional information 36. Alternatively, the second derivation unit 52 may update the trustworthiness when the user inputs additional information 36 a predetermined number of times.

[0037] Next, the operation of the server device 14 will be described with reference to Fig. 7. The CPU 20 executes the information processing program 30, thereby executing the additional information registration process shown in Fig. 7. The additional information registration process is executed, for example, when a user performs an operation to upload an input image to the server device 14 via the input device of the user terminal 12.

[0038] 7 , the acquisition unit 40 acquires an input image. In step S12, the first derivation unit 42 derives the similarity between the input image acquired in step S10 and each image 34 managed by the content management system 10, as described above. In step S14, the extraction unit 44 extracts multiple pieces of additional information 36 from the additional information 36 added to the images 34 managed by the content management system 10, based on the similarity derived in step S12, as described above. Furthermore, the extraction unit 44 extracts multiple pieces of additional information 36 from the extracted multiple pieces of additional information 36 by performing statistical analysis processing on the extracted multiple pieces of additional information 36, as described above.

[0039] In step S16, the presentation unit 46 presents the plurality of pieces of additional information 36 extracted in step S14 to the user, as described above. When presenting the plurality of pieces of additional information 36 to the user, the presentation unit 46 refers to the user data 32, as described above, and varies the display mode of the plurality of pieces of additional information 36 depending on the user's reliability. By the processing of step S16, the aforementioned additional information presentation screen is displayed on the display of the user terminal 12.

[0040] In step S18, the accepting unit 48 accepts the additional information 36 input by the user via the additional information presentation screen. In step S20, the registration unit 50 generates the additional information 36 accepted in step S18 as the additional information 36 to be added to the input image acquired in step S10. The registration unit 50 then controls the storage unit 22 to store the input image and the generated additional information 36 in association with each other, thereby registering the input image as an image 34 managed by the content management system 10.

[0041] In step S22, the second derivation unit 52 determines, based on the user's operation log for the content management system 10, whether the additional information 36 accepted in step S18 is information selected from the multiple pieces of additional information 36 presented to the user in step S16. If this determination is affirmative, the process proceeds to step S24. In step S24, the second derivation unit 52 references the user data 32 and updates the user's trustworthiness to a higher level by a predetermined amount. When the process of step S24 ends, the additional information registration process ends.

[0042] On the other hand, if the user newly inputs additional information 36, the determination in step S22 is negative, and the process proceeds to step S25. In step S25, the second derivation unit 52 determines whether the additional information 36 newly input by the user exists in the master data 38. If this determination is positive, the process proceeds to step S26. In step S26, the second derivation unit 52 references the user data 32 and updates the user's reliability to a lower level by a predetermined amount. When the process in step S26 ends, the additional information registration process ends. When the determination in step S25 is negative, the process proceeds to step S28. In step S28, the registration unit 50 adds the newly input additional information 36 by the user to the master data 38. When the process in step S28 ends, the additional information registration process ends.

[0043] As described above, according to this embodiment, the server device 14 presents candidates for additional information to the user, thereby reducing the variation in the additional information added to images. Furthermore, when the server device 14 presents candidates for additional information to the user, the server device 14 varies the display mode depending on the user's level of trust, allowing the user to efficiently input additional information. As a result, the variation in the additional information added to images can be efficiently reduced.

[0044] 8 , when presenting the plurality of pieces of additional information 36 to the user, the presenting unit 46 may also present the image 34 to which the plurality of pieces of additional information 36 have been added. This allows the user to input more appropriate additional information. When the reliability is equal to or less than a threshold, the presenting unit 46 may also present the image 34 to which the plurality of pieces of additional information 36 have been added.

[0045] Second Embodiment A second embodiment of the disclosed technology will be described. Note that the configuration of the content management system 10 (see FIG. 1) and the hardware configuration of the server device 14 (see FIG. 2) according to the second embodiment are the same as those of the first embodiment, and therefore description thereof will be omitted. In this embodiment, an example will be described in which a user's proficiency with the content management system 10 is applied as an example of user information set for each user in the content management system 10, instead of the reliability level used in the first embodiment.

[0046] In the user data 32 according to this embodiment, a user ID is associated with a user name, a level of proficiency, etc. The level of proficiency is the user's level of proficiency with the content management system 10. In this embodiment, the level of proficiency is expressed as a positive integer value in multiple stages, with the larger the value, the higher the level of proficiency.

[0047] Next, the functional configuration of the server device 14 according to this embodiment will be described with reference to FIG. 5. Functional units having the same functions as those of the server device 14 according to the first embodiment will be denoted by the same reference numerals and will not be described again. As shown in FIG. 5, the server device 14 includes an acquisition unit 40, a first derivation unit 42, an extraction unit 44, a presentation unit 46A, a reception unit 48, a registration unit 50, and a second derivation unit 52A. When the CPU 20 executes the information processing program 30, the server device 14 functions as the acquisition unit 40, the first derivation unit 42, the extraction unit 44, the presentation unit 46A, the reception unit 48, the registration unit 50, and the second derivation unit 52A.

[0048] The presentation unit 46A presents the plurality of pieces of additional information 36 extracted by the extraction unit 44 to the user. For example, the presentation unit 46A generates display data for the plurality of pieces of additional information 36 extracted by the extraction unit 44 and transmits the data to the user terminal 12. When generating this display data, i.e., when presenting the plurality of pieces of additional information 36 to the user, the presentation unit 46A references the user data 32 and varies the display mode of the plurality of pieces of additional information 36 depending on the user's proficiency level. Specifically, the presentation unit 46 presents fewer pieces of additional information 36 to the user as the user's proficiency level increases. As a result, an additional information presentation screen similar to that shown in FIG. 6 is displayed on the display of the user terminal 12. Note that the presentation unit 46 may present more pieces of additional information 36 to the user as the user's proficiency level increases. Whether the presentation unit 46 presents more or fewer pieces of additional information 36 to the user as the user's proficiency level increases may be set by an administrator of the content management system 10 according to a policy.

[0049] The second derivation unit 52A derives the user's proficiency level with the content management system 10 based on the user's operation log for the content management system 10. Specifically, if the time between the presentation unit 46A presenting the user with a plurality of pieces of additional information 36 and the user inputting the additional information 36 exceeds a predetermined time, the second derivation unit 52A refers to the user data 32 and updates the user's proficiency level to a lower level by a predetermined degree. Furthermore, if the time between the presentation unit 46A presenting the user with a plurality of pieces of additional information 36 and the user inputting the additional information 36 is equal to or shorter than a predetermined time, the second derivation unit 52A refers to the user data 32 and updates the user's proficiency level to a higher level by a predetermined degree. The second derivation unit 52A may update the user's proficiency level to a higher level as the number of times the user registers additional information 36 increases. Furthermore, the second derivation unit 52A may update the user's proficiency level to a higher level as the cumulative value of the user's operation time with the content management system 10 increases.

[0050] Next, the operation of the server device 14 will be described with reference to Fig. 9. The CPU 20 executes the information processing program 30 to execute the additional information registration process shown in Fig. 9. The additional information registration process is executed, for example, when a user performs an operation to upload an input image to the server device 14 via the input device of the user terminal 12. Note that steps in Fig. 9 that execute the same processes as those in Fig. 7 are assigned the same reference numerals, and their description will be omitted.

[0051] 9, the presentation unit 46A presents the plurality of pieces of additional information 36 extracted in step S14 to the user, as described above. When presenting the plurality of pieces of additional information 36 to the user, the presentation unit 46A refers to the user data 32, as described above, and varies the display mode of the plurality of pieces of additional information 36 depending on the user's level of proficiency.

[0052] In step S21, as described above, the second derivation unit 52A updates the user's proficiency level depending on the time from when the presenting unit 46A presents the plurality of pieces of additional information 36 to the user in step S16A to when the accepting unit 48 accepts the additional information 36 input by the user in step S18. When the processing of step S21 ends, the additional information registration process ends.

[0053] As described above, according to this embodiment, the server device 14 presents candidates for additional information to the user, thereby reducing the variation in the additional information added to images. Furthermore, when the server device 14 presents candidates for additional information to the user, the server device 14 varies the display mode depending on the user's level of proficiency, allowing the user to efficiently input additional information. As a result, the variation in the additional information added to images can be efficiently reduced.

[0054] In the second embodiment, when presenting the plurality of pieces of additional information 36 to the user, the presenting unit 46 may also present the image 34 to which the plurality of pieces of additional information 36 have been added. This allows the user to input more appropriate additional information. In this case, an additional information presentation screen similar to that shown in FIG. 8 is displayed on the display of the user terminal 12. When the proficiency level is equal to or lower than a threshold, the presenting unit 46 may also present the image 34 to which the plurality of pieces of additional information 36 have been added.

[0055] Furthermore, in the above-described embodiments, the presenting unit 46, 46A presents multiple pieces of additional information 36 to the user, and the user inputs the additional information 36. However, the disclosed technology is not limited to this configuration. For example, the registration unit 50 may generate the additional information 36 by selecting additional information 36 to be added to the input image from the multiple pieces of additional information 36 extracted by the extraction unit 44. In this case, the registration unit 50 may select the most frequently used additional information 36 from the multiple pieces of additional information 36 extracted by the extraction unit 44. In this case, the registration unit 50 may also select the most frequently used additional information 36 from the multiple pieces of additional information 36 extracted by the extraction unit 44. In this embodiment, the presenting unit 46, 46A may not present the multiple pieces of additional information 36.

[0056] In each of the above embodiments, a plurality of input images may be used. In this case, the registration unit 50 may generate the same additional information 36 for a group of input images having a similarity equal to or greater than a threshold value.

[0057] In each of the above embodiments, the acquisition unit 40 may acquire, together with the input image, input information input by the user as the additional information 36 to be added to the input image. In this case, the first derivation unit 42 may derive the similarity between the input information acquired by the acquisition unit 40 and the additional information 36 included in the master data 38 by a known process. In this case, a known index value representing the similarity between character strings, such as edit distance, may be applied as the similarity. In this case, the extraction unit 44 may extract, from all of the additional information 36, multiple pieces of additional information 36 whose similarity is equal to or greater than a threshold. In this case, the presentation unit 46, 46A, the reception unit 48, the registration unit 50, and the second derivation unit 52, 52A may function similarly to the above embodiments. In this case, the registration unit 50 may control the storage unit 22 to store, in association with the input image, the additional information 36 having the highest similarity to the input information, instead of the input information. In this case, since existing additional information 36 is used, variation in the additional information 36 can be suppressed. In this case, both the input image and the input information may be used.

[0058] In this case, the CPU 20 may present the user with additional information 36 as a correction candidate from among the additional information 36 previously added by the user, based on the user's operation log and input information. For example, the names of some objects change over time. In such a case, by presenting the user with additional information 36 including the past name of the most recent input information as a correction candidate, based on the most recent input information, it is possible to suppress variation in the additional information 36.

[0059] Furthermore, in each of the above embodiments, the first derivation unit 42 may derive a similarity between the input image and each piece of additional information 36. In this case, for example, the first derivation unit 42 maps the input image and the additional information 36 to the same vector space by inputting the input image and the additional information 36 into a trained model obtained by machine learning. Then, in this case, the first derivation unit 42 derives a similarity based on the distance between the input image and the additional information 36 mapped to the same vector space. In this case, the extraction unit 44, the presentation unit 46, 46A, the reception unit 48, the registration unit 50, and the second derivation unit 52, 52A may function in the same way as in each of the above embodiments.

[0060] In addition, in each of the above embodiments, the server device 14 may use an AI (Artificial Intelligence) model. For example, the server device 14 may use an AI model that receives an input image as input and outputs at least one of additional information 36 and a vector. In this case, the AI ​​model may be implemented as a single model or multiple models. For example, the extraction unit 44 inputs an input image to the AI ​​model. The AI ​​model outputs multiple pieces of additional information 36 corresponding to the input image. As a result, the extraction unit 44 extracts multiple pieces of additional information 36 from the additional information 36 added to the image 34 managed by the content management system 10. Furthermore, the CPU 20 may train the AI ​​model based on at least one of the additional information 36 and the user's selection results (i.e., operation log) for the multiple pieces of additional information 36 presented by the presentation unit 46.

[0061] In each of the above embodiments, the server device 14 may have a function to output a report. In this case, the CPU 20 may include in the report, as a report for the entire content management system 10, the increase in the number of pieces of additional information 36 based on the change history of the master data 38. Furthermore, for example, the CPU 20 may include in the report an index value indicating the degree to which the user accepted the additional information 36 presented by the presentation unit 46, 46A. This report is referenced by the administrator of the content management system 10.

[0062] The CPU 20 may also generate a report for each user. In this case, for example, the CPU 20 may include in the report an index value indicating the extent to which the additional information 36 added by the user has been used by other users. In this case, the CPU 20 may also include in the report a time series change in the additional information 36 added by the user to images 34 whose similarity is equal to or greater than a threshold.

[0063] Furthermore, in each of the above embodiments, the registration unit 50 may generate additional information 36 to be added to an input image based on the hierarchical structure of a folder in which the input image is stored in the user terminal 12, which is included in the user's operation log. For example, if the path of the folder in which the input image is stored in the user terminal 12 is "A\B\C," the registration unit 50 may generate additional information 36 called "A" as a major category, additional information 36 called "B" as a medium category, and additional information 36 called "C" as a minor category. In this case, the number of steps required to add additional information 36 when uploading a large number of input images stored in the user terminal 12 to the content management system 10 can be reduced. Furthermore, the registration unit 50 does not need to directly set "A," "B," and "C" in this embodiment as additional information 36. For example, the registration unit 50 may derive the similarity between each of "A," "B," and "C" and the additional information 36 included in the master data 38, and may select the additional information 36 that has the highest similarity to each of "A," "B," and "C" as the additional information 36 to be added to the input image.

[0064] Furthermore, in each of the above embodiments, the CPU 20 may refer to the master data 38 and integrate similar additional information 36. For example, the CPU 20 may integrate multiple pieces of additional information 36 whose similarity is equal to or greater than a threshold into any one piece of additional information 36 among the multiple pieces of additional information 36. In this case, the CPU 20 may integrate the multiple pieces of additional information 36 whose similarity is equal to or greater than a threshold into the additional information 36 that has been used most frequently in searches among the multiple pieces of additional information 36.

[0065] In this case, the CPU 20 may present to the user a plurality of pieces of additional information 36 whose similarity is equal to or greater than a threshold value. In this case, the CPU 20 may integrate the plurality of pieces of additional information 36 into one piece of additional information 36 selected by the user.

[0066] In addition, in the above-described embodiments, the additional information 36 is used to search for the image 34. However, the disclosed technology is not limited to this. For example, the additional information 36 may be information indicating the usage conditions of the image 34, such as the range of publication of the image 34, the medium on which the image 34 is published, the publication period of the image 34, the usage fee for the image 34, the usage form of the image 34, and whether the image 34 can be modified.

[0067] In this case, the CPU 20 may acquire the key additional information 36 input by the user. In this case, the CPU 20 may generate the additional information 36 in accordance with the acquired key additional information 36. For example, if the key additional information 36 input by the user is the name of the medium on which the image 34 is published, the CPU 20 may modify the additional information 36 including the same medium name into additional information 36 indicating the same usage conditions.

[0068] Furthermore, the CPU 20 may present to the user additional information 36 that is highly in need of change. For example, if the user changes the additional information 36 of multiple images 34 taken by a specific photographer, and there are images 34 taken by the same photographer whose additional information 36 the user has not changed, the CPU 20 may present those images 34 and their additional information 36 to the user.

[0069] In each of the above embodiments, the user terminal 12 may include at least some of the functional units included in the server device 14. The user terminal 12 and the server device 14 may be implemented by a single computer.

[0070] In each of the above embodiments, information indicating the user's preferences may be used as the user information instead of the reliability or proficiency.

[0071] Furthermore, in each of the above embodiments, the following various processors can be used as the hardware structure of a processing unit that executes various processes, such as each functional unit of the server device 14. As described above, the various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as a programmable logic device (PLD), such as an FPGA (Field Programmable Gate Array), whose circuit configuration can be changed after manufacture, a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor having a circuit configuration designed specifically for executing specific processes, and a GPU (Graphics Processing Unit).

[0072] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor.

[0073] Examples of configuring multiple processing units with a single processor include: first, a form in which one processor is configured with a combination of one or more CPUs and software, as typified by computers such as client and server computers, and this processor functions as multiple processing units; second, a form in which a processor is used to realize the functions of an entire system including multiple processing units with a single IC (Integrated Circuit) chip, as typified by systems on chips (SoCs); in this way, various processing units are configured using one or more of the above-mentioned various processors as a hardware structure.

[0074] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements.

[0075] In addition, in each of the above embodiments, the information processing program 30 is described as being pre-stored (installed) in the storage unit 22, but this is not limiting. The information processing program 30 may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory. The information processing program 30 may also be downloaded from an external device via a network.

[0076] The disclosure of Japanese Patent Application No. 2024-027472, filed on February 27, 2024, is incorporated herein by reference in its entirety. In addition, all documents, patent applications, and technical standards described herein are incorporated herein by reference to the same extent as if each individual document, patent application, and technical standard was specifically and individually indicated to be incorporated by reference.

Claims

1. An information processing device that has at least one processor and generates additional information for content managed by a content management system, wherein the processor acquires input content and generates additional information to be added to the input content based on a user's operation log for the content management system.

2. The information processing device according to claim 1, wherein the processor derives user information to be set for each user in the content management system based on the operation log, and generates additional information to be added to the input content based on the derived user information.

3. The information processing device according to claim 2, wherein the user information includes the user's level of trust or proficiency with the content management system.

4. The information processing device according to claim 3, wherein the processor extracts a plurality of pieces of additional information from the additional information added to the content managed by the content management system based on the similarity with the input content or the input information input by the user as additional information to be added to the input content, and generates additional information by selecting additional information to be added to the input content from the extracted plurality of pieces of additional information based on the derived reliability or proficiency.

5. The information processing device according to claim 4, wherein the processor presents the extracted plurality of pieces of additional information to the user, and selects the additional information input by the user as the additional information to be added to the input content.

6. The information processing device according to claim 5, wherein the processor, when presenting the extracted plurality of pieces of additional information to the user, varies the display manner of the plurality of pieces of additional information based on the reliability or the proficiency.

7. The information processing device according to claim 6, wherein the processor increases or decreases the amount of additional information presented to the user as the reliability increases.

8. The information processing device according to claim 6, wherein the processor increases or decreases the amount of additional information presented to the user as the level of proficiency increases.

9. The information processing device according to claim 6, wherein when presenting the plurality of pieces of additional information to the user, the information processing device also presents content to which the plurality of pieces of additional information have been added.

10. An information processing method comprising: an information processing device having at least one processor and generating additional information for content managed by a content management system; said processor acquiring input content; and generating additional information to be added to said input content based on a user's operation log for said content management system.

11. An information processing program for causing an information processing device having at least one processor and generating additional information for content managed by a content management system to execute the following process: acquire input content; and generate additional information to be added to the input content based on a user's operation log for the content management system.

Images