Information processing system and information processing method

Abstract

To reduce the time required for confirming right information included in video content.SOLUTION: An information processing system includes a storage unit, an analysis unit, a matching unit, and a task generation unit. The storage unit stores right information including information indicating the content of a right material included in video content, and a right holder name of the right material and use information of the right material. The analysis unit analyzes the video content. The matching unit collates a result of analyzing the video content with the right information, to obtain a matching result of the content of the right material. The task generation unit generates a task for processing the right information on the basis of the matching result.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] Embodiments of the present invention relate to an information processing system and an information processing method.

Background Art

[0002] Video content contains right information for various copyrighted materials (various materials that are subject to rights), and after the right information is generated, it has been conventional practice to reproduce the video content and check whether there is any discrepancy with the right information. For example, confirmation is performed as to whether the generated right information matches the content of the copyrighted material appearing in the video.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problem to be Solved by the Invention

[0004] However, with conventional techniques, it has been difficult to reduce the time required for checking right information included in video content.

Means for Solving the Problem

[0005] The information processing system of the embodiment comprises a storage unit, an analysis unit, a matching unit, and a task generation unit. The storage unit stores rights information including information indicating the content of rights materials included in video content, the name of the rights holder of the rights materials, and information on the use of the rights materials (primary use, multi-use use). The analysis unit analyzes the video content. The matching unit obtains a matching result for the content of the rights materials by comparing the analysis result of the video content with the rights information. The task generation unit generates a task for processing the rights information based on the matching result. [Brief explanation of the drawing]

[0006] [Figure 1] Figure 1 shows an example of the device configuration of the information processing system according to the first embodiment. [Figure 2] Figure 2 shows an example of the functional configuration of the information processing system according to the first embodiment. [Figure 3] Figure 3 shows an example of the analysis conditions for the first embodiment. [Figure 4] Figure 4 shows an example of a rights master according to the first embodiment. [Figure 5] Figure 5 shows an example of basic information for rights information in the first embodiment. [Figure 6] Figure 6 shows an example of detailed information regarding rights information in the first embodiment. [Figure 7] Figure 7 shows an example of content information in the first embodiment. [Figure 8] Figure 8 shows an example of data included in the content analysis results of the first embodiment. [Figure 9] Figure 9 shows a specific example of the content analysis results of the first embodiment. [Figure 10] Figure 10 shows an example of the matching results of the first embodiment. [Figure 11] Figure 11 shows an example of display information according to the first embodiment. [Figure 12] Figure 12 shows an example of the amended rights information in the first embodiment. [Figure 13] FIG. 13 is a flowchart illustrating an overview of the information processing method according to the first embodiment. [Figure 14] FIG. 14 is a flowchart illustrating a specific example of the information processing method according to the first embodiment. [Figure 15] FIG. 15 is a diagram for explaining information processing according to the second embodiment. [Figure 16] FIG. 16 is a diagram illustrating an example of right information according to the second embodiment. [Figure 17] FIG. 17 is a diagram illustrating an example of content analysis results according to the second embodiment. [Figure 18A] FIG. 18A is a diagram illustrating an example of a right master (portrait right) according to the second embodiment. [Figure 18B] FIG. 18B is a diagram illustrating an example of a right master (trademark / design) according to the second embodiment. [Figure 18C] FIG. 18C is a diagram illustrating an example of a right master (building) according to the second embodiment. [Figure 18D] FIG. 18D is a diagram illustrating an example of a right master (work of art) according to the second embodiment. [Figure 19] FIG. 19 is a diagram illustrating an example of right processing items according to the second embodiment. [Figure 20] FIG. 20 is a diagram illustrating an example of right processing tasks according to the second embodiment. [Figure 21] FIG. 21 is a flowchart illustrating an overview of the information processing method according to the second embodiment. [Figure 22A] FIG. 22A is a sequence diagram illustrating an example of the information processing method according to the second embodiment. [Figure 22B] FIG. 22B is a sequence diagram illustrating an example of the information processing method according to the second embodiment. [Figure 22C] FIG. 22C is a sequence diagram illustrating an example of the information processing method according to the second embodiment. [Figure 22D] FIG. 22D is a sequence diagram illustrating an example of the information processing method according to the second embodiment. [Figure 23]FIG. 23 is a diagram illustrating an example of the hardware configuration of the server device according to the first and second embodiments. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0007] Embodiments of an information processing system and an information processing method will be described in detail below with reference to the accompanying drawings.

[0008] (First Embodiment) First, an example of the device configuration and functional configuration of the information processing system 1 according to the first embodiment will be described.

[0009] [Example of Device Configuration and Functional Configuration] FIG. 1 is a diagram illustrating an example of the device configuration of the information processing system 1 according to the first embodiment. FIG. 2 is a diagram illustrating an example of the functional configuration of the information processing system according to the first embodiment.

[0010] The information processing system 1 according to the first embodiment includes a storage 10, an application server device 21, a video analysis server device 22, a task generation / matching server device 23, a database (DB: database) server device 24, and a cooperation server device 25. The storage 10 stores a plurality of video contents 101.

[0011] The application server device 21 includes an analysis condition / right master setting unit 201, a right information setting unit 202, a content information setting unit 203, and a display control unit 206. The video analysis server device 22 includes an analysis unit 204. The task generation / matching server device 23 includes a matching unit 205 and a task generation unit 207.

[0012] The database server device 24 includes an analysis condition / right master DB 301, a right information DB 302, a content information DB 303, a content analysis result DB 304, a matching result DB 305, and an analysis dictionary 306. The cooperation server device 25 includes an execution instruction unit 208.

[0013] Note that the example of the device configuration in Figure 1 is just one example, and the device configuration can be arbitrary. For example, the number of server devices can be arbitrary, and the above device configuration can be implemented with just one server device.

[0014] Next, the functional configurations of the information processing system 1 of the first embodiment will be described. The analysis conditions / rights master setting unit 201 sets the analysis conditions and rights masters to be stored in the analysis conditions / rights master DB 301.

[0015] Figure 3 shows an example of analysis conditions in the first embodiment. The analysis unit 204 detects a person, for example, when the object to be detected (detection target) is a person, using face recognition, text recognition, and voice recognition. As shown in Figure 3, the analysis conditions in the first embodiment detect copyrighted material based on analysis conditions set according to the object to be detected in the video content. The analysis conditions include various recognition techniques for appropriately detecting various detection targets. The analysis conditions are referenced by the analysis unit 204, the matching unit 205, and the task generation unit 207.

[0016] Figure 4 shows an example of a rights master in the first embodiment. The rights master in the first embodiment defines rights processing classifications as shown in Figure 4. Detection targets classified into each rights processing classification are detected by the recognition technology set by the analysis conditions in Figure 3 described above.

[0017] Returning to Figure 2, the rights information setting unit 202 manually sets the rights information stored in the rights information DB 302 in response to user input.

[0018] Figure 5 shows an example of basic rights information in the first embodiment. The basic rights information in the first embodiment includes the title of the video content 101, the broadcast date / scheduled date of the video content 101, the number of views of the video content 101, the person in charge, the contact information of the person in charge, the registrant, the contact information of the registrant, the person in charge of master recording, the contact information of the person in charge of master recording, the scope of master recording production, and the change history.

[0019] In the user interface example shown in Figure 5, "Broadcast Master Disc" is displayed as a button for proxy playback, while "Distribution Master Disc," "Videogram," and "Simultaneous Recording" are displayed as buttons for related proxy playback. "Broadcast Master Disc" is content prepared for terrestrial broadcasting. "Distribution Master Disc" is content prepared for distribution. "Videogram" is content prepared for sale on DVD / BD, etc.

[0020] "Simultaneous recording" refers to content that is a recording of the video actually being broadcast (on air). "Simultaneous recording" also includes information that is not included in the original broadcast master (for example, on-screen text or supers). In the case of private broadcasting stations, "simultaneous recording" may also include commercials that are broadcast in progress.

[0021] Furthermore, each video content 101 is managed as a single unit per master recording. For example, a single program's video content 101 may contain multiple content such as a "broadcast master recording," a "distribution master recording," and a "simultaneous recording." In the case of video content 101, if it is only broadcast on terrestrial television and not distributed, a "distribution master recording" may not exist.

[0022] Figure 6 shows an example of detailed rights information for the first embodiment. The detailed rights information for the first embodiment includes TC (Time Code) in, TC out, rights processing classification, rights material content, rights holder name, contact information, supplementary explanation, conditions, CU (Catch Up), simultaneous distribution, free distribution, paid distribution, rebroadcast, satellite broadcast, domestic distribution, international distribution, and videogram.

[0023] TC in indicates the start time of the appearance of the rights material included in video content 101. TC out indicates the end time of the appearance of the rights material included in video content 101. Rights processing classification indicates the classification of rights processing for the rights material. Rights material content indicates the content of the rights material. Rights holder name indicates the name of the rights holder of the rights material. Contact information indicates the contact information of the rights holder. Supplementary explanation is an explanation of the rights material subject to rights processing, and an explanation of the conditions for broadcasting, etc.

[0024] The conditions indicate whether or not there are conditions for multi-use. For example, "Yes" is indicated if all or any of the following usage types are present. CU, simultaneous distribution, free distribution, paid distribution, rebroadcast, satellite broadcasting, domestic distribution, international distribution, and videograms are examples of multi-use destinations for the rights material.

[0025] Returning to Figure 2, the content information setting unit 203 sets the content information to be stored in the content information DB 303.

[0026] Figure 7 shows an example of content information in the first embodiment. The content information in the first embodiment includes content type, broadcast date / distribution date, content name, episode number, person in charge, registrant, master recording 담당, master recording production scope, change history information, creation date, and video content file name.

[0027] The Content Type indicates the type of video content 101. The Broadcast / Distribution Date indicates the broadcast or distribution date of video content 101. The Content Name is the name of video content 101, such as the program name, program subtitle, or name of the footage used for filming. The Number of Broadcasts indicates the number of times video content 101 has been broadcast or distributed. The Responsible Person indicates the person responsible for video content 101. The Registrant indicates the registrant of the basic rights details for the content. The Master Recording Responsible Person indicates the person responsible for the master recording of video content 101. The Master Recording Production Scope indicates the production scope of the master recording for video content 101. The Change History Information shows the change history of the content information.

[0028] The creation date indicates the creation date of video content 101. The video content file name indicates the file name of video content 101. Note that the file for video content 101 may also be stored in the content information DB 303 along with the content information.

[0029] Returning to Figure 2, the analysis unit 204 refers to the content information DB 303 to identify the video content 101 to be analyzed, and based on the analysis conditions (Figure 3) and the analysis dictionary 306 described above, it detects the copyrighted material included in the video content 101.

[0030] The analysis dictionary 306 includes, for example, "name," "face image of the person," and "feature quantities of the person: information extracted from the face image" in the case of face recognition. For example, in object recognition, information about the object is included in the analysis dictionary 306. For example, in speech recognition, information about the song title, lyricist, composer, and lyrics is included in the analysis dictionary 306. For example, in scene recognition, information about various scenes such as sports scenes is included in the analysis dictionary 306. The analysis unit 204 stores the analysis results in the content analysis result DB 304.

[0031] Figure 8 shows an example of data included in the content analysis results of the first embodiment. For example, the analysis results by object recognition include information that identifies the range of one or more detection locations included in the video content 101 (start position to end position), a recognition degree indicating the likelihood of an object being detected at a detection location, and the object name of the object.

[0032] Figure 9 shows a specific example of the content analysis results of the first embodiment. In the example in Figure 9, for example, the first example of content analysis results includes the recognition result of the caption "Yokozuna XX" and the recognition result of face recognition.

[0033] Returning to Figure 2, the matching unit 205 checks (matches) whether the rights information created by the user (Figure 6) and the content analysis results (Figure 9) match. For example, the matching unit 205 performs the following matching and outputs the matching results.

[0034] ● Matching • Check if the classification and timing of the rights appear in the created rights information match. • Check the created rights information to ensure that video content 101 does not contain any other necessary rights information.

[0035] As described below, the scope of rights extends beyond the rights information displayed as credit titles such as end credits, to include a wide range of other things such as reflections of buildings, newspaper articles, and signs. As the multi-use of video content expands to include online distribution and other means, the work involved in rights processing is becoming more diverse and complex, and is expanding to a broader range of areas.

[0036] ●Types of rights and the targets of detection • Person (Facial recognition (person identification): Recognizing people in videos and photos) • Objects (buildings, mountains, cars, antiques, works of art, character plush toys, and logos, etc.) • Text overlays (strings of text related to articles, books, letters, people, objects, and music, as well as strings of text that identify scenes, etc.) • Audio (strings extracted from audio: speech recognition, and the voice of a specific person, etc.) • Scene (a specific scene, such as the scene where a home run is hit)

[0037] Specifically, the matching unit 205 compares the rights information (Figure 6) with the content analysis result data (Figure 8) to create a matching result. For example, if the rights information is performance permission information for performers, the matching unit 205 matches the performers in the rights information (Figure 6) with the performers detected through analysis of the video content 101, such as person information (names of people obtained from face recognition results), the display of performer names in the on-screen text, and the performer names in the audio, to determine if they match. The matching unit 205 stores the matching result in the matching result DB 305.

[0038] Figure 10 shows an example of the matching results of the first embodiment. The matching results of the first embodiment include TC in, TC out, rights processing classification, match result, overall match score, supplementary explanation, and support information. In the example in Figure 10, reference numerals 411 to 426 indicate the mismatch between the rights information created by the user (Figure 6) and the content analysis results (Figure 9).

[0039] The explanations of TC in, TC out, and rights processing classifications are the same as in Figure 6, so they are omitted here.

[0040] The matching result shows the matching result between the rights information (Figure 6) and the content analysis result (Figure 9). The matching result is determined based on the recognition result of rights materials included in the video content 101 and the timing of the appearance of said rights materials. For example, the matching unit 205 determines a match if the overall matching degree is 90% or higher, and a mismatch if the overall matching degree is less than 90%.

[0041] The overall match score is determined based on a recognition score of 1 or higher included in the content analysis results (Figure 9). For example, if the detection target is an object, the overall match score is determined by the average of the recognition scores for object recognition and the recognition scores for text recognition. Supplementary explanations are supplementary explanations of the matching results according to the analysis content, such as the overall match score and analysis status memos as shown in Figure 9, and are generated based on conditions pre-set in the matching unit 205. For example, supplementary explanations include information on the deficiencies or excesses of rights information for the video content 101. Support information is support information regarding the review of rights information. For example, support information is generated based on conditions pre-set in the matching unit 205.

[0042] Specifically, the matching results are obtained by matching methods such as those described below. • Matching whether the timing of the appearance of rights information (Figure 6) (TC in, TC out) matches the timing of the appearance of content analysis results (Figure 9). • Matching based on the degree of recognition of the person's name in the rights information (If the detected person is not the person in question, or if the person is not recognized, it is determined to be a mismatch). To identify rights information, the degree of matching is determined by a combination of criteria: object recognition (person recognition) and the degree of matching of the text information in the on-screen text (person's name in the case of a person). • If the analysis results indicate that a specific person can be detected (recognized as a subject of rights), but there is no setting in the rights information DB302, then it will be determined that there is no rights information in the rights information DB.

[0043] The display control unit 206 generates display information based on the matching results and displays the display information on the display unit 401. The display information includes information that visually indicates the degree of agreement of the rights information matching results in an easy-to-understand manner (e.g., symbols and marks), supplementary information, and support information.

[0044] For example, the displayed information includes the start and end positions in the rights information DB302, the start and end positions in the video content analysis results, the matching result, the overall matching degree, supplementary explanations, support information, and the recognition result from at least one recognition technology. This displayed information is confirmed, for example, by an operator. For example, by visually displaying the matching result with the rights information (Figure 6) in a comparative format on the display unit 401, the time required for rights-related work can be reduced.

[0045] Figure 11 shows an example of display information in the first embodiment. Figure 11 shows an example of display information based on the content analysis results in Figure 9 and the matching results in Figure 10. The display information in the first embodiment includes checkboxes, TC in, TC out, rights processing classification, rights material content, matching results (judgment and degree), analysis result information (image, analysis and recognition degree), and percentage display of appearance timing.

[0046] Furthermore, display areas 431-450 are highlighted to visually indicate discrepancies between the rights information and the content analysis results. For example, display areas 431-450 are displayed in red. For instance, in the rights information on the first line, the setting status of the rights information is shown above TC in / out, and the content analysis results are shown in red below to visualize the discrepancy. The differences may also be emphasized by changing the font and font weight of display areas 431-450.

[0047] The checkbox indicates whether or not to modify the rights information in the content analysis results by performing the correction. The rights information in rows where the checkbox is checked will be processed by the task generation unit 207 as a rights processing item subject to correction.

[0048] The TC in, TC out, rights processing classification, and rights material content are the same as in the detailed rights information (Figure 6), so the explanation is omitted.

[0049] The matching results (judgment and degree) show the match / mismatch determined by the threshold and the degree of agreement of the analysis results used for that judgment (the overall degree of agreement described above).

[0050] The analysis results information (Image, Analysis, and Recognition Score) shows the thumbnail image corresponding to the analysis result, the type of analysis, and the recognition score for that analysis.

[0051] The percentage display of appearance timing shows the timing at which rights information was detected as a percentage of the total content time, and is displayed as a bar for face recognition and object recognition, etc. For example, if there is a match (bar display 453 in the example in Figure 11), the bar display is shown in blue. If there is a mismatch (bar displays 452, 455, and 456 in the example in Figure 11), the bar display is shown in red. And if there is a partial mismatch (bar displays 451 and 454 in the example in Figure 11), the outline of the bar is displayed in red and the inside of the bar is displayed in blue.

[0052] Furthermore, the text recognition and speech recognition systems will use a format that makes it easy to visually identify the location, such as displaying the text string from the detected position. This text string display will, for example, use supplementary explanations corresponding to the overall matching degree mentioned above, and support information regarding the modification of the rights information.

[0053] Returning to Figure 2, the task generation unit 207 updates (corrects) the rights information in the matching results for any parts that need correction, in accordance with instructions from the operator or other user.

[0054] Figure 12 shows an example of corrected rights information in the first embodiment. The task generation unit 207 updates the rights information checked in the checkboxes included in the display information in Figure 11 based on the content analysis results. In the example in Figure 12, the information in display locations 461 to 469 is corrected based on the information included in the content analysis results.

[0055] Returning to Figure 2, the execution instruction unit 208 instructs external systems to perform rights processing, including coordination with external systems, using blockchain, WF (workflow), or email, etc., regarding the rights information DB 302.

[0056] [Examples of information processing methods] Figure 13 is a flowchart illustrating the information processing method of the first embodiment. First, the information processing system 1 imports the video content 101 into the storage 10 (step S1). Next, the content information setting unit 203 registers the content information of the video content 101 in the content information DB 303 (step S2).

[0057] Next, the rights information setting unit 202 sets the rights information to be stored in the rights information DB 302 in response to the user's input (step S3). Next, the matching unit 205 sets the rights information to be processed (processing item) (step S4). Next, the analysis unit 204 stores the analysis results generated by analyzing the video content 101 in the content analysis results DB 304 (step S5).

[0058] Next, the matching unit 205 matches the rights information (processing items) set in step S4 with the analysis results generated in step S5 (step S6). Next, the display control unit 206 displays the display information, including the matching results obtained in step S6, on the display unit 401 and accepts manual editing by the user (step S7). Manual editing by the user includes, for example, checking the checkboxes included in the display information in Figure 11 above.

[0059] Next, the task generation unit 207 executes a rights processing task to update (correct) the rights information in response to the manual editing in step S7 (step S8). Next, the task generation unit 207 registers the status of the rights processing task (step S9). The status of the rights processing task includes, for example, information indicating whether the rights processing task has been executed (executed / pending).

[0060] Figure 14 is a flowchart showing a specific example of the information processing method of the first embodiment. Steps S21 to S24 are the same as S1 to S3 and S5 in Figure 13, so their explanation is omitted. The matching unit 205 determines whether the rights information in the rights information DB 302 matches the analysis results in the content analysis results DB 304 (step S25). If they match (step S25, Yes), the matching unit 205 records the matching information in the matching results DB 305 (step S26).

[0061] If they do not match (Step S25, No), the matching unit 205 records the mismatch information in the matching result DB 305 (Step S27). The mismatch information also includes cases where the rights information corresponding to the rights material included in the analysis result does not exist in the rights information DB 302.

[0062] Next, the display control unit 206 displays the display information (Figure 11) based on the matching result on the display unit 401 (step S28). Next, the task generation unit 207 determines whether or not to correct the rights information (rights processing item) to be processed based on the check result of the check box included in the display information (Figure 11) (step S29). If the rights information is to be corrected (step S29, Yes), the task generation unit 207 corrects the rights information in the rights information DB 302 by executing a rights processing task that updates (corrects) the rights information according to the matching result (step S30). If the rights information is not to be corrected (step S29, No), the process proceeds to step S31.

[0063] Next, the execution instruction unit 208 determines whether or not to perform external linking of rights information in the rights information DB 302 (step S31). If external linking of rights information is to be performed (step S31, Yes), the execution instruction unit 208 performs the external linking using blockchain, WF, email, etc. (step S32), and returns to step S21. If external linking of rights information is not to be performed (step S31, No), the process returns to step S21.

[0064] As described above, in the information processing system 1 of the first embodiment, the storage unit (rights information DB 302) stores rights information including information indicating the content of the rights material included in the video content 101, the name of the rights holder of the rights material, and information on the use of the rights material (primary use, multi-use use). The analysis unit 204 analyzes the video content 101. The matching unit 205 obtains a matching result for the content of the rights material by comparing the analysis result of the video content 101 with the rights information in the rights information DB 302. Then, the task generation unit 207 generates a task to process the rights information based on the matching result.

[0065] As a result, according to the information processing system 1 of the first embodiment, the time required to verify rights information contained in the video content 101 can be reduced. For example, rights processing such as contract and licensing management is performed on rights materials contained in the video content 101. According to the information processing system 1 of the first embodiment, the matching results of the analysis results of the video content 101 and the rights information in the pre-set rights information DB 302 can be verified, thus reducing the time required for matching work.

[0066] Furthermore, the display control unit 206 displays on the display unit 401 display information that clearly indicates the difference between the rights information and the analysis results of the video content, based on the matching results. The display control unit 206 then accepts an operation input specifying whether or not to correct the difference for each piece of rights material based on the analysis results of the video content 101. The task generation unit 207 generates a task to update the rights information of the rights material for which the specification has been received.

[0067] As a result, according to the information processing system 1 of the first embodiment, the specified rights information can be corrected, thus reducing the time required for the review process.

[0068] (Second Embodiment) Next, a second embodiment will be described. In the description of the second embodiment, explanations similar to those of the first embodiment will be omitted, and the differences from the first embodiment will be explained. In the second embodiment, the operation for automatically generating rights processing items will be described.

[0069] The rights information for video content 101 is assigned as metadata to video content 101 itself or to each of the multiple scenes that make up video content 101. The various rights and their owners that exist in video content 101 are diverse. Furthermore, the uses of video content 101 are becoming more complex, and by efficiently implementing and managing comprehensive and reliable rights processing, the time required to verify the rights information contained in video content 101 can be reduced.

[0070] The device configuration of the information processing system 1 in the second embodiment is the same as that shown in Figure 1 of the first embodiment, so its explanation will be omitted.

[0071] Figure 15 is a diagram illustrating the information processing of the second embodiment. The rights information setting unit 202 receives usage conditions for the video content 101 stored in the storage 10 from the user and stores the rights information corresponding to the usage conditions in the rights information DB 302. The analysis unit 204 analyzes the video content 101 to recognize people, objects, captions, music, voiceprints, scenes, designs, trademarks, etc. contained in the video content 101. The analysis results by the analysis unit 204 are stored in the content analysis results DB 304.

[0072] The task generation unit 207 generates rights processing items by comparing the content analysis result DB 304 with the rights information DB 302, and by comparing the content analysis result DB 304 with the rights master DB 301. Then, the task generation unit 207 generates rights processing tasks by merging these rights processing items.

[0073] The execution instruction unit 208 requests the display control unit 206 to display the rights processing task, allowing the user to confirm it on the display unit 401. The execution instruction unit 208 also registers the status of the rights processing task (executed / pending, etc.). The external system 500, in response to the instructions from the execution instruction unit 208, instructs the external system to link via blockchain, WF, or email, etc., and registers the status of the rights processing task in the external system (executed / pending, etc.) with the execution instruction unit 208.

[0074] Figure 16 shows an example of rights information in the second embodiment. The rights information stored in the rights information DB302 of the second embodiment includes content name, summary, rights holder name, contact information, special notes, terrestrial broadcast, rebroadcast, program sales, simultaneous distribution, and videogram.

[0075] The content name is the name of video content 101. The summary is a summary of video content 101. The rights holder name is the name of the rights holder of video content 101. The contact information is the contact information of the rights holder. The special notes are any special notes regarding the terms of use of video content 101. For terrestrial broadcasting, rebroadcasts, program sales, simultaneous distribution, and videograms, the presence or absence of permission for use (〇: permitted, -: not permitted) is indicated.

[0076] Figure 17 shows an example of content analysis results in the second embodiment. The content analysis results stored in the content analysis results DB304 of the second embodiment include TC in, TC out, analysis type, and analysis results. TC in and TC out are the same as described in the first embodiment. The analysis type indicates the type of analysis process and corresponds to the rights type defined in the rights master DB301. The rights master may include not only the subjects of rights processing but also subjects that do not require rights processing (e.g., Creative Commons licenses and public domain). The analysis results show the analysis results according to the analysis type (e.g., names, company logos, and song titles).

[0077] Figure 18A shows an example of a rights master (portrait rights) in the second embodiment. The portrait rights rights master stored in the rights master DB301 of the second embodiment includes the person's name, group name, office, type, applicable country / state, rights holder, contact information, and remarks. The person's name is the name of the person who holds the portrait rights. The group name is the name of the group to which the person who holds the portrait rights belongs. The office is the office to which the person or group who holds the portrait rights belongs. The type indicates the type based on whether rights processing is required or not; here, "Required" indicates that rights processing for portrait rights is required, and "Not Required" indicates that rights processing for portrait rights is not required. Note that Creative Commons licenses and public domain rights, etc., which do not require any judgment and therefore do not require rights processing, may be indicated as "CC" or "PD," for example. The applicable country / state indicates the country / state to which the portrait rights apply. The rights holder indicates the rights holder of the portrait rights. The contact information indicates the contact information of the rights holder. The remarks are additional notes regarding portrait rights.

[0078] Figure 18B shows an example of a rights master (trademark / design) in the second embodiment. The trademark / design rights master stored in the rights master DB301 of the second embodiment includes the design / trademark name, type, applicable country / state, rights holder, contact information, and remarks. The design / trademark name is the name of the design / trademark. The type, applicable country / state, rights holder, contact information, and remarks are the same as described in Figure 18A.

[0079] Figure 18C shows an example of a rights master (building) in the second embodiment. The rights master for a building stored in the rights master DB301 of the second embodiment includes the building name, type, applicable country / state, rights holder, contact information, and remarks. The building name is the name of the building. The type, applicable country / state, rights holder, contact information, and remarks are the same as described in Figure 18A.

[0080] Figure 18D shows an example of a rights master (artwork) in the second embodiment. The rights master for artwork stored in the rights master DB301 of the second embodiment includes the artwork name, type, applicable country / state, rights holder, contact information, and remarks. The artwork name is the name of the artwork. The type, applicable country / state, rights holder, contact information, and remarks are the same as described in Figure 18A.

[0081] Figure 19 shows an example of a rights processing item in the second embodiment. The rights processing item in the second embodiment includes ID (identifier), TC in, TC out, analysis type, rights material, rights holder name, contact information, remarks, terrestrial broadcast, rebroadcast, program sales, simultaneous distribution, and videogram. ID is information that identifies the rights processing item. TC in, TC out, and analysis type are the same as described in the content analysis results (Figure 17). Rights material corresponds to the analysis results in Figure 17 (e.g., name, company logo, and song title). Rights holder name, contact information, remarks, terrestrial broadcast, rebroadcast, program sales, simultaneous distribution, and videogram are the same as described above.

[0082] Figure 20 shows an example of a rights processing task in the second embodiment. The example in Figure 20 shows a rights processing task in which rights processing items for the portrait rights of "○○ ××" included in video content 101 are merged. Processing Request indicates the date on which processing of the rights processing item was requested. Processed indicates the date on which the rights processing item was processed.

[0083] Figure 21 is a flowchart outlining the information processing method of the second embodiment. Steps S41 to S44, S48 and S49 are the same as steps S1 to S3, S5, S8 and S9 of the information processing method of the first embodiment, so their explanation is omitted. The explanation of Figure 21 will describe the automatic generation process of rights processing items.

[0084] The task generation unit 207 compares the rights information contained in the content analysis result DB 304 with the rights master DB 301 (step S45). Next, the task generation unit 207 generates rights processing items for processing the rights information (step S46). That is, the task generation unit 207 automatically generates rights processing items from the rights materials contained in the video content 101 that exist in the rights master DB 301.

[0085] Next, the task generation unit 207 performs a merge process of rights processing items, as shown in Figure 20, for example, to generate a rights processing task (step S47). That is, if multiple rights processing items are generated, the task generation unit 207 merges rights processing items of the same rights material into a single rights processing task.

[0086] Figures 22A to 22D are sequence diagrams showing an example of the information processing method of the second embodiment. First, the rights information setting unit 202 receives the setting of usage conditions for the video content 101 stored in the storage 10 from the user and stores the rights information corresponding to the setting of usage conditions in the rights information DB 302 (step S61). Next, the rights information setting unit 202 determines whether the video content 101 is for multi-use or not (step S62). Whether the video content 101 is for multi-use or not is determined by whether the video content 101 is already registered in the content information DB 303. If the video content 101 is for multi-use (step S62, Yes), the process proceeds to step S73.

[0087] <If not for multi-use> If the video content 101 is not for multi-use (step S62, No), that is, if the video content 101 is not registered in the content information DB 303, the video content 101 is registered in the content information DB 303 (step S63).

[0088] Next, the analysis unit 204 acquires the video content 101 from the storage 10 (step S64) and analyzes the video content 101 (step S65). Next, the task generation unit 207 compares the content analysis result DB 304 with the rights master DB 301 and determines whether or not there is corresponding rights information in the rights master DB 301 (step S66). For rights materials for which there is no corresponding rights information in the rights master DB 301 (step S66, No), the process is carried out in step S71.

[0089] <If there is relevant rights information in Rights Master DB301> For rights materials for which there is corresponding rights information in the rights master DB301 (step S66, Yes), the task generation unit 207 generates a rights processing item for which rights processing is performed on the rights material (step S67). Next, the task generation unit 207 determines whether or not a rights processing item for the same rights subject already exists (step S68).

[0090] If there are rights processing items with the same rights subject (Step S69, Yes), the task generation unit 207 performs a merge process (Step S69) as shown in Figure 20, for example, and generates a rights processing task (Step S70). If there are no rights processing items with the same rights subject (Step S69, No), the task generation unit 207 generates a rights processing task without performing a merge process (Step S70).

[0091] <If no corresponding rights information is found in Rights Master DB301> The task generation unit 207 generates a list of candidate rights processing targets (step S71). Next, the task generation unit 207 generates rights processing items in response to user input on the candidate rights processing list (step S72).

[0092] Furthermore, if the rights processing item generation process in step S72 is a general-purpose process, the rights information corresponding to that rights processing item is registered in the rights master DB301. This allows the generation process of the rights processing item for that rights information to be automated by the process in step S67 from the next rights processing onward.

[0093] <Display and verification process for rights management tasks> The execution instruction unit 208 displays the rights processing task generated by the processing in step S70 on the display unit 401 via the display control unit 206, allowing the user to confirm the rights processing task (step S74). Next, the execution instruction unit 208 determines whether or not there is external linkage of rights information included in the rights processing task (step S75).

[0094] If there is external integration (Step S75, Yes), the execution instruction unit 208 executes external integration via blockchain, WF, or email, etc. (Step S76), registers the status of the rights processing task (executed / pending, etc.) (Step S77), and terminates the process. If there is no external integration (Step S75, No), the system registers the status of the rights processing task (executed / pending, etc.) without executing external integration (Step S77), and terminates the process.

[0095] <If it is for multi-use> The task generation unit 207 compares the usage conditions in multi-use with the rights information DB 302 to determine whether any new rights processing is required (step S73). If new rights processing is required (step S73, Yes), the process proceeds to step S66; if no new rights processing is required (step S73, No), the process ends.

[0096] As explained above, the information processing system 1 of the second embodiment can generate rights processing items with high accuracy and high granularity by utilizing recognition technologies such as AI. Furthermore, the information processing system 1 of the second embodiment generates rights processing tasks, which are execution units, by merging high-granularity rights processing items for each identical rights material. This makes it possible to improve the efficiency of rights processing operations and the management of rights information.

[0097] Finally, examples of the hardware configuration of the information processing system 1 in the first and second embodiments will be described.

[0098] [Example hardware configuration] Figure 23 shows examples of the hardware configurations of server devices (application server device 21, video analysis server device 22, task generation / matching server device 23, database server device 24, and interoperability server device 25) according to the first and second embodiments. The server device comprises a processor 501, main memory 502, auxiliary storage device 503, display device 504, input device 505, and communication device 506. The processor 501, main memory 502, auxiliary storage device 503, display device 504, input device 505, and communication device 506 are connected via a bus 510.

[0099] Furthermore, the server device may not be equipped with some of the above-described components. For example, if the server device can utilize the input and display functions of an external device, the server device may not be equipped with the display device 504 and the input device 505.

[0100] The processor 501 executes the program read from the auxiliary storage device 503 into the main memory 502. The main memory 502 is memory such as ROM (Read Only Memory) and RAM (Random Access Memory). The auxiliary storage device 503 is such as an HDD (Hard Disk Drive) and a memory card.

[0101] The display device 504 is, for example, a liquid crystal display. The input device 505 is an interface for operating the server device. The display device 504 and the input device 505 may be implemented by a touch panel or the like that has both display and input functions. The communication device 506 is an interface for communicating with other devices.

[0102] For example, a program executed on a server device is provided as a computer program product, recorded in an installable or executable file format on a computer-readable storage medium such as a memory card, hard disk, CD-RW, CD-ROM, CD-R, DVD-RAM, or DVD-R.

[0103] Alternatively, for example, a program executed on a server device may be stored on a computer connected to a network such as the Internet, and provided by allowing users to download it via the network.

[0104] Alternatively, the system may be configured to provide programs that run on a server device via a network such as the Internet, without requiring users to download them. Specifically, this could be configured using, for example, an ASP (Application Service Provider) type cloud service.

[0105] Alternatively, for example, the server device program may be pre-installed and provided in ROM or similar media.

[0106] The program executed on the server device has a modular configuration that includes functions that can also be implemented by the program, as described above. In actual hardware terms, each of these functions is loaded onto the main memory 502 by the processor 501 reading and executing the program from the storage medium. In other words, each of the above function blocks is generated on the main memory 502.

[0107] Furthermore, some or all of the above-mentioned functions may be implemented using hardware such as an IC (Integrated Circuit) instead of software.

[0108] Alternatively, each function may be implemented using multiple processors 501, in which case each processor 501 may implement one of the functions, or two or more of the functions.

[0109] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of Symbols]

[0110] 1. Information Processing System 10 storage 21 Application Server Device 22 Video Analysis Server Device 23 Task Generation and Matching Server Device 24 Database Server Device 25. Interconnected Server Device 201 Analysis Conditions / Rights Master Setting Section 202 Rights Information Setting Department 203 Content Information Setting Section 204 Analysis Department 205 Matching Department 206 Display Control Unit 207 Task Generation Unit 208 Execution Instruction Unit 301 Analysis Conditions / Rights Master Database 302 Rights Information Database 303 Content Information Database 304 Content Analysis Results Database 305 Matching Results DB 306 Analysis Dictionary 401 Display section 501 Processor 502 Main storage 503 Auxiliary storage 504 Display device 505 Input device 506 Communication equipment 510 Bus

Claims

1. A storage unit that stores rights information including information indicating the content of rights materials included in video content, the name of the rights holder of the rights materials, and information on the use of the rights materials, An analysis unit for analyzing the aforementioned video content, A matching unit obtains a matching result for the content of the rights material by comparing the analysis results of the video content with the rights information. The system includes a task generation unit that generates a task for processing the rights information based on the matching results, The analysis unit detects the rights-bearing material based on analysis conditions set according to the target to be detected in the video content. Information processing system.

2. The aforementioned analysis conditions include at least one recognition technique from face recognition, object recognition, text recognition, speech recognition, and scene recognition. The information processing system according to claim 1.

3. The matching result includes at least a match result determined based on the recognition result of the at least one recognition technology. The information processing system according to claim 2.

4. The matching unit determines that any rights-bearing material present in the analysis results of the video content but not in the rights information is a mismatch. The information processing system according to claim 3.

5. The system further includes a display control unit that displays on the display unit display information indicating the difference between the rights information and the analysis results of the video content based on the matching results, The display control unit receives an operation input specifying whether or not to correct the differences for each piece of copyrighted material based on the analysis results of the video content. The task generation unit generates a task to update the rights information of the rights material for which the designation has been received. The information processing system according to claim 3 or 4.

6. The aforementioned rights information further includes the starting position of the rights material and the ending position of the rights material, The matching unit verifies whether the start position and end position in the rights information match the start position and end position in the analysis results of the video content. The display information includes the start and end positions in the rights information, the start and end positions in the analysis results of the video content, the matching results, and the recognition results by the at least one recognition technology. The information processing system according to claim 5.

7. The memory unit further stores a rights master that identifies the rights material, The task generation unit compares the analysis results of the video content with the rights master and automatically generates rights processing items from the rights materials included in the video content that exist in the rights master. The information processing system according to claim 1.

8. The task generation unit, when multiple rights processing items are generated, merges rights processing items of the same rights material into a single rights processing task. The information processing system according to claim 7.

9. The information processing system stores rights information including information indicating the content of rights materials included in video content, the name of the rights holder of the rights materials, and information on the use of the rights materials. The information processing system includes the step of analyzing the video content, The information processing system obtains a matching result for the content of the rights material by comparing the analysis result of the video content with the rights information. The information processing system includes the step of generating a task for processing the rights information based on the matching result, The aforementioned analysis step involves detecting the rights-bearing material based on analysis conditions set according to the target to be detected in the video content. Information processing methods.

Images