Video management device, video management method, and video management program

Abstract

A video management device (10) comprises an input unit (11), a video stop processing unit (12), a stop time acquisition unit (13), a comment reception unit (14), a target object identification unit (15a), a target object coordinate acquisition unit (15b), and a storage unit (18). The video stop processing unit (12) stops the reproduction of a video at a timing when the input unit (11) receives an input. The stop time acquisition unit (13) acquires the stop time at which the video was stopped. The target object identification unit (15a) identifies a target object to which a comment included in the video stopped by the video stop processing unit (12) is attached. The target object coordinate acquisition unit (15b) acquires the coordinates of the target object identified by the target object identification unit (15a). The storage unit (18) stores the received comment in association with the stop time and with the coordinates of the target object.

Description

Video management device, video management method, and video management program

[0001] The present invention relates to a video management device, a video management method, and a video management program for managing videos.

[0002] In recent years, in a captured video, when a user wants to indicate a specific situation, an event that jumps to a specified video time can be created. When the user wants to share a specific situation with another user, by creating and sharing this event, the other shared user can easily confirm the situation without operating the video.

[0003] For example, in Patent Document 1, position information of a tracking object in a plurality of past frames is stored, a predicted position of the tracking object in the current frame is obtained based on the stored position information of the tracking object in the plurality of past frames, a candidate object having a predetermined feature peculiar to the tracking object is extracted from the image data in the current frame, and the extracted candidate object closer to the predicted position is assigned as the tracking object. A moving object tracking method is disclosed.

[0004] Japanese Patent Application Laid-Open No. 2004-46647

[0005] However, the above conventional moving object tracking method has the following problems. That is, although the moving object tracking method disclosed in the above publication can clarify the object on the video, it requires complicated processing and is difficult to show fine details. Also, it was not possible to efficiently confirm the comments attached to the video at a desired timing for the objects (people, things) appearing in the video.

[0006] An object of the present invention is to provide a video management device, a video management method, and a video management program that can reduce the load when attaching comments to objects such as people and things included in a video and visually show the object and the comment when playing the video with the comment attached.

[0007] (Means for solving the problem) The video management device according to the first invention is a video management device that manages videos including input comments, and comprises an input unit, a video stop processing unit, a stop time acquisition unit, a comment reception unit, an object identification unit, an object coordinate acquisition unit, and a storage unit. The input unit receives various inputs for the video. The video stop processing unit stops the playback of the video at the timing when it receives input in the input unit. The stop time acquisition unit acquires the stop time of the video stopped by the video stop processing unit. The comment reception unit receives input of comments for the video. The object identification unit identifies the object to which the comment is attached, which is included in the video stopped by the video stop processing unit. The object coordinate acquisition unit acquires the coordinates of the object identified by the object identification unit. The storage unit stores the comments received by the comment reception unit in association with the stop time and the coordinates of the object.

[0008] Here, in a video management device that manages videos including comments entered into videos taken in places such as educational settings, sports event venues, and construction sites, the user-entered comments are saved in association with the pause time of the video to which the comment was entered and the coordinates of the object to which the comment was attached. Here, the video taken in an educational setting, etc., may be a single video taken with one camera, or it may be multiple videos taken with multiple cameras.

[0009] This reduces the burden of comment input, for example, when adding comments on students or players appearing in videos filmed in educational settings, as it eliminates the need to describe the subjects (students, etc.) in the comments. Furthermore, when sharing videos with comments on students or players appearing in educational settings, users can view the comments while checking the subjects and content of the comments as needed.

[0010] As a result, the burden of adding comments to people, objects, and other subjects included in a video is reduced, and the subjects and comments can be visually displayed when the video with comments is played.

[0011] The video management device according to the second invention is the video management device according to the first invention, further comprising a display control unit that controls the display of a predetermined mark indicating an object and a comment in the video when the video playback is paused. As a result, users watching a video with comments can easily check the content of the comments by tapping the marks and comments displayed while watching the video.

[0012] The video management device according to the third invention is a video management device according to the first or second invention, wherein the video includes multiple videos captured by multiple cameras. This allows users to view multiple videos captured using multiple cameras installed in educational settings, sports facilities, construction sites, etc., while checking the subject and content of comments as needed.

[0013] The video management device according to the fourth invention is the video management device according to the third invention, further comprising a time axis adjustment unit for adjusting the time axes of multiple videos during playback. Here, the adjustment of the time axes of multiple videos during playback may be adjusted so that the multiple videos have the same time axis, or they may be adjusted so that they have different time axes. By adjusting the time axes of multiple videos shot using multiple cameras during playback, it is possible to play videos appropriately according to the user's preferences and the type of video.

[0014] The video management device according to the fifth invention is the video management device according to the second invention, wherein the display control unit associates and displays comments and marks attached to a video in the same color. As a result, even if there are multiple marks or comments displayed while the video is playing, the related comments and marks are displayed in the same color, so the user can easily recognize which mark (object) is related to which comment.

[0015] The video management device according to the sixth invention is a video management device according to the first or second invention, further comprising a comment search unit for searching for comments attached to a video. This makes it possible to search for and confirm related comments even when, for example, multiple comments are attached to an object such as a person or thing in the video, thereby avoiding overlooking relevant comments.

[0016] The video management device according to the seventh invention is the video management device according to the sixth invention, wherein the comment search unit searches for any related comments around the coordinates of the video tapped by the user when there are multiple comments attached to the video. This makes it possible to efficiently search for and check multiple related comments attached to the same object (person or thing) in the video being played.

[0017] The video management device according to the eighth invention is the video management device according to the sixth invention, wherein the comment search unit searches for any related comments around the time the user taps to stop the video when there are multiple comments attached to the video. This makes it possible to efficiently search for and check multiple related comments attached at the same time in the video being played.

[0018] The video management device according to the ninth invention is a video management device according to the first or second invention, further comprising an object search unit for searching for objects to which comments have been attached to a video. This makes it possible to easily search for related objects, for example, when checking the content of comments written in the comment section attached to a video and confirming which object they relate to.

[0019] The video management device according to the tenth invention is the video management device according to the ninth invention, wherein the object search unit searches for an object based on the video time and coordinates associated with the comment. This allows a user who has viewed the content of a comment attached to a video to easily search for which object the comment was attached to, based on the video time and coordinates.

[0020] The video management method according to the eleventh invention is a video management method using a video management device that manages videos together with input comments, comprising the steps of: an input unit of the video management device receiving various inputs for a video; a video stop processing unit of the video management device stopping playback of the video for which input has been received by the input unit; a stop time acquisition unit of the video management device acquiring the stop time of the video for which the video stop processing unit has stopped; a comment receiving unit of the video management device receiving input of comments for a video; an object identification unit of the video management device identifying an object to which a comment has been attached that is included in the video for which the video stop processing unit has stopped; an object coordinate acquisition unit of the video management device acquiring the coordinates of the object identified by the object identification unit; and a storage unit of the video management device saving the comments received by the comment receiving unit in association with the stop time and the coordinates of the object.

[0021] Here, in a video management device that manages videos including comments entered into videos taken in places such as educational settings, sports event venues, and construction sites, the user-entered comments are saved in association with the pause time of the video to which the comment was entered and the coordinates of the object to which the comment was attached. Here, the video taken in an educational setting, etc., may be a single video taken with one camera, or it may be multiple videos taken with multiple cameras.

[0022] This reduces the burden of comment input, for example, when adding comments on students or players appearing in videos filmed in educational settings, as it eliminates the need to describe the subjects (students, etc.) in the comments. Furthermore, when sharing videos with comments on students or players appearing in educational settings, users can view the comments while checking the subjects and their content as needed. As a result, the burden of adding comments to people, objects, etc., included in videos is reduced, and the subjects and comments can be visually displayed when playing the commented-on video.

[0023] The twelfth invention relates to a video management program for a video management device that manages videos together with input comments, and causes a computer to execute a video management method comprising: a step in which an input unit of the video management device receives various inputs for a video; a step in which a video stop processing unit of the video management device stops playback of the video for which input has been received by the input unit; a step in which a stop time acquisition unit of the video management device acquires the stop time of the video for which the video stop processing unit has stopped; a step in which a comment receiving unit of the video management device receives input of comments for a video; a step in which an object identification unit of the video management device identifies an object to which a comment has been attached in the video for which the video stop processing unit has stopped; a step in which an object coordinate acquisition unit of the video management device acquires the coordinates of the object identified by the object identification unit; and a step in which a storage unit of the video management device saves the comments received by the comment receiving unit in association with the stop time and the coordinates of the object.

[0024] Here, in a video management device that manages videos including comments entered into videos taken in places such as educational settings, sports event venues, and construction sites, the user-entered comments are saved in association with the pause time of the video to which the comment was entered and the coordinates of the object to which the comment was attached. Here, the video taken in an educational setting, etc., may be a single video taken with one camera, or it may be multiple videos taken with multiple cameras.

[0025] This reduces the burden of comment input, for example, when adding comments on students or players appearing in videos filmed in educational settings, as it eliminates the need to describe the subjects (students, etc.) in the comments. Furthermore, when sharing videos with comments on students or players appearing in educational settings, users can view the comments while checking the subjects and content of the comments as needed.

[0026] As a result, the burden of adding comments to people, objects, and other subjects included in a video is reduced, and the subjects and comments can be visually displayed when the video with comments is played.

[0027] (Effects of the Invention) The video management device according to the present invention reduces the burden of adding comments to objects such as people and things included in a video, and allows for the visual display of the objects and comments when the video with comments is played back.

[0028] A conceptual diagram showing a system configuration including a video management device according to one embodiment of the present invention. A control block diagram showing the configuration of the video management device included in the system of Figure 1. A diagram showing the comment input screen when entering comments on a video managed by the video management device of Figure 2. A diagram showing the video confirmation screen when viewing a video that includes comments entered on a video managed by the video management device of Figure 2. A diagram showing how to display comments attached to one video by the video management device of Figure 2. A diagram showing how to display comments attached to multiple videos by the video management device of Figure 2. A sequence diagram showing the process when a user enters comments on a video. A sequence diagram showing the process when displaying comments when viewing a video to which comments have been entered by a user. A sequence diagram showing the process when displaying the object to which comments have been attached when viewing a video to which comments have been entered by a user. (a) is a diagram showing a table containing comment IDs and their contents stored in the storage unit of the video management device of Figure 2. (b) is a diagram showing a table containing video IDs, comment IDs, mark coordinate information, and video stop time, which are stored in association with the storage unit. A diagram showing how to tap a mark attached to a video to display related comments included in the comment field. A diagram showing how to tap a comment in the comment section to transition to the video time where the mark is displayed in the video and display the mark. A flowchart showing the processing flow of the video management method implemented by the video management device of Figure 2. A flowchart showing the processing flow of the video management method implemented by the video management device of Figure 2. A flowchart showing the processing flow of the video management method implemented by the video management device of Figure 2. A conceptual diagram showing a system configuration including a video management device according to another embodiment of the present invention. A diagram showing how to display comments and objects attached to multiple videos by the video management device of Figure 16. A conceptual diagram showing a system configuration including a video management device according to yet another embodiment of the present invention.

[0029] A video management device according to one embodiment of the present invention will be described below with reference to Figures 1 to 15. Note that in this embodiment, unnecessarily detailed explanations may be omitted. For example, detailed explanations of already well-known matters and redundant explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding for those skilled in the art.

[0030] Furthermore, the applicant provides the accompanying drawings and the following description so that those skilled in the art may fully understand the present invention, and not intends to limit the subject matter described in the claims.

[0031] (1) Configuration of the video management device 10 The video management device 10 according to this embodiment is installed in a server device, for example, and manages the captured videos. As shown in Figure 1, the video management device 10 manages multiple videos captured by multiple cameras C1 and C2 in an educational setting, for example. Specifically, the video management device 10 manages videos of students S1, S2, S3, and S4 having a group discussion.

[0032] Here, in Figure 1, A represents the recording phase, B represents the review phase, and C represents the verification phase. Specifically, in recording phase A, as shown in Figure 1, a video of a group discussion between four students S1 to S4 is recorded using two cameras C1 and C2 and transmitted to the video management device 10.

[0033] Next, in review phase B, as shown in Figure 1, teachers T1 and T2 watch the videos recorded in recording phase A and input comments on each student's evaluation, characteristics, and questions, such as "This question is good," "This gesture is good," and "Why did they say this in response to this opinion?" and send the videos to the video management device 10. Then, in confirmation phase C, as shown in Figure 1, the videos with comments added in review phase B are used for student learning and for use in lessons.

[0034] As shown in Figure 2, the video management device 10 includes an input unit 11, a video stop processing unit 12, a stop time acquisition unit 13, a comment reception unit 14, an object identification unit 15a, an object coordinate acquisition unit 15b, a time axis adjustment unit 16, a comment search unit 17a, an object search unit 17b, a storage unit 18, and a display control unit 19. In the review phase B shown in Figure 1, the input unit 11 receives tap operations (various inputs) on the video from teachers T1 and T2.

[0035] The video stop processing unit 12 stops video playback when it receives a tap operation in the input unit 11. The stop time acquisition unit 13 acquires the stop time of the video stopped by the video stop processing unit 12. The comment reception unit 14 receives comments from teachers T1 and T2 regarding the stopped video.

[0036] The object identification unit 15a identifies the objects (students S1 to S4) with comments attached to them in the video that has been stopped by the video stopping processing unit 12. The object coordinate acquisition unit 15b acquires the coordinates in the video in which the objects (students S1 to S4) identified by the object identification unit 15a are shown. The time axis adjustment unit 16 adjusts the time axis during playback for multiple videos, for example, so that they are played back on the same time axis or on different time axes.

[0037] The comment search unit 17a searches for comments attached to the video. Specifically, if there are multiple comments attached to the video, the comment search unit 17a searches for comments related to the coordinates of the video tapped by the user. Also, if there are multiple comments attached to the video, the comment search unit 17a searches for comments related to the time of the video that the user tapped to pause it.

[0038] The object search unit 17b searches for objects to which comments have been attached to the video. Specifically, when a user checks the content of comments in the comment section attached to a video and searches to find out which object (students S1 to S4) the comment refers to, the object search unit 17b searches for the object (students S1 to S4) based on the video time and coordinates associated with the comment. The storage unit 18 stores the comments received by the comment reception unit 14 in association with the stop time and the coordinates of the object (students S1 to S4, etc.).

[0039] The display control unit 19 controls the video playback to display predetermined marks and comments indicating the target object (students S1 to S4, etc.) when the playback time is stopped. The display control unit 19 also associates the comments and marks attached to the video and displays them in the same color. In the review phase B shown in Figure 1, when teachers T1 and T2 input comments into the video, a comment input screen 20a is displayed on the screen of a PC (Personal Computer), tablet terminal, smartphone, etc., as shown in Figure 3.

[0040] On the comment input screen 20a, as shown in Figure 3, there are display areas 21a and 21b that display multiple videos A and B taken by multiple cameras C1 and C2, play buttons 21aa and 21ba, stop buttons 21ab and 21bb corresponding to each display area 21a and 21b, a play button 21ca to play both videos A and B, a stop button 21cb to stop them, a comment input area 22 where teachers (users) T1 and T2 enter comments, a comment field 23 that shows a list of comments entered from the comment input area 22, a link creation button 24a, and a comment save button 24b.

[0041] In review phase B, users such as teachers T1 and T2 watch videos A and B by operating the play buttons 21aa and 21ba, and stop videos A and B at the desired timing by operating the stop buttons 21ab and 21bb. They then enter comments on points they noticed in that scene into the comment input area 22 on the comment input screen 20a, and when they press the save comment button 24b, the entered comments are entered into the comment field 23.

[0042] Then, in confirmation phase C shown in Figure 1, when viewing a video with comments entered in review phase B, the video confirmation screen 20b is displayed as shown in Figure 4. On the video confirmation screen 20b, as shown in Figure 4, the comment input area of ​​the comment input screen 20a is not displayed, and only playback and stopping of each video A and B are possible. When checking the comments attached to the video on the video confirmation screen 20b, for example, by tapping a specific comment in the comment field 23, the user can transition to the scene of each video A and B to which that comment is attached in the display areas 21a and 21b.

[0043] For example, when users such as students S1-S4 and teachers T1-T2 tap the comment "Do you understand this explanation?" in comment field 23 during confirmation phase C, as shown in Figure 5, the video confirmation screen 20b transitions to the video time where the comment was attached, and displays the mark attached to the object (person or thing) to which the comment was attached, along with its coordinates (x, y).

[0044] At this time, the display control unit 19 causes the comment and the mark to be displayed in the same color. As a result, when the user checks the comment, the user can easily recognize which object in which time zone of the video the comment is for. Next, when comments are attached to a plurality of videos respectively, as shown in FIG. 6, when the comment "Why did you make such a statement about this statement?" in the comment column 23 is tapped, on the video confirmation screen 20b, the video transitions to the respective video times of videos A and B to which the comment is attached, and is displayed together with the mark attached to the object (person or thing) to which the comment is attached and its coordinates (x, y), (x', y').

[0045] As a result, even when one comment corresponds to a plurality of videos, by tapping the comment on the video confirmation screen 20b, the video transitions to the video times to which the comment is attached in the corresponding videos A and B and pauses temporarily, so that it is possible to easily recognize what kind of action and statement of the object in which scene the comment corresponds to.

[0046] <Comment, Mark-Associated Video Saving Process> In the video management device 10 of the present embodiment, in the review phase B shown in FIG. 1, when a user such as teachers T1, T2, etc. inputs a comment while viewing a video, the process is performed according to the sequence diagram shown in FIG. 7. That is, when inputting a comment during the video on the display screen of a tablet terminal or the like owned by the user, on the comment input screen 20a of FIG. 3, the position of the object (students S1 to S4) in the video being played is tapped.

[0047] Then, the video stop processing unit 12 of the video management device 10 temporarily stops the playback of the video. Then, the display control unit 19 displays a mark at the position of the tapped video. Next, the user inputs a comment corresponding to the mark to the comment input area 22 on the comment input screen 20a, and the comment save button 24b is operated. Then, the video management device 10 saves the stopped time of the stopped video, the coordinates of the mark, the content of the comment, and the comment ID attached to the comment in the storage unit 18 in an associated state.

[0048] Next, in the video management device 10, the display control unit 19 reads out the marks stored in the storage unit 18 and the corresponding comments, and causes them to be displayed on the display screen of the user's tablet terminal or the like.

[0049] <Display process for video with comments> On the other hand, according to the process shown in FIG. 7, the content of the comment attached to the video is confirmed by tapping the mark attached to the video and following the sequence diagram shown in FIG. 8.

[0050] That is, when users such as students S1 to S4 and teachers T1 and T2 confirm the comments attached to the video while viewing the video in the confirmation phase C shown in FIG. 1, as shown in FIG. 8, they tap the mark displayed on the playing video. Then, the video stop processing unit 12 of the video management device 10 temporarily stops the playback of the video. Then, the comment search unit 17a of the video management device 10 performs a column search in the storage unit 18 using the stopped video time and the tapped coordinates.

[0051] Next, the display control unit 19 of the video management device 10 reads out the comment ID retrieved from the storage unit 18, and causes the comment that matches the comment ID to be displayed on the display screen of the user's tablet terminal or the like. Further, according to the process shown in FIG. 7, the object to which the comment is attached to the video is confirmed by tapping the comment attached to the video and following the sequence diagram shown in FIG. 9.

[0052] That is, when users such as students S1 to S4 and teachers T1 and T2 confirm the object (students S1 to S4, etc.) to which the comment is attached to the video while viewing the video in the confirmation phase C shown in FIG. 1, as shown in FIG. 9, they tap the event in the comment displayed on the playing video. Then, the comment search unit 17a of the video management device 10 performs a column search in the storage unit 18 using the comment ID of the tapped comment.

[0053] Next, the object search unit 17b of the video management device 10 searches the storage unit 18 for the video time and coordinates corresponding to the comment, and the display control unit 19 transitions the video to that video time and displays the mark corresponding to the coordinates on the display screen of the user's tablet terminal or the like. Note that the comment ID and the content of the corresponding comment only need to be stored in the storage unit 18 as a table in an associated state, as shown in Figure 10(a). Similarly, the video ID, comment ID, coordinate information of the mark, and the video stop time to which the mark is attached only need to be stored in the storage unit 18 as a table in an associated state, as shown in Figure 10(b).

[0054] As a result, for example, as shown in Figure 11, in confirmation phase C, when the user taps a mark displayed at video time A of the video being played, the content of the comment saved in association with that mark will be displayed. Therefore, the user can easily check the content of the comment they want to check from the mark in the video that they tapped.

[0055] On the other hand, as shown in Figure 12, for example, in confirmation phase C, when a user taps the content of a comment in the comment field, the video transitions to the video time where the mark was attached, based on the coordinates and video time of the mark that were saved in association with this comment, and the mark is displayed. This makes it easy for the user to confirm which mark (object) the comment they tapped in the comment field corresponds to.

[0056] <Video Management Method> The video management device 10 of this embodiment has the configuration described above and manages videos with comments according to the flowcharts shown in Figures 13, 14, and 15. Here, as shown in Figure 1, the process of inputting comments into and saving multiple videos taken by multiple cameras C1 and C2 installed in the educational setting is explained below using Figure 13.

[0057] Specifically, in step S11, the input unit 11 of the video management device 10 receives a tap operation from the user on the part they want to share. Next, in step S12, the object coordinate acquisition unit 15b of the video management device 10 acquires the coordinates in the video that were tapped by the user. Next, in step S13, the video stop processing unit 12 of the video management device 10 stops the playback of the video.

[0058] Next, in step S14, the stop time acquisition unit 13 of the video management device 10 acquires the video duration of the stopped video. Next, in step S15, the comment reception unit 14 of the video management device 10 receives the comment entered by the user in the comment input area 22 on the comment input screen 20a.

[0059] Next, in step S16, the user is prompted on the comment input screen 20a to indicate whether or not to finish comment input. If the user finishes, the process proceeds to step S17; otherwise, it returns to step S11, and the subsequent processing is repeated. Next, in step S17, the storage unit 18 of the video management device 10 saves the coordinates in the video tapped by the user, the video time at which it was stopped, and the content of the entered comment, associating them with each other.

[0060] Next, the process of displaying a video with comments along with the comments, following the flowchart shown in Figure 13, will be explained using Figure 14 as follows. Specifically, in step S21, the input unit 11 of the video management device 10 receives a tap operation from the user, and the object coordinate acquisition unit 15b receives the coordinates in the tapped video. Next, in step S22, the video stop processing unit 12 of the video management device 10 stops the playback of the video.

[0061] Next, in step S23, the comment search unit 17a of the video management device 10 searches for comments related to the coordinates around the tapped coordinates. Next, in step S24, the comment search unit 17a of the video management device 10 determines whether or not there are any matching comments. If there are matching comments, the process proceeds to step S25; otherwise, the process ends.

[0062] Next, in step S25, the comment search unit 17a of the video management device 10 searches for any comments related to the video duration around the time the video was stopped. Next, in step S26, the comment search unit 17a of the video management device 10 determines whether or not there are any matching comments. If there are matching comments, the process proceeds to step S27; otherwise, the process ends.

[0063] Next, in step S27, the display control unit 19 of the video management device 10 displays on the user's tablet terminal or the like the comments related to the time of the video that was stopped, among the comments related to the coordinates tapped by the user. Subsequently, the process flow from when the user selects a comment for a video with comments attached according to the flowchart shown in Figure 13 until the mark corresponding to the comment is displayed will be explained below using Figure 15.

[0064] Specifically, in step S31, the input unit 11 of the video management device 10 accepts the user's operation to select a comment from the comment field 23 of the video confirmation screen 20b. Next, in step S32, the object search unit 17b of the video management device 10 determines whether or not there is a video associated with the selected comment. If there is an associated video, the process proceeds to step S33; otherwise, the process ends.

[0065] Next, in step S33, the video stop processing unit 12 of the video management device 10 stops the playback of the video. Next, in step S34, the display control unit 19 of the video management device 10 transitions the video so that the video duration matches that of the comment.

[0066] Next, in step S35, the object search unit 17b of the video management device 10 determines whether or not there is coordinate information associated with the selected comment. If there is associated coordinate information, the process proceeds to step S36; otherwise, the process ends. Next, in step S36, the display control unit 19 of the video management device 10 displays a mark in the video that corresponds to the coordinate information associated with the comment selected by the user.

[0067] <Main Features> The video management device 10 of this embodiment is a device for managing videos that include input comments, and as shown in Figure 2, it comprises an input unit 11, a video stop processing unit 12, a stop time acquisition unit 13, a comment reception unit 14, an object identification unit 15a, an object coordinate acquisition unit 15b, and a storage unit 18. The input unit 11 receives various inputs for the video. The video stop processing unit 12 stops the playback of the video at the timing when it receives input in the input unit 11. The stop time acquisition unit 13 acquires the stop time of the video stopped by the video stop processing unit 12. The comment reception unit 14 receives input of comments for the video. The object identification unit 15a identifies the object to which the comment is attached in the video stopped by the video stop processing unit 12. The object coordinate acquisition unit 15b acquires the coordinates of the object identified by the object identification unit 15a. The storage unit 18 stores the comments received by the comment reception unit 14 in association with the stop time and the coordinates of the object.

[0068] This reduces the burden of comment input, for example, when adding comments on evaluations of students appearing in videos filmed in educational settings, as it eliminates the need to describe the objects of the students in the comments. Furthermore, when sharing videos with comments on evaluations of students appearing in educational settings, users can view the videos while checking the objects of the students and their content as needed.

[0069] As a result, the burden of adding comments to subjects such as students included in videos is reduced, and the students and comments can be visually displayed when playing back videos with comments.

[0070] [Other Embodiments] Although one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various modifications are possible without departing from the spirit of the invention.

[0071] (A) In the above embodiments, the present invention has been described using examples of a video management device and a video management method. However, the present invention is not limited thereto. For example, the present invention may be implemented as a video management program that causes a computer to execute the video management method described above.

[0072] This video management program is stored in the memory (storage unit) of the video management device, and the CPU reads the video management program stored in memory and causes the hardware to execute each step. More specifically, the same effect as above can be obtained by the CPU reading the video management program and executing each of the steps described above. Furthermore, the present invention may be implemented as a recording medium on which the video management program is stored.

[0073] (B) In the above embodiment, an example was given in which multiple videos of a group discussion between multiple students are managed using multiple cameras C1 and C2 installed in an educational setting. However, the present invention is not limited to this. For example, as shown in Figure 16, the video management device 10 may be configured to manage multiple videos taken using multiple cameras C1 and C2 installed in a facility where sports such as soccer are played.

[0074] In this case, as shown in Figure 16, in recording phase A, the video is captured by multiple cameras C1 and C2 and transmitted to the video management device 10. In review phase B, the player P1 who has viewed the recorded video inputs comments reflecting on their play, such as "I wish they had passed it over there" or "I wanted to attack more here." In addition, a coach or supervisor P2 inputs comments about the filmed player, such as "They should have moved forward more."

[0075] This allows the video with comments from player P1 and coach P2 to be used in confirmation phase C for player learning and strategy improvement. Furthermore, if the comment "This pass should be made this way" from player P1 and coach P2 is entered across multiple videos of a soccer match, the video time A and the coordinates (x, y) of the object in video A, and the video time D' and the coordinates (x', y') of the object in video B are stored in the storage unit 18 of the video management device 10 in an associated state, as shown in Figure 17.

[0076] As a result, comments entered across multiple videos A and B are saved in association with different objects in each video, allowing them to be effectively used for player learning and strategy. Furthermore, if the display times of objects in multiple videos A and B are out of sync, the time axis adjustment unit 16 adjusts the time axis so that they can be viewed simultaneously, allowing users to check multiple videos with comments attached at the same time.

[0077] (C) In the above embodiment, an example was given in which multiple videos of a group discussion between multiple students are managed using multiple cameras C1 and C2 installed in an educational setting. However, the present invention is not limited to this. For example, the video management device 10 may be configured to manage multiple videos taken using multiple cameras C1 and C2 at a construction site or the like, as shown in Figure 18.

[0078] In this case, as shown in Figure 18, in recording phase A, the videos captured by multiple cameras C1 and C2 and transmitted to the video management device 10 are reviewed in review phase B. The construction supervisor P3, who has viewed the recorded videos, inputs comments such as "This action is dangerous" as points to note regarding the construction. In addition, the field worker P4 inputs comments about the recorded construction, such as "We've implemented this technique" or "Some individual tasks are difficult to perform." As a result, in confirmation phase C, the videos with comments from the construction supervisor P3 and field worker P4 can be used for learning among new engineers, sharing problems, and improving the work site.

[0079] (D) In ​​the above embodiment, the video management device 10 was described in an example where it is installed within a server device. However, the present invention is not limited thereto. For example, the video management device may be installed in a cloud space or the like.

[0080] (E) In the above embodiment, as shown in Figure 1, a video management device 10 that manages two videos captured by two cameras C1 and C2 was described as an example. However, the present invention is not limited thereto. For example, it may be a video management device that manages one video captured by one camera. Or, it may be a video management device that manages three or more videos captured by three or more cameras.

[0081] <Note> The video management device according to the first invention is a video management device that manages videos including comments that are input, and comprises: an input unit that receives various inputs for the video; a video stop processing unit that stops playback of the video at the timing when the input unit receives the input; a stop time acquisition unit that acquires the stop time of the video stopped by the video stop processing unit; a comment receiving unit that receives comments for the video; an object identification unit that identifies an object to which the comment is attached, which is included in the video stopped by the video stop processing unit; an object coordinate acquisition unit that acquires the coordinates of the object identified by the object identification unit; and a storage unit that stores the comments received by the comment receiving unit in association with the stop time and the coordinates of the object.

[0082] The video management device according to the second invention is the video management device according to the first invention, further comprising a display control unit that controls the display of a predetermined mark indicating the object and the comment in the video when the stop time occurs during playback of the video. The video management device according to the third invention is the video management device according to the first or second invention, wherein the video includes a plurality of videos captured by a plurality of cameras.

[0083] The video management device according to the fourth invention is the video management device according to the third invention, further comprising a time axis adjustment unit for adjusting the time axis during playback of the plurality of videos. The video management device according to the fifth invention is the video management device according to the second invention, wherein the display control unit displays the comments and marks attached to the videos in the same color in association with each other.

[0084] The video management device according to the sixth invention is a video management device according to any one of the first to fifth inventions, further comprising a comment search unit for searching for the comments attached to the video. The video management device according to the seventh invention is a video management device according to the sixth invention, wherein, when there are multiple comments attached to the video, the comment search unit searches for any comments related to the coordinates of the video tapped by the user.

[0085] The video management device according to the eighth invention is a video management device according to the sixth or seventh invention, wherein the comment search unit searches for any comments related to the time of the video that the user tapped to stop, when there are multiple comments attached to the video. The video management device according to the ninth invention is a video management device according to any one of the first to eighth inventions, further comprising an object search unit that searches for the object to which the comment is attached in the video.

[0086] The video management device according to the tenth invention is the video management device according to the ninth invention, wherein the object search unit searches for the object based on the video time and coordinates associated with the comment.

[0087] The video management device of the present invention reduces the burden of adding comments to objects such as people and things included in a video, and also has the effect of visually indicating the objects and comments when playing back a video with comments added. Therefore, it can be widely applied to various devices and systems for managing videos.

[0088] 10 Video management device 11 Input unit 12 Video stop processing unit 13 Stop time acquisition unit 14 Comment reception unit 15a Object identification unit 15b Object coordinate acquisition unit 16 Time axis adjustment unit 17a Comment search unit 17b Object search unit 18 Storage unit 19 Display control unit 20a Comment input screen 20b Video confirmation screen 21a Display area 21aa Play button 21ab Stop button 21b Display area 21ba Play button 21bb Stop button 21ca Play button 21cb Stop button 22 Comment input area 23 Comment field 24a Link creation button 24b Comment save button A Recording phase B Review phase C Confirmation phase C1, C2 Camera P1 Player P2 Commentator P3 Construction supervisor P4 Site worker S1-S4: Students (objects) T1, T2: Teachers

Claims

1. A video management device for managing videos that include comments that are entered, comprising: an input unit for receiving various inputs for the video; a video stop processing unit for stopping the playback of the video at the timing when the input unit receives the input; a stop time acquisition unit for acquiring the stop time of the video stopped by the video stop processing unit; a comment receiving unit for receiving comments for the video; an object identification unit for identifying an object to which the comment is attached, which is included in the video stopped by the video stop processing unit; an object coordinate acquisition unit for acquiring the coordinates of the object identified by the object identification unit; and a storage unit for storing the comments received by the comment receiving unit in association with the stop time and the coordinates of the object.

2. The video management device according to claim 1, further comprising a display control unit that controls the display of a predetermined mark indicating the object and the comment in the video when the stop time occurs during playback of the video.

3. The video management device according to claim 1 or 2, wherein the video includes multiple videos captured by multiple cameras.

4. The video management device according to claim 3, further comprising a time axis adjustment unit for adjusting the time axis during playback of the plurality of videos.

5. The video management device according to claim 2, wherein the display control unit displays the comments and marks attached to the video in the same color in association with each other.

6. The video management device according to claim 1 or 2, further comprising a comment search unit for searching for the comments attached to the video.

7. The video management device according to claim 6, wherein the comment search unit searches for any comments related to the coordinates of the video tapped by the user when there are multiple comments attached to the video.

8. The video management device according to claim 6, wherein, when there are multiple comments attached to the video, the comment search unit searches for any comments related to the time of the video that the user tapped to stop.

9. The video management device according to claim 1 or 2, further comprising an object search unit for searching for the object to which the comment has been attached in the video.

10. The video management device according to claim 9, wherein the object search unit searches for the object based on the video time and coordinates associated with the comment.

11. A video management method using a video management device that manages videos together with comments that are input, comprising: a step of the input unit of the video management device receiving various inputs for the video; a step of the video stop processing unit of the video management device stopping playback of the video for which the input has been received by the input unit; a step of the stop time acquisition unit of the video management device acquiring the stop time of the video for which the video stop processing unit has stopped; a step of the comment receiving unit of the video management device receiving input of the comments for the video; a step of the object identification unit of the video management device identifying an object to which the comments are attached that are included in the video for which the comments have been stopped by the video stop processing unit; a step of the object coordinate acquisition unit of the video management device acquiring the coordinates of the object identified by the object identification unit; and a step of the storage unit of the video management device saving the comments received by the comment receiving unit in association with the stop time and the coordinates of the object.

12. A video management program for a video management device that manages videos together with comments that are input, the program causes a computer to execute a video management method comprising: a step of the input unit of the video management device receiving various inputs for the video; a step of the video stop processing unit of the video management device stopping playback of the video for which the input has been received by the input unit; a step of the stop time acquisition unit of the video management device acquiring the stop time of the video for which the video stop processing unit has stopped; a step of the comment receiving unit of the video management device receiving input of comments for the video; a step of the object identification unit of the video management device identifying an object to which the comment is attached that is included in the video for which the video stop processing unit has stopped; a step of the object coordinate acquisition unit of the video management device acquiring the coordinates of the object identified by the object identification unit; and a step of the storage unit of the video management device saving the comment received by the comment receiving unit in association with the stop time and the coordinates of the object.

Images