Video playback device, video recording and playback method, and video playback program
The system synchronizes a high-speed camera and tag information device via an NTP server to add metadata and generate playback start time tags, addressing frame rate discrepancies for precise video playback from a distant terminal.
Patent Information
- Application Number
- JP2021124066
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-07-29
- Publication Date
- 2025-04-02
- Estimated Expiration
- 2041-07-29
AI Technical Summary
Existing systems face challenges in generating and utilizing tag information for video playback from a distant terminal device, requiring complex synchronization and handling frame rate discrepancies between shooting and playback.
A system comprising a high-speed camera, a tag information generating device, and a video playback device synchronized via NTP server, which adds shooting start time metadata and generates playback start time tag information, allowing playback at a different frame rate based on calculated positions.
Enables playback of video data from a specified position using tag information generated at the time of shooting, even when played back at a different frame rate, facilitating seamless video playback and scene selection.
Smart Images

Figure 0007655129000001 
Figure 0007655129000002 
Figure 0007655129000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a moving image playback device, a moving image recording and playback method, and a moving image playback program. [Background technology]
[0002] In coaching athletes, there are increasing opportunities to use videos shot at a high frame rate with a high-speed camera and then play them in slow motion at a normal frame rate with a video player. By playing videos shot at a high frame rate in slow motion, it is possible to grasp the quick movements of athletes that cannot be followed by the naked eye.
[0003] In such a case, there may be a case where a user wants to view only a scene of a specific player's movement from the captured video. In such a case, the user needs to search for the position of the scene he or she wants to view from within the video and perform a playback operation.
[0004] There is a technology for adding tag information to a relevant position in video data to facilitate the process of searching for and playing back a desired scene from within a video (Patent Document 1). By adding tag information to video data, a user can easily play back a desired scene by simply specifying the tag information when viewing the video. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2020-107991 A Summary of the Invention [Problem to be solved by the invention]
[0006] The imaging device described in Patent Document 1 can add tag information to the corresponding position of the captured video data by specifying the timing of a scene to be played back later during shooting. On the other hand, there is a demand for a terminal device carried by a user at a location distant from the imaging device to receive the video data captured by the imaging device via wireless communication and to be able to specify the position to add the tag information to the video data while watching the video data in real time.
[0007] However, in order to generate tag information for video data captured by an imaging device using a terminal device other than the imaging device, it is necessary to connect the terminal device generating the tag information and the imaging device via communication or to synchronize the processing timing, which creates the problem of complex system construction.
[0008] In addition, even if the processing timing is synchronized between the device generating the tag information and the imaging device, as described above, if the frame rate during shooting and the frame rate during playback are different, there is a problem that the tag information cannot be used to play back from a position desired by the user. For example, assume that shooting of a subject is started at a frame rate twice as fast as normal. If the user generates tag information on a terminal device 10 minutes after shooting starts, the tag information indicates the time 10 minutes after shooting starts. Next, when playing back the shot video at a normal frame rate from the time indicated by the tag information, the video will be played back in slow motion, so it will start from a scene 5 minutes after the actual shooting.
[0009] The present invention aims to provide a video playback device, a video recording and playback method, and a video playback program that are capable of playing video data captured by an imaging device from a specified position based on tag information generated at the time of shooting by a device other than the imaging device, even when the video data is played back at a frame rate different from the shooting frame rate of the imaging device. [Means for solving the problem]
[0010] In order to achieve the above-mentioned object, the video playback device of the present invention is characterized in that it comprises a video data acquisition unit that acquires video data generated at a first frame rate with the addition of information of a shooting start time based on a reference time; a tag information acquisition unit that acquires tag information including a playback start time of the video data based on the reference time; a video playback unit that plays back the video data at a second frame rate different from the first frame rate; a playback start position calculation unit that calculates a playback start position of the video data according to the tag information based on the difference between the shooting start time and the playback start time and the ratio of the second frame rate to the first frame rate; and a playback control unit that, when playback of the video data according to the tag information is instructed, causes the video playback unit to play the video data from the playback start position at the second frame rate.
[0011] In addition, a video recording and playback method of the present invention is characterized in that an imaging device generates and records video data at a first frame rate, to which information of a shooting start time based on a reference time is added, a tag information generation device stores tag information including a playback start time of the video data based on the reference time, and a video playback device that plays back the video data at a second frame rate different from the first frame rate acquires the video data and the tag information, calculates a playback start position of the video data according to the tag information based on the difference between the shooting start time and the playback start time and the ratio of the second frame rate to the first frame rate, and when playback of the video data according to the tag information is instructed, plays back the video data from the calculated playback start position at the second frame rate.
[0012] In addition, the video playback program of the present invention is characterized in that it enables a computer to realize the following functions: acquire video data generated at a first frame rate to which information of a shooting start time based on a reference time is added; acquire tag information including a playback start time of the video data based on the reference time; play the video data at a second frame rate different from the first frame rate; calculate a playback start position of the video data using the tag information based on the difference between the shooting start time and the playback start time and the ratio of the second frame rate to the first frame rate; and, when playback of the video data using the tag information is instructed, play the video data from the playback start position at the second frame rate. Effect of the Invention
[0013] According to the video playback device, video recording and playback method, and video playback program of the present invention, even if a video captured by an imaging device is played back at a frame rate different from the shooting frame rate of the imaging device, it is possible to play back the video from a position specified based on tag information generated at the time of shooting by a device other than the imaging device. [Brief description of the drawings]
[0014] [Figure 1] 1 is a block diagram showing a configuration of a moving image processing system using a moving image playback device according to an embodiment of the present invention. [Diagram 2] 1 is a block diagram showing a configuration of a video playback device according to an embodiment of the present invention; [Diagram 3] 4 is a sequence diagram showing processing executed in a video processing system using a video playback device according to an embodiment of the present invention; FIG. [Figure 4] 2 is an explanatory diagram showing the structure of moving image data acquired by the moving image playback device according to the embodiment of the present invention; FIG. [Diagram 5] FIG. 13 is an example of a screen configuration diagram displayed on a tag information generating device that generates tag information to be input to a video playback device according to an embodiment of the present invention. [Figure 6]11 is an example of a display screen of video data viewed by a user when generating tag information to be input to the video playback device according to one embodiment of the present invention. [Figure 7] 4 is an example of a tag information table to be input to the video playback device according to an embodiment of the present invention. [Figure 8] 11 is an example of a tag information table updated in the video playback device according to an embodiment of the present invention. [Figure 9] 13 is an example of a tag information table updated in a video playback device according to another embodiment of the present invention. [Figure 10] 13 is an explanatory diagram showing a playback portion in video data when the playback start position is adjusted in a video playback device according to another embodiment of the present invention; FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] A moving image processing system 1 using a moving image playback device according to an embodiment of the present invention will be described below with reference to the drawings.
[0016] Configuration of video processing system 1 according to an embodiment 1, a video processing system 1 according to this embodiment includes a high-speed camera device 10 as an imaging device, a tag information generating device 20, and a video playback device 30. The video processing system 1 is connected to an NTP (Network Time Protocol) server 3 via a communication network 2. The NTP server 3 is a server that distributes information on a reference time.
[0017] The high-speed camera device 10 includes a shooting unit 11, a first video data storage unit 12, a camera control unit 13, and a video data transmission unit 14. The shooting unit 11 shoots video at a first frame rate. The first frame rate is a frame rate, for example, 240 FPS, that is set higher than a normal frame rate so that the video can be played back smoothly in slow motion when played back at a normal frame rate of 60 FPS (frames per second). The first video data storage unit 12 stores the video data shot by the shooting unit 11, and adds information about the first frame rate to the video data as metadata.
[0018] The camera control unit 13 has a first time information acquisition unit 131 and a start time information addition unit 132. The first time information acquisition unit 131 acquires reference time information distributed from the NTP server 3. The start time information addition unit 132 acquires time information when shooting is started by the shooting unit 11 based on the reference time information acquired by the first time information acquisition unit 131, and adds it as metadata to the corresponding video data stored in the first video data storage unit 12. The video data transmission unit 14 transmits the video data stored in the first video data storage unit 12 to the video playback device 30 via wired or wireless communication, for example, a wired LAN, a wireless LAN, or the like. The first time information acquisition unit 131 has a built-in clock, and may update the built-in clock based on the reference time information acquired from the NTP server 3 at a predetermined cycle.
[0019] The tag information generating device 20 is formed of, for example, a smart device, and has a user interface unit 21, a generating device control unit 22, a first tag information storage unit 23, and a tag information transmitting unit 24. The user interface unit 21 is formed of, for example, a touch panel, and inputs information of an operation performed by a user to the generating device control unit 22, and outputs the information processing result by the generating device control unit 22.
[0020] The generation device control unit 22 has a second time information acquisition unit 221, a first operation information acquisition unit 222, and a tag information generation unit 223. The second time information acquisition unit 221 acquires reference time information distributed from the NTP server 3. The first operation information acquisition unit 222 acquires user operation information input from the user interface unit 21. The second time information acquisition unit 221 has a built-in clock, and may update the built-in clock based on the reference time information acquired from the NTP server 3 at a predetermined cycle.
[0021] When operation information for generating tag information is acquired by the first operation information acquisition unit 222, the tag information generation unit 223 acquires time information indicating the acquired timing based on the reference time information acquired by the second time information acquisition unit 221, and generates tag information including the time information as information on the playback start time.
[0022] The first tag information storage unit 23 stores the tag information generated by the tag information generation unit 223. The tag information transmission unit 24 transmits the tag information stored in the first tag information storage unit 23 to the video playback device 30 via wired or wireless communication, for example, a wired LAN, a wireless LAN, or the like.
[0023] 2, video playback device 30 has a CPU 31, a storage unit 32, and a display unit 33. CPU 31 has a video data acquisition unit 311, a tag information acquisition unit 312, a video playback unit 313, a playback start position calculation unit 314, a second operation information acquisition unit 315, a tag information update processing unit 316, and a playback control unit 317. Storage unit 32 has a second video data storage unit 321 and a second tag information storage unit 322.
[0024] The video data acquisition unit 311 acquires video data captured by the high-speed camera device 10 and stores it in the second video data storage unit 321. The tag information acquisition unit 312 acquires tag information transmitted from the tag information generation device 20 and stores it in the second tag information storage unit 322.
[0025] The video playback unit 313 plays back video data at a second frame rate different from the first frame rate. In the video playback unit 313, the second frame rate is set in advance to a normal frame rate (60 FPS). The second frame rate can be changed by the user. The playback start position calculation unit 314 calculates, for each piece of tag information stored in the second tag information storage unit 322, a playback start position of the corresponding video data according to the corresponding tag information based on the difference between the shooting start time of the video data stored in the second video data storage unit 321 and the playback start time indicated by the corresponding tag information, and the ratio between the second frame rate and the first frame rate. The playback start position calculation unit 314 adds the calculated playback start position information to the corresponding tag information in the second tag information storage unit 322 and stores it.
[0026] The second operation information acquisition unit 315 acquires operation information performed by a user to instruct playback of video data based on specified tag information, operation information for adjusting the playback start position of specified tag information, or operation information for adding tag information.
[0027] When second operation information acquisition section 315 acquires operation information for adjusting the playback start position of predetermined tag information, tag information update processing section 316 updates, based on the acquired information, information on the playback start position of the corresponding tag information stored in second tag information storage section 322. Furthermore, when second operation information acquisition section 315 acquires operation information for adding new tag information, tag information update processing section 316 adds the new tag information to second tag information storage section 322 and stores it.
[0028] When second operation information acquisition unit 315 acquires operation information instructing playback of video data based on predetermined tag information, playback control unit 317 causes video playback unit 313 to play the corresponding video data from the corresponding playback start position at the second frame rate. Display unit 33 displays the video data transmitted from video playback unit 313.
[0029] <Operation of video processing system 1 according to one embodiment> Next, the operation of the video processing system 1 according to this embodiment will be described with reference to Fig. 3 to Fig. 10. In this embodiment, the first time information acquisition unit 131 of the high-speed camera device 10 and the second time information acquisition unit 221 of the tag information generation device 20 acquire reference time information from the NTP server 3 via the communication network 2. This allows the high-speed camera device 10 and the tag information generation device 20 to synchronize their time information.
[0030] First, in FIG. 3, when the shooting unit 11 of the high-speed camera device 10 shoots a video, the video data X (see FIG. 4) generated by shooting is stored in the first video data storage unit 12 (S1). At that time, the start time information addition unit 132 acquires time information when shooting is started by the shooting unit 11 based on the reference time acquired by the first time information acquisition unit 131. Then, the start time information addition unit 132 adds information on the shooting start time of the video data X as metadata to the video data X stored in the first video data storage unit 12 (S2). Here, it is assumed that date information "2021 / 04 / 01" and time information "13:37:09" are acquired as information on the shooting start time and added to the video data X as metadata.
[0031] While the high-speed camera device 10 is shooting a video, the user, while watching the subject of the shooting or while watching the video being shot in real time, performs an operation to instruct the tag information generating device 20 to generate tag information related to a predetermined timing. The predetermined timing is the playback start timing when playing back the video data X shot and stored by the high-speed camera device 10 from a desired position.
[0032] As an example, a case will be described in which a user watches a baseball practice scene captured by the high-speed camera device 10 in real time on a television device (not shown) or the like, and performs an operation to instruct generation of tag information related to the timing of the pitcher's pitching using a smart device S (see FIG. 5) as the tag information generating device 20. Of course, the user may operate the smart device S while directly watching the baseball practice scene at the location where the high-speed camera device 10 is capturing the image.
[0033] 5 shows an example of a smart device S equipped with a touch panel 200 as the user interface unit 21. On the touch panel 200, a tag input button 201 that the user touches to input an instruction to generate tag information related to a corresponding timing, tag list information 202, and playback condition information 203 are displayed.
[0034] While watching a baseball practice scene, the user touches the tag input button 201 on the touch panel 200 each time the user recognizes the timing when the pitcher takes his or her swing and starts the pitching motion, as shown in FIG.
[0035] When the user touches the tag input button 201, the first operation information acquisition unit 222 acquires information of the touch operation (S3). When the first operation information acquisition unit 222 acquires the information of the touch operation, the tag information generation unit 223 acquires time information indicating the timing when the information of the touch operation was acquired, based on the reference time information acquired by the second time information acquisition unit 221. Then, the tag information generation unit 223 generates tag information regarding the touch operation, including the acquired time information as information of the playback start time.
[0036] The tag information generating unit 223 generates tag information corresponding to the timing each time the user recognizes the timing at which the pitcher's pitching motion starts during shooting of a video and performs a touch operation. Then, the tag information generating unit 223 generates a tag information table T (see FIG. 7) related to the pitching scene that stores the tag information generated until the end of the shooting (S4). The tag information table T is a table in which information such as the playback start time is associated with each piece of tag information, and may be generated as a CSV file.
[0037] Furthermore, when the user performs an operation to specify "10 seconds" as the playback time for the tag information in the playback condition information 203 of the touch panel 200, the playback time information for the tag information is stored in the tag information table T.
[0038] FIG. 7 shows an example of the tag information table T generated by the tag information generating unit 223. The tag information table T in FIG. 7 holds first to third tag information related to three touch operations performed during the shooting of the video. Specifically, as information on the first tag information by the first touch operation, date information "2021 / 04 / 01" and information on the playback start time "13:37:19" are held. As information on the second tag information by the second touch operation, date information "2021 / 04 / 01" and information on the playback start time "13:37:43" are held. As information on the third tag information by the third touch operation, date information "2021 / 04 / 01" and information on the playback start time "13:37:58" are held. As information on the playback time of the first to third tag information, "10 seconds" is held. The tag information table T generated by the tag information generating unit 223 is stored in the first tag information storage unit 23.
[0039] As shown in FIG. 5, the information stored in the tag information table T is displayed on the touch panel 200 as tag list information 202 and playback condition information 203.
[0040] After the shooting of the video is completed, the video data transmission unit 14 of the high-speed camera device 10 transmits the video data X stored in the first video data storage unit 12 to the video playback device 30 (S5). In the video playback device 30, the video data acquisition unit 311 acquires the video data X transmitted from the high-speed camera device 10 and stores it in the second video data storage unit 321 (S6).
[0041] Furthermore, the tag information transmission unit 24 of the tag information generation device 20 transmits the tag information table T stored in the first tag information storage unit 23 to the video playback device 30 (S7). In the video playback device 30, the tag information acquisition unit 312 acquires the tag information table T transmitted from the tag information generation device 20 and stores it in the second tag information storage unit 322 (S8).
[0042] Next, the playback start position calculation unit 314 calculates playback start position information for each piece of tag information in the tag information table T stored in the second tag information storage unit 322. Specifically, the playback start position calculation unit 314 acquires information on the first frame rate added as metadata from the video data X and information on the second frame rate preset in the video playback unit 313, and calculates, as playback start position information for each piece of tag information, a second time t2 obtained by multiplying a first time t1 indicated by the difference between the shooting start time of the video data X and the playback start time indicated by the corresponding tag information by the ratio of the first frame rate to the second frame rate.
[0043] For example, with respect to the first tag information, the playback start position calculation unit 314 calculates, as the playback start position information, the second time t2 "40 seconds" obtained by multiplying the first time t1 "10 seconds" from the shooting start time "13:37:09" to the playback start time "13:37:19" of the tag information by the ratio "4" of the first frame rate "240 FPS" to the second frame rate "60 FPS".
[0044] Similarly, the playback start position calculation unit 314 calculates the second time t2 "136 seconds" by multiplying the first time t1 "34 seconds" from the shooting start time "13:37:09" to the tag information time "13:37:43" by the ratio "4" as the playback start position information for the second tag information. Also, for the third tag information, the playback start position calculation unit 314 calculates the second time t2 "196 seconds" by multiplying the first time t1 "49 seconds" from the shooting start time "13:37:09" to the tag information time "13:37:58" by the ratio "4" as the playback start position information. As shown in FIG. 8, the playback start position calculation unit 314 adds the calculated first time t1 and second time t2 (playback start position information) of each tag information to the tag information table T and updates it (S9).
[0045] A case will be described where the user performs a playback operation based on desired tag information after tag information table T has been updated in this way. When the user performs an operation on video playback device 30 to instruct playback based on the first to third tag information of the pitching scene in video data X, second operation information acquisition unit 315 acquires information on the operation and sends it to playback control unit 317.
[0046] The playback control unit 317 obtains, from the tag information table T of the second tag information storage unit 322, the playback start position information of "40 seconds" of the first tag information corresponding to the pitching scene, the playback start position information of "136 seconds" of the second tag information, the playback start position information of "196 seconds" of the third tag information, and the playback time information of "10 seconds" of the first to third tag information.
[0047] Then, based on the acquired information, the playback control unit 317 instructs the video playback unit 313 to play partial video data X1 corresponding to the first tag information of the video data X shown in FIG. 4, partial video data X2 corresponding to the second tag information, and partial video data X3 corresponding to the third tag information.
[0048] Specifically, partial video data X1 corresponding to the first tag information is video data for 10 seconds recorded from a position 40 seconds into playback time from the beginning of video data X. Partial video data X2 corresponding to the second tag information is video data for 10 seconds recorded from a position 136 seconds into playback time from the beginning of video data X. Partial video data X3 corresponding to the third tag information is video data for 10 seconds recorded from a position 196 seconds into playback time from the beginning of video data X.
[0049] The video playback unit 313 extracts partial video data X1, partial video data X2, and partial video data X3 from the video data X stored in the second video data storage unit 321, and plays these partial video data continuously at the second frame rate on the display unit 33. By performing the process in this manner, only pitching scenes are extracted from the video data X and played continuously.
[0050] According to the above embodiment, when video data captured by a high-speed camera device is played back by a video playback device at a frame rate different from that at which the video was captured, it is possible to play back the video data from a desired position based on tag information generated by a tag information generation device different from that of the high-speed camera device.
[0051] In the above-described embodiment, the video data is transmitted from the high-speed camera device 10 to the video playback device 30, and the tag information is transmitted from the tag information generating device 20 to the video playback device 30, via wired or wireless communication. However, the present invention is not limited to this. The video data stored in the first video data storage unit 12 of the high-speed camera device 10 may be saved in a recording medium such as an SD card or a USB memory, and the recording medium may be attached to the video playback device 30 to transfer the video data. In this case, the high-speed camera device 10 may not have the video data transmission unit 14.
[0052] Similarly, the tag information stored in the first tag information storage unit 23 of the tag information generation device 20 may be saved in a recording medium, and the recording medium may be attached to the video playback device 30 to transfer the tag information. In this case, the tag information generation device 20 may be configured not to include the tag information transmission unit 24.
[0053] In the above-described embodiment, when playing back video data based on tag information, there is a case where the user wants to start playing back the video data several seconds before the user performs an operation to instruct generation of tag information in the tag information generating device 20. For example, when a baseball practice scene is filmed as in the above-described embodiment, and the user performs a touch operation on the smart device S when the pitcher is about to pitch, the touch operation is performed recognizing that the pitching motion has started when the pitcher raises his / her bat as shown in FIG.
[0054] However, when playing back video data based on the tag information generated by this touch operation, there may be cases where the viewer wishes to watch the video before the pitcher takes his swing. To accommodate such cases, when the playback start position calculation unit 314 of the video playback device 30 calculates the playback start position of each piece of tag information, the first time t1 from the shooting start time of the video data X to the time indicated by the corresponding tag information may be calculated shorter by a predetermined first adjustment time (for example, about 2 seconds).
[0055] In this case, the playback start position calculation unit 314 acquires information on the first adjustment time input by the user to the tag information generation device 20 or the video playback device 30. When the user inputs information on the first adjustment time to the tag information generation device 20, the tag information generation device 20 transmits the information on the first adjustment time together with the tag information generation table T to the video playback device 30.
[0056] Then, the playback start position calculation unit 314 determines the time obtained by subtracting the first adjustment time from the time from the shooting start time of the video data X to the time indicated by the corresponding tag information as the first time t1, and calculates the second time t2 based on this. By this process, for example, for the tag information table T of Fig. 6, the first time t1 is calculated to be 2 seconds shorter than in Fig. 8 as shown in Fig. 9, and accordingly the value of the second time t2 is calculated to be 8 seconds shorter.
[0057] When the tag information table T is updated with the second time t2 calculated in this way, the playback start position of each tag information is shifted forward by 2 seconds at the frame rate at the time of shooting when the first adjustment time is taken into consideration compared to when playback is not taken into consideration. Figure 10 shows a playback portion (a) of the video data X without taking the first adjustment time into consideration at the frame rate at the time of shooting, and a playback portion (b) of the video data X with the first adjustment time taken into consideration. The numbers at the bottom of Figure 10 indicate the second unit of the corresponding shooting time in the video data X.
[0058] By adjusting the playback start position in this way, playback of the partial video data indicated by each tag information can be started before the pitcher takes his or her swing. The information on the first adjustment time used in this process can be changed as appropriate by the user's operation.
[0059] In addition, after the playback start position calculation unit 314 calculates the playback start position information, the playback start position may be adjusted by the user inputting an instruction on the video playback device 30 to move the playback start position forward or backward by the second adjustment time (e.g., 1 second).
[0060] In this case, the tag information update processing unit 316 acquires the instruction information input by the user, and increases or decreases the value of the second time of the tag information in the tag information table T stored in the second tag information storage unit 322 by the instructed second adjustment time. For example, when the playback start position is shifted forward by the second adjustment time, the second time is decreased by the corresponding time, and when the playback start position is shifted backward by the second adjustment time, the second time is increased by the corresponding time.
[0061] At this time, the tag information update processing unit 316 increments or decrements the second time by the same value for all tag information in the tag information table T, so that the playback start positions of multiple tag information are shifted forward or backward by a specified amount while maintaining the same relative time intervals between them.
[0062] By performing this processing, when a user watches video data played based on tag information and recognizes that the playback start position is off from the desired position, the playback start position based on the tag information can be adjusted by shifting it forward or backward to the desired position.
[0063] In addition, when a user performs an operation to add a new tag to the tag information table T stored in the second tag information storage unit 322, the tag information update processing unit 316 generates new tag information based on the operation and adds it to the tag information table T.
[0064] In this case, as an operation for adding a new tag, the user, for example, plays back the video data X on the display unit 33 at the second frame rate, and while watching the video data, performs an operation to instruct the generation of tag information that specifies the timing of the operation as a new playback start time at a desired timing on the video playback device 30. When the tag information update processing unit 316 acquires information on the operation, it acquires information on a second time that is the time from the playback start time of the video data X being played back to the designated playback start time, generates tag information that specifies a position in the video data X based on the acquired second time as the playback start position, and stores the tag information in the second tag information storage unit 322. By performing the processing in this manner, new tag information can be added later to the tag information table T that has already been generated and stored in the video playback device 30.
[0065] In addition, in the above-mentioned embodiment, a case has been described in which tag information is generated by user operation, but this is not limited to this. A specific scene, for example a pitching motion scene, may be automatically detected by a sensor that detects the movement of a subject, and the tag information generation device 20 may automatically generate tag information based on time information indicating the timing when the corresponding scene was detected.
[0066] In the above-described embodiment, the high-speed camera device 10 and the tag information generation device 20 acquire time information distributed from the NTP server 3, and synchronize the time information between the high-speed camera device 10 and the tag information generation device 20. The method of synchronizing the time information is not limited to using the time information distributed from the NTP server 3. The high-speed camera device 10 and the tag information generation device 20 may acquire time information based on radio waves received from a satellite for a Global Navigation Satellite System (GNSS). One example of the GNSS is the Global Positioning System (GPS).
[0067] It is also possible to construct a video playback program that causes a computer to function as the video playback device 30 by programming the functional configuration of the video playback device 30 described above and incorporating the program into the computer. [Explanation of symbols]
[0068] 1. Video Processing System 2. Communication Network 3 NTP (Network Time Protocol) Server 10 High-speed camera equipment 11. Photography Department 12 First video data storage unit 13 Camera control section 14 Video data transmission unit 20 Tag information generating device 21 User Interface Section 22 Generator Control Unit 23 First tag information storage unit 24 Tag information transmission unit 30 Video playback device 31 CPU 32 Storage section 33 Display section 131 1st time information acquisition unit 132 Start time information addition section 200 Touch Panel 201 Tag input button 202 Tag List Information 203 Playback condition information 221 Second time information acquisition section 222 1st operation information acquisition unit 223 Tag information generator 311 Video Data Acquisition Unit 312 Tag information acquisition unit 313 Video playback section 314 Playback start position calculation unit 315 2nd operation information acquisition unit 316 Tag information update processing unit 317 Playback control section 321 Second video data storage unit 322 Second tag information storage unit
Claims
1. a video data acquisition unit that acquires video data generated at a first frame rate to which information on a shooting start time based on a reference time is added; a tag information acquiring unit that acquires tag information including a playback start time of the video data based on the reference time; a video playback unit that plays back the video data at a second frame rate different from the first frame rate; a playback start position calculation unit that calculates a playback start position of the video data based on the tag information, based on a difference between the shooting start time and the playback start time and a ratio between the second frame rate and the first frame rate; a playback control unit that, when an instruction to play back the video data based on the tag information is received, causes the video playback unit to play back the video data from the playback start position at the second frame rate; A video playback device comprising:
2. The apparatus further includes a tag information update processing unit that updates, when the information for adjusting the playback start position is acquired, the information for adjusting the playback start position based on the acquired information.
2. The video playback device according to claim 1.
3. When a new playback start time of the video data is specified while the video data is being played back at the second frame rate, the tag information update processing unit obtains information on a playback time from the playback start time of the video data being played back to the specified new playback start time, and generates tag information with a playback start position set to a position within the video data based on the obtained playback time.
3. The video playback device according to claim 2.
4. the imaging device generates and records, at a first frame rate, video data to which information on a shooting start time based on a reference time has been added; a tag information generating device stores tag information including a playback start time of the video data based on the reference time; A video playback device that plays back video data at a second frame rate different from the first frame rate acquires the video data and the tag information, calculates a playback start position of the video data according to the tag information based on a difference between the shooting start time and the playback start time and a ratio between the second frame rate and the first frame rate, and when an instruction to play back the video data according to the tag information is given, plays back the video data at the second frame rate from the calculated playback start position. How to record and play videos.
5. On the computer, a function of acquiring video data generated at a first frame rate to which information on a shooting start time based on a reference time is added; a function of acquiring tag information including a playback start time of the video data based on the reference time; playing the video data at a second frame rate different from the first frame rate; a function of calculating a playback start position of the video data based on the tag information, based on a difference between the shooting start time and the playback start time and a ratio between the second frame rate and the first frame rate; a function of, when a playback of the video data is instructed based on the tag information, playing the video data from the playback start position at the second frame rate; A video playback program to achieve this.
Citation Information
Patent Citations
Moving image data playback device, moving image data playback method and program
JP2015226306A
Moving picture reproduction device and method
JP2016201617A
Moving image tagging device and moving image tagging method
JP2020107991A
Variable playback speed template for video editing application
US20160225405A1
Display control device, display control method, and program
WO2017150237A1