Video processing system, video playback device, video playback method, and video playback program

Abstract

To provide a video reproducing apparatus configured to reproduce a video captured by an imaging apparatus so that a subject that a user is watching may be easily identified, in reproducing the video while reducing reproduction speed only of a desired scene.SOLUTION: A shutter speed switching tag storage unit 232 stores shutter speed switching tag information including information on a shutter speed switching timing in captured video data. A reproduction speed switching tag storage unit 233 stores reproduction speed switching tag information including information on a switching timing of reproduction speed in the video data. A moving region detection unit 255 detects a moving region from the video data. A reproduction control unit 253 reproduces the video data at a predetermined reproduction speed, acquires, when detecting arrival of a timing to change the reproduction speed during the reproduction, information on a shutter speed at the detection point of time, and modifies luminance of the moving region on the basis of the acquired shutter speed information, to reproduce the video data at the changed reproduction speed.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a moving image processing system, a moving image playback device, a moving image playback method, and a moving image playback program. [Background technology]

[0002] In coaching athletes, there are increasing opportunities to use videos taken at a high frame rate with a high-speed camera and then played back in slow motion at a normal frame rate with a video player. Playing back in slow motion makes it possible to grasp the quick movements of athletes that cannot be followed with the naked eye.

[0003] In this case, since playing back the entire shot video in slow motion would take a long time, there are cases where a user wishes to play back only desired scenes in the video in slow motion.

[0004] There is a technology that adds tag information to the relevant positions in video data in order to play only desired scenes in slow motion. By adding tag information to video data, it is possible to play only desired scenes in slow motion while playing other scenes at normal speed. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2016-201617 A Summary of the Invention [Problem to be solved by the invention]

[0006] When a desired scene is played back in slow motion as described above, the playback speed switches from normal speed to slow motion at the position of the desired scene while the user is watching. At this time, there is a problem that the user who is watching has difficulty immediately recognizing the subject that he or she wants to focus on on the screen due to the sudden change in playback speed.

[0007] Furthermore, when shooting a scene in which the subject is moving quickly, the shutter speed may be increased so that the subject's movement can be clearly seen during playback. However, increasing the shutter speed reduces the brightness of the image information, making it difficult to see the desired subject.

[0008] The present invention aims to provide a video processing system, a video playback device, a video playback method, and a video playback program that are capable of playing back a video captured by an imaging device in a state that makes it easy for a user to recognize a subject that the user is focusing on when the playback speed is reduced and only desired scene portions are played back. [Means for solving the problem]

[0009] In order to achieve the above object, a video processing system of the present invention includes an imaging device and a video playback device, the imaging device having an imaging section for capturing an image of a subject, an exposure degree switching section for switching an exposure degree of the image captured by the imaging section, and an exposure degree switching tag generation section for generating exposure degree switching tag information including information on exposure degree switching timing in video data captured by the imaging section and information on the exposure degree after switching for each switching timing based on the exposure degree switching process executed by the exposure degree switching section, and the video playback device generates a playback speed tag including information on the switching timing of the playback speed in the video data. a playback speed switching tag storage unit that stores exposure degree switching tag information; a motion area detection unit that detects, from the video data, an area of ​​the subject that has a predetermined or greater amount of movement as a motion area; and a playback control unit that plays back the video data at a predetermined playback speed, and when it detects during playback that a timing to switch the playback speed has arrived based on the playback speed switching tag information, obtains information on the exposure degree at the time of the detection based on the exposure degree switching tag information, changes the luminance of the motion area detected by the motion area detection unit based on the obtained exposure degree information, and plays back the video data at the switched playback speed.

[0010] The video playback device of the present invention is characterized in that it has an exposure degree switching tag memory unit that stores exposure degree switching tag information including information on the timing of exposure degree switching within the captured video data and information on the exposure degree after switching for each switching timing; a playback speed switching tag memory unit that stores playback speed switching tag information including information on the timing of playback speed switching within the video data; a motion area detection unit that detects, as a motion area, an area of ​​a subject that has a predetermined or greater amount of movement from within the video data; and a playback control unit that plays back the video data at a predetermined playback speed, and when it detects during playback that the timing to switch the playback speed has arrived based on the playback speed switching tag information, obtains exposure degree information at the time of the detection based on the exposure degree switching tag information, changes the brightness of the motion area detected by the motion area detection unit based on the obtained exposure degree information, and plays back the video data at the playback speed after switching.

[0011] In addition, the video playback method of the present invention is characterized in that the video playback device stores exposure degree switching tag information, which includes information on the timing of exposure degree switching in the captured video data and information on the exposure degree after switching for each switching timing, and playback speed switching tag information, which includes information on the timing of switching the playback speed in the video data, in a memory unit of the video playback device, detects an area of ​​a subject that has more than a predetermined amount of movement from the video data as a moving area, and while playing back the video data at a predetermined playback speed, when it detects that the timing to switch the playback speed has arrived based on the playback speed switching tag information, obtains information on the exposure degree at the time of detection based on the exposure degree switching tag information, changes the brightness of the detected moving area based on the obtained exposure degree information, and plays back the video at the switched playback speed.

[0012] In addition, the video playback program of the present invention is characterized in that it implements in a computer an exposure degree switching tag storage function that stores exposure degree switching tag information including information on the timing of exposure degree switching within the captured video data and information on the exposure degree after switching for each switching timing; a playback speed switching tag storage function that stores playback speed switching tag information including information on the timing of playback speed switching within the video data; a motion area detection function that detects an area of ​​a subject that has a predetermined or greater amount of movement from within the video data as a motion area; and a playback control function that plays back the video data at a predetermined playback speed, and when it is detected during playback that the timing to switch the playback speed has arrived based on the playback speed switching tag information, obtains exposure degree information at the time of the detection based on the exposure degree switching tag information, changes the brightness of the motion area detected by the motion area detection function based on the obtained exposure degree information, and plays back the video at the switched playback speed. Effect of the Invention

[0013] According to the video processing system, video playback device, video playback method, and video playback program of the present invention, when a video captured by an imaging device is played back at a slower playback speed for only the desired scene portion, the video can be played back in a state that makes it easy for the user to recognize the subject that is the user's focus. [Brief description of the drawings]

[0014] [Figure 1] 1 is a block diagram showing a configuration of a high-speed camera device of a video processing system according to an embodiment of the present invention. [Diagram 2] 1 is a block diagram showing a configuration of a moving image playback device of a moving image processing system according to an embodiment of the present invention. [Diagram 3] 4 is a flowchart showing a process executed by the high-speed camera device according to the embodiment of the present invention. [Figure 4] 4 is an example of a shutter speed switching tag information table generated by the high-speed camera device according to the embodiment of the present invention. [Diagram 5] 5 is an example of a playback speed switching tag information table generated by the high-speed camera device according to the embodiment of the present invention. [Figure 6] 4 is a flowchart showing a process executed by the video playback device according to the embodiment of the present invention. [Figure 7] 1 is an explanatory diagram showing the relationship between video data played back by the video playback device according to an embodiment of the present invention, the position of a shutter speed switching tag related to the video data, and the position of a playback speed switching tag; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] A moving image processing system according to an embodiment of the present invention will be described below with reference to the drawings.

[0016] Configuration of a video processing system according to an embodiment As shown in FIGS. 1 and 2, a moving image processing system 1 according to this embodiment includes a high-speed camera device 10 as an imaging device, and a moving image playback device 20.

[0017] The high-speed camera device 10 includes a first input unit 11, an imaging unit 12, a first CPU 13, a first storage unit 14, and a first communication unit 15.

[0018] The first input unit 11 inputs information such as a user's image capture start operation, image capture stop operation, shutter speed switching operation, timing designation operation for generating a playback speed switching tag described later, and video data transmission operation. The image capture unit 12 captures a subject at a preset frame rate higher than normal so that the video can be played back smoothly in slow motion, for example, 120 FPS (frames per second), and at a set shutter speed. In this embodiment, a case where the frame rate during shooting by the image capture unit 12 is 120 FPS will be described, but this is not limited to this, and other frame rates higher than the general normal frame rate of 60 FPS, such as 240 FPS and 300 FPS, may be used.

[0019] The first CPU 13 has an imaging control unit 131, a shutter speed switching unit 132 as an exposure level switching unit, a shutter speed switching tag generating unit 133 as an exposure level switching tag generating unit, a playback speed switching tag generating unit 134, and a data transmission control unit 135.

[0020] The imaging control unit 131 controls the start and stop of imaging processing by the imaging unit 12 based on information input from the first input unit 11. The shutter speed switching unit 132 switches the shutter speed for imaging based on an instruction input from the first input unit 11 while imaging is being performed by the imaging unit 12.

[0021] The shutter speed switching tag generating unit 133 generates information indicating the timing of shutter speed switching in the captured video data and information on the shutter speed after switching for each switching timing as the degree of exposure, based on the shutter speed switching process executed by the shutter speed switching unit 132. The information indicating the timing of shutter speed switching in the video data is indicated by, for example, the elapsed time from the start of video shooting.

[0022] The playback speed switching tag generating unit 134 generates playback speed switching tag information including operation information specifying the timing to switch the playback speed within the video data, which is input from the first input unit 11 during shooting by the imaging unit 12. The operation information specifying the timing to switch the playback speed within the video data is represented, for example, by the elapsed time from the start of shooting the video.

[0023] The data transmission control unit 135 causes the information stored in the first storage unit 14 to be transmitted from the first communication unit 15 to the video playback device 20 based on the information input from the first input unit 11 .

[0024] The first storage unit 14 includes a first moving image data storage unit 141 , a first shutter speed switching tag storage unit 142 , and a first playback speed switching tag storage unit 143 .

[0025] The first video data storage unit 141 stores video data captured by the imaging unit 12. The first shutter speed switching tag storage unit 142 stores information on the shutter speed switching tag generated by the shutter speed switching tag generation unit 133. The first playback speed switching tag storage unit 143 stores information on the playback speed switching tag generated by the playback speed switching tag generation unit 134. The first communication unit 15 communicates with the video playback device 20 via wired or wireless communication, for example, a wired LAN, a wireless LAN, or the like.

[0026] 2, the video playback device 20 has a second communication unit 21, a second input unit 22, a second storage unit 23, a display unit 24, and a second CPU 25. The second communication unit 21 communicates with the high-speed camera device 10. The second input unit 22 inputs information on a video playback operation by a user.

[0027] The second storage unit 23 has a second video data storage unit 231, a second shutter speed switching tag storage unit 232, and a second playback speed switching tag storage unit 233. The second video data storage unit 231 stores video data transmitted from the high speed camera device 10. The second shutter speed switching tag storage unit 232 stores information on the shutter speed switching tag transmitted from the high speed camera device 10. The second playback speed switching tag storage unit 233 stores information on the playback speed switching tag transmitted from the high speed camera device 10.

[0028] The display unit 24 displays the moving image data stored in the second moving image data storage unit 231 under the control of the second CPU 25 .

[0029] The second CPU 25 has a data acquisition section 251 , a data reading section 252 , a playback control section 253 , a motion vector detection section 254 , and a motion area detection section 255 .

[0030] The data acquisition unit 251 acquires information transmitted from the high-speed camera device 10 via the second communication unit, and sends it to the second storage unit. The data reading unit 252 reads the video data stored in the second video data storage unit 231 when video playback operation information is input from the second input unit 22.

[0031] The playback control unit 253 starts playback of the video data read by the data reading unit 252 at a speed corresponding to the shooting speed. In this embodiment, the frame rate at the time of shooting the video data is used as the shooting speed. When the playback control unit 253 detects that the timing to switch the playback speed based on the playback speed switching tag has arrived during playback of the video data, it acquires information on the shutter speed at the time of the detection based on the shutter speed switching tag information. In addition, the playback control unit 253 increases the luminance of the moving area detected by the moving area detection unit 255 (described later) by the ratio of the shutter speed during normal shooting to the shutter speed at the corresponding timing in the video data, and plays the video in slow motion for a predetermined period of time.

[0032] The motion vector detection unit 254 detects motion vectors within frames of the video data read by the data reading unit 252. The motion area detection unit 255 detects, based on the motion vectors detected by the motion vector detection unit 254, areas of a subject having motion equal to or greater than a predetermined value from within the frames of the video data as motion areas.

[0033] Operation of the video processing system according to an embodiment Next, the operation of the video processing system 1 according to this embodiment will be described. First, the video shooting process executed by the high-speed camera device 10 will be described with reference to the flowchart of FIG.

[0034] When a user performs an operation to start shooting on the high-speed camera device 10, information on the operation is input from the first input unit 11 ("YES" in S1), and the imaging unit 12 starts shooting under the control of the imaging control unit 131. At this time, the imaging unit 12 starts shooting at a preset shooting speed of a frame rate of 120 FPS and a shutter speed of 1 / 120 seconds. When the imaging unit 12 starts shooting, the video data X generated by shooting is sequentially stored in the first video data storage unit 141 (S2). In addition, when the imaging unit 12 starts shooting, the shutter speed switching tag generation unit 133 holds information on the shutter speed of 1 / 120 seconds at the start of shooting.

[0035] During shooting, the user operates the high-speed camera device 10 to switch the shutter speed according to the movement of the subject. For example, before a scene where the movement of the subject speeds up, the user operates to increase the shutter speed to 1 / 240 seconds in order to smoothly reproduce the movement of the subject in the moving image data X. At this time, the user can switch the shutter speed with a value S in the range where 0 < n ≤ 1 in the following formula (1).

[0036] S = n × (1 / [frame rate during shooting = 120]) …(1) When the user operates the high-speed camera device 10 to switch the shutter speed, information on the operation is input from the first input unit 11 ("YES" in S3). Then, based on the input information, the shutter speed switching unit 132 switches the shutter speed setting of the imaging unit 12 to 1 / 240 seconds. The imaging unit 12 continues shooting at the switched shutter speed.

[0037] When the shutter speed is switched by the shutter speed switching unit 132, the shutter speed switching tag generation unit 133 holds information on the shutter speed switching timing and the shutter speed after switching for each switching timing in the captured moving image data X regarding the switching process (S4). The process of step S4 is executed each time information on the shutter speed switching operation is input until information on the shooting stop operation is input ("NO" in S5 → "YES" in S3).

[0038] Also during shooting, the user operates the high-speed camera device 10 to specify the timing for switching the playback speed during playback according to the movement of the subject. For example, when a scene where the movement of the subject speeds up starts, the user operates to specify the timing for starting slow-motion playback by reducing the playback speed during playback.

[0039] When the user performs an operation to specify the timing to switch the playback speed on the high-speed camera device 10, information on the operation is input from the first input unit 11 ("NO" in S3→"YES" in S6). The playback speed switching tag generation unit 134 retains information on the timing of switching the playback speed in the captured video data X based on the input information (S7). This process of retaining information on the timing of switching the playback speed is executed each time information on the operation to switch the playback speed is input, until information on the operation to stop shooting is input ("NO" in S5→"NO" in S3→"YES" in S6).

[0040] Then, when the user performs an operation to stop shooting on the high-speed camera device 10, information on that operation is input from the first input unit 11 ("YES" in S5), and the shooting process of the imaging unit 12 is stopped under the control of the imaging control unit 131.

[0041] When the shooting process stops, the shutter speed switching tag generation unit 133 generates a shutter speed switching tag information table including the information held during shooting, and stores it in the first shutter speed switching tag storage unit 142 of the first storage unit 14 together with the information on the shutter speed of 1 / 120 seconds at the start of shooting. The shutter speed switching tag generation unit 133 may generate the shutter speed switching tag information as a CSV file.

[0042] Fig. 4 shows an example of a shutter speed switching tag information table stored in the first shutter speed switching tag storage unit 142. The shutter speed switching tag information table T1 in Fig. 4 stores information on a first shutter speed switching tag (first S tag) and a second shutter speed switching tag (second S tag) that are generated based on an operation to switch the shutter speed performed by the user while shooting a video.

[0043] The information of the first S tag includes "10 seconds", which is information indicating the timing of the shutter speed change, and "1 / 240 seconds", which is information on the shutter speed after the change due to the change timing. This information indicating the timing of the shutter speed change is the elapsed time from the start of shooting to the user's change operation. In other words, the first S tag is a tag generated based on the user's operation of changing the shutter speed setting to 1 / 240 seconds, which was performed 10 seconds after the start of shooting.

[0044] Similarly, the second S tag is a tag generated based on the user's operation of switching the shutter speed setting to 1 / 120 seconds 30 seconds after the start of shooting.

[0045] Furthermore, when the shooting process stops, the playback speed switching tag generation unit 134 generates an information table of the playback speed switching tag including the information held during shooting, and stores the information table in the first playback speed switching tag storage unit 143 (S8). The playback speed switching tag generation unit 134 may generate the playback speed switching tag information as a CSV file.

[0046] Fig. 5 shows an example of a playback speed switching tag information table stored in the first playback speed switching tag storage unit 143. The playback speed switching tag information table T2 in Fig. 5 stores information on a first playback speed switching tag (first R tag) generated based on an operation performed by the user during video shooting to specify the timing of switching the playback speed.

[0047] The information of the 1R tag includes "12 seconds", which is information indicating the timing of switching the playback speed, and "10 seconds", which is information on the playback time at the switched speed. This information indicating the timing of switching the playback speed is the elapsed time from the start of shooting until the user performs a switching operation. In other words, this tag is generated based on the operation performed by the user 12 seconds after the start of shooting to specify the timing to start 10 seconds of slow motion playback during playback.

[0048] After this information is stored, when the user performs an operation to transmit video data, the first communication unit 15, under the control of the data transmission control unit 135, transmits the video data X stored in the first memory unit 14, information on the shutter speed at the start of shooting, information on the shutter speed switching tag, and information on the playback speed switching tag to the video playback device 20 (S9).

[0049] In the video playback device 20, the data acquisition unit 251 acquires the information transmitted from the high-speed camera device 10 via the second communication unit 21. Of the acquired information, the data acquisition unit 251 stores the video data X in the second video data storage unit 231, stores the information on the shutter speed at the start of shooting and the shutter speed switching tag information in the second shutter speed switching tag storage unit 232, and stores the playback speed switching tag information in the second playback speed switching tag. This concludes the explanation of the video shooting process.

[0050] Next, the video playback process executed by the video playback device 20 will be described with reference to the flowchart of FIG.

[0051] When the user performs an operation to instruct video playback on the video playback device 20, information on the operation is input from the second input unit 22 ("YES" in S11), and the data reading unit 252 starts reading the video data X from the second video data storage unit 231 (S12). Then, the playback control unit 253 displays the read video data X on the display unit 24 and starts playback (S13). The normal video playback speed by the playback control unit 253 is 60 FPS (frames per second), but when playing back the video data X in this embodiment, playback starts at 120 FPS, which is the same speed as the shooting speed when shooting by the high-speed camera device 10.

[0052] During playback of the video data X, the playback control unit 253 monitors whether or not the timing for switching the playback speed has arrived based on the playback speed switching tag stored in the second playback speed switching tag storage unit 233. Specifically, the playback control unit 253 monitors whether or not the time "12 seconds" indicated by the shutter speed switching timing of the first R tag has elapsed since the start of playback.

[0053] When 12 seconds have passed since the start of playback and the playback control unit 253 detects that it is time to switch the playback speed ("YES" in S14), the motion vector detection unit 254 starts the process of detecting a motion vector from the frame being played back of the video data X read by the data reading unit 252.

[0054] Then, based on the motion vector detected by the motion vector detection section 254, the motion area detection section 255 detects, from within the frame being played back of the video data X, an area of ​​the subject having a motion equal to or greater than a predetermined value as a motion area.

[0055] If a motion area is detected here ("YES" in S15), the playback control unit 253 acquires shutter speed information at the timing indicated by the first R tag (12 seconds after the start of playback) based on the shutter speed switching tag information stored in the second shutter speed switching tag memory unit 232.

[0056] 7, the shutter speed is switched as indicated by the first S tag 10 seconds after the start of playback, which is immediately before the timing indicated by the first R tag. As a result, the playback control unit 253 obtains the shutter speed information "1 / 240 seconds" after switching by the first S tag from the shutter speed switching tag information table T1 as the shutter speed information at the timing indicated by the first R tag.

[0057] At this time, since the shutter speed has been switched from 1 / 120 seconds at the start of shooting to half that, 1 / 240 seconds, the brightness of the corresponding frame in the video data X is half that at the start of shooting. Here, the playback control unit 253 sets the brightness of the moving area to be four times higher, which is the ratio of the previously set shutter speed of 1 / 60 seconds during normal shooting to the acquired shutter speed of 1 / 240 seconds (S16).

[0058] Then, the playback control unit 253 switches the playback speed of the video data X to the normal playback speed of 60 FPS with the brightness of the moving area increased by four times, and performs slow motion playback for 10 seconds based on the first R tag information table T2 (S17).

[0059] In step S15, when no motion area is detected in the video data X (NO in S15), the brightness is not changed and slow motion playback is performed for 10 seconds (S17).

[0060] The playback control unit 253 repeats the processes of steps S15 to S17 until the slow-motion playback ends ("NO" in S18). As a result, even if a moving area was not detected when the timing to switch the playback speed arrived but a moving area is detected during slow-motion playback, the brightness of the moving area increases from the point of detection. Also, if the shutter speed is 1 / 120 seconds when the timing to switch the playback speed arrives and is switched to 1 / 240 seconds during slow-motion playback, the brightness of the moving area will be doubled when the slow-motion playback starts and will be quadrupled after the shutter speed is switched.

[0061] When 22 seconds have passed since the start of playback and the 10-second slow-motion playback scene in the video data X ends ("YES" in S18), the process returns to step S13, and the playback control unit 253 continues playing back the video data X at the same speed as the shooting speed, 120 FPS. At that time, the playback control unit 253 returns the changed brightness to the normal state.

[0062] When the playback control unit 253 ends the playback of the video data X ("NO" in S14->"NO" in S19), the process ends.

[0063] According to the above embodiment, a video captured by a high-speed camera device is played back at the same frame rate as when the video was captured, for normal scenes, while a scene desired by a user that has been captured by switching to a high shutter speed is played back in slow motion with increased brightness in areas of moving subjects, so that the part of the desired subject in the scene that the user is focusing on can be played back in a state that makes it easy to recognize.

[0064] In the above-described embodiment, the playback control unit 253 of the video playback device 20 may display information of the playback speed switching tag stored in the second playback speed switching tag storage unit 233 on the display unit 24. Furthermore, the video playback device 20 may have a function of adjusting the position of the playback speed switching tag by an operation of a user who visually recognizes the information of the displayed playback speed switching tag. On the other hand, information of the shutter speed switching tag is not displayed on the display unit 24 because it is not information adjusted by the user.

[0065] In the above embodiment, the video playback device adjusts the luminance of the moving area in the video data based on the shutter speed setting value at the timing of switching the playback speed designated by the user. However, the present invention is not limited to this, and the video playback device 20 may adjust the luminance of the moving area based on the ISO sensitivity or the aperture value, which are other elements for adjusting the exposure level, instead of the shutter speed setting value.

[0066] In the above embodiment, a case has been described in which video data is transmitted from the high-speed camera device 10 to the video playback device 20 by wired or wireless communication. However, the present invention is not limited to this, and the information stored in the first storage unit 14 in the high-speed camera device 10 may be saved in a recording medium such as a memory card or USB memory, and the recording medium may be attached to the video playback device 20 to transfer the video data. In this case, the high-speed camera device 10 may be configured not to have the data transmission control unit 135 and the first communication unit 15.

[0067] It is also possible to construct a video playback program that causes a computer to function as the video playback device 20 by programming the functional configuration of the video playback device 20 described above and incorporating the program into the computer. [Explanation of symbols]

[0068] 1. Video Processing System 10 High-speed camera equipment 11 First input section 12 Imaging unit 13 1st CPU 14 1st memory section 15 First Communications Department 20 Video playback device 21 Second Communications Department 22 Second input section 23 2nd memory section 24 Display 25 2nd CPU 131 Imaging control section 132 Shutter speed switching section 133 Shutter speed switching tag generator 134 Playback speed change tag generator 135 Data transmission control section 141 First video data storage unit 142 First shutter speed switching tag memory unit 143 First playback speed switching tag storage unit 231 Second video data storage unit 232 Second shutter speed switching tag memory section 233 Second playback speed switching tag storage unit 233 Playback speed change tag storage section 251 Data Acquisition Department 252 Data reading section 253 Playback control section 254 Motion Vector Detector 255 Motion Area Detector

Claims

1. An imaging device and a video playback device are provided, The imaging device includes: An imaging unit that captures an image of a subject; an exposure degree switching unit that switches an exposure degree of the image captured by the imaging unit; an exposure level switching tag generating unit that generates exposure level switching tag information including information on exposure level switching timings in the video data captured by the imaging unit and information on the exposure level after switching for each switching timing based on the exposure level switching process executed by the exposure level switching unit; The video playback device includes: a playback speed switching tag storage unit for storing playback speed switching tag information including information on a timing for switching the playback speed in the video data; a motion area detection unit that detects an area of ​​the subject having a predetermined or greater amount of motion from the video data as a motion area; a playback control unit that plays back the video data at a predetermined playback speed, and when detecting that a timing to switch the playback speed has arrived during playback based on the playback speed switching tag information, acquires information on an exposure level at the time of the detection based on the exposure level switching tag information, changes the luminance of the motion area detected by the motion area detection unit based on the acquired exposure level information, and plays back the video data at the switched playback speed; A video processing system comprising:

2. A playback control unit of the video playback device plays back the video data at a speed corresponding to the shooting speed, and when it detects that the timing to switch the playback speed has arrived based on the playback speed switching tag information, increases the brightness of the moving area detected by the moving area detection unit based on the acquired exposure level information, and switches the playback speed to a speed slower than the shooting speed.

2. The video processing system according to claim 1.

3. an exposure degree switching tag storage unit that stores exposure degree switching tag information including information on exposure degree switching timings in the captured video data and information on the exposure degree after switching for each switching timing; a playback speed switching tag storage unit for storing playback speed switching tag information including information on a timing for switching the playback speed in the video data; a motion area detection unit that detects an area of ​​a subject having a predetermined or greater amount of motion from the video data as a motion area; a playback control unit that plays back the video data at a predetermined playback speed, and when detecting that a timing to switch the playback speed has arrived during playback based on the playback speed switching tag information, acquires information on an exposure level at the time of the detection based on the exposure level switching tag information, changes the luminance of the motion area detected by the motion area detection unit based on the acquired exposure level information, and plays back the video data at the switched playback speed; A video playback device comprising:

4. The video playback device storing, in a storage unit of the video playback device, exposure level switching tag information including information on timings at which exposure levels are switched within the captured video data and information on the exposure levels after switching for each switching timing, and playback speed switching tag information including information on timings at which the playback speed is switched within the video data; Detecting an area of ​​a subject having a predetermined or greater amount of movement from the video data as a moving area; When it is detected that a timing for switching the playback speed has arrived based on the playback speed switching tag information while the video data is being played back at a predetermined playback speed, information on the degree of exposure at the time of the detection is obtained based on the exposure degree switching tag information, and the brightness of the detected moving area is changed based on the obtained information on the degree of exposure, and the video data is played back at the playback speed after switching. A video playback method comprising:

5. On the computer, an exposure degree switching tag storage function for storing exposure degree switching tag information including information on timing of switching the exposure degree in the captured video data and information on the exposure degree after switching for each switching timing; a playback speed switching tag storage function for storing playback speed switching tag information including information on a timing for switching the playback speed in the video data; a motion area detection function for detecting an area of ​​a subject having a predetermined or greater motion as a motion area from the video data; a playback control function of playing back the video data at a predetermined playback speed, and when detecting that a timing for switching the playback speed has arrived based on the playback speed switching tag information during playback, acquiring information on a degree of exposure at the time of the detection based on the exposure degree switching tag information, changing the luminance of the motion area detected by the motion area detection function based on the acquired information on the degree of exposure, and playing back the video data at the playback speed after switching; A video playback program to achieve this.

Images