Regeneration apparatus and regeneration method

Abstract

To facilitate detection of a scene from a video.SOLUTION: A regeneration apparatus 10 is provided with: an image obtaining part 200 that obtains a photographed moving image and information about directions of visual lines of a person detected when the moving image is photographed; a regeneration control part 121 that regenerates the moving image obtained by the image obtaining part 200; and a display control part 119 that makes a display part display the moving image regenerated by the regeneration control part 121, where the regeneration control part 121 changes a method for regenerating the moving image, depending on whether variation in the visual lines of the person is less or not.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a playback device and a playback method. [Background technology]

[0002] When the captured video is constantly recorded, as in the case of a so-called drive recorder, it may be difficult to search for a scene that includes, for example, a specific vehicle or a specific person from a long video. A technology related to a drive recorder that switches between and plays back videos from multiple cameras is known (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2021-185666 A Summary of the Invention [Problem to be solved by the invention]

[0004] For example, in the case of event data recorded when an event occurs, the fact that the event occurred is recorded, and the recording time is relatively short, so there is little need to search for the desired scene. In contrast, in the case of normal recording data that is constantly recorded, if it is difficult to identify the desired scene from information such as the recording time and recording position, it is necessary to play back and check the video within the range where the desired scene is expected to be recorded.

[0005] The present invention has been made in view of the above, and has an object to facilitate detection of scenes from video. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the playback device of the present invention includes an image acquisition unit that acquires a captured video and information detecting the gaze direction of a person at the time the video was captured, a playback control unit that plays back the video acquired by the image acquisition unit, and a display control unit that displays the video played by the playback control unit on a display unit, and the playback control unit changes a playback method of the video depending on whether there is little fluctuation in the gaze direction of the person.

[0007] The playback method of the present invention includes an image acquisition step of acquiring a captured video image and information detecting a person's gaze direction at the time the video image was captured, a playback control step of changing the playback method and playing the video image acquired in the image acquisition step depending on whether there is little fluctuation in the person's gaze direction, and a display control step of displaying the video image played in the playback control step on a display unit, performed by a playback device. Effect of the Invention

[0008] According to the present invention, an effect is achieved in that it is possible to easily detect a scene from a video. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a playback device according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram showing another example of the configuration of the playback device according to the first embodiment. [Diagram 3] FIG. 3 is a flowchart showing an example of the flow of the regeneration process in the control device according to the first embodiment. [Figure 4] FIG. 4 is a flowchart showing an example of the flow of the regeneration process in the control device according to the second embodiment. [Diagram 5] FIG. 5 is a block diagram showing an example of the configuration of a playback device having a control device according to the third embodiment. [Figure 6] FIG. 6 is a flowchart showing an example of the flow of the recording process in the control device according to the third embodiment. [Figure 7] FIG. 7 is a flowchart showing an example of the flow of the regeneration process in the control device according to the third embodiment. [Figure 8] FIG. 8 is a flowchart showing an example of the flow of the regeneration process in the control device according to the fourth embodiment. [Figure 9] FIG. 9 is a diagram for explaining the area on the display screen where the gazes are concentrated. [Figure 10] FIG. 10 is a flowchart showing an example of the flow of the regeneration process in the control device according to the fifth embodiment. [Figure 11] FIG. 11 is a flowchart showing an example of the flow of the regeneration process in the control device according to the sixth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of a playback device and a playback method according to the present disclosure will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiment.

[0011] [First embodiment] The playback device is a device that plays back moving images. In this embodiment, the playback device changes the playback method of moving images depending on whether or not the gaze of a person is focused on a certain range of the display screen of the display unit 216. The playback device of this embodiment is implemented as an electronic device such as a so-called drive recorder, a personal computer, or a smartphone.

[0012] <Playback device (drive recorder)> With reference to FIG. 1, a case will be described in which the reproducing device 10 is, for example, a drive recorder as a recording and reproducing device that records a video image when an event occurs in a vehicle. FIG. 1 is a block diagram showing an example of a configuration of the reproducing device 10 having a reproducing control device (hereinafter, referred to as a "control device") 100 according to the first embodiment. The reproducing device 10 shown in FIG. 1 captures images of the periphery of the vehicle and reproduces the captured files. The reproducing device 10 may be a portable device that can be used in a vehicle, in addition to a device that is mounted on a vehicle, which is an example of a moving body. The reproducing device 10 may also be realized by including the functions or configurations of a device previously installed in the vehicle, a navigation system, and the like. The reproducing device 10 has a first camera 210, a second camera 211, a recording unit 212, an operation unit 213, an acceleration sensor 214, a GNSS (Global Navigation Satellite System) receiving unit 215, a display unit 216, and a control device 100.

[0013] The first camera 210 is a camera provided in the vehicle. The first camera 210 is a camera that captures at least one of the surroundings and the interior of the vehicle. The first camera 210 may be a group of multiple cameras. The first camera 210 is disposed, for example, at a position in the front of the vehicle interior where it can capture the front of the vehicle. In this embodiment, the first camera 210 captures video at all times while the accessory power of the vehicle is ON. The first camera 210 outputs the captured image data to the image data acquisition unit 111 of the control device 100. The image data is, for example, a moving image composed of images of 27.5 frames per second.

[0014] The second camera 211 is a camera provided around the display screen of the display unit 216. The second camera 211 captures an image in a direction opposite to the display screen of the display unit 216. The second camera 211 is a camera provided in the vehicle. In this embodiment, the second camera 211 is, for example, a camera that captures the face of a user such as a vehicle occupant. The second camera 211 is a camera that captures an image so as to detect the line of sight of the user. The second camera 211 may be provided, for example, inside the vehicle's inner mirror, or near the inner mirror or on the dashboard. The second camera 211 may be a group of multiple cameras. The second camera 211 is, for example, disposed at a position where it is possible to capture an image of an occupant of each seat of the vehicle. The second camera 211 is, for example, configured as a visible light camera or a near infrared camera. The second camera 211 may be, for example, configured as a combination of a visible light camera and a near infrared camera. In this embodiment, the second camera 211 constantly captures an image while the accessory power of the vehicle is ON. The second camera 211 outputs captured image data to the image data acquisition unit 111 of the control device 100. The image data is, for example, a moving image composed of images at 27.5 frames per second.

[0015] The recording unit 212 is used for temporary storage of data in the playback device 10. The recording unit 212 is, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a recording unit such as a memory card. Alternatively, the recording unit 212 may be an external recording unit wirelessly connected via a communication device (not shown). The recording unit 212 records a captured file, which is continuous recording data or event recording data, based on a control signal output from the recording control unit 122 of the control device 100.

[0016] The operation unit 213 can accept various operations on the playback device 10. The operation unit 213 is, for example, a touch panel provided on the display unit 216. For example, the operation unit 213 can accept an operation to manually save captured image data in the recording unit 212 as event recording data. For example, the operation unit 213 can accept an operation to play back the continuous recording data or event recording data recorded in the recording unit 212. For example, the operation unit 213 can accept an operation to erase the event recording data recorded in the recording unit 212. For example, the operation unit 213 can accept an operation to end the continuous recording. The operation unit 213 outputs operation information to the operation control unit 116 of the control device 100.

[0017] The acceleration sensor 214 is a sensor that detects acceleration occurring with respect to the vehicle. The acceleration sensor 214 outputs a detection result to the event detection unit 117 of the control device 100. The acceleration sensor 214 is a sensor that detects acceleration in, for example, three axial directions. The three axial directions are the forward / rearward direction, the left / right direction, and the up / down direction of the vehicle.

[0018] The GNSS receiving unit 215 is configured with a GNSS receiver that receives GNSS signals from GNSS satellites, etc. The GNSS receiving unit 215 outputs the received position information signal to the position information acquisition unit 118 of the control device 100.

[0019] The display unit 216 is, for example, a display device specific to the reproduction device 10, or a display device shared with other systems including a navigation system. The display unit 216 may be formed integrally with the first camera 210. The display unit 216 is, for example, a display including a liquid crystal display or an organic EL (Electro-Luminescence) display. In this embodiment, the display unit 216 is disposed in front of the driver of the vehicle on a dashboard, an instrument panel, a center console, or the like. The display unit 216 displays an image based on a video signal output from the display control unit 119 of the control device 100. The display unit 216 displays an image captured by the first camera 210 or an image recorded in the recording unit 212.

[0020] <Playback control device (drive recorder control device)> The control device 100 is an arithmetic processing device (control device) configured with, for example, a CPU (Central Processing Unit) and the like. The control device 100 loads a stored program into a memory and executes instructions included in the program. The control device 100 includes an internal memory (not shown), which is used for temporary storage of data in the control device 100. The control device 100 includes an image data acquisition unit 111, a buffer memory 112, an image data processing unit 113, a gaze detection unit 114, an operation control unit 116, an event detection unit 117, a position information acquisition unit 118, a display control unit 119, a storage unit 120, a playback control unit 121, and a recording control unit 122.

[0021] The image acquisition unit 200 acquires a captured video image. In this embodiment, the image acquisition unit 200 is composed of a first camera 210, a captured data acquisition unit 111, a buffer memory 112, a captured data processing unit 113, and a recording unit 212.

[0022] The image capturing data acquisition unit 111 controls the first camera 210 and the second camera 211 used in the vehicle, and acquires image capturing data captured by the first camera 210 and the second camera 211. The image capturing data acquisition unit 111 outputs the image capturing data acquired from the first camera 210 to the buffer memory 112.

[0023] The buffer memory 112 is an internal memory included in the control device 100, and is a memory for temporarily recording the image capture data for a certain period of time acquired by the image capture data acquisition unit 111 while updating it.

[0024] The shooting data processing unit 113 generates a shooting file for each predetermined time from the shooting data. The shooting data processing unit 113 converts the shooting data temporarily stored in the buffer memory 112 into an arbitrary file format, such as MP4 format, encoded with an arbitrary codec such as H.264 or MPEG-4 (Moving Picture Experts Group). The shooting data processing unit 113 generates a shooting file for a certain period of time from the shooting data temporarily stored in the buffer memory 112. As a specific example, the shooting data processing unit 113 generates 60 seconds of shooting data in the order of recording as a shooting file from the shooting data temporarily stored in the buffer memory 112. The shooting data processing unit 113 outputs the generated shooting file to the recording control unit 122. In addition, the shooting data processing unit 113 outputs the generated shooting file to the display control unit 119 after decoding the image through the playback control unit 121. The period of the generated shooting file is set to 60 seconds as an example, but is not limited to this. The photographed data referred to here may be data that includes audio in addition to the video photographed by first camera 210.

[0025] The gaze detection unit 114 detects the gaze direction of a person from the image captured by the second camera 211 capturing an image in a direction facing the display screen of the display unit 216. The gaze detection unit 114 recognizes the user's face from the image data captured by the second camera 211 and acquired by the image data acquisition unit 111, and detects the gaze direction from the detected image of the eyes. The user is a person viewing the display screen of the display unit 216. In the playback device 10, the user may be limited to the driver of the vehicle. In the playback device 10, the user may be a passenger including a passenger in addition to the driver.

[0026] In this embodiment, the gaze detection unit 114 detects which range of the display screen of the display unit 216 the person's gaze direction is directed to. More specifically, the gaze detection unit 114 detects the range on the display screen of the display unit 216 where the person's gaze is concentrated. For example, the gaze detection unit 114 detects a state where the person's gaze direction does not fluctuate much and the person is looking at a range centered on one point on the display screen as the gaze being concentrated on a certain range on the display screen of the display unit 216. For example, when the person is gazing at an object of interest on the display screen, the gaze is likely to be concentrated on a certain range on the display screen. For example, the gaze detection unit 114 detects a state where the person's gaze direction fluctuates a lot and the person is looking at the entire display screen as the gaze is not concentrated on a certain range on the display screen of the display unit 216. For example, when the person is checking the entire display screen rather than a specific object on the display screen, the gaze is not concentrated on a certain range on the display screen.

[0027] The operation control unit 116 acquires operation information of an operation accepted by the operation unit 213. For example, the operation control unit 116 acquires playback operation information indicating a playback operation or erase operation information indicating an erase operation, and outputs a control signal. For example, the operation control unit 116 acquires end operation information indicating an operation to end continuous recording, and outputs a control signal.

[0028] The event detection unit 117 detects an event based on the acceleration applied to the vehicle. More specifically, the event detection unit 117 detects an event based on the detection result of the acceleration sensor 214. The event detection unit 117 detects that an event has occurred when the acceleration information acquired by the event detection unit 117 from the acceleration sensor 214 is equal to or greater than a threshold value.

[0029] The position information acquisition unit 118 acquires position information indicating the current position of the vehicle. The position information acquisition unit 118 calculates the position information of the current position of the vehicle based on the GNSS signal received by the GNSS receiving unit 215 by a known method.

[0030] Display control unit 119 controls the display on display unit 216. Display control unit 119 causes display unit 216 to display the continuous recording data or event recording data, which is a moving image reproduced by reproduction control unit 121. Display control unit 119 outputs a video signal that causes display unit 216 to output the continuous recording data, event recording data, or the like. More specifically, display control unit 119 outputs a video signal that displays the video captured by first camera 210, or the continuous recording data or event recording data recorded in recording unit 212 by reproduction.

[0031] The storage unit 120 is an internal memory that stores data and the like required for processing in the control device 100.

[0032] Based on a playback operation control signal output from operation control unit 116, playback control unit 121 controls playback of the video captured by first camera 210, and the continuous recording data or event recording data recorded in recording unit 212. Playback control unit 121 includes a decoder (not shown), and plays back various types of data by decoding the compressed data supplied thereto.

[0033] The playback control unit 121 changes the playback method of the video depending on whether the lines of sight detected by the gaze detection unit 114 are concentrated on a certain range on the display screen of the display unit 216. More specifically, the playback control unit 121 changes the playback speed of the video depending on whether the lines of sight detected by the gaze detection unit 114 are concentrated on a certain range on the display screen of the display unit 216.

[0034] In this embodiment, when the gaze detected by the gaze detection unit 114 is concentrated on a certain range of the display screen of the display unit 216, the playback control unit 121 performs playback at a slower speed than when the gaze detected by the gaze detection unit 114 is not concentrated on a certain range of the display screen of the display unit 216.

[0035] In this embodiment, when the gaze detected by the gaze detection unit 114 is concentrated on a certain range of the display screen of the display unit 216, the playback control unit 121 performs slow playback or pause, and when the gaze detected by the gaze detection unit 114 is not concentrated on a certain range of the display screen of the display unit 216, the playback control unit 121 performs playback at normal speed.

[0036] When pausing, the playback control unit 121 may cancel the pause by a pause cancel operation by the user, or may stop the playback for only a period of time, such as three seconds.

[0037] The recording control unit 122 records the shooting data acquired by the shooting data acquisition unit 111. In the embodiment, the recording control unit 122 controls the recording unit 212 to record the shooting file filed by the shooting data processing unit 113. During a period in which a continuous recording process is performed, such as when the accessory power of the vehicle is ON, the recording control unit 122 records the shooting file filed by the shooting data processing unit 113 in the recording unit 212 as an overwritable shooting file. More specifically, during a period in which a continuous recording process is performed, the recording control unit 122 continues to record the shooting file generated by the shooting data processing unit 113 in the recording unit 212, and when the capacity of the recording unit 212 becomes full, the recording control unit 122 overwrites the oldest shooting file with a new shooting file.

[0038] When an event is detected by the event detection unit 117, the recording control unit 122 stores event record data, which is shooting data corresponding to the detection of the event. The event record data is a shooting file of a predetermined period in the shooting file generated by the shooting data processing unit 113. The recording control unit 122 stores the shooting file corresponding to the detection of the event in the recording unit 212 as event record data that is prohibited from being overwritten. When an event is detected by the event detection unit 117, the recording control unit 122 copies a shooting file of a predetermined period, for example, about 10 seconds before and after the time the event is detected, from the buffer memory 112 and stores it as event record data.

[0039] <Playback device (electronic equipment)> A case where the playback device 30 is an electronic device such as a personal computer or a smartphone that plays back a file captured by a drive recorder will be described with reference to Fig. 2. Fig. 2 is a block diagram showing another example of the configuration of the playback device 30 having the control device 400 according to the first embodiment. The playback device 30 shown in Fig. 2 plays back a file captured in an external system.

[0040] The playback device 30 may be installed in a vehicle, which is an example of a moving object, or may be a portable device that can be used in a vehicle. The playback device 30 has a camera 310, an interface unit (hereinafter, referred to as “I / F”) 311, an operation unit 312, a display unit 313, and a control device 400.

[0041] Camera 310 is a camera provided around the display screen of display unit 313. Camera 310 captures an image in a direction opposite to the display screen of display unit 313. Camera 310 is configured similarly to second camera 211 of playback device 10 shown in FIG.

[0042] The I / F 311 is an interface for acquiring a captured file from an external system. In this embodiment, the I / F 311 is an interface for acquiring a captured file from a drive recorder. The I / F 311 is, for example, a communication function such as Wi-Fi (registered trademark) for communicating with the drive recorder, a memory card reader, etc.

[0043] The operation unit 312 is, for example, a touch panel provided on the display unit 313. The operation unit 312 is configured similarly to the operation unit 213 of the playback device 10 shown in Fig. 1. The operation unit 312 outputs operation information to an operation control unit 413 of the control device 400.

[0044] The display unit 313 is, for example, a display device specific to the playback device 30. The display unit 313 has a similar configuration to the display unit 216 shown in FIG.

[0045] <Playback control device (control device for electronic devices)> The control device 400 is, for example, an arithmetic processing device configured with a CPU or the like. The control device 400 loads a stored program into a memory and executes instructions included in the program. The control device 400 includes an internal memory (not shown), which is used for temporary storage of data in the control device 400. The control device 400 has an image acquisition unit 411, a gaze detection unit 412, an operation control unit 413, a playback control unit 418, and a display control unit 419.

[0046] The image acquisition unit 411 acquires a shooting file based on shooting data captured by an external system. The image acquisition unit 411 acquires a shooting file based on shooting data captured by a camera (not shown) provided in the vehicle. In this embodiment, the image acquisition unit 411 acquires a shooting file based on shooting data captured by the first camera 210 of the drive recorder.

[0047] The gaze detection unit 412 detects the user's gaze from the image data captured by the camera 310. The gaze detection unit 412 has the same function as the gaze detection unit 114 of the playback device 10 shown in FIG.

[0048] The operation control unit 413 acquires operation information of the operation accepted by the operation unit 312. The operation control unit 413 has the same function as the operation control unit 116 of the playback device 10 shown in FIG.

[0049] The playback control unit 418 controls the image acquisition unit 411 to play back the captured file acquired based on a playback operation control signal output from the operation control unit 413. The playback control unit 418 has the same function as the playback control unit 121 of the playback device 10 shown in FIG.

[0050] The display control unit 419 controls the display on the display unit 313. The display control unit 419 has the same function as the display control unit 119 of the playback device 10 shown in FIG.

[0051] <Information processing in playback control device> Next, the flow of the playback process will be described with reference to Fig. 3. As an example, the playback process in the control device 100 of the playback device 10 will be described. Fig. 3 is a flowchart showing an example of the flow of the playback process in the control device 100 according to the first embodiment. The playback process is similar in the control device 400 of the playback device 30. During the playback process, the second camera 211 captures an image so that the user's gaze can be detected. Then, the gaze detection unit 114 detects the person's gaze.

[0052] 3 is based on the premise that the photographed data to be reproduced has been selected and a reproduction instruction for the selected photographed data has been issued in the reproduction device 10 or the reproduction device 30. The photographed data to be reproduced may be either continuous recorded data or event recorded data.

[0053] The control device 100 starts playing back the captured image data (step S101). More specifically, the control device 100 outputs a control signal for the playing operation from the playing operation information indicating the playing operation on the operation unit 213, by the operation control unit 116. The control device 100 proceeds to step S102.

[0054] The control device 100 plays back at normal speed (step S102). More specifically, the control device 100 plays back the continuous recorded data or event recorded data at normal speed by the playback control unit 121. The control device 100 causes the display control unit 119 to display video based on the played back continuous recorded data or event recorded data on the display unit 216 during the period when the continuous recorded data or event recorded data is being played back by the playback control unit 121, in other words, during the period from the start of playback to the end of playback. The control device 100 proceeds to step S103.

[0055] The control device 100 determines whether the gaze is concentrated (step S103). More specifically, the control device 100 detects, by the gaze detection unit 114, a state in which the person's gaze direction fluctuates little and the person is looking at a point on the display screen as the gaze being concentrated in a certain range of the display screen on the display unit 216. If the control device 100 determines from the detection result of the gaze detection unit 114 that the gaze is concentrated (Yes in step S103), the control device 100 proceeds to step S104. If the control device 100 does not determine from the detection result of the gaze detection unit 114 that the gaze is concentrated (No in step S103), the control device 100 proceeds to step S108.

[0056] When it is determined that the gaze is concentrated (Yes in step S103), the control device 100 performs slow playback or pauses (step S104). More specifically, the control device 100 performs slow playback or pauses the continuous recorded data or event recorded data that started to be played back in step S101, by using the playback control unit 121. Slow playback refers to playing back at a slower speed than the normal playback speed, for example, 0.5 times the normal playback speed. Slow playback also includes frame-by-frame playback. Pausing refers to temporarily stopping playback and displaying the frame image at the time of the pause in the moving image in a still state. The control device 100 proceeds to step S105.

[0057] The control device 100 determines whether the state of concentrated gaze continues (step S105). When the control device 100 determines from the detection result of the gaze detection unit 114 that the state of concentrated gaze of the person continues (Yes in step S105), the control device 100 proceeds to step S106. When the control device 100 does not determine from the detection result of the gaze detection unit 114 that the state of concentrated gaze of the person continues (No in step S105), the control device 100 proceeds to step S107.

[0058] When it is determined that the state of focused gaze continues (Yes in step S105), the control device 100 determines whether or not to end playback (step S106). For example, it is determined to end playback when the power or motive power of the vehicle is turned off or the operation unit 213 is operated. When it is determined to end playback (Yes in step S106), the control device 100 ends this process. When it is not determined to end playback (No in step S106), the control device 100 executes the process of step S105 again.

[0059] If it is not determined that the gaze concentration state continues (No in step S105), playback is performed at normal speed (step S107). More specifically, the control device 100 causes the playback control unit 121 to play back at normal speed the continuous recorded data or event recorded data that was played back in slow motion or paused in step S104. The control device 100 proceeds to step S108.

[0060] The control device 100 determines whether or not to end regeneration (step S108). For example, the control device 100 determines to end regeneration when the vehicle's power source or motive power is turned off or the operation unit 213 is operated. If the control device 100 determines to end regeneration (Yes in step S108), it ends this process. If the control device 100 does not determine to end regeneration (No in step S108), it executes the process of step S103 again.

[0061] When this process ends, the playback of the continuous recorded data or the event recorded data ends.

[0062] In this way, the control device 100 changes the playback method of the moving image depending on whether or not the gaze of the person is focused on a certain range of the display screen of the display unit 216.

[0063] <Effects> As described above, in this embodiment, the method of playing back moving images can be changed depending on whether or not the gaze of a person is focused on a certain range on the display screen of the display unit 216.

[0064] In this embodiment, when a person's line of sight is focused on a certain range of the display screen of the display unit 216, playback is performed at a slower speed than when the line of sight is not focused on the certain range of the display screen. According to this embodiment, when the line of sight is focused on a certain range of the display screen, the playback speed is slowed down, making it easier to check the moving image.

[0065] In this embodiment, when a person's line of sight is focused on a certain range of the display screen of the display unit 216, slow playback or pausing is performed, and when the line of sight is not focused on the certain range of the display screen, normal speed playback is performed. According to this embodiment, when the line of sight is focused on a certain range of the display screen, slow playback or pausing is performed, making it easier to check the moving image.

[0066] In this way, according to the present embodiment, it is easy to play back and check the video within the range in which the desired scene is assumed to be captured, and it is easy to detect the scene from the video.

[0067] [Second embodiment] The playback device according to this embodiment will be described with reference to FIG. 4. The playback device 10 is a drive recorder. When the playback device is an electronic device, the playback device 30 is equipped with similar functions. FIG. 4 is a flowchart showing an example of the flow of playback processing in a control device according to a second embodiment. The playback device 10 has a basic configuration similar to that of the playback device 10 of the first embodiment. In the following description, the same or corresponding reference symbols are used for components similar to those in the first embodiment, and detailed description thereof will be omitted. The same applies to the following embodiments. In this embodiment, the processing in the playback control unit 121 is different from that in the first embodiment.

[0068] When the line of sight detected by line of sight detection unit 114 is not concentrated on a certain range of the display screen of display unit 216, playback control unit 121 performs playback at a faster speed than when the line of sight detected by line of sight detection unit 114 is concentrated on a certain range of the display screen of display unit 216. For example, when the line of sight is not concentrated on the display screen, there is a high possibility that a video other than the video that the user particularly wants to check is being displayed. In such a case, the playback speed is increased so that the video that the user wants to check can be checked more quickly.

[0069] When the gaze detected by the gaze detection unit 114 is not concentrated on a certain range of the display screen of the display unit 216, the playback control unit 121 performs fast-forward playback or skip playback, and when the gaze detected by the gaze detection unit 114 is concentrated on a certain range of the display screen of the display unit 216, the playback control unit 121 performs playback at normal speed.

[0070] Next, the flow of the playback process will be described with reference to Fig. 4. As an example, the playback process in the control device 100 of the playback device 10 will be described. The playback process is similar in the control device 400 of the playback device 30. The processes in steps S111 to S113 and steps S115 to S118 shown in Fig. 4 are the same as those in steps S101 to S103 and steps S105 to S108 in the flowchart shown in Fig. 3.

[0071] When it is determined that the gaze is concentrated (Yes in step S113), the control device 100 performs fast-forward playback (step S114). More specifically, the control device 100 performs fast-forward playback or skip playback of the continuous recorded data or event recorded data that started to be played in step S111 by the playback control unit 121. Fast-forward playback means playing back faster than the normal playback speed, for example, playing back at 2.0 times the normal speed. Skip playback means playing back while skipping forward in units of, for example, 0.5 seconds to 1 second. The control device 100 proceeds to step S115.

[0072] <Effects> As described above, in this embodiment, when the person's line of sight is not focused on a certain range of the display screen of the display unit 216, playback can be performed at a faster speed than when the line of sight is focused on a certain range of the display screen. According to this embodiment, when the person's line of sight is not focused on a certain range of the display screen, the playback speed is increased, and the moving image can be checked efficiently.

[0073] In this embodiment, when the gaze of a person is not focused on a certain range of the display screen of the display unit 216, fast forward playback or skip playback is performed, and when the gaze of a person is focused on a certain range of the display screen, normal speed playback is performed. According to this embodiment, the moving image can be checked efficiently.

[0074] [Third embodiment] The playback device according to this embodiment will be described with reference to Figs. 5 to 7. Fig. 5 is a block diagram showing an example of the configuration of a playback device having a control device according to a third embodiment. Fig. 6 is a flowchart showing an example of the flow of a recording process in the control device according to the third embodiment. Fig. 7 is a flowchart showing an example of the flow of a playback process in the control device according to the third embodiment. In this embodiment, the playback device changes the playback method of the moving image depending on whether there is little variation in the line of sight of a person when the moving image is captured.

[0075] <Playback device (drive recorder)> The playback device 10 has the same basic configuration as the playback device 10 of the first embodiment.

[0076] <Playback control device (drive recorder control device)> The control device 100 has a basic configuration similar to that of the control device 100 of the first embodiment.

[0077] The image acquisition unit 200 acquires information on the captured video and the gaze direction of the person when the video was captured. In this embodiment, the image acquisition unit 200 is composed of a first camera 210, a capture data acquisition unit 111, a buffer memory 112, a capture data processing unit 113, a recording unit 212, a second camera 211, and a gaze detection unit 114.

[0078] The information on the detected gaze direction of a person is at least one of information indicating the gaze direction of a person and information indicating a change in the gaze direction of a person.

[0079] The gaze detection unit 114 detects at least one of information indicating a person's gaze direction and information indicating a change in the person's gaze direction.

[0080] The recording control unit 122 records information detecting the gaze direction of the person when the moving image was captured in the recording unit 212 in association with the captured moving image. More specifically, the recording control unit 122 records information detecting the gaze direction of the person when the moving image was captured based on the detection result of the gaze detection unit 114 in association with the captured moving image in the recording unit 212.

[0081] For example, when a passenger such as a driver of a vehicle gazes at an object such as a facility, a person, or another vehicle while the vehicle is traveling, in other words, when a video is being captured, the recording control unit 122 stores information indicating that there is little fluctuation in the passenger's gaze direction together with the captured video. For example, when a passenger such as a driver of a vehicle gazes at an object while the video is being captured, the recording control unit 122 stores information indicating that there is little fluctuation in the passenger's gaze direction together with the captured video.

[0082] The playback control unit 121 changes the playback method of the moving image depending on whether there is little variation in the gaze direction of the person when the moving image was captured. In other words, the playback control unit 121 changes the playback method of the moving image depending on whether there is little variation in the gaze direction of the person in the moving image being played back. More specifically, the playback control unit 121 changes the playback speed of the moving image and plays it back depending on whether there is little variation in the gaze direction of the person based on information that detects the gaze direction of the person stored together with the moving image.

[0083] A driver of a vehicle visually checks various directions to check for safety while the vehicle is traveling. "When there is little change in the gaze direction" refers to, for example, when the driver's gaze is mainly directed in the traveling direction and the gaze direction mainly changes to check for safety. For example, when the vehicle is traveling, the driver's gaze is mainly directed in the traveling direction, and even if the driver turns his gaze in a direction other than the traveling direction, it is for less than one second. "When there is a lot of change in the gaze direction" refers, for example, when the driver's gaze is mainly directed in the traveling direction while the vehicle is traveling, to, for example, turning to the right or left of the traveling direction multiple times in succession, for example, twice within one second or more or two seconds.

[0084] For example, if there are multiple passengers in a vehicle, it may be determined that there is a large variation in the gaze direction of the vehicle passengers if all of the passengers (e.g., about two people) or a predetermined ratio or more (two or more people when four passengers are on board) turn their gaze in the same direction at almost the same time. Determining based on the gaze of all passengers may be limited to cases where there are a small number of passengers, for example, about two people. A predetermined ratio or more may be, for example, more than half of the passengers.

[0085] In this embodiment, when the person's gaze direction fluctuates little during the capture period of the video, the playback control unit 121 plays back the video at a faster speed than when the gaze direction fluctuates a lot. When the person's gaze direction fluctuates little in the video being played back, the playback control unit 121 plays back the video at a faster speed than when the gaze direction fluctuates a lot.

[0086] In this embodiment, the playback control unit 121 fast-forwards or skips the video when there is little change in the gaze direction of the person during the capture period of the video, and plays the video at normal speed when there is much change in the gaze direction of the person. The playback control unit 121 fast-forwards or skips the video when there is little change in the gaze direction of the person during playback of the video, and plays the video at normal speed when there is much change in the gaze direction of the person. For example, the playback control unit 121 may perform fast-forward playback at double speed during a period when there is little gaze change. For example, the playback control unit 121 may perform skip playback during a period when there is little gaze change, in other words, during a period when the gaze change becomes small and then increases. The timing when the playback control unit 121 cancels fast-forward playback or skip playback and starts playback at normal speed may be the point when the gaze change becomes small and then increases. It is preferable that the timing is changed to a certain time before the point when the gaze change becomes small and then increases, for example, 2 seconds before.

[0087] <Playback device (electronic equipment)> 5, the playback device 30A includes an I / F 311, an operation unit 312, a display unit 313, and a control device 400A. The I / F 311, the operation unit 312, and the display unit 313 are configured in the same manner as in the first embodiment.

[0088] <Playback control device (control device for electronic devices)> The control device 400A has an image acquisition unit 411, an operation control unit 413, a playback control unit 418, and a display control unit 419. The operation control unit 413 and the display control unit 419 are configured similarly to the first embodiment. The playback control unit 418 is configured similarly to the playback control unit 121 of the playback device 10 of this embodiment.

[0089] The image acquisition unit 411 acquires, from an external system such as a drive recorder, information on the detected line-of-sight direction of a person when the moving image was captured, together with the captured moving image.

[0090] <Information processing in playback control device> Next, the flow of the recording process in the control device 100 will be described with reference to Fig. 6. While the playback device 10 is operating, the process of the flowchart shown in Fig. 6 is executed.

[0091] 6 starts, the control device 100 starts gaze detection, event detection, and normal recording (step S201), and while the process of Fig. 6 is being executed, in other words, while the playback device 10 is operating, continues gaze detection by the gaze detection unit 114, event detection by the event detection unit 117, and normal recording by the recording control unit 122. The control device 100 proceeds to step S202.

[0092] The control device 100 determines whether an event has been detected (step S202). More specifically, the control device 100 detects that an event has occurred when the acceleration information acquired by the event detection unit 117 from the acceleration sensor 214 is equal to or greater than a threshold value. When the control device 100 determines that an event has been detected (Yes in step S202), the control device 100 proceeds to step S203. When the control device 100 does not determine that an event has been detected (No in step S202), the control device 100 proceeds to step S204.

[0093] When it is determined that an event has been detected (Yes in step S202), the control device 100 executes an event recording process (step S203). The control device 100 proceeds to step S204.

[0094] In the event recording process in step S203, the control device 100 causes the recording control unit 122 to store the captured video data as event data in the recording unit 212 while prohibiting overwriting. The event data is captured data including the time before and after the event detection time.

[0095] When it is not determined that an event has been detected (No in step S202), the control device 100 proceeds to step S204 while continuing the normal recording process.

[0096] In the normal recording process, the control device 100 causes the recording control unit 122 to store the captured image data in the recording unit 212 as an overwritable normal file.

[0097] The control device 100 judges whether or not to end the recording process (step S204). For example, it is judged that the process should be ended when the power or motive power of the vehicle is turned off, or when the operation unit 213 is operated. If it is judged that the process should be ended (Yes in step S204), the control device 100 ends this process. If it is not judged that the process should be ended (No in step S204), the control device 100 proceeds to step S202. In other words, gaze detection, event detection, and normal recording are continued. By performing such processing, the control device 100 generates and records shooting data including information on the detected gaze direction.

[0098] Next, the playback process will be described with reference to Fig. 7. As an example, the playback process in the control device 100 of the playback device 10 will be described. The playback process is similar in the control device 400A of the playback device 30A. The processes in steps S211, S212, and S216 to S218 shown in Fig. 7 are similar to those in steps S101, S102, and S106 to S108 in the flowchart shown in Fig. 3.

[0099] The control device 100 determines whether or not there is little line-of-sight variation (step S213). More specifically, the control device 100 detects that there is little variation in the person's line-of-sight direction based on information detecting the person's line-of-sight direction stored in association with the video being played back. If the control device 100 determines that there is little line-of-sight variation (Yes in step S213), it proceeds to step S214. If the control device 100 does not determine that there is little line-of-sight variation (No in step S213), it proceeds to step S218.

[0100] When it is determined that the line of sight variation is small (Yes in step S213), the control device 100 performs fast-forward playback or skip playback (step S214). More specifically, the control device 100 performs fast-forward playback or skip playback of the continuous recorded data or the event recorded data by the playback control unit 121. The control device 100 causes the display control unit 119 to display the continuous recorded data or the event recorded data that has been fast-forward played by the playback control unit 121 on the display unit 216. The control device 100 proceeds to step S215.

[0101] The control device 100 determines whether the state with little gaze movement continues (step S215). More specifically, the control device 100 determines whether the state with little gaze movement continues based on information detecting the gaze direction of the person stored in association with the video being played back. If the control device 100 determines that the state with little gaze movement continues (Yes in step S215), it proceeds to step S216. If the control device 100 does not determine that the state with little gaze movement continues (No in step S215), it proceeds to step S217.

[0102] In this way, the control device 100 changes the playback method of the moving image depending on whether there is little fluctuation in the line of sight of the person when the moving image is captured.

[0103] <Effects> As described above, in this embodiment, the playback method of the moving image can be changed depending on whether there is little change in the line of sight of the person when the moving image is captured.

[0104] According to this embodiment, when the fluctuation of the gaze direction of a person during shooting of a moving image is small, the moving image can be played back at a faster speed than when the fluctuation of the gaze direction is large. According to this embodiment, when the fluctuation of the gaze direction of a person during shooting of a moving image is small, the moving image can be played back at a high speed, and the moving image can be efficiently checked.

[0105] In this embodiment, when there is little change in the gaze direction of a person when the moving image is shot, the moving image can be played back in fast forward or skip, and when there is a lot of change in the gaze direction, the moving image can be played back at normal speed. According to this embodiment, when there is little change in the gaze direction when the moving image is shot, the moving image can be played back in fast forward or skip, so that the moving image can be checked efficiently. According to this embodiment, when there is a lot of change in the gaze direction when the moving image is shot, the playback speed can be slowed down to make it easier to check the moving image.

[0106] In this way, according to the present embodiment, it is easy to play back and check the video within the range in which the desired scene is assumed to be captured, and it is easy to detect the scene from the video.

[0107] [Fourth embodiment] The playback device 10 according to this embodiment will be described with reference to FIG. 8. FIG. 8 is a flowchart showing an example of the flow of playback processing in a control device according to the fourth embodiment. The playback device 10 has a basic configuration similar to that of the playback device 10 of the third embodiment. A case where the playback device is a drive recorder will be described. When the playback device is an electronic device, the same functions are implemented in the playback device 30A.

[0108] The playback control unit 121 plays the video at normal speed when there is little change in the gaze direction of the person when the video is captured, and plays the video in slow motion or pauses it when there is a lot of change in the gaze direction of the person. More specifically, based on information on the detected gaze direction of the person stored together with the video, the playback control unit 121 plays the video at normal speed when there is little change in the gaze direction of the person, and plays the video in slow motion or pauses it when there is a lot of change in the gaze direction of the person.

[0109] When pausing, the playback control unit 121 may cancel the pause by a pause cancel operation by the user, or may stop the playback for only a period of time, such as three seconds.

[0110] Next, the playback process will be described with reference to Fig. 8. As an example, the playback process in the control device 100 of the playback device 10 will be described. The playback process is similar in the control device 400 of the playback device 30. The processes in steps S221, S222, and S226 to S228 shown in Fig. 8 are similar to those in steps S211, S212, and S216 to S218 in the flowchart shown in Fig. 7.

[0111] The control device 100 determines whether there is a lot of gaze variation (step S223). More specifically, the control device 100 detects that there is a lot of variation in the gaze direction of the person based on information detecting the gaze direction of the person stored in association with the moving image being played back. If the control device 100 determines that there is a lot of gaze variation (Yes in step S223), it proceeds to step S224. If the control device 100 does not determine that there is a lot of gaze variation (No in step S223), it proceeds to step S228.

[0112] When it is determined that there is a lot of gaze fluctuation (Yes in step S223), the control device 100 performs slow playback or pauses (step S224). More specifically, the control device 100 performs slow playback or pauses the continuous recorded data or event recorded data by using the playback control unit 121. The control device 100 causes the display control unit 119 to display the continuous recorded data or event recorded data played back in fast forward by the playback control unit 121 on the display unit 216. The control device 100 proceeds to step S225.

[0113] The control device 100 determines whether the state in which there is a lot of gaze variation continues (step S225). More specifically, the control device 100 determines whether the state in which there is a lot of gaze variation continues based on information that detects the gaze direction of a person stored in association with the video being played back. If the control device 100 determines that the state in which there is a lot of gaze variation continues (Yes in step S225), it proceeds to step S226. If the control device 100 does not determine that the state in which there is a lot of gaze variation continues (No in step S225), it proceeds to step S227.

[0114] <Effects> As described above, in this embodiment, when the fluctuation of the gaze direction of the person during shooting of the moving image is small, the moving image is played back at normal speed, and when the fluctuation of the gaze direction is large, the moving image can be played back in slow motion or paused. According to this embodiment, when the fluctuation of the gaze direction of the person during shooting of the moving image is large, the playback speed can be slowed down to make the moving image easier to check.

[0115] [Fifth embodiment] The playback device 30A according to the present embodiment will be described with reference to Figs. 9 and 10. Fig. 9 is a diagram illustrating the range on the display screen where the gazes are concentrated. Fig. 10 is a flowchart showing an example of the flow of playback processing in the control device according to the fifth embodiment. In this embodiment, the playback device changes the playback method of the moving image based on the range on which the gazes of people are concentrated during shooting and the gaze direction relative to the display unit 216.

[0116] <Playback device (drive recorder)> The playback device 10 has a basic configuration similar to that of the playback device 10 of the first and third embodiments. The playback device 10 changes the playback method of the moving image based on the range in which the gaze of the person is concentrated when the moving image is captured and the gaze direction with respect to the display unit 216.

[0117] <Playback control device (drive recorder control device)> The control device 100 has a basic configuration similar to that of the control device 100 of the first and third embodiments. The photographed data acquisition unit 111, the buffer memory 112, the photographed data processing unit 113, the operation control unit 116, the event detection unit 117, the position information acquisition unit 118, the display control unit 119, and the storage unit 120 are similar to those of the first embodiment. The image acquisition unit 200, the gaze detection unit 114, and the recording control unit 122 are similar to those of the third embodiment.

[0118] The playback control unit 121 changes the playback method of the video based on the range where people's gazes are concentrated in the video being played back and the gaze direction detected by the gaze detection unit 114 with respect to the display unit 216. More specifically, the playback control unit 121 changes the playback method of the video based on information on the detected gaze direction of the person stored together with the video and the gaze direction detected by the gaze detection unit 114 with respect to the display unit 216, in accordance with the range where people's gazes are concentrated in the video being played back and the gaze direction of the user who is the viewer of the video.

[0119] In this embodiment, when the range in which people's gazes are concentrated in the video being played back matches the gaze direction detected by gaze detection section 114 with respect to display section 216, playback control section 121 plays back the video at a slower speed than when they do not match. More specifically, based on information on the detected gaze direction of the person stored together with the video and the gaze direction detected by gaze detection section 114 with respect to display section 216, when the range in which people's gazes are concentrated in the video being played back matches the gaze direction detected by gaze detection section 114 with respect to display section 216, playback control section 121 plays back the video at a slower speed than when they do not match.

[0120] In this embodiment, when the range in which people's gazes are concentrated in the video being played back matches the gaze direction detected by gaze detection unit 114 with respect to display unit 216, playback control unit 121 plays the video at normal speed, and when they do not match, plays the video at fast forward. More specifically, based on information on the detected gaze direction of the person stored together with the video and the gaze direction detected by gaze detection unit 114 with respect to display unit 216, playback control unit 121 plays the video at normal speed when the range in which people's gazes are concentrated in the video being played back matches the gaze direction detected by gaze detection unit 114 with respect to display unit 216, and plays the video at fast forward when they do not match.

[0121] As shown in FIG. 9, for example, display screen 216a of display unit 216 on which a moving image is displayed is virtually divided into three areas, such as a left part, a center part, and a right part. Division in the vertical direction is not necessary. The number of divisions is not limited. The displayed moving image is an image of first camera 210 facing forward of the vehicle. In the moving image being played back, the range in which the gaze is concentrated on display screen 216a of display unit 216 is indicated by A. For example, when the gaze direction detected by gaze detection unit 114 during playback of the moving image matches range A, playback control unit 121 plays back the moving image at normal speed, and when it does not match range A, plays back the moving image at fast forward.

[0122] During playback of a video, if there is a tendency to gaze to the right based on the gaze direction detected by gaze detection unit 114, in other words, the gaze direction of the user who is the viewer of the video, it is determined that there is a match if the gaze information of the person associated with the video is gazing to the right of the vehicle's traveling direction. The direction in which the person is gazing does not need to be a strict angle, and can be determined to be forward, left, right, etc.

[0123] <Playback device (electronic device)> The playback device 30 is similar to the playback device 30 of the first embodiment.

[0124] <Playback control device (control device for electronic devices)> The control device 400 is similar to the control device 400 of the first and third embodiments. The gaze detection unit 412, the operation control unit 413, and the display control unit 419 are configured similarly to the first embodiment. The image acquisition unit 411 is configured similarly to the third embodiment. The playback control unit 418 is configured similarly to the playback control unit 121 of the playback device 10 of this embodiment.

[0125] <Information processing in playback control device> Next, the flow of processing in the control device will be described with reference to Fig. 10. As an example, the playback processing in the control device 100 of the playback device 10 will be described. The playback processing is similar in the control device 400 of the playback device 30. The processing in steps S301, S302, and S306 shown in Fig. 10 is similar to the processing in steps S101, S102, and S108 in the flowchart shown in Fig. 3.

[0126] The control device 100 determines whether the gaze directions match (step S303). More specifically, the control device 100 detects whether the range in which the gaze of the person in the moving image being played back is concentrated matches the gaze direction detected by the gaze detection unit 114 for the display unit 216. If the control device 100 determines that the gaze directions match (Yes in step S303), it proceeds to step S304. If the control device 100 does not determine that the gaze directions match (No in step S303), it proceeds to step S305.

[0127] When it is determined that the line of sight directions match (Yes in step S303), the control device 100 performs normal speed playback or continues normal speed playback (step S304). More specifically, the control device 100 performs normal speed playback or continues normal speed playback of the continuous recorded data or event recorded data by the playback control unit 121. In the process of step S304, if the process progresses from step S302 via Yes in step S303, the control device 100 continues normal speed playback of the continuous recorded data or event recorded data being played back at normal speed. In the process of step S304, if the process progresses from step S305 via No in step S306 and Yes in step S303, the control device 100 changes the fast-forward playback of the continuous recorded data or event recorded data to normal speed playback. The control device 100 proceeds to step S306.

[0128] If it is not determined that the line of sight directions match (No in step S303), the control device 100 performs fast-forward playback (step S305). More specifically, the control device 100 performs fast-forward playback of the continuous recorded data or the event recorded data by the playback control unit 121. The control device 100 proceeds to step S306.

[0129] In this way, the control device 100 changes the playback method of the moving image based on the range in which the gazes of the passengers in the vehicle are concentrated and the direction of their gazes with respect to the display unit 216.

[0130] <Effects> As described above, in this embodiment, the playback method of a moving image can be changed based on the range in which a person's gaze is concentrated in the moving image being played back and the gaze direction detected by gaze detection unit 114 relative to display unit 216.

[0131] According to this embodiment, when the range in which people's gazes are concentrated in the video being played back matches the gaze direction detected by gaze detection section 114 with respect to display section 216, the video can be played back at a slower speed than when they do not match. According to this embodiment, when the range in which people's gazes are concentrated in the video being played back matches the gaze direction detected by gaze detection section 114, the playback speed can be slowed down to make the video easier to check.

[0132] According to this embodiment, when the range in which people's gazes are concentrated in the moving image being played back matches the gaze direction detected by gaze detection unit 114 with respect to display unit 216, the moving image can be played back at normal speed, and when they do not match, the moving image can be played back in fast forward. According to this embodiment, when the range in which people's gazes are concentrated in the moving image being played back matches the gaze direction detected by gaze detection unit 114, the moving image can be played back at a fast speed, allowing the moving image to be checked efficiently.

[0133] [Sixth embodiment] The playback device 10 according to this embodiment will be described with reference to FIG. 11. FIG. 11 is a flowchart showing an example of the flow of playback processing in a control device according to the sixth embodiment. The playback device 10 has a basic configuration similar to that of the playback device 10 of the first embodiment. A case where the playback device is a drive recorder will be described. When the playback device is an electronic device, the playback device 30 is implemented with similar functions.

[0134] When the range in which a person's gaze is concentrated in the video being played back matches the gaze direction detected by gaze detection unit 114 relative to display unit 216, playback control unit 121 plays the video in slow motion or pauses it, and when they do not match, plays the video at normal speed.

[0135] Next, the flow of processing in the control device 100 will be described with reference to FIG. 11. As an example, the playback processing in the control device 100 of the playback device 10 will be described. The playback processing in the control device 400 of the playback device 30 is also equivalent. The processing in steps S311, S312, and S316 shown in FIG. 11 is similar to that in steps S101, S102, and S108 in the flowchart shown in FIG. 3. The processing in step S312 shown in FIG. 11 is similar to that in step S302 in FIG. 10.

[0136] When it is determined that the line of sight directions match (Yes in step S313), the control device 100 performs slow playback or pauses (step S314). More specifically, the control device 100 performs slow playback or pauses the continuous recorded data or event recorded data through the playback control unit 121. The control device 100 proceeds to step S316.

[0137] If it is not determined that the line of sight directions match (No in step S313), the control device 100 continues normal speed playback or normal speed playback (step S315). More specifically, the control device 100 performs normal speed playback or continues normal speed playback of the continuous recorded data or event recorded data through the playback control unit 121. In the process of step S315, if the process progresses from step S312 via No in step S313, playback at normal speed is continued for the continuous recorded data or event recorded data being played back at normal speed. In the process of step S315, if the process progresses from step S314 via No in step S316 and No in step S313, playback of the continuous recorded data or event recorded data being played back in slow motion or paused is changed to playback at normal speed.

[0138] <Effects> As described above, according to this embodiment, when the range in which people's gazes are concentrated in the video being played back matches the gaze direction detected by gaze detection unit 114 with respect to display unit 216, the video can be played back in slow motion or paused, and when they do not match, the video can be played back at normal speed. According to this embodiment, when the range in which people's gazes are concentrated in the video being played back matches the gaze direction detected by gaze detection unit 114, the video can be played back in slow motion or paused to make it easier to check the video.

[0139] The playback device according to the present disclosure may be embodied in various different forms other than the embodiment described above.

[0140] Each component of the illustrated playback device is a functional concept, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to that shown in the figure, and all or part of the device may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0141] The configuration of the playback device is realized, for example, as software, by a program loaded into a memory. In the above embodiment, the functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms, by hardware alone, software alone, or a combination of both.

[0142] The above-mentioned components include those that a person skilled in the art can easily imagine and those that are substantially the same. Furthermore, the above-mentioned configurations can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations are possible without departing from the scope of the present invention. [Explanation of symbols]

[0143] 10 Playback device 100 Control device (playback control device) 111 Shooting data acquisition section 112 Buffer Memory 113 Shooting data processing section 114 Gaze detection unit 116 Operation control section 117 Event detection unit 118 Location information acquisition unit 119 Display control section 120 Storage section 121 Playback control section 122 Recording control section 200 Image acquisition unit 210 First Camera 211 Second Camera 212 Recording Department 213 Operation section 214 Acceleration Sensor 215 GNSS receiver 216 Display section

Claims

1. An image acquisition unit that acquires information on a moving image captured in a vehicle and the gaze direction of a person who is a driver or a passenger of the vehicle at the time the moving image was captured; a playback control unit that plays back the moving image acquired by the image acquisition unit; a display control unit that displays the moving image played back by the playback control unit on a display unit; the playback control unit changes a playback method of the moving image depending on whether there is little change in the person's line of sight when the moving image is captured. playback device.

2. the playback control unit plays back the moving image at a faster speed when there is little change in the person's line of sight during shooting of the moving image than when there is a lot of change in the person's line of sight. The playback device according to claim 1 .

3. the playback control unit plays back the moving image at a fast forward speed or a skip speed when there is little change in the person's line of sight during shooting of the moving image, and plays back the moving image at a normal speed when there is much change in the person's line of sight during shooting of the moving image. The playback device according to claim 2 .

4. the playback control unit plays back the moving image at a normal speed when there is little change in the person's line of sight during shooting of the moving image, and plays back or pauses the moving image at a slow speed when there is much change in the person's line of sight during shooting of the moving image. The playback device according to claim 2 .

5. An image acquisition step of acquiring a moving image captured in a vehicle and information detecting the line of sight of a person who is a driver or a passenger of the vehicle at the time of capturing the moving image; a playback control step of changing a playback method for playing back the moving image acquired in the image acquisition step depending on whether or not there is little change in the line of sight of the person when the moving image is captured; a display control step of displaying the moving image played back in the playback control step on a display unit; A playback method executed by a playback device.

Images