Reproducing apparatus, reproducing method, and storage medium

Abstract

This invention relates to a playback apparatus, a playback method, and a storage medium. The recording and playback apparatus (10) includes a recording data acquisition unit (120) for acquiring captured data, an event detection unit (127) for detecting the occurrence of an event involving a moving body, a recording control unit (123), a display unit (141) for displaying images contained in the event recording data, a gaze detection unit (130), and a playback control unit (124). The recording control unit (123) saves captured data for a predetermined period as event recording data from at least a portion of the captured data based on event detection. The gaze detection unit (130) detects the user's gaze directed towards the display unit (141). The playback control unit (124) starts playback of the event recording data if it detects the user's gaze directed towards the display unit within a predetermined period from the detection of the event.

Description

[0001] This application is a divisional application based on the invention patent with application number 201980069607.6, application date December 13, 2019, applicant JVC Kenwood Corporation, entitled “Recording and Reproducing Apparatus, Recording and Reproducing Method and Procedure”. Technical Field

[0002] This invention relates to a reproduction apparatus, a reproduction method, and a storage medium. Background Technology

[0003] Dashcams are becoming increasingly common. These dashcams include a unit that captures images and other data by recording the conditions around the vehicle, and a unit that detects when the vehicle is subjected to an impact. They can reproducibly save images for a predetermined period based on the time point at which the impact was detected. For example, Patent Document 1 discloses a dashcam that records image data based on the progression of acceleration. In the event of an accident, such a dashcam can reproducibly save the accident's details. Furthermore, in the event of abnormal acceleration detected due to dangerous driving, the dashcam can reproducibly save the dangerous driving situation.

[0004] Existing technical documents

[0005] Patent documents

[0006] Patent document 1: Japanese Patent Application Publication No. 2009-087007. Summary of the Invention

[0007] The problem that the invention aims to solve

[0008] However, many dashcam users are unfamiliar with how to operate their devices. Furthermore, in the event of an accident or other incident, users may not be able to immediately perform complex operations. Therefore, users sometimes cannot properly reproduce the footage saved by the dashcam.

[0009] This embodiment was made to solve such a problem, and provides a recording and playback device that can reproduce saved data without performing complicated operations.

[0010] means for solving problems

[0011] This embodiment relates to a recording and playback device, installed on a moving body, for recording and playback of shooting data captured by a camera. The recording and playback device includes: a shooting data acquisition unit, an event detection unit, a recording control unit, a display unit, a gaze detection unit, and a playback control unit. The shooting data acquisition unit acquires the shooting data. The event detection unit detects an event occurring on the moving body. Based on the event detection, the recording control unit saves at least a portion of the shooting data for a predetermined period as event recording data. The gaze detection unit detects that a user's gaze is directed towards the display unit, which displays the event recording data. The playback control unit begins playback of the event recording data when the gaze detection unit detects that the user's gaze is directed towards the display unit within a predetermined period from the detection of the event.

[0012] This embodiment relates to a recording and playback method for recording and playing back captured data from a camera mounted on a moving body. The recording and playback method includes a data acquisition step, an event detection step, a recording control step, a gaze detection step, and a playback control step. The data acquisition step acquires captured data from the camera mounted on the moving body. The event detection step detects an event occurring in relation to the moving body. The recording control step, based on the event detection, saves at least a portion of the captured data for a predetermined period as event recording data. The gaze detection step detects that a user's gaze is directed towards a display unit, which displays the event recording data. The playback control step begins playback of the event recording data when the gaze detection step detects that the user's gaze is directed towards the display unit within a predetermined period from the detection of the event.

[0013] The program involved in this embodiment is executed by a computer, which causes the recording and playback device to operate. The recording and playback method includes a data acquisition step, an event detection step, a recording control step, a gaze detection step, and a playback control step. The data acquisition step acquires data captured by a camera mounted on a moving body. The event detection step detects that an event has occurred targeting the moving body. The recording control step saves at least a portion of the captured data for a predetermined period as event recording data based on the event detection. The gaze detection step detects that the user's gaze is directed towards a display unit, which is used to display the event recording data. The playback control step begins playback of the event recording data when the gaze detection step detects that the user's gaze is directed towards the display unit within a predetermined period from the detection of the event.

[0014] Invention Effects

[0015] According to this embodiment, a recording and playback device or the like can be provided to reproduce saved data without performing complicated operations. Attached Figure Description

[0016] Figure 1 This is a block diagram showing the configuration of the recording and reproduction apparatus according to Embodiment 1.

[0017] Figure 2 This is a right view of the recording and playback apparatus according to Embodiment 1.

[0018] Figure 3 This is a rear view of the recording and playback apparatus according to Embodiment 1.

[0019] Figure 4 This is a front view of the recording and playback apparatus according to Embodiment 1.

[0020] Figure 5 This is the first graph showing the relationship between the captured data stored in the recording and playback device and time.

[0021] Figure 6 This is the second graph showing the relationship between the captured data stored in the recording and playback device and time.

[0022] Figure 7 It is a flowchart of the event detected by the recording and reproduction device.

[0023] Figure 8 This is a flowchart of the recording and reproduction device according to Embodiment 1 when reproducing event recording data.

[0024] Figure 9 This is a schematic diagram of a recording and playback apparatus according to a variation of Embodiment 1.

[0025] Figure 10 This is a block diagram showing the configuration of the recording unit according to a variation of Embodiment 1.

[0026] Figure 11 This is a block diagram illustrating the configuration of a reproduction device according to a variation of Embodiment 1.

[0027] Figure 12 This is a diagram illustrating an example of the shooting data acquired by the gaze detection camera according to Embodiment 2.

[0028] Figure 13 This is a flowchart illustrating the recording and playback device according to Embodiment 2 when reproducing event recording data. Detailed Implementation

[0029] For clarity, the following descriptions and figures have been appropriately omitted and simplified. Furthermore, in the figures, the same symbols are used to denote the same elements, and repeated descriptions are omitted where necessary.

[0030] <Implementation Method 1>

[0031] Hereinafter, the configuration of Embodiment 1 will be described with reference to the accompanying drawings. The recording and playback device 10 according to this embodiment is installed on a vehicle such as a car, which is a mobile unit, and records and plays back captured data from a camera; for example, it is a device called a dashcam. The recording and playback device 10 has the following function: triggered by an impact such as a sudden impact, it records captured data within a preset period as "event recording data" in a reproducible manner. The driver of the car or other vehicle can understand the situation of the event by playing back the event recording data and viewing the reproduced event recording data image.

[0032] Figure 1 This is a block diagram showing the configuration of the recording and playback apparatus according to Embodiment 1. As shown, the recording and playback apparatus 10 has a control unit 100 that manages the control of each component and multiple components connected to the control unit 100. The control unit 100 is a control device that has a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a memory, and a circuit board with multiple interfaces, etc., and executes stored programs to perform various processes.

[0033] The details of the control unit 100 will be described below. The control unit 100 includes a shooting data acquisition unit 120, a buffer memory 121, a shooting data processing unit 122, a recording control unit 123, a playback control unit 124, an operation control unit 125, a display control unit 126, an event detection unit 127, a position information acquisition unit 128, a timer 129, a gaze detection unit 130, and a light emission control unit 131. The execution of these processes and controls is achieved through a program executed by the control unit 100. For convenience, these components are shown as being connected to the bus 110.

[0034] The image data acquisition unit 120 acquires image data provided by the camera 150. The image data acquisition unit 120 provides the image data to the buffer memory 121 via the bus 110. In addition, the image data acquisition unit 120 acquires image data provided by the gaze detection camera 151 and provides the acquired image data to the gaze detection unit 130.

[0035] The buffer memory 121 is a volatile or non-volatile memory device. The buffer memory 121 receives periodically generated shooting data from the camera 150 sequentially via the shooting data acquisition unit 120, and temporarily stores the received shooting data. The shooting data temporarily stored in the buffer memory 121 is within a preset period. The buffer memory 121 sequentially deletes shooting data that has elapsed within the preset period, or sequentially overwrites it with newly received shooting data.

[0036] The shooting data processing unit 122 generates a shooting file in a pre-set format based on the shooting data stored in the buffer memory 121. The pre-set format is, for example, H.264, MPEG-4 (Moving Picture Experts Group), etc.

[0037] In addition, the shooting data processing unit 122 can also process the shooting data to generate a shooting file with a preset field of view. Furthermore, the shooting data processing unit 122 can also process the shooting data output from the buffer memory 121 to generate shooting data with a preset time or preset field of view, and add header information such as filenames, thereby generating a shooting file. Additionally, the shooting data processing unit 122 can process the shooting data output from the buffer memory 121 to perform noise removal or distortion correction, and can also generate a shooting file that displays time information, vehicle speed information, or vehicle position information in the shooting data.

[0038] The recording control unit 123 controls the recording device 160 to save the captured files generated by the shooting data processing unit 122. When the event detection unit 127 detects an event, the recording control unit 123, based on the event detection, saves the captured files within a preset period as event recording data that cannot be overwritten in the recording device 160. The recording control unit 123 saves the event recording data in a predetermined recording area in the recording device 160. The predetermined recording area is, for example, a storage area that is determined to be un-overwritten or un-deleted. Alternatively, the event recording data provided to the recording device 160 by the recording control unit 123 may also include a flag indicating un-overwritten or un-deleted behavior within the file for saving.

[0039] Furthermore, the recording control unit 123 records information in the recording device 160 indicating whether the event recording data stored in the recording device 160 has been reproduced by the reproduction control unit 124 in the past. Therefore, the reproduction control unit 124 can identify which event recording data has not been reproduced.

[0040] Furthermore, when the event detection unit 127 does not detect an event, the recording control unit 123 can store the captured file in the recording device 160 as an overwriteable file. Here, the captured file stored in the recording device 160 that is different from the event recording data is referred to as a "normal file". The recording control unit 123 may also delete the old file from the normal file and record the newly generated normal file in the recording device 160 when the storage capacity of the recording device 160 reaches its limit.

[0041] The playback control unit 124 processes the saved event recording data for playback under preset conditions. The preset conditions refer to the situation where the user's gaze is detected as being directed toward the display unit 141 within a preset period after the event is detected. In this case, the playback control unit 124 receives a signal from the gaze detection unit 130 indicating that the user's gaze is directed toward the display unit 141.

[0042] The playback control unit 124 monitors the timer 129 and determines whether a preset period has elapsed since the event was detected. When playbacking event recording data, the playback control unit 124 reads the event recording data recorded in the recording device 160 and provides the read event recording data to the display control unit 126. Furthermore, the preset period, such as 1 minute, 3 minutes, or 5 minutes, is an appropriate period used to generate a playback request for event recording data after an event such as an accident has occurred, in order to confirm the event.

[0043] Upon detecting an event, specifically if the user's gaze is directed towards the display unit 141 within a preset period from the moment the event was detected, the playback control unit 124 begins playing back the event recording data. Similarly, if the user's gaze is directed towards the display unit 141 within a preset period from the end of saving the event recording data, the playback control unit 124 may begin playing back the event recording data. Furthermore, if the user's gaze is detected towards the display unit 141 before the end of saving the event recording data, playback of the saved event recording data may begin after the end of saving the event recording data; if the event recording data can be played back before the end of saving the event recording data, playback of the event recording data may begin.

[0044] The operation control unit 125 acquires operation information received from the operation unit 140 and outputs operation instructions based on the operation information to each component. When the operation unit 140 receives a selection instruction for various data that is to be reproduced, the operation control unit 125 instructs the reproduction control unit 124 to select files, etc., recorded in the recording device 160. When the operation unit 140 receives an instruction related to the reproduction of various data, the operation control unit 125 instructs the reproduction control unit 124 to perform reproduction-related processing. Instructions related to the reproduction of various data include, for example, reproduction start, temporary stop, reproduction stop, magnified display, etc.

[0045] The display control unit 126 controls the display unit 141 to display various information. For example, the display control unit 126 displays the shooting data being captured by the camera 150 on the display unit 141. Furthermore, the display control unit 126 receives event recording data provided from the playback control unit 124 and displays the received event recording data on the display unit 141. When the touch sensor is superimposed on the display unit 141 and functions as an operation unit 140, the display control unit 126 appropriately displays icons or the like corresponding to the touch sensor on the display unit 141.

[0046] The event detection unit 127 receives information related to the acceleration detected by the acceleration sensor 142, and detects that a predetermined event has occurred based on the signal magnitude and signal pattern of the received information. The so-called externally received acceleration refers to the acceleration received by the recording and playback device 10 from outside the recording and playback device, such as the acceleration generated by the impact when a car collides with other objects.

[0047] When the event detection unit 127 detects that the information received from the acceleration sensor 142 corresponds to the occurrence of a predetermined event, it provides a signal indicating that the event has occurred to the image data processing unit 122. The occurrence of an event refers to the detection of acceleration generated in an accident-like situation, such as an impact caused by emergency braking or an impact when an object collides with a vehicle. For example, the event detection unit 127 detects an event when acceleration exceeding a predetermined magnitude is detected for a predetermined period in a predetermined direction, or when there is a large change in acceleration within a predetermined period. Furthermore, the event detection unit 127 can detect acceleration along the X, Y, and Z axes of a three-axis coordinate system, or acceleration in at least one of these directions. It can also weight the acceleration received from these three axes. Additionally, the event detection unit 127 provides a signal indicating that the event has occurred to the timer 129.

[0048] The location information acquisition unit 128 receives signals from GPS satellites received by the GPS (Global Positioning System) receiver 143, acquires location information from the received signals, and provides the acquired location information to the recording control unit 123. The location information is information related to the current location. For example, the location information includes the vehicle's latitude and longitude at the time the signal was received from the GPS satellite.

[0049] The timer 129 receives a signal from the event detection unit 127 indicating that an event has been detected, and uses this signal as a trigger signal to reset the timer's count value and start working. Furthermore, when the timer 129 starts working, it counts until a preset period has elapsed.

[0050] The gaze detection unit 130 receives image data acquired by the image acquisition unit 120 from the gaze detection camera 151, and detects the user's gaze direction toward the display unit 141 from the received image data. The gaze detection unit 130 identifies the position of the eyes contained in the user's face from the received image data, and analyzes the movement of the pupils and Purkinje images in the detected eyes to detect the gaze. Furthermore, gaze detection technology is well known to those skilled in the art, and a detailed description is omitted here.

[0051] The gaze detection unit 130 receives capture data from the capture data acquisition unit 120 corresponding to the frame rate (e.g., 30 frames per second) of the gaze detection camera 151. One example of detecting a user's gaze towards the display unit 141 is when the user's gaze remains directed towards the display unit 141 for a predetermined period (e.g., 1 second). Another example of detecting a user's gaze towards the display unit 141 is when the user's gaze is directed towards the display unit 141 at a frequency of 80% or more for a preset period (e.g., 1.5 seconds). As described above, within the preset period, when the frequency of the user's gaze towards the display unit 141 is high, the gaze detection unit 130 provides a signal indicating that the user's gaze is towards the display unit 141 to the playback control unit 124.

[0052] The light-emitting control unit 131 is a driver that controls the light-emitting device 152. When performing gaze detection, the light-emitting control unit 131 appropriately provides a signal to the light-emitting device 152 to illuminate the light-emitting device 152.

[0053] Next, the components connected to the control unit 100 will be described. The recording and playback device 10 includes an operation unit 140, a display unit 141, an acceleration sensor 142, a GPS receiver 143, a camera 150, a line-of-sight detection camera 151, a light-emitting device 152, and a recording device 160.

[0054] The operation unit 140 is a user interface that receives operations performed by the user on the recording and playback device 10. The user interface may be, for example, an operation button or a touch sensor superimposed on the display unit 141. Alternatively, the user interface may be an infrared or wireless communication receiver, or a component that receives signals transmitted from a remote control or similar device. The operation unit 140 provides the control unit 100 with information related to the received operation, i.e., operation information, via a predetermined interface. Operation information may include, for example, an instruction to start event recording or an instruction to reproduce event recording data.

[0055] Display unit 141 is a display device that displays various information under the control of display control unit 126. Display unit 141 may have, for example, at least a liquid crystal panel or an organic EL (Electroluminescence) display panel. Display unit 141 is connected to display control unit 126 and displays signals provided from display control unit 126. Display unit 141 is configured to display images contained in event recording data.

[0056] Accelerometer 142, for example, is a triaxial accelerometer and is installed at any location within the recording and playback apparatus 10. Accelerometer 142 detects the acceleration applied to it and provides information related to the detected acceleration to the control unit 100 in response to the detected acceleration. Accelerometer 142 is connected to event detection unit 127 and provides information related to the detected acceleration to event detection unit 127. Furthermore, other configurations may appropriately utilize the acceleration-related status provided to the control unit 100 by accelerometer 142; more specifically, the playback control unit 124 also utilizes the acceleration-related information received from accelerometer 142. Alternatively, instead of a triaxial accelerometer, accelerometer 142 may be a single-axis or two-axis accelerometer.

[0057] The GPS receiver 143 receives information related to the vehicle's current location via a satellite positioning system called GPS or GNSS (Global Navigation Satellite System). The GPS receiver 143 can be an antenna for receiving GPS signals or a communication interface for receiving location information acquired by the vehicle. The GPS receiver 143 provides signals related to the received current location to the location information acquisition unit 128.

[0058] Camera 150 is an imaging device that includes an objective lens, an imaging element, and an AD (Analog to Digital) conversion element. Camera 150 captures images of the scenery surrounding a moving object, i.e., a vehicle, and generates data of the captured images, i.e., imaging data. Camera 150 provides the generated imaging data to imaging data acquisition unit 120.

[0059] The gaze detection camera 151 is an imaging device for detecting the gaze of a user contained in the face of the user being photographed. The gaze detection camera 151 photographs the user's face and generates image data, i.e., image data. The gaze detection camera 151 provides the generated image data to the image data acquisition unit 120.

[0060] The light-emitting device 152 is a device that emits light for gaze detection, such as an LED (light-emitting diode). The light-emitting device 152 emits infrared light, for example, with a wavelength of 850 nanometers, into the field of view of the gaze detection camera 151. The light-emitting device 152 emits infrared light, and the gaze detection camera 151 captures an image of the user's eyeball reflecting the infrared light, thereby detecting the user's gaze.

[0061] Recording device 160 is a recording device that stores the captured data provided by camera 150. Recording device 160 is, for example, a non-volatile recording device including a memory card with flash memory, an SSD (Solid State Drive), or an HDD (Hard Disc Drive). Recording device 160 is connected to recording control unit 123, receives predetermined data from recording control unit 123, and records the received data. Additionally, recording device 160 provides an event file containing recorded event data to playback control unit 124 in response to instructions from playback control unit 124. Recording device 160 may be configured to be detachable from recording and playback device 10, or it may be configured to be non-detachable.

[0062] Next, refer to Figures 2-4 The mechanical structure of the recording and playback device 10 will be explained. Figure 2 This is a right view of the recording and playback apparatus 10 according to Embodiment 1. Figure 3 This is a rear view of the recording and playback device 10 according to Embodiment 1, viewed from the shooting direction. Figure 4 This is a front view of the recording and playback apparatus 10 according to Embodiment 1, viewed from the display direction. Furthermore, to facilitate explaining the positional relationships of the constituent elements, in... Figures 2-4 An orthogonal coordinate system with a right-handed coordinate system was added. Furthermore, in later figures, with the orthogonal coordinate system added, Figures 2-4The X, Y, and Z axes of the coordinate system are aligned with the X, Y, and Z axes of these orthogonal coordinate systems, respectively.

[0063] like Figure 2 As shown, the recording and playback device 10 is fixed to the windshield WS of the vehicle by a bracket 900. The bracket 900 has an adhesive portion 901, a retaining portion 902, and a ball joint 903.

[0064] The adhesive part 901 is a component on which adhesive is applied to the surface that contacts the windshield WS. The bracket 900 is fixed by being bonded to any position on the windshield WS by the adhesive part 901.

[0065] The retaining part 902 is detachably fitted onto the mounting / removing part 921 of the recording / reproducing device 10, and the installed recording / reproducing device 10 will not fall off due to vehicle movement or other reasons, or the shooting direction will shift. For example, the retaining part 902 has ribs or grooves that can slide into the mounting / removing part 921 of the recording / reproducing device 10 in a predetermined direction. If it slides to a predetermined size, it is locked by a locking mechanism (not shown) and fixed without wobbling.

[0066] The ball joint 903 is a joint mechanism in which the angle of the bonding part 901 and the retaining part 902 are adjustable, and it is movable when a predetermined external force is applied. When the bonding part 901 is bonded to the windshield WS and the retaining part 902 is engaged with the recording and playback device 10, the ball joint 903 is configured to remain stationary when no predetermined external force is applied.

[0067] The user of the recording and playback device 10 attaches the adhesive part 901 to the windshield WS and engages the disassembly part 921 of the recording and playback device 10 with the retaining part 902. Thus, the recording and playback device 10 is fixed to the vehicle.

[0068] Furthermore, when removing the recording / reproduction device 10 fixed to the vehicle, the user releases the disassembly part 921 of the recording / reproduction device 10 from the holding part 902. After releasing the disassembly part 921 from the holding part 902, the user slides the disassembly part 921 away from the holding part 902 after unlocking the locking mechanism (not shown). Thus, the recording / reproduction device 10 is removed from the vehicle, and the user can hold the recording / reproduction device 10.

[0069] like Figures 2-4 As shown, the front and back surfaces of the recording and playback device 10 are rectangular, forming a roughly cuboid shape with a thickness of about a fraction of the shorter side of the rectangle as projected from the front. The recording and playback device 10 is surrounded by a housing 920 made of resin.

[0070] In the recording and playback device 10, the objective lens of the camera 150 is exposed on its back, and a mounting / removing part 921 is provided on its upper surface. Therefore, the recording and playback device 10 is fixed to the vehicle with the mounting / removing part 921 on its upper surface engaged with the retaining part of the bracket 900, and the objective lens of the camera 150 exposed in the vehicle's direction of travel. With the recording and playback device 10 fixed to the vehicle as described above, its front faces the user. The display panel of the display unit 141, the gaze detection camera 151, and the light-emitting device 152 are arranged on the front of the recording and playback device 10. By configuring the recording and playback device 10 in this way, the recording and playback device 10 captures images in the direction of travel and displays the captured images to the user. Figure 4 The display unit 141 shown is in the state of displaying event log data.

[0071] Furthermore, the recording and playback device 10 has a gaze detection camera 151 and a light-emitting device 152 on the display side of the display unit 141. With this configuration, the light-emitting device 152 illuminates infrared light onto the face of the user facing the display unit 141, and the gaze detection camera 151 captures an image of the user's face illuminated by the infrared light. The size of the display panel of the recording and playback device 10 is, for example, approximately 1.5 inches to 4 inches diagonally. Additionally, the size of the housing 920 is, for example, approximately 5 cm to 10 cm in the width direction (X-axis direction).

[0072] Next, refer to Figure 5 Explain the shooting data. Figure 5 This is the first graph showing the relationship between the captured data stored in the recording and playback device and time. The horizontal axis of the graph represents time, indicating that time passes from time t10 to time t11 in the direction of the arrow (to the right).

[0073] The long bar shown along the timeline represents the shooting data C11 at time t11. Shooting data C11 is the shooting data generated by camera 150 and stored in buffer memory 121. The recording and playback device 10 is configured to always store shooting data for a preset period Pn. Period Pn is, for example, a period of 60 seconds, 120 seconds, or 150 seconds. The shooting data C11 at time t11 is the shooting data from time t10 back to time t11, tracing back from time t11 to time t11 within period Pn. Furthermore, as time passes, shooting data stored in buffer memory 121 is sequentially deleted from past periods Pn.

[0074] Here, in Figure 5 In the example shown, it is assumed that the recording and playback device 10 detects the occurrence of an event at time t11. Therefore, the recording and playback device 10 then processes the generation of event recording data based on time t11.

[0075] Next, refer to Figure 6This section explains the captured data and event recording data after the event was detected. Figure 6 The second graph shows the relationship between the captured data stored in the recording and playback device and time. Figure 6 This indicates the composition of the data at time t21 after time t11. At time t21, the buffer memory 121 stores the captured data C21 from time t20 to time t21 of the tracing period Pn from time t21.

[0076] The rectangle shown under the captured data C21 represents event recording data E11. Event recording data E11 is data extracted from the captured data in response to an event detected at time t11. In this embodiment, the recording and playback device 10 sets the time ts of the period P1 tracing back from time t11 as the start time of the event recording data, based on the time t11 when the event was detected. Furthermore, in this embodiment, the recording and playback device 10 sets the time te, after a period P2 has elapsed, as the end time of the event recording data, based on the time t11 when the event was detected. Periods P1 and P2 are, for example, 10 seconds, 15 seconds, or 20 seconds. That is, the recording and playback device 10 saves the captured data from time ts to time te as event recording data E11.

[0077] By generating event recording data as described above, the recording and playback device 10 can record and capture data for the period before and after an event. Therefore, by reproducing the event recording data saved by the recording and playback device 10 after the event, the user can visually confirm the situation around the vehicle before and after the event.

[0078] In addition to recording event data, the recording and playback device 10 can also record ordinary files in the recording device 160. In this case, the recording and playback device 10 extracts the shooting data for a predetermined period from the shooting data stored in the buffer memory 121, and records the extracted shooting data as an ordinary file in the recording device 160. The recording and playback device 10 can perform the processing of recording ordinary files and the processing of saving event recording data in parallel.

[0079] Next, refer to Figure 7 The processing performed on the recording and playback device 10 will be explained. Figure 7 This is a flowchart of the recording and playback device detecting an event. Figure 7 The process performed by the control unit 100 when the recording and playback device 10 detects an event is shown. Figure 7 The flowchart shown begins under any conditions, such as the supply of power from the vehicle to the recording and playback device 10, based on the start of vehicle movement.

[0080] First, the control unit 100 begins acquiring shooting data (step S10). In step S10, the control unit 100 also begins event detection. Shooting data is provided periodically (e.g., 30 frames per second) from the camera 150. The shooting data acquisition unit 120 provides the shooting data provided from the camera 150 to the buffer memory 121. The buffer memory 121 stores shooting data for a preset period (e.g., 60 seconds), and after storing shooting data for the preset period, it sequentially stores new shooting data while deleting old shooting data.

[0081] Next, the event detection unit 127 determines whether an event has been detected based on the information provided by the acceleration sensor 142 (step S11). If it is determined that an event has been detected (step S11: Yes), the recording control unit 123 generates event recording data and causes the recording device 160 to record it (step S12). On the other hand, if it is not determined that an event has been detected in step S11 (step S11: No), the control unit 100 does not generate event recording data and proceeds to step S13.

[0082] Next, the control unit 100 determines whether to end the series of processes (step S13). If it is not determined that the process has ended (step S13: No), the control unit 100 returns to step S11 and performs the determination again to see if the occurrence of an event has been detected. On the other hand, if it is determined that the process has ended (step S13: Yes), the control unit 100 ends the process.

[0083] Next, refer to Figure 8 This describes the reproduction process of event log data performed by the control unit 100. Figure 8 This is a flowchart of the process when the recording and playback device reproduces event record data. Figure 8 The processing in Figure 7 Step S11 in the processing starts when an event is detected.

[0084] First, the playback control unit 124 resets the count value of the timer 129 upon detecting an event (step S110), and then starts the operation of the timer 129 (step S111). Furthermore, the timer 129 increments its count value sequentially as time passes. Next, the playback control unit 124 reads the count value of the timer 129 and determines whether the count value has exceeded the period PX (step S112). If it is determined that the count value has exceeded the period PX (step S112: Yes), the control unit 100 terminates. Figure 8 The processing is shown.

[0085] If it is not determined in step S112 that the count value has passed the period PX (step S112: no), the reproduction control unit 124 determines whether the user's gaze is directed toward the display unit 141 based on the signal related to gaze detection received from the gaze detection unit 130 (step S113).

[0086] If it is not determined that the user's gaze is directed towards the display unit 141 (step S113: No), the control unit 100 again determines in step S112 whether the count value has passed the period PX. On the other hand, if it is determined in step S113 that the user's gaze is directed towards the display unit 141 (step S113: Yes), the playback control unit 124 stops the counting of the timer 129 (step S114) and begins to play back the event recording data that is the object of playback (step S115). The event recording data that is the object of playback is based on the event recording data that is the object of playback. Figure 8 The event triggered by the processing Figure 7 The event log data saved during the processing, that is, the most recently saved event log data when the line of sight is facing the display.

[0087] Next, the playback control unit 124 determines whether to end the playback of the event recording data (step S116). More specifically, the playback control unit 124 detects, for example, whether the operation control unit 125 receiving the user's operation has received a notification that the playback of the event recording data has stopped. If no operation to end playback is received (step S116: No), the control unit 100 continues the playback of the event recording data. On the other hand, if an operation to end playback is received (step S116: Yes), the playback control unit 124 performs the process of ending the playback of the event recording data (step S117), and ends the playback. Figure 8 The processing is shown.

[0088] The above describes the event log data reproduction process performed by the control unit 100. In the above process, the order of steps S114 and S115 can be interchanged, or they can be performed simultaneously.

[0089] In step S115, when the playback of the event recording data begins, a prompt may be displayed urging the user to allow playback to begin. Once the user grants permission, the playback of the event recording data begins. Therefore, the recording and playback device 10 reproduces the event recording data according to the user's instructions without requiring complex operations.

[0090] The above describes Embodiment 1. With the above configuration, when the user's gaze is directed toward the display unit 141 after a predetermined period PX following the occurrence of a predetermined event, the recording and playback device 10 reproduces the most recent event recording data. Therefore, for example, immediately after an event such as an accident, the user can check the event recording data by looking at the display unit of the recording and playback device. Therefore, according to Embodiment 1, a recording and playback device can be provided that reproduces saved data without complicated operations.

[0091] <Modification of Implementation Method 1>

[0092] Next, a variation of Embodiment 1 will be described. In the recording and playback apparatus of the variation of Embodiment 1, the recording apparatus having at least a camera 150 for generating shooting data and a shooting data acquisition unit 120 exists separately from the playback apparatus having at least a gaze detection camera 151 and a display unit 141.

[0093] Figure 9 This is a schematic diagram of a recording and playback device according to a variation of Embodiment 1. As shown, the recording and playback device 10 has a recording unit 20 and a playback unit 30. The recording unit 20, shown in the upper part of the figure, has a camera 150 and a mounting / removing part 921, and is fixed on a bracket 900 to capture the scenery in the direction of the vehicle's travel. The playback unit 30, shown in the lower part of the figure, exists separately from the recording unit 20 and has a line-of-sight camera 151, a light-emitting device 152, and a display unit 141. The playback unit 30 is a portable terminal with a built-in battery that can be carried by the user. The recording unit 20 and the playback unit 30 are connected wirelessly. The playback unit 30 shown in the figure displays the status of the event recording data C1 on the display unit 141. In addition, as shown in the figure, the display unit 141 can also display the date and time of the event, latitude and longitude, driving speed, etc., in addition to the image of the event recording data.

[0094] Reference Figure 10 The structure of the recording section 20 will be explained. Figure 10This is a block diagram illustrating the configuration of the recording unit according to a variation of Embodiment 1. The recording unit 20, as its main component, includes a control unit 200 and, respectively, a camera 150, a recording device 160, an operation unit 240, an accelerometer 142, a GPS receiver 143, and a communication unit 270, all connected to the control unit 200. Furthermore, the control unit 200 includes a shooting data acquisition unit 120, a buffer memory 121, a shooting data processing unit 122, a recording control unit 123, a playback control unit 124, an operation control unit 225, an event detection unit 127, a location information acquisition unit 128, a timer 129, and a communication control unit 232, all of which are connected to the bus 110. In the above configuration, components having the same functions as the recording and playback device 10 according to Embodiment 1 are labeled with the same reference numerals. Here, descriptions of components labeled with the same reference numerals are appropriately omitted, and descriptions of components labeled with new reference numerals will be provided.

[0095] The operation unit 240 is a user interface that receives operations performed by the user on the recording unit 20. The user interface can be, for example, an operation button or a touch sensor. Alternatively, the user interface can be an infrared or wireless communication receiver, or a component that receives signals transmitted from a remote control, etc. The operation unit 240 can be an interface that receives instructions for predetermined operations from the playback unit 30 via the communication unit 270. The operation unit 240 provides information related to the received operation, i.e., operation information, to the operation control unit 225 via the predetermined interface. The operation information can be, for example, an instruction to start event recording.

[0096] The communication unit 270 is an interface that can be communicatively connected to the playback unit 30, and is composed, for example, of an antenna and circuitry for modulating or demodulating signals transmitted via the antenna. The communication unit 270 receives signals from the playback unit 30 and transmits event recording data to the playback unit 30.

[0097] The operation control unit 225 acquires the operation information received by the operation unit 240 and outputs operation instructions based on the operation information to each component. The communication control unit 232 controls the communication with the playback unit 30 via the communication unit 270. For example, when the communication control unit 232 receives a signal from the playback unit 30 requesting the playback of event recording data, it provides the request signal to the playback control unit 124. Furthermore, when the playback control unit 124 outputs event recording data in response to the request from the playback unit 30, the communication control unit 232 sends the event recording data to the playback unit 30 via the communication unit 270.

[0098] Next, refer to Figure 11 The reproduction section 30 will be explained. Figure 11This is a block diagram illustrating the configuration of the playback unit according to a variation of Embodiment 1. The playback unit 30, as its main component, includes a control unit 300 and a display unit 141, a gaze detection camera 151, a light-emitting device 152, an operation unit 340, and a communication unit 370, all connected to the control unit 300. Furthermore, the control unit 300 includes a capture data acquisition unit 120, a light-emitting control unit 131, a display control unit 126, a gaze detection unit 130, a buffer memory 321, a communication control unit 332, and an operation control unit 325, all of which are connected to the bus 310.

[0099] The communication unit 370 is an interface that can be communicatively connected to the recording unit 20, and for example, has the same configuration as the communication unit 270 of the recording unit 20. The communication unit 370 sends a signal requesting event recording data to the recording unit 20, receives event recording data from the recording unit 20, and provides the received event recording data to the communication control unit 332.

[0100] The operation control unit 325 acquires the operation information received by the operation unit 340 and outputs operation instructions based on the operation information to each component. The communication control unit 332 controls the communication with the recording unit 20 via the communication unit 370. For example, the communication control unit 332 sends a signal requesting the reproduction of event recording data to the reproduction unit 30 via the communication unit 370. In addition, the communication control unit 332 provides the event recording data received via the communication unit 370 to the buffer memory 321.

[0101] The operation unit 340 is a user interface for receiving operations performed by the user on the playback unit 30. The user interface may be, for example, an operation button or a touch sensor overlaid on the display unit 141. The operation unit 340 provides information related to the received operation, i.e., operation information, to the operation control unit 325 via a predetermined interface. Operation information may include, for example, an instruction to start playback of event recording data or an instruction to stop playback of event recording data in progress.

[0102] The buffer memory 321 is a volatile memory. The buffer memory 321 temporarily stores event recording data sent from the recording unit 20 and provides the stored event recording data to the display control unit 126.

[0103] Alternatively, the aforementioned playback unit 30 can also be implemented using a smartphone or tablet computer with wireless communication capabilities. When using a smartphone as the playback unit 30, for example, an application for playing back event recording data can be pre-installed on the smartphone, and the function of the playback unit 30 can be performed by executing the installed application.

[0104] The above describes a variation of Embodiment 1. The recording and playback apparatus 10 according to the variation of Embodiment 1 records event recording data in the recording device 160 within the recording unit 20 when a predetermined event occurs. After an event occurs but before a period PX has elapsed, the recording and playback apparatus 10 according to the variation of Embodiment 1 displays the event recording data on the display unit 141 when the gaze detection unit 130 of the playback unit 30 detects that the user's gaze is directed towards the display unit 141. With this configuration, a user of the recording and playback apparatus 10 according to the variation of Embodiment 1 can visually identify the event recording data of the most recently occurred event by looking at the playback unit 30 held in their hand. Therefore, according to the variation of Embodiment 1, a recording and playback apparatus, etc., can be provided that appropriately reproduces the stored data in a posture easily viewed by the user without requiring complicated operations.

[0105] <Implementation Method 2>

[0106] Next, Embodiment 2 will be described. In the recording and playback apparatus according to Embodiment 2, the function of the gaze detection unit 130 in processing the recorded event data is different from that in Embodiment 1. In the recording and playback apparatus 10 according to Embodiment 2, the gaze detection unit 130 detects the position of the user's two eyes based on the shooting data acquired from the gaze detection camera 151, and measures the distance between the detected two eyes.

[0107] Figure 12This is a diagram illustrating an example of the image data acquired by the gaze detection camera 151 according to Embodiment 2. Image D1 shown in the figure is an image of the image data acquired by the gaze detection camera 151. User U1 is captured on the left side of image D1, and user U2 is captured on the right side of image D1. User U1's face is closer to the gaze detection camera 151 than user U2's face. The gaze detection unit 130 identifies a person's face and eyes based on the pixel values ​​contained in the image data, and calculates the distance between the two eyes in the identified face in the image data. For example, the distance B1 between user U1's eyes is greater than the distance B2 between user U2's eyes. Thus, the user's face captured by the gaze detection camera 151 tends to be closer together and further apart, with the user's face appearing closer together. The gaze detection unit 130 determines whether a value corresponding to the distance between the user's eyes is greater than a preset threshold Bth. Furthermore, the recording and playback device 10 is set to start reproducing event recording data when the distance between the eyes is greater than the threshold Bth. That is, the playback control unit 124 calculates the distance between the user's two eyes, and starts playing back the event recording data when the calculated value is greater than a preset threshold. For the threshold Bth, for example, it is set to a value when the user's face is about 50cm away from the display surface of the display unit 141, based on the average width of the two eyes.

[0108] Next, refer to Figure 13 The processing of the recording and playback device according to Embodiment 2 will be described. Figure 13 This is a flowchart illustrating the process of reproducing event recording data by the recording and reproduction unit according to Embodiment 2. The difference between the flowchart of Embodiment 2 and the process of Embodiment 1 lies in the presence of step S120 between steps S113 and S114. Content identical to that in the flowchart of Embodiment 1 will be omitted hereinforcing the explanation of the differences from Embodiment 1.

[0109] If, in step S113, it is determined that the user's gaze is directed towards the display unit 141 (step S113: Yes), the playback control unit 124 determines whether the distance BX between the user's two eyes is greater than a threshold Bth (step S120). If it is not determined that the distance BX is greater than the threshold Bth (step S120: No), the control unit 100 proceeds to step S112. On the other hand, if it is determined that the distance BX is greater than the threshold Bth (step S120: Yes), the playback control unit 124 proceeds to step S114.

[0110] The above describes Embodiment 2. According to the above configuration, if the user's gaze is directed towards the display unit 141 before a predetermined period PX elapses from the occurrence of a predetermined event, and the user's face has not left the display unit 141, the recording and playback device 10 according to Embodiment 2 reproduces the most recent event recording data. Therefore, for example, immediately after an event such as an accident, if the user approaches the display unit of the recording and playback device, they can confirm the event recording data by looking at the display unit. Therefore, according to Embodiment 2, a recording and playback device can be provided that reproduces saved data without complicated operations.

[0111] Furthermore, the aforementioned programs can be stored and provided to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of physical recording media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., floppy disks, magnetic tapes, hard disks), optical-magnetic recording media (e.g., optical discs), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash memory ROMs, and RAMs (Random Access Memory)). Additionally, programs can also be provided to a computer using various types of temporary computer-readable media. Examples of temporary computer-readable media include electrical signals, optical signals, and electromagnetic waves. Temporary computer-readable media can provide programs to a computer via wired communication paths such as wires and optical fibers, or via wireless communication paths.

[0112] Furthermore, this embodiment is not limited to the above-described embodiment, and appropriate modifications can be made without departing from the spirit of the invention. For example, the recording and playback device described above is an example of a driving recorder mounted on a car, but the recording and playback device can also be mounted on various vehicles such as motorcycles and bicycles. Furthermore, the object on which the recording and playback device is mounted is not limited to vehicles, but can also be a moving body such as a railway, ship, or aircraft. Additionally, the recording and playback device can also be a device installed and used by a person or a walking robot.

[0113] This application claims priority based on Japanese Patent Application No. 2019-033740, filed on February 27, 2019, the entire disclosure of which is incorporated herein by reference.

[0114] Industrial availability

[0115] This application can be applied to recording and reproducing devices installed on vehicles for recording and reproducing images.

[0116] 10 Recording and playback devices

[0117] 20 Records Department

[0118] 30 Reproduction Section

[0119] 100 Control Department

[0120] 110 bus

[0121] 120 Camera Data Acquisition Department

[0122] 121 Buffer Memory

[0123] 122 Shooting Data Processing Department

[0124] 123 Record Control Department

[0125] 124 Reproduction Control Department

[0126] 125 Operation Control Department

[0127] 126 Display Control Unit

[0128] 127 Incident Detection Department

[0129] 128 Location Information Acquisition Department

[0130] 129 timer

[0131] 130 Line of Sight Inspection Department

[0132] 131 Lighting Control Department

[0133] 140, 240, 340 Operations Unit

[0134] 141 Display Section

[0135] 142 accelerometer

[0136] 143 GPS receiver

[0137] 150 camera

[0138] 151 line-of-sight detection camera

[0139] 152 Light-emitting device

[0140] 160 recording device

[0141] 232 and 332 Communication Control Department

[0142] 270, 370 Communications Department

[0143] 900 bracket

[0144] 901 Adhesive Part

[0145] 902 Maintenance Department

[0146] 903 ball joint

[0147] 920 housing

[0148] 921 Disassembly and Assembly Department

[0149] C11 and C21 shooting data

[0150] E11 event log data

[0151] D1 image

[0152] WS windshield

Claims

1. A playback apparatus for acquiring and playing back event recording data recorded in a recording unit, wherein the recording unit detects an event involving a moving object and captures an image, and saves the captured image data as the event recording data, the playback apparatus comprising: The display control unit controls the display of the displayed images on the display unit. The gaze detection unit detects whether the user's gaze is directed toward the display unit for a predetermined period of time. as well as A communication control unit that controls communication with the recording unit. When the gaze detection unit detects that the user's gaze is directed toward the display unit for a predetermined period of time immediately following the detection of the event by the recording unit, the communication control unit requests the most recently saved event recording data from the recording unit via the communication unit. The display control unit displays the event log data acquired via the communication unit on the display unit.

2. The reproduction apparatus as claimed in claim 1, wherein, It also includes a gaze detection camera, which is located on the display surface side of the display unit. The gaze detection unit detects whether the user's gaze is directed toward the display unit based on the shooting data captured by the gaze detection camera.

3. A reproduction method, comprising the following steps: The system detects that the user's gaze remains directed toward the display unit for a predetermined period of time, and the display unit displays an image. The system communicates with a recording unit, which detects events related to a moving object and captures images, saving the captured data as event recording data. When the recording unit detects that the user's gaze is directed towards the display unit for a predetermined period immediately following the detection of the event, it requests the most recently saved event recording data from the recording unit. The event record data obtained from the recording unit is displayed on the display unit.

4. A computer-readable storage medium storing a program that causes a computer to perform the following actions, The system detects that the user's gaze remains directed toward the display unit for a predetermined period of time, and the display unit displays an image. The system communicates with a recording unit, which detects events related to a moving object and captures images, saving the captured data as event recording data. When the recording unit detects that the user's gaze is directed towards the display unit for a predetermined period immediately following the detection of the event, it requests the most recently saved event recording data from the recording unit. The event record data obtained from the recording unit is displayed on the display unit.

Images