Video recording device and video recording program

The video recording device integrates mobile terminal imaging and recording functions to reduce camera requirements, lowering costs while effectively capturing vehicle interior and exterior images.

JP7730232B2Active Publication Date: 2025-08-27PANASONIC AUTOMOTIVE SYST CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2022049228
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-03-25
Publication Date
2025-08-27
Estimated Expiration
2042-03-25

AI Technical Summary

Technical Problem

Existing vehicle video recording systems require multiple cameras to capture images inside and outside the vehicle, increasing costs.

Method used

A video recording device that integrates a first receiving unit for rear camera images, a second receiving unit for mobile terminal images, and a recording unit that overwrites or stores videos based on predetermined conditions, utilizing a mobile terminal for image capture and setting information.

Benefits of technology

Inexpensive recording of vehicle interior and exterior images is achieved by reducing the number of cameras needed and incorporating mobile terminal capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007730232000001
    Figure 0007730232000001
  • Figure 0007730232000002
    Figure 0007730232000002
  • Figure 0007730232000003
    Figure 0007730232000003
Patent Text Reader

Abstract

To be able to record a video obtained by imaging an inside / outside of a vehicle at a low cost.SOLUTION: A video recording device according to the present invention includes a first receiving unit that receives a first video from a first imaging device that images a rear of a vehicle to generate a first video, a second receiving unit that receives a second video from a portable terminal that images at least one of a front of the vehicle and an inside of the vehicle to generate the second video, and a recording unit that records the first video and the second video in an overwriting folder to be overwritten when a capacity for recorded videos exceeds a predetermined capacity, or a storage folder to be protected a video from being overwritten.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a video recording device and a video recording program. [Background technology]

[0002] There is a known technology for capturing and recording images of the inside and outside of a vehicle using cameras attached to the vehicle body, but in this case, multiple cameras are required to capture images of the inside and outside of the vehicle, which increases the cost of the entire system. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-005234 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present disclosure is to provide a video recording device and a video recording program that can inexpensively record video captured inside and outside a vehicle. [Means for solving the problem]

[0005] The video recording device according to the present disclosure includes a first receiving unit that receives a first video from a first imaging device that captures an image of the rear of a vehicle and generates the first video; a second receiving unit that receives the second video from a mobile terminal that captures an image of at least one of the front of the vehicle and the interior of the vehicle and generates a second video; and a recording unit that records the first video and the second video in an overwrite folder that is overwritten when the recorded video reaches a predetermined capacity or in a storage folder where the video is not overwritten. The second receiving unit receives setting information relating to a display method of a display device installed in the vehicle from the mobile terminal, and the recording unit records the setting information. . [Effects of the Invention]

[0006] According to the video recording device and video recording program of the present disclosure, it is possible to inexpensively record video images of the inside and outside of a vehicle. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of a vehicle equipped with a drive recorder unit according to an embodiment. [Figure 2] FIG. 2 is a block diagram illustrating an example of the configuration of the video recording system according to the embodiment. [Figure 3] FIG. 3 is a block diagram illustrating an example of a configuration of a display unit according to the embodiment. [Figure 4] FIG. 4 is a block diagram illustrating an example of a configuration of the mobile terminal according to the embodiment. [Figure 5] FIG. 5 is a flowchart illustrating an example of a procedure of a video recording process performed by the drive recorder unit and the mobile terminal according to the embodiment. [Figure 6] FIG. 6 is a flowchart illustrating an example of a procedure of a video recording process performed by the drive recorder unit according to the embodiment using the navigation function of the mobile terminal. [Figure 7] FIG. 7 is a flowchart illustrating an example of a procedure of a setting process performed by the drive recorder unit according to the embodiment using an authentication function of the mobile terminal. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments of a video recording device and a video recording program according to the present disclosure will be described with reference to the drawings.

[0009] (Example of vehicle configuration) 1 is a schematic diagram showing an example of a vehicle 5 equipped with a drive recorder unit 10 according to an embodiment. As shown in FIG. 1, the vehicle 5 according to the embodiment includes, for example, the drive recorder unit 10, a rear camera 32, a display device 25, a display 45, and a terminal holder 59.

[0010] The rear camera 32 is provided, for example, on the rear window of the vehicle 5. The rear camera 32 captures an image of the rear of the vehicle 5 and generates a rear image. The rear image is an example of a first image. The rear camera 32 is an example of a first imaging device.

[0011] The drive recorder unit 10 is housed, for example, in a console box of the vehicle 5. The drive recorder unit 10 records video captured by a mobile terminal (described later) and rearward video captured by a rear camera 32. The drive recorder unit 10 is an example of a video recording device.

[0012] The display device 25 is a liquid crystal display or the like that displays the rear of the vehicle, and is, for example, a mirror-type electronic mirror that resembles a mirror for checking the rear of the vehicle. The display device 25 displays a rear image that has been subjected to predetermined processing by, for example, an electronic control unit (ECU) formed integrally with the display device 25. The display device 25 is an example of a display device. An electronic mirror is an example of a mirror-type display device.

[0013] Note that the display device 25 in FIG. 1 is configured as an electronic mirror in the form of a rearview mirror, but when the display device 25 is configured as an electronic mirror, it may have the shape of another mirror for checking behind, such as a door mirror or a fender mirror.

[0014] The display 45 is, for example, a panel-type liquid crystal display fitted in an instrument panel or the like. The display 45 displays images processed by the drive recorder unit 10. The display 45 may also display an omnidirectional overhead image that combines images from multiple cameras capturing images of the outside of the vehicle, including the rear camera 32.

[0015] The terminal holder 59 is provided on, for example, an instrument panel, and is configured to be able to hold a mobile terminal owned by a user such as the driver of the vehicle 5.

[0016] The drive recorder unit 10, rear camera 32, display device 25, and display 45 described above are part of a video recording system, which will be described later. A terminal holder 59 may be included in the video recording system.

[0017] (Example of video recording system configuration) Fig. 2 is a block diagram showing an example of the configuration of a video recording system 1 according to an embodiment. As shown in Fig. 2, the video recording system 1 according to the embodiment includes a drive recorder unit 10, a display unit 20, a rear camera 32, and a display unit 40, and is configured to be mountable in, for example, the above-mentioned vehicle 5. The video recording system 1 also includes a mobile terminal 50 owned by a user.

[0018] The mobile terminal 50 is a smartphone, a mobile phone, a tablet terminal, or the like owned by a user such as the driver or a passenger of the vehicle 5. The mobile terminal 50 is held in a terminal holder 59 while the vehicle 5 is traveling and captures images of the surroundings of the vehicle 5 using a built-in camera. The detailed configuration of the mobile terminal 50 will be described later.

[0019] The drive recorder unit 10 includes a main microcomputer 11, a sub-microcomputer 12, a serializer 13p, a serializer 13m, a deserializer 14m, a recording device 15, a G sensor 16, a WiFi (registered trademark)-IC module 17, and an antenna 18.

[0020] The main microcomputer 11 is a computer including a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The main microcomputer 11 is configured as a SoC (System on Chip) including, for example, an image processing processor 11p that processes images captured by the mobile terminal 50 and the rear camera 32.

[0021] The CPU of the main microcomputer 11 loads a video recording program stored in a ROM or the like into a RAM and executes it, thereby realizing the function of the drive recorder unit 10 as a video recording device, which will be described below.

[0022] The main microcomputer 11 receives the rearward video generated by the rear camera 32 as a video signal SGvr from the deserializer 14m. The main microcomputer 11 also receives the video generated by the mobile terminal 50 as a video signal SGvs from the WiFi-IC module 17 via the antenna 18.

[0023] The image processor 11p processes the image received from the mobile terminal 50 and the rearward image received from the rear camera 32. In the image processing by the image processor 11p, for example, color and contrast adjustments are made to make the image suitable for video recording and display on the display 45.

[0024] Furthermore, the main microcomputer 11 controls the WiFi-IC module 17 and the serializer 13p by transmitting a control signal SGc to the WiFi-IC module 17 and the serializer 13p.

[0025] For example, when a video is transmitted from the mobile terminal 50 to the drive recorder unit 10, the main microcomputer 11 causes the WiFi-IC module 17 to receive the video signal SGvs from the mobile terminal 50 via the antenna .

[0026] Furthermore, for example, after processing the images from the mobile terminal 50 and the rear camera 32, the main microcomputer 11 causes the serializer 13p to transmit the processed images to the display unit 40.

[0027] The video processed by the main microcomputer 11 is also stored as a recorded video in a recording device 15 (described later) via the sub-microcomputer 12.

[0028] Furthermore, the main microcomputer 11 notifies the sub-microcomputer 12 of various statuses by transmitting a status signal SGs to the sub-microcomputer 12. The various statuses include the status of the main microcomputer 11 itself, as well as information on whether or not a failure has occurred in devices under the control of the main microcomputer 11, such as the serializer 13p and the display unit 40.

[0029] When the serializer 13p receives the control signal SGc from the main microcomputer 11, it transmits the processed video received from the main microcomputer 11 to the display unit 40. At this time, the serializer 13p converts the parallelized video into serial data and transmits them to the display unit 40 as video signals SGvs and SGvr, respectively.

[0030] The WiFi-IC module 17 is configured to be able to transmit and receive information via WiFi communication between the drive recorder unit 10 and the mobile terminal 50. The WiFi-IC module 17 transmits and receives information between the drive recorder unit 10 and the mobile terminal 50 in the form of WiFi radio waves via the antenna 18. The WiFi-IC module 17 and the antenna 18 are an example of a second receiving unit.

[0031] The sub-microcomputer 12 is a computer including a CPU, a ROM, and a RAM, and is configured as, for example, an MCU (Micro Controller Unit).

[0032] The sub-microcomputer 12 controls the serializer 13m and the deserializer 14m by transmitting a control signal SGc to the serializer 13m and the deserializer 14m.

[0033] For example, when a rearward video image is transmitted from the rear camera 32 to the drive recorder unit 10, the sub-microcomputer 12 causes the deserializer 14m to receive the rearward video image from the rear camera 32.

[0034] Furthermore, for example, when the deserializer 14m receives a rearward video image, the sub-microcomputer 12 causes the serializer 13m to transmit the unprocessed rearward video image to the display unit 20.

[0035] In addition, the sub-microcomputer 12 notifies the main microcomputer 11 of various statuses by transmitting a status signal SGs to the main microcomputer 11. The various statuses include the status of the sub-microcomputer 12 itself, as well as information on whether or not a fault has occurred in devices under the control of the sub-microcomputer 12, such as the serializer 13m, the deserializer 14m, the G sensor 16, the rear camera 32, and the display unit 20.

[0036] In addition, the sub-microcomputer 12 stores the video from the mobile terminal 50 received from the main microcomputer 11 and the rearward video from the rear camera 32, etc., in the recording device 15 in overwrite mode or storage mode. In overwrite mode, when the amount of video recorded in the recording device 15 reaches a certain amount, the video is stored by sequentially overwriting old video with new video. In storage mode, the recorded video is stored without being overwritten by new video.

[0037] When recording video in the recording device 15, the sub-microcomputer 12 switches between the overwrite mode and the save mode according to the content of an instruction input from the user or based on the detection result of the G sensor 16.

[0038] When the deserializer 14m receives the control signal SGc from the sub-microcomputer 12, it receives the rearward video transmitted from the rear camera 32. At this time, the deserializer 14m converts the rearward video transmitted as the serialized video signal SGvr into parallel data. The deserializer 14m also transmits the parallelized rearward video in the form of the video signal SGvr to the main microcomputer 11 and the serializer 13m. The deserializer 14m is an example of a first receiving unit.

[0039] When the serializer 13m receives the control signal SGc from the sub-microcomputer 12, it transmits the unprocessed rearward video received from the deserializer 14m to the display unit 20. At this time, the serializer 13m converts the parallel rearward video into serial data and transmits it as a video signal SGvr to the display unit 20. The serializer 13m is an example of a transmitting unit.

[0040] The recording device 15 records the video captured by the mobile terminal 50 and the rearward video captured by the rear camera 32. The recording device 15 has an overwrite area such as an overwrite folder and a storage area such as a storage folder. In the overwrite area, the video is stored by sequentially overwriting old video with new video when the amount of recorded video reaches a certain amount in the overwrite mode described above. In the storage area, the recorded video is stored without being overwritten by new video in the storage mode described above. The recording device 15 is an example of a recording unit.

[0041] The G sensor 16 is an acceleration sensor or the like that detects acceleration applied to the vehicle 5. The G sensor 16 transmits the detection result to the sub-microcomputer 12, for example, at predetermined intervals.

[0042] The control signal SGc is transmitted from the main microcomputer 11 to the serializer 13p and the WiFi-IC module 17, and from the sub-microcomputer 12 to the serializer 13m and the deserializer 14m in, for example, an I2C (Inter-Integrated Circuit) format.

[0043] Furthermore, the transmission and reception of the video signals SGvs and SGvr between the main microcomputer 11 and the serializer 13p, and the transmission of the video signal SGvr from the deserializer 14m to the main microcomputer 11 and the serializer 13m are performed in, for example, MIPI (Mobile Industry Processor Interface) format.

[0044] Furthermore, transmission and reception of the video signals SGvs and SGvr between the serializer 13p, the serializer 13m, and the deserializer 14m and the rear camera 32, the display unit 20, and the display unit 40 is performed in, for example, FPD-Link III (Flat Panel Display-Link III) format.

[0045] For transmitting these images, for example, a coaxial cable or Wi-Fi can be used.

[0046] Furthermore, the status signal SGs is transmitted and received between the main microcomputer 11 and the sub-microcomputer 12 in, for example, a UART (Universal Asynchronous Receiver / Transmitter) format.

[0047] The display unit 40 includes, for example, a panel-type display 45, and is configured as, for example, a part of an in-vehicle infotainment (IVI) system.

[0048] The processed video received by the display unit 40 from the drive recorder unit 10 is passed to the display 45 and displayed on the display 45. The video displayed on the display 45 is used for purposes such as displaying the outside situation of the vehicle in parking assistance, displaying parking spaces, and displaying parking routes.

[0049] The display unit 20 includes an ECU 21 and a display device 25 .

[0050] The ECU 21 receives and processes unprocessed rearward images from the drive recorder unit 10. The rearward images processed by the ECU 21 are transferred to the display device 25 and displayed on the display device 25, and are used, for example, for checking the rear of the vehicle 5.

[0051] The display unit 20 can also receive rearward images directly from the rear camera 32. In other words, the function of receiving rearward images from the drive recorder unit 10 can also be used as a function of receiving rearward images from the rear camera 32.

[0052] In this case, the drive recorder unit 10 may receive the rearward video processed by the display unit 20 from the display unit 20, rather than receiving the rearward video directly from the rear camera 32. That is, in this case, the main microcomputer 11 of the drive recorder unit 10 does not need to process the rearward video. In addition, the sub-microcomputer 12 stores the processed rearward video received from the display unit 20 in the recording device 15.

[0053] Here, the main microcomputer 11, serializer 13p, WiFi-IC module 17, antenna 18, and display unit 40 constitute the main control block 2. In the main control block 2, the serializer 13p, WiFi-IC module 17, antenna 18, and display unit 40 are under the control of the main microcomputer 11. The main microcomputer 11 appropriately notifies the sub-microcomputer 12 of the status, such as whether any faults or the like have occurred in the main control block 2, including the main microcomputer 11 itself.

[0054] Additionally, the sub-microcomputer 12, serializer 13m, deserializer 14m, recording device 15, G-sensor 16, rear camera 32, and display unit 20 constitute a sub-control block 3. In the sub-control block 3, the serializer 13m, deserializer 14m, recording device 15, G-sensor 16, rear camera 32, and display unit 20 are under the control of the sub-microcomputer 12. The sub-microcomputer 12 appropriately notifies the main microcomputer 11 of its status, such as whether any faults or the like have occurred in the sub-control block 3, including the sub-microcomputer 12 itself.

[0055] The main control block 2 and the sub control block 3 can operate independently of each other. Therefore, even if a failure occurs in the main control block 2, the sub control block 3 can continue to operate. By continuing to operate the sub control block 3, for example, the display device 25 can continue to display a rear view image.

[0056] Furthermore, the main microcomputer 11 and the sub-microcomputer 12 can operate independently of each other. Therefore, even if a failure occurs in the main microcomputer 11, the sub-microcomputer 12 continues to operate, and the display device 25 continues to display a rear view image, for example.

[0057] The following describes the configuration of the display unit 20 in more detail with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the configuration of the display unit 20 according to the embodiment.

[0058] As shown in FIG. 3, the display unit 20 includes an ECU 21, an operation unit 22, a recording unit 23, a deserializer 24, and a display device 25.

[0059] The ECU 21 is a computer including a CPU, a ROM, and a RAM, and includes an image processor 21p that processes an image captured by the rear camera 32, for example.

[0060] The image processor 21p processes the rearward image from the rear camera 32. In the image processing by the image processor 21p, for example, color and contrast adjustments are made to make the image suitable for display on the display device 25.

[0061] The operation unit 22 is a user interface. That is, the operation unit 22 accepts settings from the user regarding the display method of the display device 25, such as brightness, image quality, and camera angle. The operation unit 22 also presents various information, such as the status of the display unit 20, to the user.

[0062] The recording unit 23 stores, for example, settings such as the display method set by the user and various parameters related to the operation of the display unit 20.

[0063] The deserializer 24 receives rearward video transmitted from the drive recorder unit 10 or the rear camera 32. At this time, the deserializer 24 converts the rearward video transmitted as a serialized video signal SGvr into parallel data. The deserializer 24 also transmits the parallelized rearward video to the ECU 21 in the form of the video signal SGvr.

[0064] As described above, the display device 25 is a liquid crystal display or the like that displays the view behind the vehicle, and is, for example, a mirror-type electronic mirror that resembles a mirror for checking the view behind the vehicle. The display device 25 has the shape of a rearview mirror, such as a room mirror, a door mirror, or a fender mirror.

[0065] The detailed configuration of the mobile terminal 50 will be described below with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the configuration of the mobile terminal 50 according to the embodiment.

[0066] As shown in FIG. 4, the mobile terminal 50 includes a control unit 51, an in-camera 52in, an out-camera 52ot, a speaker 53, an operation switch 54s, a display unit 54m, an external memory 55, an acceleration sensor 56a, a gyro sensor 56b, a GPS (Global Positioning System) receiver 56c, a WiFi-IC module 57, and an antenna 58.

[0067] The control unit 51 is a computer including a CPU, a ROM, and a RAM, and has a DVR application 510 installed therein that works in conjunction with the drive recorder unit 10 to realize various functions.

[0068] As a result, the control unit 51 transmits, for example, images of the interior of the vehicle 5 captured by the in-camera 52in and images of the front of the vehicle 5 captured by the out-camera 52ot to the drive recorder unit 10 via the WiFi-IC module 57 and the antenna 58.

[0069] In-camera 52in is provided on the front side of mobile terminal 50, i.e., on the display screen side of display unit 54m. In-camera 52in generates an image captured of the interior of the vehicle, which is the side in front of the screen of display unit 54m of mobile terminal 50 held in terminal holder 59, i.e., the side toward which display unit 54m faces. In-camera 52in is an example of a second imaging device. The image of the interior of vehicle 5 is an example of a second image.

[0070] The outer camera 52ot is provided on the rear side of the mobile terminal 50. The outer camera 52ot generates a forward image by capturing an image of the area in front of the rear side of the mobile terminal 50 held in the terminal holder 59, that is, the area in front of the vehicle 5, which is the side to which the rear of the mobile terminal 50 faces. The outer camera 52ot is an example of a third imaging device. The forward image of the vehicle 5 is an example of a second image.

[0071] The speaker 53 outputs a sound corresponding to an audio signal input from the control unit 51 .

[0072] The operation switch 54s includes various switches such as mechanical switches provided around the display unit 54m and touch switches provided on the front surface of the display unit 54m, and outputs a signal to the control unit 51 in response to a switch operation by the user.

[0073] The display unit 54m is a liquid crystal display or the like, and displays an image based on the image signal input from the control unit 51.

[0074] The external memory 55 is a recording medium such as an SD card.

[0075] The acceleration sensor 56a detects acceleration applied to the mobile terminal 50 and outputs an acceleration signal to the control unit 51. The gyro sensor 56b detects angular velocities of the mobile terminal 50 in three axial directions (x, y, and z axes) and outputs angular velocity signals to the control unit 51. The GPS receiver 56c receives a positioning signal from a satellite positioning system and outputs location information indicating the current location of the mobile terminal 50 to the control unit 51.

[0076] The WiFi-IC module 57 is configured to be able to transmit and receive information via WiFi communication between the drive recorder unit 10 and the mobile terminal 50. The WiFi-IC module 57 transmits and receives information between the drive recorder unit 10 and the mobile terminal 50 via an antenna 58 in the form of WiFi radio waves.

[0077] (Drive recorder unit processing example 1) Next, an example of a video recording process by the drive recorder unit 10 and the mobile terminal 50 according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a flow chart showing an example of a procedure of a video recording process by the drive recorder unit 10 and the mobile terminal 50 according to the embodiment.

[0078] As shown in FIG. 5, when a user such as a driver launches the DVR application 510 on the mobile terminal 50 and selects a video of the front of the vehicle 5 or the interior of the vehicle, the DVR application 510 sends a video selection notification by the user to the main microcomputer 11 of the drive recorder unit 10 (step S11).

[0079] While holding the mobile terminal 50 in the terminal holder 59, the user can select the interior image of the vehicle captured by the in-camera 52in of the mobile terminal 50, the front image of the vehicle 5 captured by the out-camera 52ot, or both the interior image of the vehicle and the front image.

[0080] Furthermore, the DVR application 510 starts transmitting video from the selected camera, for example, when triggered by a video selection by the user (step S12). The video selection that serves as the trigger is, for example, the user pressing a selection completion button.

[0081] The user operates the mobile terminal 50 using the above-described operation switch 54s provided on the mobile terminal 50. Alternatively, the user may operate the mobile terminal 50 using gesture detection, voice instructions, or the like. This allows the transmission of video by the camera of the mobile terminal 50 to be started even in a situation where the user cannot operate the operation switch 54s of the mobile terminal 50, such as when the user is driving the vehicle 5.

[0082] Gesture detection is a function in which the user makes a preset gesture toward the mobile terminal 50, and the mobile terminal 50 detects the gesture as an instruction input instructing a specific operation. Furthermore, voice instructions are realized by a voice recognition function of the mobile terminal 50 that detects voice instructions from the user.

[0083] The main microcomputer 11 of the drive recorder unit 10 receives the video from the mobile terminal 50, performs predetermined processing on the received video, and causes the sub-microcomputer 12 to record the video in an overwrite folder in the recording device 15 (step S13).

[0084] At this time, the main microcomputer 11 may display the image that has been subjected to predetermined processing on the display 45 of the display unit 40 in response to an instruction from the user.

[0085] In parallel with the above processing, rearward images captured by the rear camera 32 are also recorded as appropriate in the recording device 15 of the drive recorder unit 10. In response to an instruction from the user, the main microcomputer 11 may display the rearward images that have been subjected to predetermined processing on the display 45 of the display unit 40. In addition, the display unit 20 may display the rearward images captured by the rear camera 32 on the display device 25.

[0086] Here, under a predetermined condition, the video received from the mobile terminal 50 and the rearward video received from the rear camera 32 are switched from recording in the overwrite mode to recording in the non-overwritten storage mode.

[0087] One example is when a specific event recording request is made from DVR application 510 of mobile terminal 50 (step S14). When main microcomputer 11 of drive recorder unit 10 receives the event recording request from mobile terminal 50, it causes sub-microcomputer 12 to switch recording in recording device 15 from overwrite mode to save mode, and records video in a save folder in recording device 15 (step S15). Specific examples of event recording requests will be described later.

[0088] Another example of switching from overwrite mode to storage mode is when the G-sensor 16 detects acceleration equal to or greater than a predetermined value. When the sub-microcomputer 12 receives the detection result from the G-sensor 16 and determines that the detection result indicates acceleration equal to or greater than a predetermined value (step S114), the main microcomputer 11 causes the sub-microcomputer 12 to switch the recording in the recording device 15 from overwrite mode to storage mode, and records the video in a storage folder in the recording device 15 (step S115).

[0089] The case where the G sensor 16 detects acceleration equal to or greater than a predetermined value can be rephrased as the case where the G sensor 16 detects an impact to the vehicle 5. If the G sensor 16 detects an impact to the vehicle 5, there is a possibility that the vehicle 5 has been involved in some kind of trouble, such as an accident or aggressive driving. In this case, the main microcomputer 11 switches from the overwrite mode to the save mode and causes the recording device 15 to record the video.

[0090] However, in the processing of step S114 described above, the G sensor 16 may be configured to transmit the detection result to the sub-microcomputer 12 only when it detects acceleration equal to or greater than a predetermined value that corresponds to an impact on the vehicle 5. In this case, when the sub-microcomputer 12 receives the detection result from the G sensor 16, the main microcomputer 11 switches from overwrite mode to save mode and records the video in a save folder in the recording device 15.

[0091] In addition, if an event that could be considered an emergency, such as the deployment of an airbag, the illumination of hazard lights, a sudden stop, or a sudden start, is detected in addition to the G sensor 16 detecting an acceleration above a predetermined value, the main microcomputer 11 may switch from overwrite mode to save mode and record the video in the recording device 15.

[0092] Events such as airbag deployment, hazard lights turning on, sudden stops, and sudden starts can be detected from various parts of the vehicle 5, for example, by connecting the drive recorder unit 10 to the CAN (Controller Area Network) of the vehicle 5.

[0093] (Drive recorder unit processing example 2) Next, an example of video recording processing using the navigation function of the mobile terminal 50 of the embodiment will be described with reference to Fig. 6. Fig. 6 is a flow chart showing an example of the procedure of video recording processing performed by the drive recorder unit 10 according to the embodiment using the navigation function of the mobile terminal 50.

[0094] As shown in FIG. 6, when a user such as a driver launches the DVR application 510 of the mobile terminal 50 and selects to start the navigation function, the DVR application 510 sends a notification of the user's navigation start to the main microcomputer 11 of the drive recorder unit 10 (step S21).

[0095] Furthermore, the DVR application 510 starts transmitting video from the selected camera (step S22) when, for example, the user starts the navigation function as a trigger. The start of the navigation function that serves as a trigger is, for example, the user pressing a start button.

[0096] These operations of the mobile terminal 50 by the user are performed by the above-mentioned operation switch 54s provided on the mobile terminal 50. Alternatively, the above-mentioned operations by the user may be performed by gesture detection, voice instructions, or the like.

[0097] The DVR application 510 also starts transmitting the current time and the location information received by the GPS receiver 56c of the mobile terminal 50 (step S23). The time information and location information may be transmitted to the drive recorder unit 10 at intervals longer than the intervals for transmitting the video, such as once per minute.

[0098] The main microcomputer 11 of the drive recorder unit 10 receives the location information and video from the mobile terminal 50, performs predetermined processing on the received video, and causes the sub-microcomputer 12 to record the video linked to the current time information and location information in the recording device 15 (step S24).

[0099] At this time, the sub-microcomputer 12 records the video, time information, and location information in a storage folder in the recording device 15. This is because when a user instructs recording of a video after adding time information and location information, it is assumed that the user intends to save the video as some kind of record.

[0100] In addition, the main microcomputer 11 may display an image that has been subjected to predetermined processing on the display 45 of the display unit 40 in response to an instruction from the user.

[0101] In parallel with the above processing, rearward video captured by the rear camera 32 is also recorded in storage mode in the recording device 15 of the drive recorder unit 10 as appropriate. In response to an instruction from the user, the main microcomputer 11 may display the rearward video that has been subjected to predetermined processing on the display 45 of the display unit 40. In addition, the display unit 20 may display the rearward video captured by the rear camera 32 on the display device 25.

[0102] When the user selects to end the navigation function from the DVR application 510, the DVR application 510 transmits a notification of the end of navigation by the user to the main microcomputer 11 of the drive recorder unit 10 (step S25).

[0103] When the main microcomputer 11 receives a navigation end notification from the DVR application 510, it ends recording of the video from the mobile terminal 50 (step S26). Alternatively, the main microcomputer 11 may end recording of the video from the mobile terminal 50 when the mobile terminal 50 arrives at the navigation destination.

[0104] Furthermore, when the video linked to the time information and location information is read from the recording device 15 and played on the display unit 40 or a dedicated viewer such as a personal computer owned by the user, it is possible to view the video linked to the route on the map.

[0105] Furthermore, the time stamp function allows users to retrieve video from a desired time based on the time information attached to the video.Also, by selecting a specific location on the map, users can retrieve video from a desired location.

[0106] (Drive recorder unit processing example 3) Next, an example of a setting process using the authentication function of the mobile terminal 50 according to the embodiment will be described with reference to Fig. 7. Fig. 7 is a flow chart showing an example of the procedure of the setting process performed by the drive recorder unit 10 according to the embodiment using the authentication function of the mobile terminal 50.

[0107] As shown in FIG. 7, when a user such as a driver starts the DVR application 510 of the mobile terminal 50 and turns on the setting function of the display unit 20 (step S31), the DVR application 510 sends a notification that the user has turned on the setting function to the main microcomputer 11 of the drive recorder unit 10 (step S31).

[0108] When starting the DVR application 510, the user inputs at least one of a user ID that uniquely identifies the user and an authentication code, and is authenticated by the DVR application 510 using the authentication function of the mobile terminal 50.

[0109] For authentication using the authentication function of the mobile terminal 50, biometric authentication such as facial authentication or fingerprint authentication of the user may be used in addition to inputting an authentication code.

[0110] When the main microcomputer 11 receives a setting function on notification from the user for the first time, it acquires from the display unit 20 items that can be set by the user regarding the display method of the display device 25, such as brightness, image quality, and camera angle. When the user inputs these setting values, the main microcomputer 11 causes the sub-microcomputer 12 to record these setting values ​​in the recording device 15, linking them to the user ID of the user.

[0111] The recording device 15 may be capable of storing setting values ​​corresponding to multiple users, linked to each user ID.

[0112] When a setting function on notification is received from a specified user for the second or subsequent time (steps S311, S312), the main microcontroller 11 causes the sub-microcontroller 12 to read out setting value information corresponding to the user ID of that user from the recording device 15 and transfer it to the display unit 20.

[0113] Based on the setting information received from the main microcomputer 11, the display unit 20 changes the display method settings of the display device 25, such as brightness, image quality, and camera angle, to the setting values ​​corresponding to the user ID of the user.

[0114] The user may also be able to change the settings of the display device 25 by directly operating the display device 25. When the user changes the setting value of the display method by operating the display device 25 (step S314), the display unit 20 transmits information about the changed setting value to the main microcomputer 11, which records the information in the recording device 15 of the drive recorder unit 10 (step S315).

[0115] In this way, when logging in for the second time or later, each individual user can automatically set the display method of the display device 25 to the desired setting value for that user. Also, if the setting value of the display device 25 is changed, the display device 25 will be set to the changed setting value the next time it is used. This is useful for the user because it eliminates the need for the user to set the display device 25 to the desired setting value every time it is used.

[0116] Information regarding the setting values ​​between the main microcontroller 11 and the display unit 20 as described above is transmitted from the main microcontroller 11 of the drive recorder unit 10 to the ECU 21 via the sub-microcontroller 12, the serializer 13m, and the deserializer 24 of the display unit 20, or is transmitted from the ECU 21 to the main microcontroller 11 via the reverse route.

[0117] Note that the setting changes and the like using the authentication function of the mobile terminal 50 as described above may be applied to images displayed on the above-mentioned display unit 40 or other displays such as a meter display, a head-up display, etc.

[0118] Furthermore, as another process using the authentication function of the mobile terminal 50, it may be possible to operate various parts of the vehicle 5, such as turning on the engine. That is, it is possible to configure the engine to be turned on only when a predetermined user is authenticated. This can lead to theft prevention of the vehicle 5. Such a process is possible, for example, by connecting the drive recorder unit 10 to the CAN of the vehicle 5.

[0119] (Comparative Example) In a drive recorder unit that captures and records images of the inside and outside of a vehicle using cameras mounted on the vehicle body, multiple cameras must be installed in the vehicle. However, the high cost of cameras increases the cost of the entire system. Depending on the vehicle model, it may not be possible to install the desired number of cameras.

[0120] Furthermore, in order to add time and location information to the video recorded in the drive recorder unit, a GPS receiver had to be built into the drive recorder unit in the past, which further increased costs. It is also possible to obtain this information from a navigation system installed in the vehicle 5, but this requires cooperation with the vehicle, such as connecting the drive recorder unit to the vehicle's CAN.

[0121] In addition, since display devices such as electronic mirrors usually do not have input / output devices, the user interface for operating the display device has to be substituted by the IVI screen installed in the vehicle. Therefore, when linking a drive recorder unit with a display device, linking with the IVI is also required.

[0122] According to the embodiment of the drive recorder unit 10, the drive recorder unit 10 is equipped with a WiFi-IC module 17 and an antenna 18 that receive images from a mobile terminal 50 that captures images of at least one of the area in front of and inside the vehicle 5 and generates images of the interior of the vehicle and the area in front of the vehicle.

[0123] This allows, for example, the front camera provided on the vehicle body and the in-vehicle camera provided inside the vehicle cabin to be eliminated and substituted with the in-camera 52in and the out-camera 52ot of the mobile terminal 50. Thus, an inexpensive, high-value-added drive recorder unit 10 can be obtained that can capture and record images of the inside and outside of the vehicle 5 while reducing the number of cameras mounted on the vehicle 5.

[0124] According to the drive recorder unit 10 of the embodiment, when the G sensor 16 detects acceleration equal to or greater than a predetermined value, the recording device 15 switches the recording destination from the overwrite folder to the storage folder and records the front video, rear video, video of the interior of the vehicle, etc. This allows the video of the vehicle 5 being involved in trouble to be recorded.

[0125] According to the embodiment of the drive recorder unit 10, the WiFi-IC module 17 and the antenna 18 receive location information from the mobile terminal 50, and the recording device 15 links the location information to the front image, rear image, interior image, etc., and records these images in a storage folder.

[0126] In this way, by using the navigation function of the mobile terminal 50, it is possible to record video linked to location information without incorporating a GPS receiver into the drive recorder unit 10. In addition, there is no need for linking with the vehicle 5 via a CAN or the like. Therefore, an inexpensive, high-value-added drive recorder unit 10 can be obtained.

[0127] According to the drive recorder unit 10 of the embodiment, the WiFi-IC module 17 and the antenna 18 receive setting information related to the display method of the display device 25 installed in the vehicle 5 from the mobile terminal 50, and the recording device 15 records the received setting information. As a result, even if the display unit 20 does not have an input / output device, it is possible to input setting values ​​for the display method without using the IVI screen installed in the vehicle 5 as a substitute, and it is possible to realize an inexpensive, high-value-added display unit 20.

[0128] According to the drive recorder unit 10 of the embodiment, the recording device 15 records setting information in association with a user, and when accessed by a predetermined user, the serializer 13m transmits the setting information corresponding to the predetermined user to the display device 25. This makes it possible to automatically change the display method of the display device 25 to a setting value desired by each user.

[0129] Although several embodiments of the present disclosure have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention described in the claims and their equivalents. [Explanation of symbols]

[0130] 1. Video recording system 2 Main Control Block 3 Secondary Control Blocks 5 vehicles 10 Drive recorder unit 11 Main microcomputer 12 Sub-microcomputer 15 Recording Devices 16 G sensor 17 WiFi-IC module 18 Antenna 20 Display Unit 25 Display device 32 Rear camera 40 Display Unit 45 Display 50 Mobile Devices 52-inch front camera 52ot Out Camera 56c GPS receiver 57 WiFi-IC Module 58 Antenna 59 Terminal holder 510 DVR Application

Claims

1. a first receiving unit that receives a first image from a first imaging device that captures an image of a rear area of ​​the vehicle and generates the first image; a second receiving unit that receives a second image from a mobile terminal that captures an image of at least one of a front of the vehicle and an interior of the vehicle and generates the second image; a recording unit that records the first video and the second video in an overwrite folder that is overwritten when the recorded video reaches a predetermined capacity or in a storage folder that is not overwritten; The second receiving unit receiving setting information relating to a display method of a display device installed in the vehicle from the mobile terminal; The recording unit Recording the setting information; Video recording device.

2. the mobile terminal has a display screen and a rear surface located on the opposite side to the display screen; a second imaging device provided on the display screen side of the mobile terminal and configured to capture an image of the side toward which the display screen faces; a third imaging device provided on the rear side of the mobile terminal for capturing an image of the side toward which the rear side faces, 2. The video recording device according to claim 1.

3. further comprising an acceleration sensor that detects acceleration applied to the vehicle; The recording unit When the acceleration sensor detects the acceleration equal to or greater than a predetermined value, the recording destination is switched from the overwrite folder to the storage folder, and the first video and the second video are recorded therein.

3. The video recording device according to claim 1.

4. the mobile terminal has a receiver that receives location information from a satellite positioning system; The second receiving unit receiving the location information from the mobile terminal; The recording unit linking the second video with the location information and recording the second video in the storage folder; 4. The video recording device according to claim 1.

5. The recording unit recording the second video in association with a route on a map according to the location information; 5. The video recording device according to claim 4.

6. The recording unit the second video is recorded so that, when the second video is played back, the second video can be played back at a predetermined position by selecting the predetermined position on the map; 6. The video recording device according to claim 5.

7. the receiver of the mobile terminal receives time information together with the location information from the satellite positioning system; The recording unit linking the second video with the time information along with the location information, and recording the second video; 7. The video recording device according to claim 4.

8. The recording unit recording the second video so that, when the second video is played back, a predetermined time can be selected to play back the second video at the predetermined time; 8. The video recording device according to claim 7.

9. a transmitter that transmits the setting information to the display device; The second receiving unit receiving the setting information from the mobile terminal; The recording unit The setting information is recorded in association with the user; The transmission unit When a predetermined user accesses the device, the setting information corresponding to the predetermined user is transmitted to the display device.

9. The video recording device according to claim 1.

10. The display device is a mirror-type display device modeled after a mirror for checking the rear of the vehicle.

10. The video recording device according to claim 9.

11. On the computer, receiving a first image from a first imaging device that captures an image of a rear area of ​​the vehicle and generates the first image; receiving a second image from a mobile terminal that captures an image of at least one of a front of the vehicle and an interior of the vehicle and generates the second image; recording the first image and the second image in an overwrite folder in which the image is overwritten when the image reaches a predetermined capacity or in a storage folder in which the image is not overwritten; receiving setting information relating to a display method of a display device installed in the vehicle from the mobile terminal; Recording the setting information; Video recording program.

Citation Information

Patent Citations

  • Drive recorder, recording method and program

    JP2011135418A

  • Portable communication terminal

    JP2013008347A

  • On-vehicle display device

    JP2016005234A

  • Mobile communication terminal, information processing system, information processing method, and program

    JP2019165296A

  • Driving evaluation screen display method, program, driving evaluation system, and driving evaluation screen

    JP2020129091A