Systems and programs, etc.

Abstract

To provide a system and the like better than before.SOLUTION: A system includes a first set to a fourth set as a "camera display state set," and when a "short press" of a switch part 28 is detected, performs display while switching the set currently displayed on a second display 200 to the next set. When "press twice" is detected, and the "camera display state set" displayed on the second display 200 is a camera display state set (first set) displaying images from a front camera 26 and not displaying images from a second camera 27, the system switches to a camera display state set (third set) displaying only the images from the second camera 27.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to, for example, a system, a program, and the like. [Background Art]

[0002] Conventionally, there have been known a drive recorder installed in a vehicle to capture images of the front of the vehicle, and a viewer that plays back images captured by the drive recorder on a personal computer or the like. As a drive recorder, for example, as described in Patent Document 1, some drive recorders capture an area of a hemisphere or larger. [Prior Art Documents] [Patent Documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2018-196066 [Summary of the Invention] [Problem to be Solved by the Invention]

[0004] However, conventional systems have had various problems. Therefore, an object of the present invention is to provide a system, a program, and the like having superior characteristics compared to conventional ones.

[0005] The object of the present invention is not limited thereto, and the applicant intends to obtain rights through divisional applications, amendments, etc., for configurations that aim to obtain the effects derived from the components of the configuration disclosed in this specification and the drawings, etc. For example, problems that can be described in this specification as "~is possible" or "~is feasible" are disclosed in this specification. Each problem is described independently, and the applicant intends to obtain rights to each configuration for solving each problem independently through divisional applications, amendments, etc. Even if a problem is implicitly understood from the description in the specification, the applicant intends to include a part of the configuration described in this specification in the claims through amendment or divisional application. Furthermore, configurations that solve problems by combining these independent problems are also disclosed, and the applicant intends to obtain rights to them. [Means for solving the problem]

[0006] (1) A system characterized by having an improved means that improves the user experience compared to conventional drive recorders. As a means of improvement, it is preferable to include at least part of the contents of this specification and the following lines.

[0007] (2) A system comprising a drive recorder equipped with a function for recording video captured by a camera installed in the vehicle, wherein an indicator is provided on the side of the drive recorder body that is not the side with the camera and is not the side opposite to the side with the camera. (3) The side surface may be provided with a portion to prevent the light of the indicator from leaking to the side having the camera.

[0008] For example, it is particularly good to have indicators such as LEDs attached to the side of the main unit. Attaching them to the front (camera side) is not advisable, as light leakage could obstruct traffic. Attaching them to the inside has been commonplace in previous products. Attaching them to the side, as in this system, is preferable. It is especially good to install them in a position that is visible but not immediately obvious on the side. Also, it is good to add a cover or protrusion to the front to prevent light leakage. This system is particularly suitable for installation in vehicles carrying passengers, such as buses, trucks, and trains. In vehicles carrying passengers, the light can be designed to be inconspicuous to passengers and to soften the impression of surveillance for the driver. In particular, the status display should indicate that recording is in progress, but not be obvious without looking closely. This system is especially suitable for installation near the driver's seat. (4) A system equipped with a drive recorder that has the function of recording video captured by a camera installed in the vehicle, The drive recorder comprises a fixing means between the main body and the portion that is attached to the vehicle, The fixing means includes a connector for receiving power from the vehicle and means for supplying the received power to the main body. The fixing means may be provided with a light-emitting means on the side facing the vehicle when the fixing means is fixed to the vehicle, to indicate the state of power reception from the vehicle.

[0009] For example, it would be good to provide a power connector on the bracket side and a lamp on the bracket side to indicate whether power is being supplied. The lamp should be placed on the front side.

[0010] In particular, it offers the excellent benefit of solving the problem of not being able to tell if a dashcam is working, especially when the system lacks a monitor. (5) A system equipped with a drive recorder that has the function of recording video captured by a camera installed in the vehicle, The slot for inserting the recording medium for recording the aforementioned video is provided on the side facing the vehicle when the drive recorder is installed in the vehicle. It is preferable to provide an access lamp near the slot on the interior side of the vehicle to indicate that the recording medium is being accessed.

[0011] For example, the slot should be located on the front, and the indicator light showing that writing to the recording medium is located around the slot on the front. The light should be located inside the cover of the slot into which the recording medium is inserted; this way, it is not dazzling when the cover is closed, and visible when it is open. For example, the SD card slot should be located on the front, and the indicator light showing that writing to the SD card is located around the SD card slot on the front. The light should be located inside the SD card slot cover. (6) A system equipped with a drive recorder that has the function of recording video captured by a camera installed in the vehicle, A motion detection recording function that records the video when it detects the aforementioned moving object, It also includes a time-lapse recording function that records the aforementioned video for a predetermined period of time at regular time intervals, The motion detection recording function and the time-lapse function should ideally be operated simultaneously.

[0012] (7) The video in the time-lapse recording function is a still image, and the predetermined time is one frame, while the video in the motion detection function is a video. For example, the time-lapse and motion detection functions should be operated simultaneously, with the time-lapse recording a still image and the motion detection recording a video.

[0013] (8) Although the time-lapse recording function and the motion detection function are processed separately as events, it is preferable to record the respective videos in the same folder without distinction. For example, time lapse and motion detection should be performed simultaneously, and while they are detected as distinct events, it's best to record them in the same folder without distinguishing between them. (9) A drive recorder equipped with HDR functionality, It would be beneficial to have a function that allows for the distinction between video recorded in HDR and video recorded without HDR.

[0014] Various HDR formats can be used. For example, this may include something called WDR. DOL-HDR is particularly good. It would also be good to have a function to select the type of HDR automatically or through user settings, and a function to record the selected type of HDR in association with the video being recorded.

[0015] (10) It is preferable to record information associated with the video that distinguishes whether the video is with HDR on or off. In particular, it is preferable to record information associated with the video that identifies whether the video is with DOL-HDR on or off. It is preferable to provide a function for the user to set whether or not to use DOL-HDR.

[0016] (11) When the camera is capable of capturing circular fisheye images, it is desirable to have a function to disable DOL-HDR. In particular, at night, it is desirable to have a function to use Long Exposure and disable DOL-HDR.

[0017] (12) The camera should have a function to extract both short exposure and long exposure images and record both images onto a recording medium. The viewer should have a function to perform so-called "developing" using both images individually or in combination.

[0018] (13) The image sensor of the drive recorder camera should have a function to bin multiple pixels together as one pixel, a function to set whether or not to bin by the user, and a function to perform bin when bin is set to be performed. In particular, when bin is set to be performed by the user, it should have a function to decide whether or not to perform bin, prioritizing the user's setting, regardless of the binning functions described in (14) and later. (14) It is recommended that the setting for whether or not to perform binning be provided as a separate setting from the recording resolution setting in the dashcam.

[0019] (15) It is preferable that the drive recorder has a function of storing information indicating whether binning is performed in association with video data. For example, it is preferable to have a function of storing information indicating whether binning is performed in association with each video frame. (16) The camera has a function of binning a plurality of pixels together into one pixel, It is preferable to have a function of determining whether to perform binning according to the remaining capacity or total capacity of a recording means for recording the video captured by the camera. (17) It has a function of determining whether it is currently daytime or nighttime, It is preferable to have a function of not performing binning when it is daytime, and performing binning when it is nighttime. (18) It is preferable to have a function of not performing binning even when it is nighttime, if the headlight is turned on.

[0020] (19) It is preferable to comprise a front camera for photographing the front of the vehicle and a rear camera for photographing the rear of the vehicle, and to have a function such that the front camera does not perform binning while the rear camera performs binning even when it is nighttime. (20) It is preferable to have a function such that the front camera does not perform binning even at night, and the rear camera performs binning at night.

[0021] (21) It is preferable to have a function of detecting whether the vehicle is in a tunnel, and to have a function of performing binning when the vehicle is in a tunnel. When the vehicle is in a tunnel, binning is preferably performed even if the functions according to (15) and the following aspects exist and would otherwise result in no binning being performed. (22) A drive recorder, comprising a headlight forgetting-on warning function, It is preferable to have a function of controlling such that the headlight forgetting-on warning is not issued more than once a day. (23) It is preferable to comprise a headlight forgetting-on warning function, and to have a function of controlling such that the headlight forgetting-on warning is issued only once per driving trip.

[0022] (24) A system comprising a drive recorder equipped with a function to record video footage captured by a camera installed in a vehicle, wherein multiple drive recorders are installed in one vehicle, and the system is equipped with a function to receive and display the video footage from the first drive recorder on a second drive recorder different from the first drive recorder. For example, a 360° drive recorder that captures circular panoramic video without a monitor is installed at the rear, and a regular drive recorder with a monitor is installed at the front. The video footage from the rear 360° drive recorder can be viewed on the monitor of the regular front drive recorder.

[0023] (25) A drive recorder equipped with a function to convert a circular fisheye image captured by a camera into an image in another coordinate system and display it on a display means, wherein the drive recorder is equipped with a function to receive a circular fisheye image captured by another drive recorder using wireless communication, and convert the received image into an image in the other coordinate system and display it on a display means. (26) A system equipped with a drive recorder that has the function of recording video captured by a camera installed in the vehicle,

[0024] The camera captures a circular fisheye image, transmits the captured circular fisheye image to a smartphone, and the smartphone is equipped with a function to convert the circular fisheye image into an image in another coordinate system and display it.

[0025] For example, the dashcam itself could send circular fisheye video to a smartphone, and the smartphone could then select from multiple view modes such as "panorama," "split screen," "quadruple screen," or "cropped" to play the video in various views. (27) A system equipped with a drive recorder that has the function of recording video captured by a camera installed in the vehicle, It is preferable to have a function to generate and record image data in which a predetermined area outside the circumference of the circular fisheye image captured by the aforementioned camera is filled with a single color. (28) When recording a circular fisheye image, it is desirable to have a function that generates and records image data in which the area outside the predetermined circumference is filled with a single color (masked).

[0026] This method reduces the amount of video data and prevents the playback of unwanted reflections, such as reflections outside the circumference. Even with physical measures taken inside the lens barrel, faint brown rings or other reflections may appear around the edges of the circular image area, but this method prevents such reflections from being recorded in the video. The predetermined circumference may be the range in which the circular fisheye image is formed on the sensor, but it is preferable to set it to a range inside this range by a predetermined width. For example, when recording a circular fisheye image, it is preferable to have a function that generates and records video data that is slightly inside the circumference and filled (masked) with a single color. (29) A system equipped with a drive recorder that has the function of recording video captured by a camera installed in the vehicle, The aforementioned camera has a rectangular imaging area,

[0027] It is preferable to include a function that records as video data an image of a square area within the rectangular imaging area, where the vertical width is a length that exceeds the diameter of the circumference of the circular fisheye image captured by the camera by a predetermined range. (30) The system may be provided with a selection means for selecting whether to record the image of the rectangular imaging area captured by the camera or to record the image of the square area. (31) A system for playing back images of a rectangular or square region including a circular fisheye image recorded by the drive recorder, When playing back the circular fisheye image, it is preferable to play the circular fisheye image within a predetermined circumference and fill in the area outside the predetermined circumference with black.

[0028] (32) A system for playing back video of a square area recorded by the drive recorder, which may include a function to play back the video by adding black rectangular areas to the left and right of the square area.

[0029] (33) When recording a circular fisheye image formed on a rectangular imaging sensor area, it is preferable to have a function that records only the image of a square area whose vertical width is slightly (within several tens of pixels) greater than the diameter of the circumference as image data.

[0030] (34) Viewers that play back video recorded with configurations such as the 33rd and 34th should have a function to add black areas to the left and right of the area outside the circumference so that the video inside the circumference is centered in the long rectangular area in the left-right direction.

[0031] (35) It is desirable to have a function that allows the user to set whether to record using configurations such as (33) and (34) or using the rectangular area of ​​the image sensor, and to record according to that setting. It is also desirable to have a function that records which of these was selected to record the video. (36) Recording should be done in a square or rectangular area, but it would be good to have a function that masks the area outside the circular region with a single color during playback. (37) A system equipped with a camera, The aforementioned camera is a camera that forms a circular fisheye image within a non-square image sensor area, The imaging means of the aforementioned camera is equipped with a function to output a cropped image.

[0032] The system is equipped with means for precisely aligning the image sensor area so that the entire diameter of the exercise fisheye image fits within the shorter direction of the image sensor area, while for fixing the image sensor area in the longer direction with less precise alignment than in the shorter direction.

[0033] It is preferable to actually measure the range of the longitudinal fisheye image of the exercise formed on the image sensor area (for example, by measuring the image output in All-pxiel scan mode) and then perform a process to output an image cropped with that range as one of the sides (for example, by outputting in Window Cropping Mode).

[0034] This eliminates the need for precise longitudinal alignment during assembly. For example, using Sony's IMX415 CMOS image sensor and setting its Readout Mode to Window cropping mode would be a good approach. (38) A system equipped with a camera, The aforementioned camera is a camera that forms a circular fisheye image within a rectangular image sensor area,

[0035] It is preferable to configure the system such that the center of the circular region where the circular fisheye image is formed by the first lens is offset from the longitudinal center of the rectangular region, and an image is formed by a lens other than the first lens in the region of the rectangle other than the circular region in the longitudinal direction.

[0036] For example, with a 4K resolution image sensor, the horizontal dimension is 3840 pixels, but the vertical dimension is 2160 pixels. Therefore, in a circular fisheye image, only the diameter of the sensor, 2160 pixels, is used horizontally at most. As a result, a black area of ​​up to 1680 x 2160 pixels is wasted. It is a good idea to forcibly form an image in this area with another lens. For example, if the area of ​​the circular fisheye image is shown as a circle and the area to be forcibly imaged is shown as a square, then the images can be formed by arranging them horizontally, such as □○□, or □○. In this case, it is a good idea to place a shielding plate between the square and the circle. The square itself can be imaged using a refractive optical system, but simply placing lenses at an angle is also an option. The image will be blurred, but it is particularly good for sensing things like whether there is a suspicious person.

[0037] (39) The other lens side may be configured to have a larger F-number than the first lens side. For example, the F-number of the square side may be made larger (stopped down) than the F-number of the circle side. Even if the image of the square side is formed at an angle to the sensor, depth of field can be secured and blur of the image can be reduced, and the image of the circle side can be recorded relatively brighter. (40) A system that acquires video footage recorded on a drive recorder via wireless communication and displays a list of its titles, A function to display a download icon for entering download instructions, which is paired with the aforementioned title, It includes a function to display a share icon for inputting instructions to share to social media, which is paired with the aforementioned title. When displaying the list of titles, the system displays the Char icon in pairs with the titles of videos downloaded from the drive recorder.

[0038] When displaying the list of titles, the system should not display the Char icon alongside the titles of videos that have not been downloaded from the drive recorder, but instead display the download icon.

[0039] For example, when displaying a list of video files recorded by a dashcam on a smartphone, it would be good to display a download button for files that have not yet been downloaded to the smartphone, while hiding the share button, and to display the share button but not the download button for files that have already been downloaded to the smartphone. (41) Equipped with a function to share video recorded by the dashcam to social media, etc. When a user enters instructions to share a video on social media, The system should include a function to display a screen that allows users to specify the scope of sharing, and a function to upload the specified scope to a server such as a designated social networking service (SNS).

[0040] For example, it would be good to have a function that, when a user presses the share button, displays a screen that allows them to specify the range of the video file's total time range to be shared, and then uploads the specified range to a designated server. (42) Equipped with a function to share video recorded by the dashcam to social media, etc.

[0041] The video recorded by the dashcam includes files of continuously recorded video and files of event-recorded video. The system should allow event-recorded video files to be uploaded to servers such as SNS using the sharing function, while the continuously recorded video files should not be uploaded to servers such as SNS using the sharing function. For example, you could have an event log file and a continuous recording file, where the event log file can be shared, but the continuous recording file cannot. (43) A system that displays video and also has a function to display the location where the video was taken on a map,

[0042] The system should include a function to display a marker on a map indicating the location of the aforementioned video, and to draw a graphic shape indicating the display range of the video from the location of the marker.

[0043] For example, it would be good to display a pin-shaped icon on the map indicating the current playback location, along with the driving trajectory to that point. Within the area displaying a portion of the recorded video, which is smaller than the entire video area, it would be good to have a function that allows the user to change the display range of that video, and to display the direction indicated by the currently displayed range at the current location on the map. In particular, it would be good to reflect the currently displayed direction in real time with an arrow or fan shape. (44) Equipped with a function to change the display direction of the video by user operation, The system includes a function to change the orientation of the graphics in accordance with the change in the display direction of the video. It would be good to make it a system. (45) Equipped with a function to change the display direction of the video by user operation, The system should include a function to change the orientation of the graphic in accordance with the change in the display orientation of the video. (46) A system that has the function of displaying video and the location of the video on a map,

[0044] It is preferable to include a function that displays a mark on a map indicating the location of the aforementioned video, and also draws a graphic shape that indicates an area narrower than the display range of the video, which varies according to the vehicle's speed, starting from the position of the mark.

[0045] For example, the angle of the fan can be narrowed in proportion to the speed as the speed increases, or another fan with an angle corresponding to the speed can be drawn within the fan graphic of configuration (43). This angle should generally correspond to the angle at which the driver's field of view narrows as the speed increases. (47) A system that has the function of displaying video and the location of the video on a map,

[0046] It is preferable to include a function that displays a marker on a map indicating the location of the aforementioned video, and also draws a graphic indicating the display mode of the video from the location of the marker.

[0047] For example, the graphic indicating the video display mode should be an icon that corresponds to the view mode and displayed on the map. The shape should change depending on the view mode: a circle for round, a fan shape indicating the panoramic range for panorama, a fan shape for the front and back shooting ranges for 2-way split, a fan shape for front, back, left, and right for 4-way split, and a fan shape for the cropped range for crop.

[0048] (1) A system having a drive recorder equipped with a function to record video footage captured by a camera installed in a vehicle, wherein the system may also be equipped with a function to perform predetermined processing using a predetermined range of video footage captured by the camera installed in the vehicle in response to an operation from the user.

[0049] In this way, a system superior to conventional systems can be provided. For example, predetermined processing can be performed using a predetermined range of video footage captured by a camera installed in the vehicle, in response to user operations. Therefore, for example, predetermined processing can be performed using a predetermined range of video footage captured by a camera installed in the vehicle in a way that is more in line with the user's intentions than in conventional systems.

[0050] The cameras installed in the vehicle should include at least one of the following: a camera that photographs the front of the vehicle, a camera that photographs the rear of the vehicle, a camera that can photograph both the front and rear of the vehicle simultaneously, and a camera that photographs the driver. The camera installed on the vehicle should be at least one of the following: a wide-angle camera, a hemispherical camera, or a 360-degree camera.

[0051] The function for recording video may be a function that records to a recording device built into the dashcam, but it is preferable to have a function that records to a recording device that is detachably attached to the dashcam. The camera and dashcam can be housed in separate enclosures and connected by wire or wireless connections, but it is preferable to house them in a single enclosure. A system that includes a dashcam could, for example, be a system that includes a dashcam and a power line that supplies power to the dashcam.

[0052] User input could include, for example, touch panel operation, but button operation is particularly preferable. It is also desirable to provide a means for receiving user input, such as a touch panel or operation buttons.

[0053] A system that has a function to perform a predetermined processing using a predetermined range of video footage captured by a camera installed in the vehicle in response to user operations may be built into the camera housing, the drive recorder housing, or the housing of an electronic device separate from the camera or drive recorder. For example, it may be built into a personal computer, tablet, etc. When built into the housing of an electronic device separate from the camera, the "video footage captured by the camera installed in the vehicle" may be input (e.g., acquired) by connecting the drive recorder and the electronic device separate from the camera via a wired or wireless connection, or the drive recorder may record the video footage captured by the camera installed in the vehicle onto a recording medium that can be removed from the drive recorder, and this recording medium may be removed from the drive recorder and attached to the electronic device separate from the camera, so that the electronic device separate from the camera can read and acquire the video footage.

[0054] (2) The predetermined processing includes a process for generating an image in which a predetermined range of the image captured by a camera installed on the vehicle is incorporated into a predetermined position on a single screen and output, The user operation may include an operation to change a predetermined range in the video captured by the camera, which is incorporated at a predetermined position on the screen.

[0055] In this way, the user can operate the system to change a predetermined range of the video footage captured by a camera installed in the vehicle, which is then incorporated into a designated position on a single screen.

[0056] The output video should preferably be at least one of the following: video to be displayed on a screen, video to be recorded on a recording device, or video to be output to an external video output terminal.

[0057] The predetermined range of the video footage captured by the camera installed on the vehicle may be, for example, the entire video footage captured by the camera installed on the vehicle, but it is particularly preferable to define it as a portion of the video footage captured by the camera installed on the vehicle.

[0058] A designated location within a screen can be a specific area within that screen. For example, the screen can be divided into multiple areas, and the designated location can be one of those divided areas.

[0059] The video footage captured by the camera installed on the vehicle may have multiple predetermined ranges, and it may also have multiple different ranges within a single frame of the video. These multiple different ranges may be non-overlapping, or some or all of them may overlap.

[0060] A single screen may have multiple designated positions, and may have multiple different positions. These multiple different positions may overlap in some or all of their ranges, but may also be in ranges that do not overlap.

[0061] The correspondence between a predetermined range of video footage captured by a camera installed on the vehicle and a predetermined position on a single screen may be fixed in advance, but it is preferable to have a function to change this correspondence.

[0062] (3) The system comprises a first predetermined range, which is the entire range of the video captured by the camera installed on the vehicle, and a second predetermined range, which is a part of the video captured by the camera installed on the vehicle, and a first screen layout, which is the position of the entire area of ​​the screen, and a second screen layout, which is the position of a part of the area of ​​the screen, and a first mode for generating the output video by associating the first predetermined range with the first layout, a second mode for generating the output video by associating the first predetermined range with the second layout, a third mode for generating the output video by associating the second predetermined range with the first layout, and a fourth mode for generating the output video by associating the second predetermined range with the second layout, and it is preferable to have a configuration that includes an operation for switching between each mode as an operation for the user.

[0063] In this way, the user can switch between at least three modes provided by the system, which include a first mode that generates the output video by associating the first predetermined range with the first layout, a second mode that generates the output video by associating the first predetermined range with the second layout, a third mode that generates the output video by associating the second predetermined range with the first layout, and a fourth mode that generates the output video by associating the second predetermined range with the second layout. By providing at least three modes, either two modes where the predetermined range is "whole" or two modes where the predetermined range is "partial," or two modes where the layout is "whole" or two modes where the layout is "partial," are among the switchable modes. Therefore, when switching, the user can switch using the identity of the predetermined range or layout as a clue, and it is easier than before to understand which range is displayed in which layout.

[0064] (4) The predetermined processing includes a process for generating an image in which a predetermined range of the image captured by a camera installed in the vehicle is incorporated into a predetermined position on a single screen and output, wherein there are multiple predetermined positions on the single screen, and the user is provided with an operation to select which of the multiple predetermined positions on the single screen the predetermined range of the image captured by the camera should be incorporated into.

[0065] In this way, the user can choose which of several predetermined locations on a single screen to incorporate a specific range of the video captured by the camera.

[0066] (5) The predetermined processing includes a process for generating an image in which a predetermined range of the image captured by a camera installed in the vehicle is incorporated into a predetermined position on a single screen and output, and the user operation includes an operation to set the predetermined position on the single screen to a position moved from the initial position of the predetermined position.

[0067] In this way, the user can set a predetermined position to a position moved from its initial position within a single screen. For example, when the configuration includes both configuration (4) and configuration (5), it is particularly good to include a function to select which of several predetermined positions to move, and to set the selected predetermined position to a position moved from its initial position.

[0068] (6) The predetermined processing includes a process for generating an image in which a predetermined range of the image captured by a camera installed on the vehicle is incorporated into a predetermined position on a single screen and output; the predetermined range is provided in multiple locations on a single screen of the image captured by the camera installed on the vehicle; the predetermined position is provided in multiple locations on the single screen; and the system is configured to include an operation by the user to set the correspondence between which of the predetermined ranges in the multiple locations is incorporated into which of the predetermined positions in the multiple locations.

[0069] In this way, the user can set the correspondence between which of the predetermined ranges of the multiple locations is incorporated into which of the predetermined positions of the multiple locations.

[0070] (7) A system comprising a plurality of predetermined layouts, each having a predetermined position for incorporating one or more images into a single screen, and having a function to generate an image by combining different predetermined ranges within an image captured by a camera into predetermined positions on the predetermined layout, wherein the system is configured to include a function that allows the user to select which of the plurality of predetermined layouts to use to generate the combined image. In this way, the user can select which of several predetermined layouts to use to generate the combined video.

[0071] (8) The system is equipped with a function to record both the camera's video and the generated video, and at least one of the predetermined layouts is equipped with a layout that displays the video captured by the camera on one screen, and when the layout is selected by the selection function, the system is equipped with a function that does not record the video generated in the selected layout. This reduces the amount of video to be recorded.

[0072] (9) The system may include a first mode in which the video of the selected layout is displayed on the display screen and the video of the same layout as the selected layout displayed on the display screen is recorded in the recording means, and a second selection function in which the video of the layout selected by the selection function is displayed on the display screen, but a recording layout different from the layout selected by the selection function and displayed on the display screen is selected.

[0073] In this way, a system can be provided that is easily usable by both users who want the display layout and the recording layout to be the same, and users who want them to be different.

[0074] (10) The system may include a function to enlarge the image at a predetermined position in the image of the selected layout that generates the combined image, based on the user's instructions. In this way, users can enlarge the image at a specific location on a given layout by inputting instructions.

[0075] (11) When the enlarged display is being performed, it is preferable to have a function to record the enlarged display video, or a function to record the video of the selected layout without recording the enlarged display video.

[0076] (12) The different predetermined ranges within the image captured by the first camera are arranged so as not to overlap, and the system may be provided with a function to generate an image in which a second camera image, which is an image from a camera other than the first camera, is displayed at one of the plurality of predetermined positions. In this way, the user can view the images from the first camera and the images from the second camera, both of which do not overlap and are set to a predetermined range, on a single screen. (13) The system may be provided with a function to select the predetermined position for displaying the image from the second camera.

[0077] In this way, the user can view the image from the second camera at a location selected by the user, while simultaneously viewing the non-overlapping images from different predetermined ranges of the first camera and the image from the second camera on a single screen. (14) It is preferable to have a function to store information that identifies the correspondence between the predetermined position and the predetermined range in association with the recorded video.

[0078] In this way, when playing back the recorded video, it becomes easy to set the playback mode based on information that identifies the correspondence between the predetermined position and the predetermined range that has been stored. (15) The generated video is not recorded, and the system is provided with a function to display the generated video on a display screen. In this way, user actions do not affect the recorded video, and the screen can display the video desired by the user in response to their actions. For example, the configuration may include (7), and may also include a function to display the video generated with the selected layout on a display screen without recording it.

[0079] In this way, users can freely switch the layout in which the video is displayed on the screen to their desired layout, without the video recorded by the dashcam being affected by the user's layout changes.

[0080] For example, the configuration of (7) may be provided, and it may also have a function to record both the video captured by the camera and the video generated with the selected layout, along with information that distinguishes between the two videos, in a recording means so that both can be played back in sync. This makes it easy to synchronize and play both video feeds. (16) The system may also include a function to display the generated video on a display screen and a function to record the generated video.

[0081] In this way, the system can display screen content in response to user actions, and simultaneously record generated video content that is identical to the screen content displayed in response to user actions. In particular, it is desirable to record the video from the camera itself in addition to displaying screen content in response to user actions and recording generated video content that is identical to the screen content displayed in response to user actions.

[0082] (17) The image captured by the camera is a circular fisheye image, and the camera includes an operation by the user to pre-set a position in the circular fisheye image that corresponds to the installation position of the vehicle speed measuring device, and the camera also includes a function to display a predetermined warning for a predetermined range that includes the position corresponding to the installation position set in response to the user's operation.

[0083] In this way, a predetermined warning is displayed within a predetermined range in the circular fisheye image set by the user, including the position corresponding to the installation location of the vehicle speed measuring device, allowing the user to recognize the warning more quickly and easily than before.

[0084] (18) The camera may be provided with a function to control an infrared irradiation means that irradiates infrared light onto the shooting range of the camera, and a function to record images before and after a change in predetermined control of the infrared irradiation means.

[0085] In this way, video footage is recorded before and after a change in the predetermined control of the infrared illumination means from this system. For example, by viewing the recorded video footage, it is easy to understand the circumstances when a predetermined change occurred in the infrared illumination means. For example, the system could detect the ambient brightness around the drive recorder and, if the detected brightness falls below a predetermined level, control could be performed to turn on the infrared illumination means. (19) The system may be provided with a function to detect areas in the video that are redder than their surroundings and to perform the predetermined processing on those areas as being within the vehicle interior.

[0086] In this way, a system that performs a predetermined process on a region inside a car's interior within a video feed does not need to manually set the location of that region; it can automatically identify that region and perform the predetermined process.

[0087] (20) The system is equipped with a function to play back recorded video, the video recording of the time when the event occurred, and if the video being played back does not show the driver and playback reaches a point in time related to the time when the event occurred, it is preferable to have a function to display video showing the driver for the period including the time when the event occurred.

[0088] In this way, when playing back recorded video, if the video does not show the driver and playback reaches a point in time related to the event, the system will automatically display video showing the driver for the period including the event. Therefore, when playback reaches a point in time related to the event, the user can easily check the driver's condition at that time without having to perform operations such as switching to video showing the driver. This is particularly effective when someone other than the driver, such as a fleet manager, needs to check the vehicle's condition and the driver's driving condition.

[0089] (21) The predetermined range may include an area in the video captured by the camera that contains smoked glass, and the predetermined processing may include a smoked glass partial area video adjustment function that adjusts the video of the area in the video captured by the camera that contains smoked glass.

[0090] In this way, the image of the area containing the smoked glass in the video captured by the camera can be adjusted according to the user's operation. The user operation should include an operation to set the area containing the smoked glass in the video captured by the camera. The adjustment of the image of the area containing the smoked glass in the video captured by the camera should be performed by increasing the brightness of the set area.

[0091] (22) The video includes a video of the rear of the vehicle, and the predetermined processing includes a function to provide notification based on the approach status of the vehicle behind in the video, and the notification includes a notification indicating that the vehicle behind is too close, and the user operation may include a function to change the position of the reference for proximity determination in the video for determining that the vehicle behind is too close in response to the user operation. This allows users to easily adjust the frequency and sensitivity of notifications when a vehicle behind them gets too close to their own vehicle.

[0092] (23) The video includes a video showing the rear of the vehicle, and the predetermined processing includes a function to provide notification based on the approaching state of the vehicle behind in the video, and the notification includes a notification indicating that the vehicle behind is driving erratically, and the user operation includes a function to change the position of the criterion for determining whether the vehicle behind is driving erratically in the video according to the user operation. This allows users to easily adjust the frequency and sensitivity of notifications regarding erratic driving by vehicles behind them.

[0093] (24) The video includes a video of the rear of the vehicle, and the predetermined processing includes a function to provide multiple different types of notifications based on the approaching state of the vehicle behind in the video, and the recording time range is set to be different for each different type based on the approaching state of the vehicle behind in the video. In this way, it is possible to obtain video footage with different recording time ranges for each different type based on the approaching state of the vehicle behind in the video.

[0094] It would be beneficial to record "swerving" and "sudden approach" as different types of events and to have a function to distinguish and display them separately in the viewer. It would also be beneficial to have different recording time ranges for sudden approach / swerving events and impact events.

[0095] (25) The camera may be equipped with a function to display the video captured by the camera on a display screen, a function to change the predetermined range as an operation by the user, and a function to record the video including the time when the user inputs an instruction to change the predetermined range. In this way, it is possible to obtain video footage that includes the moment when the user inputs an instruction to change the predetermined range.

[0096] (26) The device may be provided with a function to set a predetermined range of the input video as the target to be displayed on the display screen or the target to be recorded, and to provide an operation to switch the predetermined range as an operation from the user, and to provide an instruction to the user when the device is first powered on after being shipped from the factory to perform the operation to switch the predetermined range and to check whether there are any problems with the video captured by the camera in the predetermined range of the input video that is to be displayed on the display screen or the target to be recorded.

[0097] This method makes it easy to check whether there are any problems with the video footage, regardless of which state the dashcam is in, when it is installed in a vehicle, or when it is switched by the user.

[0098] (27) The video image captures an area that includes at least one of the driver's side or the passenger's side, and the video image may have a function to convert the background image of the driver or passenger in the video image into a pre-stored image.

[0099] (28) The device has a function to incorporate and display the video captured by the camera in a predetermined layout on the screen as an image to be displayed on the display screen, and has a plurality of the predetermined layouts, and a function to switch between the plurality of layouts based on user operation, and has a function to incorporate and play back the video recorded by the recording function in the predetermined layout, and the order in which the layouts are switched based on user operation during playback is preferably the same as the order in which the layouts for incorporating and displaying the video captured by the camera in a predetermined layout on the screen are switched based on user operation. This approach allows users to switch playback layouts in the same order as they switch screen display layouts, making it user-friendly.

[0100] The system may consist solely of a drive recorder, with both recording and playback functions integrated into the drive recorder. However, it is preferable for the system to include both a drive recorder and a separate playback device (such as a computer), with the drive recorder providing the recording function and the separate playback device providing the playback function. For example, the order in which the video display layout switches on the drive recorder itself should be the same as the order in which the video display layout switches on a viewer running on a computer or similar device.

[0101] (29) The camera has a function to incorporate and display images captured by the first camera and the second camera in a predetermined layout on the screen as images to be displayed on the screen, and the predetermined layout has a plurality of layouts incorporating the images from the first camera and at least one layout incorporating the images from the second camera, and the first operation unit has a function to switch between these plurality of layouts in a predetermined order based on user operation, and the second operation unit has a function to switch to a layout of a camera different from the camera of the image incorporated in the currently displayed layout when a predetermined operation is performed on the second operation unit.

[0102] In this way, the user can switch between layouts incorporating camera images in a predetermined order by operating the first control unit, and if they want to see the image from another camera immediately, they can switch to the image from another camera by operating the second control unit.

[0103] For example, if the system is configured with a dashcam, it would be a good idea to provide a separate camera switching button on the dashcam itself, distinct from the display mode switching button.

[0104] (30) The camera has a function to incorporate and display images captured by the camera on a screen in a predetermined layout, and has a plurality of predetermined layouts, and a first operation unit that switches between the plurality of layouts in a predetermined order based on user operation, and it is preferable to have a separate operation unit different from the first operation unit, and a switching function that, when a predetermined operation is made on the separate operation unit, switches to a predetermined layout based on user operation, rather than switching in the predetermined order.

[0105] In this way, the user can switch between multiple layouts incorporating the video captured by the camera in a predetermined order by operating the first control unit, and can also instantly view a display with the video captured by the camera incorporated into a predetermined layout by operating another control unit. For example, the drive recorder itself, or a viewer on a separate device (such as a PC), should have a separate button for switching to a single pre-set mode in addition to the buttons for sequentially changing the display mode.

[0106] (31) The housing side of the drive recorder is provided with an event recording button, and the drive recorder is connected to a separate button operation unit that can be installed in a location that is difficult to see from outside the vehicle, and when the button operation unit is operated, it is preferable that the unit be provided with a function to record video for a predetermined period of time, including before and after the time the button operation unit was operated, for a recording time different from the recording time of the event recording.

[0107] In this way, the user can initiate event recording by operating an event recording button on the drive recorder's housing, and can also record video for a predetermined period of time, including before and after the moment the button is operated, with a different recording time than the event recording, by operating a separate button control unit located in a place that is difficult to see from outside the vehicle. For example, a drive recorder equipped with a manual event recording button could be provided with a separate button that can be installed in a place that is not visible from the outside of the drive recorder unit, and this button could be the manual recording start button for road rage incidents, with the recording time for road rage incidents being longer than the recording time for manual event recordings.

[0108] (32) The button operation unit, which is located in a part of the vehicle that is separate from the drive recorder and is difficult to see from the outside, may be configured to be a button on the remote control of the radar detector connected to the drive recorder. For example, the button control section could be assigned to a radar detector remote control as a button for taunting aggressive driving. (33) A system comprising at least one of the configurations of (1) to (32), wherein the functions of the system may be provided in the drive recorder.

[0109] (34) A system comprising at least one of the configurations of (1) to (32), wherein the functions of the system may be provided in an electronic device separate from the drive recorder. It is particularly preferable to provide both (33) and (34), and both may have the same functions.

[0110] Another electronic device could, for example, have the function to play back video data recorded by a dashcam. This other electronic device could consist of, for example, a personal computer, tablet, or smartphone. (35) It is preferable to configure it as a program that enables a computer to implement at least one of the functions described in (1) through (34).

[0111] The inventions described in (1) to (47) and (1) to (35) above can be combined in any way. For example, one may combine all or part of the configuration of the invention described in (1) with at least part of the configuration of at least one of the inventions described in (2) and later. Another may combine all or part of the configuration of the invention described in (1) with at least part of the configuration of at least one of the inventions described in (2) and later. In particular, it is preferable to create an invention that combines the invention described in (1) with at least part of the configuration of at least one of the inventions described in (2) and later. Alternatively, one may extract any configuration from the inventions described in (1) to (47) and (1) to (35) and combine the extracted configurations. The applicant of this application intends to acquire rights to inventions that include these configurations. Furthermore, even if there are descriptions such as "in the case of" or "when," these are not meant to indicate that the configuration is limited to that case or time. These are merely examples of better configurations, and the applicant intends to acquire rights to configurations that do not fall under these cases or times. Also, even if there are descriptions with a specific order, the order is not limited to that order. We have also disclosed configurations that include deletions or rearrangements of certain sections, and we intend to acquire the rights to them. [Effects of the Invention]

[0112] According to the present invention, it is possible to provide a system that is superior to conventional systems.

[0113] Furthermore, the effects of the present invention are not limited to those described herein. Effects derived from the components disclosed in this specification and the drawings are also disclosed, and the applicant intends to obtain rights to such components through divisional applications, amendments, etc. For example, phrases such as "can do" or "is possible" in this specification are descriptions that clearly indicate the effects to be achieved, and there are components that demonstrate effects even without such descriptions. Moreover, there are effects that can be grasped by the component even without such descriptions. [Brief explanation of the drawing]

[0114] [Figure 1]This is a perspective view showing a preferred embodiment of the drive recorder according to the present invention. [Figure 2] This is a diagram illustrating the procedure for installing the dashcam on the windshield. [Figure 3] (a) and (b) are perspective views showing parts of the main body case of the dashcam, and (c) is a bottom view of the dashcam. [Figure 4] This is a perspective view of the main body case of this type of dashcam, with a portion omitted. [Figure 5] This is an exploded perspective view showing the lens section. [Figure 6] This diagram shows the dashcam installed in a vehicle. [Figure 7] This is a perspective view of the dashcam, with some parts of the main case, housing, and circuit board omitted. [Figure 8] This diagram explains the field of view, angle of view, etc., of the camera unit. [Figure 9] This is a diagram illustrating the blinking patterns of the lamp. [Figure 10] This diagram illustrates the images captured by the first and second cameras. [Figure 11] (a) is a diagram illustrating an example of how captured video is displayed, and (b) is a diagram illustrating the exposure control function. [Figure 12] This is a diagram illustrating the functions of the PC viewer. [Figure 13] This is a diagram illustrating the functions of the PC viewer. [Figure 14] This is a diagram illustrating the functions of the PC viewer. [Figure 15] This is a diagram illustrating the functions of the PC viewer. [Figure 16] This is a diagram illustrating the functions of the PC viewer. [Figure 17] This is a diagram illustrating the functions of the PC viewer. [Figure 18] This is a diagram illustrating the functions of the PC viewer. [Figure 19] This is a diagram illustrating the functions of the PC viewer. [Figure 20] This is a diagram illustrating the functions of the PC viewer. [Figure 21] This is a six-view drawing showing an example of a dashcam. [Figure 22] This is a perspective view showing an example of a dashcam. [Figure 23] This figure shows another example of a dashcam. [Figure 24] This is a diagram illustrating the functions of the PC viewer. [Modes for carrying out the invention]

[0115] Embodiments of the present invention will be described below with reference to the drawings. These drawings are based on the present invention.

[0116] This is used to describe the technical features that may be adopted. The configuration and shape of the described apparatus are merely illustrative examples, and the present invention is not to be construed as being limited thereto. Various changes, modifications, and improvements may be made based on the knowledge of those skilled in the art, as long as they do not depart from the scope of the present invention.

[0117] Figures 1 to 8, 21, 22, etc., show an external view of a preferred embodiment of a drive recorder equipped with the system according to the present invention. The drive recorder 10 of this embodiment has the function of recording and outputting a 360-degree panoramic image obtained by capturing all directions of 360 degrees in the horizontal plane and 360 degrees in the vertical plane. The drive recorder 10 comprises a main unit 11 that performs various processing and a camera unit 12 that is positioned below the main unit 11 when installed in a vehicle.

[0118] The main body 11 has a flat rectangular main body case 13, and various circuit boards and devices are mounted inside the main body case 13. The main body case 13 is constructed by connecting a first case 14 and a second case 15. The first case 14 and the second case 15 are box-shaped with their opposing surfaces open, and are connected by a connecting means with their front ends touching. The connecting means may consist, for example, of a projection provided on one of the first case 14 and the second case 15 and a recess provided on the other that is linked to the projection, with the projection and recess being fitted together.

[0119] The first case 14 has a shallow bottom, and the periphery of the opening surface is roughly rectangular with rounded corners, and the depth is almost uniform throughout. When the drive recorder 10 is installed in the vehicle, this first case 14 is located on the front side of the vehicle. Therefore, the surface of the first case 14 opposite to the opening surface becomes the front surface 13a of the main case 13. A joint rail 16 is provided on this front surface 13a. Two joint rails 16 are provided vertically along the longitudinal direction of the first case 14 at a predetermined interval. A bracket 17 is detachably attached between these two joint rails 16.

[0120] The second case 15 is a deeper box shape than the first case 14, and the periphery of the opening surface is roughly rectangular with rounded corners, similar to the first case 14. When the drive recorder 10 is installed in the vehicle, this second case 15 is located on the rear side of the vehicle. Therefore, the surface of the second case 15 opposite to the opening surface becomes the rear surface 13b of the main case 13. The rear surface 13b has a flat surface 13b' adjacent to one of the pair of long sides of the rectangle, which is a plane parallel to the front surface 13a of the main case 13, and an inclined surface 13b'' adjacent to the other of the pair of long sides. The inclined surface 13b'' is formed so that it gradually approaches the opening surface of the second case 15 as it moves from the middle of the short side toward the outer long side. Therefore, the depth of the second case 15 is uniform in the first region including the flat surface 13b', and in the second region including the inclined surface 13b'', it is formed to gradually become shallower towards the longer side. By including the inclined surface 13b'', the external shape of the main case 13 is like a rectangular parallelepiped with one of its longer sides chamfered. The one longer side that is chamfered is the rear upper side when the drive recorder 10 is installed in the vehicle (see Figure 6(a) for the state when installed in the vehicle). When the first case 14 and the second case 15 are connected, the front surface 13a on the first case 14 side and the flat surface 13b' on the second case 15 side are parallel. The inclined surface 13b″ is equipped with a first display 100 and a second display 200, arranged side by side. Both the first display 100 and the second display 200 are 4-inch full HD (1920 horizontal x 1080 vertical) dot matrix color liquid crystal displays. In the factory default settings, the first display 100 displays the drive recorder's settings and status information, while the second display 200 displays a first layout that enlarges a portion of the captured video, incorporating a rectangular area (first range) that is cropped from the vertical center of the forward-facing video captured by the first camera 26. For example, the video shown on the left side of Figure 10(a) is displayed. Multiple combinations of this "layout," "camera," and "video range" relationship (hereinafter referred to as "camera display state set") are provided, and switching between them is performed by operating the switch unit 28, which will be described later.

[0121] The bracket 17 has a flat plate 17a, and grooves 17b are formed along the longitudinal direction on a pair of sides of its long edge. These grooves 17b are configured to correspond with the joint rail 16. The user attaches or detaches the bracket 17 to the main body case 13 by aligning the grooves 17b with the joint rail 16 and sliding the bracket 17 and the main body case 13 relative to each other (see Figure 2, etc.).

[0122] When the bracket 17 is attached to the main case 13, the surface of the plate 17a facing the main case 13 has a projection 17c (see Figures 2(a) and 2(b), etc.). This projection 17c is located on the first case 14 when the bracket 17 is attached between the joint rails 16.

[0123] The leaf spring portion 14a is fitted into the hole 14b provided in it, preventing it from coming loose. An adhesive material such as double-sided tape 19 is attached to the surface of the bracket 17 opposite to the surface facing the main body case 13. When installing the drive recorder 10 in a vehicle, the bracket 17 is removed from the main body case 13, and the removed bracket 17 is attached and fixed to the windshield 2 of the car via the double-sided tape 19 (see Figure 2(b), etc.). At this time, the bracket 17 is in a horizontal position, with the pair of long sides being horizontal. By attaching the main body case 13 to the bracket 17 attached to the windshield 2 in this state (see Figure 2(c), etc.), the drive recorder 10 is installed and fixed in the predetermined position on the vehicle. In this installed state, the front surface 13a and the flat surface 13b' of the main body case 13 are arranged parallel to the mounting surface of the windshield 2, the long side of the main body case 13 is located in a horizontal plane, and the short side of the main body case 13 is located in a vertical plane. Therefore, the main body case 13 is fixed to the front glass 2 in a horizontally elongated state, and the camera unit 12 is positioned suspended from the bottom side of the main body case 13.

[0124] As shown in Figures 1(a) and 3, a notched window 14c is formed on one of the shorter sides of the first case 14, and a cover member 20 is attached to close the notched window 14c. The cover member 20 is positioned to close the notched window 14c and is fastened and secured with screws 21. When the cover member 20 is removed, the memory card slot 22, which is mounted inside the main case 13, is exposed through the notched window 14c. A memory card 23 is detachably inserted into this memory card slot 22.

[0125] On the side opposite to the side with the notched window 14c, a window opening 13c is provided that spans the second case 15 of the first case 14, and a DC jack 24 is placed behind this window opening 13c. A connector attached to one end of a power cable is attached to this DC jack 24 to receive power from an external source. External power can be supplied, for example, from the vehicle's battery. This can be done by, for example, attaching the other end of the power cable attached to the DC jack 24 to the vehicle's cigarette lighter socket or directly connecting it to the vehicle's battery power line. Alternatively, a separate power supply device may be provided, and the drive recorder may receive power from this power supply device. This power supply device is capable of supplying power from its internal battery even when the vehicle is parked or when power is not supplied from the vehicle's battery. The internal battery may be, for example, a rechargeable battery, and when this power supply device is installed in the vehicle, the power supply device is placed between the vehicle's battery and the drive recorder in the power line. When the vehicle is running or when power can be supplied from the vehicle's battery, power is supplied from the vehicle's battery to the drive recorder 10 via the power supply unit. In this state, the power supply unit's built-in battery is charged by the power supply from the vehicle's battery. When the power supply from the vehicle's battery is turned OFF, the drive recorder 10 operates by receiving power from the power supply unit.

[0126] A hole 13d is provided at a predetermined position on the inclined surface 13b'' of the first case 14. A microphone 18 is placed inside the main case 13 near this hole 13d. The microphone 18 collects ambient sound. In the setup shown in Figure 6, the inclined surface 13b'' is oriented slightly downward towards the interior of the vehicle. By equipping this inclined surface 13b'' with the first display 100, the second display 200, the hole 13d, and the microphone 18 inside it, it is possible to acquire and record sounds from inside the vehicle with directionality towards the interior of the vehicle, and to record spoken content at a louder volume when the driver is looking in the direction of the first display 100 and the second display 200. Multiple holes 13e are provided at predetermined positions on the flat surface 13b′ of the first case 14. A speaker 29 is placed inside the main case 13 near these holes 13e.

[0127] The main case 13 houses various processing circuits and power supply circuits. The processing circuit includes a control unit. The control unit is composed of an SoC (System on Chip), which contains a CPU, ROM, RAM, and peripheral circuits. Electrical components and modules described in this embodiment, such as the first camera 26, second camera 27, first display 100, second display 200, microphone 18, switch unit 28, speaker 29, memory card slot 22, and GPS antenna unit 43, are connected to it, and the general processing of a drive recorder and the processing described in this embodiment are realized by the CPU executing a program stored in ROM. As shown in Figure 4, these processing circuits and power supply circuits are mounted on a main circuit board 40 and a sub-circuit board 41. The main circuit board 40 and the sub-circuit board 41 are mechanically integrated by connecting the connectors 42 attached to each board, and the signal lines and power lines formed on each circuit board are connected. The main circuit board 40 and the sub-circuit board 41 are connected in a parallel, overlapping state and mounted inside the main case 13. In this mounted state, the main circuit board 40 is located on the second case 15 side, and the sub-circuit board 41 is located inside the first case 14.

[0128] The sub-circuit board 41 is equipped with a GPS antenna unit 43 and a battery 44 on the side not facing the main circuit board 40. The memory card slot 22 is mounted on the side of the sub-circuit board 41 facing the main circuit board 40. The main circuit board 40 is equipped with a CPU that controls various functions, as well as the aforementioned DC jack 24 and speaker 29. Although not shown in the diagram, an acceleration sensor is also built into the main case 13.

[0129] As shown in Figure 5, the camera unit 12 comprises a housing 25, a first camera 26 and a second camera 27 mounted inside the housing 25, and a switch unit 28. The housing 25 has an overall spherical shape and is constructed by connecting a hemispherical first camera case 30 and a second camera case 31 that are divided into two parts and joined together. The first camera case 30 and the second camera case 31 are fixed together in the same way as the fixing of the first case 14 and the second case 15 described above, by using the fitting of a projection 30a provided on the first camera case 30 and a recess 31a provided on the second camera case 31.

[0130] The first camera 26 and the second camera 27 are positioned back-to-back and fixed and connected so that they each shoot in opposite directions to form a camera unit 35. The camera unit 35 is formed by erecting a flat rectangular holder 36, fixing the first camera 26 to its front, and fixing the second camera 27 to its rear, thereby integrating them. This fixing is done, for example, by screws.

[0131] The first camera 26 is constructed by placing a first lens unit 26b on a first circuit board 26a. The first circuit board 26a is equipped with an image sensor and processing circuits for shooting. The second camera 27 is constructed by placing a second lens unit 27b on a second circuit board 27a. The second circuit board 27a is equipped with an image sensor and processing circuits for shooting. The first camera 26 and the second camera 27 are of the same specifications and performance. Same specifications and performance means, for example, that the angle of view, the optical system from the front lens to the image sensor, and the sensor size of the image sensor are the same. For example, when shooting the same subject under the same shooting conditions, such as exposure conditions, the captured images will be the same. In this embodiment, there is no physical aperture, and the brightness of the image is adjusted by changing the exposure time by changing the shutter speed.

[0132] As shown in Figure 5, when the first camera 26 and the second camera 27 are mounted on the holder 36, the optical axes L of the first lens section 26b and the second lens section 27b are set to lie on the same straight line. As a result, the first camera 26 and the second camera 27 each capture images in opposite directions. A circular window opening 30b is provided in the center of the first camera case 30, and a circular window opening 31b is provided in the center of the second camera case 31. When the camera unit 35 is mounted inside the housing 25, the tip of the first lens section 26b of the first camera 26 and the tip of the second lens section 27b of the second camera 27 are located inside the window openings 30b and 31b, respectively, and are exposed to the outside.

[0133] The housing 25 of the camera unit 12 is connected to the main body case 13 via an angle adjustment mechanism 50. The angle adjustment mechanism 50 rotates the housing 25 only around a rotation axis provided along the long side on the front of the bottom surface of the main body case 13, allowing for forward and backward swaying (see Figure 6), but preventing sideways swaying. For example, it is configured as shown in Figure 5.

[0134] The housing 25 is provided with a first bearing piece 51 that protrudes above the first camera case 30 and a second bearing piece 52 that protrudes above the second camera case 31. The first bearing piece 51 has a wall portion 51a that extends upward and two first bearing portions 51b formed on the rear surface of the wall portion 51a that protrude backward. The second bearing piece 52 has a wall portion 52a that faces the wall portion 51a of the first bearing piece 51 and second bearing portions 52b arranged on both the left and right sides of the wall portion 52a. These four bearing portions 51b, 52b have through holes of the same diameter, and when the first camera case 30 and the second camera case 31 are connected, these four through holes are arranged concentrically.

[0135] The second case 15 of the main case 13 has a recess 15d at a predetermined position on its bottom surface. The recess 15d is formed in the central part of the front long side of the bottom surface of the second case 15 and has through holes 15e on a pair of inner surfaces perpendicular to that long side. The through holes 15e formed on the pair of inner surfaces are formed coaxially, and the inner diameter of one of them is larger than the shaft portion of the bolt 53 and smaller than the outer diameter of the nut 54 that is attached to the threaded portion of the bolt 53. On the inner side of the second case 15 with the through hole 15e that is smaller than the outer diameter of the nut 54, a small chamber 55 for attaching the nut 54 is provided, and the nut is set in this small chamber. The inner diameter of the other through hole 15e is larger than the outer diameter of the head of the bolt 53. The other through hole 15e connects to an opening 15g on the side surface 15f of the second case 15.

[0136] The bolt 53 described above is inserted from the opening 15g side with the threaded portion leading, with the first bearing piece 51 and the second bearing piece 52 inserted into the recess 15d. The shaft of the bolt 53 passes through the first bearing piece 51b and the second bearing piece 52b, and the threaded portion of the bolt 53 is inserted into one of the through holes 15e to position it in the small chamber. The bolt 53 is rotated using a fastening tool such as a hex wrench to fasten the threaded portion and the nut. In this state, one side of the recess 15d is sandwiched between the nut and one of the second bearing pieces 52b, preventing the bolt 53 and housing 25 from separating. When the bolt 53 is tightened firmly, the head of the bolt 53 biases the other second bearing piece 52b, preventing rotation. When the bolt 53 is loosened, the housing 25 rotates within a predetermined angular range with the bolt 53 as the center of rotation.

[0137] The bolt 53 is positioned parallel to the long side of the second case 15 and, consequently, the main case 13. Since the long side of the main case 13, which is attached and fixed to the windshield 2, is located on a horizontal plane, the angle adjustment mechanism 50, which consists of the bolt 53 and the first bearing piece 51, second bearing piece 52, etc., is allowed to rotate around the horizontal axis but not around the vertical axis, and the camera unit 12 is only allowed to swivel in the forward and backward direction.

[0138] When using the drive recorder 10, as described above, it is attached and fixed to the windshield 2, and the housing 25 and, consequently the camera unit 12, is rotated back and forth to the desired position, and the nuts are tightened to fix the orientation of the camera unit 12. The desired position is such that the first camera 26 faces forward and the second camera 27 faces backward, and the optical axes L of the first lens unit 26b and the second lens unit 27b are parallel to the direction of travel of the vehicle. In this position, as shown in Figure 6(a), the joint surface M of the first camera case 30 and the second camera case 31 is located in a vertical plane and in a plane perpendicular to the direction of travel of the vehicle.

[0139] As shown in Figure 8, the first camera 26 and the second camera 27 are cameras that can capture the entire surrounding area by setting the field of view θ perpendicular to the plane to a predetermined angle greater than 180 degrees, with a field of view of 360 degrees in the plane parallel to the lens. The predetermined angle is the same for both the first camera 26 and the second camera 27. Since the first camera 26 and the second camera 27 are positioned back to back and facing opposite directions, there is a predetermined gap between the tip of the first lens section 26b and the tip of the second lens section 27b. For example, if the field of view of both cameras is set to 180 degrees, a band-shaped uncaptured area will be generated around the entire perimeter equal to the width of the predetermined gap between the two lens sections. By increasing the field of view θ to more than 180 degrees, the area behind the plane perpendicular to the optical axis at the tip of the lens becomes part of the shooting range. For example, as shown in Figure 8, an overlapping area occurs in the areas that can be captured by both cameras (see hatched area in Figure 8), making it possible to capture a 720-degree (360 degrees horizontal + 360 degrees vertical) full-spherical image with a single drive recorder 10 (see Figure 8(d), etc.).

[0140] The images captured by the first camera 26 and the second camera 27 are circular, as shown in Figures 8(b) and (c), and consist of a first region R1 in which the hemispherical portion in front of the lens is captured, with a field of view of 360 degrees in the direction parallel to the lens and within 180 degrees in the direction perpendicular to that parallel direction, and a second region R2 in which the area behind the lens is captured, with a field of view of 180 degrees or more in the direction perpendicular to that direction.

[0141] Areas beyond a predetermined angle are blind spots that cannot be captured by each camera. Therefore, the area from the point where the shooting areas of the two cameras overlap (shown by hatching in Figure 8) to the vicinity of the camera unit 12 becomes a blind spot R3 that cannot be captured by either camera. The closer the predetermined angle is to 180 degrees, the further the point where the shooting areas begin to overlap is from the camera unit 12, and the larger the blind spot R3 becomes. On the other hand, increasing the predetermined angle reduces the blind spot R3, but it also reduces the first region R1, which captures the hemispherical portion in front of the lens unit. This reduces the resolution of the image captured in the first region R1, making it difficult to see. Therefore, in this embodiment, the predetermined angle is set to 210 degrees, so that the blind spot R3 can be appropriately reduced while maintaining high resolution of the forward view of the vehicle and the interior captured in the first region R1.

[0142] The switch unit 28 is mounted below the camera unit 35 and integrated with it. Semicircular notches 30c and 31c are provided below the joining edges of the first camera case 30 and the second camera case 31. The radii of the notches 30c and 31c are equal, and when the first camera case 30 and the second camera case 31 are joined together, the two notches 30c and 31c connect to form a circular hole. The switch unit 28 is located within this circular hole and is exposed to the outside.

[0143] The switch unit 28 is mounted within the housing 25 for the camera unit 12 and is housed in a separate housing from the main unit 11 which has a built-in speaker 29. The switch unit 28 is a push button type, and when the switch unit 28 is pressed, an operation sound is produced. However, since the microphone 18 is built into the main unit case 13, which is separate from the housing 25, even if the operation sound resonates within the housing 25, the operation sound will not be transmitted into the main unit case 13, and therefore will not be picked up by the microphone 18 and recorded. In contrast, if the switch unit were provided on the main unit case 13 side, for example, the operation sound produced when the switch unit is pressed would be picked up by the microphone 18 and recorded, resulting in the problem of the operation sound becoming a significant noise. However, this embodiment avoids this problem. Furthermore, if the microphone and the switch unit are mounted on the same circuit board, the circuit board may vibrate when the switch unit is operated, and the sound from that vibration may also be recorded as noise. However, in this embodiment, the mounting circuit boards are separate, so this situation does not occur.

[0144] The control unit detects the state of the switch 28 when it is pressed and performs a predetermined process. The pressed states include "double press" when two consecutive presses are detected within 0.5 seconds, "short press" when a single consecutive press of less than 2 seconds is detected without a double press, and "long press" when a continuous press of 2 seconds or more is detected, and different functions are assigned to each of these states. If a "short press" is detected, the current "camera display state set" will be switched to the next "camera display state set".

[0145] The "camera display state set" consists of the following first to fourth sets. When a "short press" is detected, the display switches to the next set after the set currently displayed on the second display 200. The order of these sets is from the first set to the fourth set, and after the fourth set, it returns to the first set, performing a cyclical switch. In this way, the camera display state sets can be switched in a predetermined order by a short press. As described later, by performing a predetermined operation from the initial state of each set, the screen display content can be changed from the state of each set. If a short press is detected while the screen is in a state changed from each set by this operation, the screen is returned to the state of the set before the change. For example, if the display arrangement is changed in the state of the fourth set and a short press is detected, the screen is returned to the state of the fourth set.

[0146] The first set, as shown on the left side of Figure 10(a), is a combination of images where the layout is a first layout with one rectangular area in the shape of a horizontal rectangle on the screen, the camera is the first camera 26 (front), and the image range is a combination of images where the origin of the circle of the camera image area R1 in Figure 8(b) is the intersection of the diagonals of the rectangle (first range) from the circular image in Figure 8(b), as shown in Figure 10.

[0147] The second set, as shown in Figure 19, has a second layout in which different video areas can be assigned to two square areas on the screen: a left square area and a right square area. The cameras are the first camera 26 (front) in the left square area of ​​the second layout and the second camera 27 (rear) in the right square area of ​​the second layout. The video area for both the first camera 26 and the second camera 27 is a square region (second area) that includes the R2 area in Figure 8 (the area with the circular fisheye image). Note that in the display state of Figure 19, the string "360°" is superimposed at the bottom of each square area. This indicates that each video is capturing an area of ​​360° or more, and the mode in which this display is shown and the mode in which it is not shown can be switched using the setting information recorded in the memory card 23.

[0148] The third set, as shown on the right side of Figure 10(a), is a combination of images where the layout is the first layout described above, the camera is the second camera 27 (rear), and the image range is the rectangular area (first range) extracted from the circular image in Figure 8(c), where the origin of the circle in the camera image area R1 of Figure 8(c) is the intersection of the diagonals of the rectangle, as shown in Figure 10.

[0149] The fourth set, as shown in Figure 11, is a third layout with a total of six regions, where the screen is divided into roughly two-thirds of the upper region and one-third of the lower region in the vertical direction, the upper region is further divided into roughly half to the left and half to the right, and the lower region is divided into roughly one-quarter to the left and one-quarter to the right. For the camera, the upper right region is the second camera 27 (rear), and all other regions are the first camera 26 (front). The range of the image is divided into the upper left and right regions, which are the rectangular areas in the center of each camera (the first range, which is the same camera range as in Figure 10(a)), and the lower region, from left to right, is divided into the third range (referred to as the upper range), the fourth range (referred to as the lower range), the fifth range (referred to as the left range), and the sixth range (referred to as the right range), which will be explained next. The third range is the rectangular area inside the circle in Figure 8(b), and is the upper range divided by the left and right lines passing through the origin of the circle as part of the bottom edge. The fourth range is a rectangular area inside the circle in Figure 8(b), which is the lower range divided by the left and right lines passing through the origin of the circle as part of the upper edge. The fifth range is a rectangular area inside the circle in Figure 8(b), which is the left range divided by the top and bottom lines passing through the origin of the circle as part of the right edge, with the center of the right edge being the origin of the circle in Figure 8(b). The sixth range is a rectangular area inside the circle in Figure 8(b), which is the right range divided by the top and bottom lines passing through the origin of the circle as part of the left edge, with the center of the left edge being the origin of the circle in Figure 8(b). With the display using the fourth set, as shown in Figure 11, the images before and after can be viewed in a wide area of ​​two-thirds of the upper section, and the images at each position can be viewed at a glance in the images above, below, left, and right of the lower section.

[0150] If a "double press" is detected, and the "camera display state set" displayed on the second display 200 is the camera display state set (first set) which displays the image from the front camera 26 but not the image from the second camera 27, the system switches to the camera display state set (third set) which displays only the image from the second camera 27. On the other hand, if the "camera display state set" displayed on the second display 200 is the camera display state set (third set) which displays the image from the second camera 27 but not the image from the front camera 26, the system switches to the camera display state set (first set) which displays only the image from the front camera 26. If a "double press" is detected when the "camera display state set" displayed on the second display 200 is one of the other sets (second set, fourth set), the system switches to a specific set or a specific set (third set in this embodiment).

[0151] If a "long press" is detected, event recording is performed. This form of drive recorder 10 has a continuous recording function that records video to the memory card from engine start (ACC ON) to engine stop (ACC OFF), and an event recording function that records a certain period of time before and after an event when the event conditions are met. Event conditions include, for example, when the acceleration sensor detects an impact above a certain level, or when the switch unit 28 is pressed and held. Detection of an impact above a certain level is used to record video and audio before and after an accident, and pressing and holding the switch unit 28 is used for one-touch recording to record video and audio for a certain period of time when passing through a specified point. The control unit of the drive recorder, for example, while performing continuous recording, records video and audio for a certain period of time before and after an event as separate data when the event conditions are met. Both the continuous recording data and the separate data from when an event occurs are recorded to the memory card 23. Furthermore, if continuous recording is not performed, the control unit of the drive recorder normally temporarily records video and audio for a certain period of time in buffer memory, etc., and when an event condition is met, it uses the temporarily recorded data, etc., to record video and audio for a certain period before and after the event occurs onto the memory card 23.

[0152] As described above, in this configuration, even when the vehicle is powered off, such as when the ignition switch is OFF and power cannot be supplied from the vehicle's battery, the drive recorder 10 can operate by receiving power from a power supply device prepared separately from the vehicle.

[0153] Therefore, the system includes a mode for recording while parked, utilizing the aforementioned functions. In parking recording mode, power is supplied to the drive recorder 10 from the power supply unit for a set period of time even after the vehicle's power is turned off, such as when the vehicle is parked, allowing for continuous recording and event recording even while parked.

[0154] This configuration includes a GPS antenna unit 43 and has the function of acquiring location information, date and time information, and speed information. Therefore, when recording the above information, it is preferable to record each of these pieces of information in association with it.

[0155] In this configuration, the switch unit 28 is located in the center of the lower surface of the spherical housing 25. Therefore, the switch unit 28 is in the closest position to the driver and passenger in the front seat, making it easy to reach and operate, easy to press, and easy to see, thus making it easy to confirm the location of the switch unit. In this configuration, the camera unit 12 is located on the lower side of the main body case 13, and there is a risk that the user may accidentally touch the lens when operating the switch, but by placing the switch unit 28 on the lower side as in this configuration, the risk of touching the lens can be minimized as much as possible.

[0156] Furthermore, when the switch unit 28 is pressed upwards, a load is applied to the angle adjustment mechanism 50 that rotates the camera unit 12, and the load is received there, so it can be pressed firmly. In addition, to prevent the direction of the lens from changing when pressed, the bolt 53 and nut 54 are securely fastened to fix it in place.

[0157] Since the housing 25 is spherical, it is clear that the camera unit 12 captures a full 360-degree omnidirectional image centered on the housing 25, which is good. Because the housing 25 is spherical, it is located in the blind spot of the first lens unit 26b and the second lens unit 27b and does not appear in the image. In addition, in order to prevent the main body case 13 from appearing in the image captured by the first camera 26 and the second camera 27 as much as possible, for example, the main body case 13 and the housing 25 are placed close together, and even if there is no gap between the top of the housing 25 and the bottom of the main body case 13, a space can be secured between the housing 25 and the main body case 13 as you move towards the left and right sides of the housing 25, making it easier to hold the housing 25 with your fingers. Then, when pressing the switch unit 28, for example, you can touch the top of the housing with your index and middle fingers as if you were holding a ball, and grip it with your thumb touching the switch unit 28, which allows you to press the switch unit. Performing this pressing operation is good because it does not put any load on the main body case 13 or the angle adjustment mechanism 50, or puts little load on them.

[0158] Furthermore, in this configuration, a lamp is mounted on the switch unit 28, causing the surface of the switch unit 28 to illuminate. Since the switch unit 28 illuminates, its location is easy to see even at night, which is good. By positioning the switch unit 28 on the underside of the housing 25, it illuminates downwards. Therefore, the driver will be looking up from below, making it easier to see the illumination, but from outside the vehicle, the view may be from diagonally above, so the illumination will not be visible, which is good. The illuminated parts, including the switch unit 28, should be positioned in the camera's blind spot so that the illuminated state is not recorded and is not visible from the outside.

[0159] Furthermore, the lamp is capable of emitting different colors, such as red and blue. This capability is achieved by incorporating light-emitting elements that emit different colors, such as a tricolor LED. By enabling the emission of different colors, the operating status can be indicated by appropriately changing the emitted color and pattern (see Figure 9).

[0160] In this configuration, the first camera 26 and the second camera 27 capture images in opposite directions, both with a field of view of 210 degrees, and the peripheral regions of the captured images overlap. As will be described later, the images captured by the first camera 26 and the second camera 27 are combined to generate a 360-degree spherical image, which is then recorded or output. The boundary of the images to be joined when combining the images from the two cameras becomes a vertical plane including the joint surface of the first camera case 30 and the second camera case 31, and the region of a predetermined width including that vertical plane becomes the overlapping region.

[0161] The bracket 17 is attached to the desired position on the windshield 2, the main body case 13 is mounted on the bracket 17, and the angle and orientation of the camera unit 12 is adjusted so that the joint surface M of the first camera case 30 and the second camera case 31 is positioned on a vertical plane, and then the bolt 53 is tightened to secure it. In the normal installation and mounting state, with the bolt 53 tightened and the camera unit 12 adjusted to the desired orientation, the first camera 26 captures the area in front of the drive recorder 10 in a 210-degree range (360 degrees vertically and 210 degrees horizontally), and the second camera 27 captures the area behind the drive recorder 10 in a 210-degree range (360 degrees vertically and 210 degrees horizontally). The peripheral areas of the images captured by the first camera 26 and the second camera 27 are designed to capture a predetermined position inside the vehicle, which is close to the camera. When the drive recorder 10 is fixed in a designated position inside the vehicle, the point where the images captured by the first camera 26 and the second camera 27 are joined together should be located in a designated position inside the vehicle that is close to the camera. This designated position inside the vehicle includes, for example, the pillar 3, the dashboard 4, or the ceiling.

[0162] In this configuration, the first camera 26 and the second camera 27 have a field of view θ of 210 degrees all around, so in the peripheral region of the image captured by each camera, the same surrounding objects are captured by both cameras. For example, as shown in Figure 10(b), suppose there are objects at positions P1, P2, and P3 in the peripheral region captured by both cameras. These positions P1, P2, and P3 are near the boundary K2 of the region captured by the second camera 27, and are at different distances from the camera unit 12. Even though the distances are different, because they are near the boundary K2, they are at similar positions in the circular image captured by the second camera 27, as shown on the right side of Figure 10(c). On the other hand, since the distances from the boundary K1 of the region captured by the first camera 26 are different for positions P1, P2, and P3, their positions within the circular region captured by the first camera 26 are different, as shown on the left side of Figure 10(c). Therefore, when compositing the boundary between two images containing the same object, there is a risk that the object present in each image may appear separately, making it impossible to recognize them as the same object. In particular, the amount of discrepancy increases as the distance from the camera, i.e., the vehicle, increases, as seen in P2 and P3. For example, if the object is a person, there is a risk that it may appear as if there are two people, rather than the same person.

[0163] In this configuration, fixed objects inside the vehicle, such as pillar 3 and dashboard 4, are used as objects that appear at the boundary between the two cameras. As a result, the outside scenery located behind these fixed objects is not captured, or only appears minimally at the boundary. Since the vehicle parts such as pillar 3 and dashboard 4 are located about 1 to 3 meters from the cameras, there is little discrepancy even if these vehicle parts appear on both boundary points. In contrast, outside the vehicle, objects are often 10 to 30 meters or more away, resulting in a large discrepancy in the positions captured by each camera, making it impossible to combine them into a single image. On the other hand, in this configuration, as mentioned above, the seam between the images from the two cameras is positioned at an object inside the vehicle that is at the same or close distance, making it less likely for people or other objects located behind the object to be captured. Furthermore, in this configuration, instead of simply obscuring the rear with a nearby pillar 3, etc., the system cleverly utilizes the human cognitive behavior that if there is a stationary object, people and objects behind it blend in and the sense of incongruity diminishes. Even if the images are displayed separately, they are not conspicuous and do not bother the viewer. Furthermore, since users tend to only look at the front, back, or sides, they don't pay much attention to pillars located in the middle, and therefore their attention to the scenery behind them is also reduced, which makes the whole experience feel less jarring and is therefore a good thing.

[0164] In contrast, if, for example, the housing 25 of the camera unit 12 is rotated 90 degrees in the horizontal plane from the standard position described above, and the first camera 26 and the second camera 27 are positioned to capture the left and right areas respectively, then the boundary or seam between the shooting areas of both cameras would be, for example, in the central part of the left and right sides of the windshield, extending vertically. In such cases, the two areas would be separated, and what is reflected in each would be visible, resulting in an unnatural image. No. [Camera 26 and Camera 27 were both set to the same brightness for shooting.]

[0165] In this configuration, the exposure control functions of the first camera 26 and the second camera 27 are controlled to shoot under the same exposure conditions. Furthermore, as mentioned above, since the apertures of the first camera 26 and the second camera 27 in this configuration are fixed to the same value, the exposure conditions, which adjust the brightness during shooting, are adjusted by adjusting the shutter speed. In this configuration, the exposure control function is a function that adjusts the shutter speed. By setting the shutter speeds of the first camera 26 and the second camera 27 to the same value, the first camera 26 and the second camera 27 shoot under the same exposure conditions and brightness. Thus, this configuration is characterized by treating the two cameras as if they were a single camera and shooting with a common brightness.

[0166] This method is good because it prevents abrupt changes in brightness at the transition points between the images captured by the first camera 26 and the second camera 27, making the transitions less noticeable and resulting in a seamless, continuous image across the entire perimeter. For example, in the case of a dark and hard-to-see interior of a car, capturing the image in its current state allows for playback that accurately reflects what was seen, which is beneficial.

[0167] As described above, in the correct installation and mounting state, the first camera 26 captures the area in front of the drive recorder 10 in a range of more than a hemisphere, with a vertical range of 360 degrees and a horizontal range of 210 degrees, and the second camera 27 captures the area behind the drive recorder 10 in a range of more than a hemisphere, with a vertical range of 360 degrees and a horizontal range of 210 degrees. By combining the images captured by the first camera 26 and the second camera 27, an image is constructed that captures the entire 360-degree horizontal and 360-degree vertical view of the drive recorder 10 (see Figure 8(d), etc.). When playing back the forward-facing image, the display screen can either show the entire 360-degree view or display a portion of the 360-degree view. As an example of how to crop a portion of the entire field of view, as shown in Figure 11(a), it is possible to display the front of the vehicle in front of the drive recorder 10 captured by the first camera 26, the interior of the vehicle in the rear of the drive recorder 10 captured by the second camera 27, or display images from any direction, such as diagonally upward, diagonally downward, left side, or right side.

[0168] The video displayed on the computer screen used to play back the recorded video, as described later, can be based on video captured by only one of the first camera 26 or the second camera 27, or on video created by stitching together video captured by both cameras, depending on the direction of the viewpoint. Furthermore, the omnidirectional full-spherical video created by stitching together the two videos is a continuous video in any direction, and as described later, the display area can be gradually moved by spanning to gradually change the viewpoint. In this case, during the movement, there are states where only the video from one camera is displayed, and states where the stitched portion of the video from both cameras is present on the display screen, and video from different cameras is displayed on the same display screen.

[0169] The first camera 26 and the second camera 27 are equipped with metering and exposure control functions, respectively, and depending on the surrounding conditions, they capture the shooting range with the same exposure conditions and, in this embodiment, the same shutter speed. In this case, when the edges of the images captured by the two cameras are joined together to form a single image, the seam is not noticeable. In contrast, if, for example, the exposure control functions of the two cameras adjust the exposure conditions separately based on the brightness of the subject measured by their respective metering functions, typically, for example, a short shutter speed is used to reduce brightness when shooting a bright outdoor scene, and a long shutter speed is used to capture a bright image when shooting a relatively dark car interior, thus shooting with different exposure conditions so that each image is clearly visible. When two images captured in this way are joined together, for example, if the joined portion of the images from the first camera 26 and the second camera 27 is present on the display screen, and images from different cameras are displayed on the same display screen, the brightness of the displayed images will differ, the seam will be noticeable, and a sense of incongruity will occur. In contrast, as in this embodiment, the exposure conditions and brightness are the same. Taking photos this way is good because it avoids the problems associated with it.

[0170] For example, when two images are stitched together to form a 360-degree spherical image, and this spherical image is viewed while rotating 360 degrees horizontally, the displayed content may change from a bright and clear outdoor scene to a dark and difficult-to-see indoor scene, but the seam between the images from the two cameras is not noticeable. On the other hand, if the brightness is adjusted during shooting so that the indoor scene is also clearly visible, when rotated 360 degrees as described above, both the outdoor scenery and the interior of the car will be bright and clear, but an unnatural feeling will arise at the seam. With a normal camera, each image is captured and displayed brightly and clearly, but in this embodiment, because of the concept of capturing and displaying a 360-degree spherical image, if an image of a portion of the 360-degree spherical area is displayed while moving in an arbitrary direction, an unnatural feeling will arise if the space is not displayed as continuous when viewed in all 720 degrees. Therefore, as one solution to prevent an unnatural feeling at the seam in this embodiment, the exposure conditions of the first camera 26 and the second camera 27 are made equal, so that they are captured at the same brightness. For example, at night, the outside can be filmed, but the inside of a moving car is dark and difficult to see because the interior lights are off. By filming in the dark, the connection between the images filmed by the first camera 26 and the second camera 27 can be seamlessly joined. In the real world, if the outside is visible but the inside is not visible or is difficult to see, the system is characterized by filming in that state.

[0171] As described above, the exposure control function of the first camera 26 and the second camera 27 shoots at the same shutter speed, but the shutter speed is determined as follows: The brightness is determined based on the image from the first camera 26, which shoots the area in front of the vehicle. One of the functions of the drive recorder 10 is to photograph and record the situation outside the vehicle, such as in the event of an accident. In this configuration, by determining the exposure conditions, such as the shutter speed, based on the image taken by the first camera 26, the area including the area in front of the vehicle can be photographed clearly, and the above-mentioned function of the drive recorder can be performed, which is good.

[0172] As shown in Figure 11(b), an area spot R10 is provided in the upper half of the circular image captured by the first forward-facing camera 26. The metering function of the first camera 26 measures the brightness of the subject within the area spot R10, and the exposure control function takes pictures based on the exposure conditions determined based on the brightness of the subject, which in this embodiment is based on the shutter speed. The peripheral area R11 of the upper half is not used when determining the exposure conditions. The view ahead seen through the windshield 2 is within the range of the area spot R10, and the lower half often contains objects inside the vehicle, such as the dashboard 4. Also, the peripheral area R11 includes scenery behind the lens part with a vertical field of view of 180 degrees or more, so it is not used when determining the exposure conditions. This is advantageous because it allows for capturing and recording scenery in front of the vehicle, such as the vehicle in front. For example, while a typical camera might use center-weighted metering, this system is characterized by metering only the upper half of the image, excluding the lower half. Furthermore, unlike multi-pattern metering which meter the entire screen, it also excludes the peripheral area R11 from metering.

[0173] Furthermore, the lower half and peripheral area R11 are areas where unimportant parts of the car's interior, such as the ceiling and dashboard, are captured. Therefore, even if the metering in these areas is not reflected and they become invisible, it has little impact, which is acceptable. Also, the main body case 13 of the drive recorder 10 may be captured in the peripheral area R11, but since the main body case 13 is not something we want to capture in the first place, it is not a problem if it is not visible. For these reasons, it is best not to use the peripheral area R11 or the lower half of the area to determine the exposure conditions.

[0174] For example, sports cameras and action cameras that capture a full 360-degree view are used outdoors, so the surrounding area is uniformly bright. Therefore, even if the front and rear cameras individually measure light and set their exposure conditions and brightness individually based on the metering results, as with the exposure control function of a normal camera, they can capture a beautiful image in all directions without any unnatural transitions between shots. In contrast, in the installation and operating environment of a dashcam as described in this invention, the brightness of the view in front of the camera and the interior of the vehicle at the rear differ significantly, leading to the aforementioned problems. This embodiment solves these problems. [Differences with the same brightness]

[0175] In the embodiment described above, exposure conditions such as shutter speed are determined based solely on the metering result of the metering function of the front-facing first camera 26. However, the present invention is not limited to this, and for example, it is preferable to consider the metering result of the metering function of the second camera 27 to some extent when determining exposure conditions. Considering it to some extent means, for example, giving more weight to the metering result of the front-facing first camera 26. By evaluating the metering result of the second camera 27 in this way, it is possible to prevent situations where the image of the car interior captured by the second camera 27 is completely dark and no people are captured. The metering function of the second camera 27 should be similar to that of the first camera 26, with an area spot in the upper center, and should be metered on the area of ​​that area spot. Since this area is where passengers are captured, metering on this area spot and determining the exposure conditions based on that will allow passengers to be captured clearly. Also, since the lower area includes the dashboard, the floor and seats of the car interior, etc., this area is not affected in determining the exposure conditions. The weighting is determined by assigning, for example, +5 to the area spot on the first camera 26 side and +2 to the area spot on the second camera 27 side to determine the brightness.

[0176] Alternatively, contrary to the above modification, the exposure conditions may be determined by prioritizing the metering result of the second camera 27. In this case, the interior of the vehicle can be clearly captured and recorded. For example, in applications where it is necessary to clearly capture the faces of passengers, such as in taxis and buses, this modified configuration is preferable. However, if the metering result of the second camera 27 is prioritized as in this modified configuration, the shutter speed will be longer, and the brightness of the front camera will also be set based on that, which may cause the scenery outside in front to be overexposed and appear white. Therefore, considering the original function of the drive recorder 10, it is better to prioritize the first camera 26, as in the above-described embodiment and modification.

[0177] Furthermore, it is preferable to determine the exposure conditions by treating the metering results of the first camera 26 and the second camera 27 equally without weighting them. This prevents the interior of the vehicle from becoming too dark when the first camera 26 is prioritized, or the scenery in front from being overexposed when the second camera 27 is prioritized, and allows for shooting in all directions. However, in order to record the interior of the vehicle while recording the external situation such as before and after an accident, which is the original function of the drive recorder 10, it is preferable to modify the system to prioritize the forward view from the first camera 26 and also partially incorporate the metering results of the second camera 27.

[0178] Furthermore, it would be beneficial to have a mode setting function that allows users to choose whether to prioritize the metering results of the first camera 26 or the second camera 27. This would allow users to prioritize the view ahead or the interior of the vehicle, depending on their usage. The mode setting function should ideally allow users to choose whether to use only one metering result or both metering results but to set which camera to prioritize, and it would be even better if the degree of weighting could be set.

[0179] In the embodiments and modifications described above, it is assumed that the video captured by a single camera is shot with the same settings throughout without any image processing. However, for example, measures may be taken during shooting to ensure that there is no unnaturalness at the transition points, and the brightness of the transition points may be made the same. However, in such cases, it is necessary to set which area the correction should begin from, and it is preferable to shoot the entire image with the same brightness as in the embodiments and modifications described above because it is easy to configure. Alternatively, the brightness may be adjusted when compositing the images using a PC viewer or the like, as described later, so that the transition points are not noticeable. [The main unit case and other components are designed to be difficult to photograph.]

[0180] The mounting position of the housing 25 to the main body case 13 was shifted from the center of the bottom surface in the front-to-back direction to the rear surface 13b. The angle adjustment mechanism 50 was positioned along the rear surface 13b of the bottom surface. For example, as shown in Figure 6, the flat rectangular main body case 13 is attached and fixed to the windshield 2, so when attached, it is positioned diagonally along the slope of the windshield 2, and the edge of the bottom surface of the main body case 13 on the rear surface 13b side is at the lowest position. By attaching the housing 25 of the camera unit 12 via the angle adjustment mechanism 50 at that lower position, the area in which the main body case 13 is reflected in the first camera 26 and the second camera 27 is reduced.

[0181] The main body case 13 is configured to be positioned close to the lens body. The blind spot area R3, which is not visible to either the first camera 26 or the second camera 27, is conical in shape and narrows as it moves away from the camera unit 12. Therefore, the further the main body case 13 is from the lens unit, the wider the area in which the main body case 13 is visible to both the first camera 26 and the second camera 27, so it is best to position it closer.

[0182] The shape of the main body case 13 is designed to include inclined surfaces 13b″, etc., so that the first display 100 and the second display 200 are as far as possible in the camera's blind spot. Making the camera unit 12 spherical is also good because it will not be reflected. The camera captures images with a 210-degree field of view all around, and since the rearview mirror is near the lens, it is best to make sure the rearview mirror is in the camera's blind spot and not visible in the image. There are no components such as a GPS antenna inside the camera unit 12.

[0183] This embodiment provides a system having a drive recorder 10 equipped with a function to record video captured by a first camera 26 and a second camera 27 installed in a vehicle, and a function to perform predetermined processing using a predetermined range of video captured by the first camera 26 and the second camera 27 installed in the vehicle in response to an operation of a switch unit 28 by the user. This provides a system that is superior to conventional systems. For example, predetermined processing using a predetermined range of video captured by the first camera 26 and the second camera 27 installed in the vehicle can be performed in response to an operation of the user's switch unit 28. Therefore, for example, predetermined processing using a predetermined range of video captured by the first camera 26 and the second camera 27 installed in the vehicle can be performed in a way that is more in line with the user's intentions than in conventional systems.

[0184] For example, in addition to the first camera 26 and second camera 27 that photograph the front of the vehicle, a third camera, which is a wide-angle rear camera attached to the inside of the rear window of the vehicle to photograph the rear of the vehicle, and a fourth camera, which is an infrared camera that photographs the driver, may be connected to the drive recorder 10 and incorporated as targets for switching the display of these images.

[0185] In this embodiment, the camera installed in the vehicle is configured as a 360-degree camera consisting of a first camera 26 and a second camera 27, but it may also be configured as a hemispherical camera. For example, the second camera 27 may be omitted, and the first camera 26 may be installed facing downwards at the position of the switch unit 28. The switch unit 28 may be moved to another location, for example, to the right of the camera unit 12. In each camera display state set, the image from the aforementioned rear camera connected to the drive recorder 10 may be incorporated instead of displaying the image from the second camera 27.

[0186] The video recording function may be configured to record to non-volatile memory such as flash memory built into the drive recorder 10, but it is preferable to have the function to record to a memory card 23 that is detachably attached to the drive recorder 10, as in this embodiment.

[0187] The first camera 26 and the second camera 27 and the drive recorder 10 may each be housed in separate enclosures and connected by wire or wireless, but it is preferable to house them in a single enclosure as in this embodiment.

[0188] As a system having a drive recorder 10, it is preferable to have a system that includes a drive recorder 10 and a power line that supplies power to the drive recorder 10, as in this embodiment.

[0189] User operation may be, for example, operation of a touch panel by the user, but it is particularly preferable to use button operation, as in the operation of the switch unit 28 in this embodiment. Any means for receiving user operation is acceptable, for example, a touch panel may be provided on at least one of the first display 100 or the second display 200.

[0190] A system that performs predetermined processing using a predetermined range of video footage captured by the first camera 26 and the second camera 27 installed in the vehicle, in response to user input, may be built into the camera unit 12, which is the housing of the first camera 26 and the second camera 27; it may be built into the housing of the main unit 11 of the drive recorder 10, as in this embodiment; or it may be built into the housing of an electronic device separate from the drive recorder 10. For example, it may be built into a personal computer, tablet, etc. When the drive recorder is built into the casing of a separate electronic device, the "video footage captured by the first camera 26 and the second camera 27 installed in the vehicle" may be input (e.g., acquired) by connecting the drive recorder 10 and the separate electronic device by wire or wireless connection, or the drive recorder 10 may record the video footage captured by the first camera 26 and the second camera 27 installed in the vehicle onto a memory card 23 that can be attached to the drive recorder 10, and then remove the memory card 23 from the drive recorder 10 and attach it to the separate electronic device so that the separate electronic device can read and acquire the video footage captured by the first camera 26 and the second camera 27 installed in the vehicle.

[0191] In this embodiment, a predetermined process is provided for generating an image in which a predetermined range of images captured by a first camera 26 and a second camera 27 installed on the vehicle is incorporated into a predetermined position on a single screen and output. The user operation is provided for changing the predetermined range of images captured by the first camera 26 and the second camera 27 that is incorporated into the predetermined position on the single screen. As a result, the user can change the predetermined range of images captured by the first camera 26 and the second camera 27 installed on the vehicle that is incorporated into the predetermined position on the single screen by operating the switch unit 28.

[0192] In this embodiment, the output video is displayed on the screen, but it may also be recorded on the memory card 23. In this case, the video generated by the camera display state set selected by the user for display on the screen will also be recorded on the memory card 23. Alternatively, this output video may be output to an external video output terminal. In this case, the video generated by the camera display state set selected by the user for display on the screen will be output to the external video output terminal, allowing the user to view the video generated by the camera display state set selected by the user on a larger monitor connected to the external video output terminal, for example.

[0193] The predetermined range of the video footage captured by the first camera 26 and the second camera 27 installed on the vehicle may be, for example, the entire video footage captured by the first camera 26 and the second camera 27 installed on the vehicle, but it is particularly preferable to define it as a portion of the video footage captured by the first camera 26 and the second camera 27 installed on the vehicle, as in this embodiment.

[0194] The predetermined position within a single screen may be a location within a portion of the screen, as in this embodiment. For example, the screen may be divided into multiple regions, and the predetermined position may be one of those divided regions.

[0195] As in this embodiment, the predetermined ranges of the video captured by the first camera 26 and the second camera 27 installed on the vehicle may be multiple, and it may be multiple different ranges within a single frame of the video. The multiple different ranges may be non-overlapping ranges, or some or all of them may overlap.

[0196] A single screen may have multiple designated positions, and may have multiple different positions. These multiple different positions may overlap in some or all of their ranges, but may also be in ranges that do not overlap.

[0197] The correspondence between a predetermined range of images captured by the first camera 26 and the second camera 27 installed on the vehicle and a predetermined position on a single screen may be fixed in advance, as in the camera display state set of this embodiment. However, it is preferable to have a function to change this correspondence using setting information stored on the memory card 23. For example, the set number, the layout number, the camera number associated with each area within the layout, and the camera image range number associated with each area within the layout may be stored in association, and the camera display state set may be switched in the order of the set numbers of this set.

[0198] The camera display state set may be configured as follows: A predetermined range of video footage captured by a first camera 26 installed on a vehicle includes a first predetermined range which is the entire video footage from the first camera 26 installed on the vehicle, and a second predetermined range which is a part of the video footage captured by the first camera 26 installed on the vehicle; A predetermined position within the screen includes a first screen layout which is the position of the entire area within the screen, and a second screen layout which is the position of a part of the area within the screen; At least three modes are provided: a first mode which generates the output video by associating the first predetermined range with the first layout; a second mode which generates the output video by associating the first predetermined range with the second layout; a third mode which generates the output video by associating the second predetermined range with the first layout; and a fourth mode which generates the output video by associating the second predetermined range with the second layout; and the user can switch between the modes by short-pressing the switch unit 28. In this way, the user can switch between at least three modes provided by the system, which include a first mode that generates the output video by associating the first predetermined range with the first layout, a second mode that generates the output video by associating the first predetermined range with the second layout, a third mode that generates the output video by associating the second predetermined range with the first layout, and a fourth mode that generates the output video by associating the second predetermined range with the second layout. By providing at least three modes, either two modes where the predetermined range is "whole" or two modes where the predetermined range is "partial," or two modes where the layout is "whole" or two modes where the layout is "partial," are among the switchable modes. Therefore, when switching, the user can switch using the identity of the predetermined range or layout as a clue, and it is easier than before to understand which range is displayed in which layout.

[0199] Furthermore, the control unit includes processing for generating an image that incorporates a predetermined range of the images captured by the first camera 26 and the second camera 27 installed in the vehicle into a predetermined position on a single screen for output. The predetermined position can be provided in multiple locations on a single screen, similar to the fourth set in this embodiment. The configuration may also include an operation that allows the user to select which of the multiple predetermined positions on a single screen the predetermined range of the images captured by the first camera 26 and the second camera 27 should be incorporated into. For example, with the desired camera display state set selected, the user can select the area to be changed using the touch panel, and then set the camera and range to be incorporated into that area by operating the switch unit 28. For example, with the third layout in Figure 11 displayed, the user touches one of the six areas described with reference to Figure 11 that they want to change. When this touch is detected, the touched area is enclosed in an indicator frame to indicate that it has been selected. If a double press of the switch unit 28 is detected in this state, the camera for the selected area is switched between the first camera 26 and the second camera 27. Furthermore, if a short press of the switch unit 28 is detected, the range to be incorporated is cyclically switched from the first range to the sixth range. If a long press of the switch unit 28 is detected, the state of the camera and range at that time is confirmed and stored, and this state is exited. As a result, the next time the camera display state set is changed by a short press, the display will be made using the stored confirmed combination. In this way, the user can select which of several predetermined positions on a single screen to incorporate a predetermined range from the video captured by the first camera 26 and the second camera 27, and the next time the video is incorporated using the selected combination, it is easy to display the video incorporated using that combination. It is preferable to store this information in non-volatile memory so that the display will be made using the combination stored in this non-volatile memory from the next time the system is started up.

[0200] Furthermore, the control unit may include a process for generating an image in which a predetermined range of images captured by the first camera 26 and the second camera 27 installed in the vehicle is incorporated into a predetermined position on a single screen and output. The user may also perform an operation to set the predetermined position on the single screen to a position moved from its initial position. For example, in a configuration with a touch panel, when dragging the lower left "upper" image on the touch panel is detected while the third layout in Figure 11 is displayed, the display position may be moved according to the drag. In this way, the user can set the predetermined position on a single screen to a position moved from its initial position. In particular, it is preferable to include a function to select which of several predetermined positions to move, and to set the selected predetermined position to a position moved from its initial position. No other drive recorder offers such movement capabilities, and this configuration offers excellent benefits.

[0201] The control unit includes a process for generating an image in which a predetermined range of the image captured by the first camera 26 and the second camera 27 installed on the vehicle is incorporated into a predetermined position on a single screen and output. As shown and explained in Figure 11, the predetermined range is provided in multiple locations on a single screen of the image captured by the first camera 26 and the second camera 27 installed on the vehicle, and the predetermined position is provided in multiple locations on the single screen. Furthermore, the system may be configured to allow the user to set the correspondence between which of the predetermined ranges in the multiple locations is incorporated into which of the predetermined positions in the multiple locations. In this way, the user can set the correspondence between which of the predetermined ranges in the multiple locations is incorporated into which of the predetermined positions in the multiple locations. For example, with the camera display state set to be changed selected, the user can select the area to be changed on the touch panel and set the camera and range to be incorporated into that area by operating the switch unit 28. For example, with the third layout of Figure 11 displayed, the user touches one of the six areas to be changed from the areas described with reference to Figure 11. When this touch is detected, the touched area is drawn with an indicator frame to indicate that it has been selected. If a second press of the switch unit 28 is detected in this state, the camera for the selected area is switched between the first camera 26 and the second camera 27. If a short press of the switch unit 28 is detected, the range to be incorporated is cyclically switched from the first range to the sixth range. If a long press of the switch unit 28 is detected, the state of the camera and range at that time is confirmed and stored, and the state is exited. As a result, the next time the camera display state set is changed by a short press, the display will be made using the stored and confirmed combination. In this way, the user can select which of several predetermined locations on a single screen to incorporate a predetermined range from the video captured by the first camera 26 and the second camera 27, and it is easy to display the video incorporated with the selected combination on subsequent occasions.This information should be stored in non-volatile memory, and the combinations stored in this non-volatile memory should be used for display purposes from the next startup onward.

[0202] In this embodiment, the system has a function to generate an image by combining different predetermined ranges within the images captured by the first camera 26 and the second camera 27 into predetermined positions on the predetermined layouts, and the system has a function to allow the user to select which of the multiple predetermined layouts to use to generate the combined image.

[0203] It is preferable to have at least one of the predetermined layouts that displays the video captured by the first camera 26 on one screen. For example, it is preferable to have at least one camera display state set that displays the video captured by the first camera 26 on one screen. For example, it is preferable to have a camera display state set that displays only the video from the left front camera 26 in Figure 19 directly in the center of the screen. When this camera display state set is selected, it is preferable to have a function that does not record the video generated by the selected camera display state set. In this way, the amount of video to be recorded can be reduced.

[0204] The system may also include a first mode in which the video of the selected camera display state set is displayed on the display screen and the video of the same camera display state set that is selected and displayed on the second display 200 is recorded on the memory card 23, and a second selection function in which the video of the camera display state set selected by the selection function is displayed on the display screen, but a different camera display state set for recording is selected by the selection function and displayed on the display screen. The second selection function may be switched by providing, for example, a slide switch on the main unit 11.

[0205] In this way, a system can be provided that is easily usable by both users who want the display layout and the recording layout to be the same, and users who want them to be different.

[0206] It is preferable to include a function that enlarges the image at a predetermined position in the predetermined layout of the image of the selected layout that generates the combined image, based on the user's instructions. For example, if the control unit is equipped with a voice recognition function and, in the display state of the fourth set in Figure 11, the microphone 18 recognizes that the characters displayed in each area (in this example, "up" in Figure 11) and the instruction to enlarge them, such as "up, enlarge", the image of the third range displayed in the lower left area should be displayed across the entire screen. In this way, users can enlarge the image at a specific location on a given layout by inputting instructions.

[0207] When zooming in is enabled, it is preferable to have a function to record the zoomed-in video, or a function to record the video of the selected layout without recording the zoomed-in video.

[0208] In this embodiment, as shown in Figure 11, there is an overlap between the first and third ranges. However, different predetermined ranges within the image captured by the first camera 26 may be arranged so as not to overlap. Furthermore, a video may be generated in which the second camera image, which is the image from a camera other than the first camera 26 and the second camera 27 (for example, a rear camera), is displayed at one of the embedded areas of the layout in Figure 6. In this way, the user can view the images from different predetermined ranges that do not overlap from the first camera 26 and the second camera 27, as well as the image from the rear camera, on a single screen. It is preferable to have a function to select the predetermined position for displaying the second image. For example, if the voice recognition system recognizes the voice command, "Place the rear camera in the upper right position," the video in the upper right region of Figure 11 is switched from the image from the second camera 27 (rear) to the image from the third camera, the rear camera.

[0209] In this way, the second image can be displayed at a position selected by the user, while the images from the first camera 26 and the second camera 27, which are in different predetermined ranges that do not overlap, and the second image can be viewed on a single screen.

[0210] Furthermore, it is preferable to have a function that stores information identifying the correspondence between the predetermined position and the predetermined range in association with the recorded video. For example, the camera display state set number may be embedded and recorded in the video data, or the layout number, the camera number associated with each area within the layout, and the range number associated with each area may be stored in association with each other. In this way, when playing back the recorded video, it is easy to set the playback mode based on the stored information identifying the correspondence between the predetermined position and the predetermined range.

[0211] The generated video is not recorded, and the system should have a function to display the generated video on a screen. In this way, user operations do not affect the recorded video, and the system can display the video desired by the user on the screen in response to user operations.

[0212] It is preferable to have a function that displays the video generated with the selected layout on the display screen without recording it. It is preferable to have a function that displays the video generated with the camera display state set selected by the user on the second display 200 as described above, without recording it. In this way, the user can freely switch the layout in which the video displayed on the display screen is incorporated to their desired one, without the video recorded by the drive recorder 10 being affected by the user's operation of changing the layout or camera display state set.

[0213] The system may also include a function to record both the video captured by the first camera 26 and the second camera 27, and the video generated with the selected layout, onto the memory card 23, along with information that distinguishes between the two videos, so that both can be played back in sync. This makes it easy to play back both videos in sync.

[0214] It is preferable to have a function to display the generated video on a screen and a function to record the generated video. In this way, the screen display can be changed according to the user's operation, and the generated video, which is the same as the screen display, can be recorded. In particular, it is preferable to have the screen display changed according to the user's operation, the generated video, which is the same as the screen display, and the video itself from the first camera 26 and the second camera 27 be recorded.

[0215] The images captured by the first camera 26 and the second camera 27 may be in the form of a circular fisheye image, as in this embodiment. Furthermore, the system may include an operation by the user to pre-set a position in the circular fisheye image that corresponds to the installation location of the vehicle speed measuring device, and a function to display a predetermined warning for a predetermined range that includes the position corresponding to the installation location set in response to the user's operation. For example, if the user voice says "speed camera detected," the system may store the location at that time and output a warning from the speaker 29 when approaching that location in the future. In this way, a predetermined warning is displayed for a predetermined range in the circular fisheye image that includes the position corresponding to the installation location of the vehicle speed measuring device, as set by the user, making it quicker and easier for the user to recognize the warning than before.

[0216] The system should include a function to control an infrared illumination means that irradiates infrared light into the shooting range of the second camera 27, and a function to record video before and after a change in predetermined control of the infrared illumination means. For example, multiple infrared LEDs (four or more are particularly desirable) can be installed around the second camera 27, and the control unit can control the lighting and delighting of these infrared LEDs. In this way, video before and after a change in predetermined control of the infrared illumination means from this system can be recorded. For example, by viewing the recorded video, the situation when a predetermined change in the infrared illumination means occurs can be easily understood. For example, the system should detect the brightness around the drive recorder 10 from the video of the second camera 27, and control the infrared illumination means to turn on when the detected brightness falls below a predetermined level, and to delight when the detected brightness exceeds a predetermined level.

[0217] It is preferable to have a function that detects areas in the image from the second camera 27 that appear reddish compared to their surroundings, and processes those areas as interior of the vehicle. In this way, the system that processes the interior of the vehicle in the image does not need to manually set the location of the area, and can automatically identify the area and perform the predetermined processing. The inventors have found that areas that appear reddish compared to their surroundings are likely to be interior of the vehicle, while areas that do not appear reddish are likely to be window areas (areas corresponding to images of the outside scenery).

[0218] Furthermore, the system should include a function to play back recorded video, where the time of the event is recorded. If playback reaches a point in time related to the event while the driver is not visible in the currently playing video, the system should have a function to display video showing the driver for the period including the event. For example, when the voice command "playback" is recognized, playback of the video from the first camera 26, recorded on the memory card 23, begins. When playback reaches 10 seconds before the event, the system switches to displaying the video from the second camera 27 as well (for example, playing both videos side-by-side as shown in Figure 19). In this way, when playing back recorded video, if playback reaches a point in time related to the event while the driver is not visible in the currently playing video, the system will automatically display video showing the driver for the period including the event. Therefore, when playback reaches a point in time related to the event, the user can easily check the driver's condition at that time without having to perform operations such as switching to video showing the driver. This is particularly effective when persons other than the driver, such as fleet managers, need to check the vehicle's condition and the driver's driving condition.

[0219] It is preferable to have a smoked glass area image adjustment function that adjusts the image of the smoked glass area in the image captured by the first camera 26 and the second camera 27 as a predetermined range, and adjusts the image of the smoked glass area in the image captured by the first camera 26 and the second camera 27 as a predetermined process. In this way, the image of the smoked glass area in the image captured by the first camera 26 and the second camera 27 can be adjusted according to the user's operation. For example, the image adjustment may be a process to adjust the camera exposure, a process to perform post-processing on the image, or an adjustment to the image quality which differs between the area with smoked glass and the area without smoked glass. The user operation may include an operation to set the area with smoked glass in the image captured by the first camera 26 and the second camera 27. For example, in the initial setup process performed when the drive recorder 10 is first powered on, the third set of video shown on the right side of Figure 10 is displayed (the rear view is displayed), and the speaker 29 outputs the voice message, "Please trace the area with the tinted glass. When you have finished tracing, please say 'Done'." The area where the user's finger touches the touch panel before the voice message "Done" is recognized is stored (set) as the area with the tinted glass. Then, the adjustment of the video for the area with the tinted glass in the video captured by the second camera 27 should be a process that increases the brightness of the set area. Furthermore, it is preferable to have a predetermined range that includes the area with the sunroof in the video captured by the first camera 26 and the second camera 27, and a sunroof partial area video adjustment function that adjusts the video for the area with the sunroof in the video captured by the first camera 26 and the second camera 27 as a predetermined process. In this way, the video for the area with the sunroof in the video captured by the first camera 26 and the second camera 27 can be adjusted according to the user's operation. The user operation should include setting the area containing the sunroof within the video footage captured by the first camera 26 and the second camera 27.For example, during the initial setup process performed when the drive recorder 10 is first powered on, the third set of video shown on the right side of Figure 10 is displayed (the rear view is displayed), and the speaker 29 outputs the voice message, "Please trace the area with the sunroof. When you have finished tracing, please say 'Done'." The area where a finger touches the touch panel before the voice message "Done" is recognized is stored (set) as the sunroof area. Then, the adjustment of the video for the area with the sunroof in the video captured by the second camera 27 should be a process that lowers the brightness of the set area. Alternatively, instead of providing this process, a function to simply set whether or not to have a sunroof should be provided, and the video adjustment content should be different when the sunroof is set to "yes" and when it is set to "no." For example, when the sunroof is set to "yes," the video brightness should be lowered compared to when the sunroof is set to "no."

[0220] In a configuration equipped with a rear camera, the rear camera's image includes footage of the area behind the vehicle, and the system has a function to provide notification from speaker 29 based on the approaching status of a vehicle behind the vehicle in the image as a predetermined process. The notification includes an audio message from speaker 29 saying "Caution: Approaching Vehicle Behind!" indicating that a vehicle behind is approaching too closely, and the system also has a function to change the position of the reference point in the image used to determine if a vehicle behind is approaching too closely, according to user operation. In this way, the frequency and sensitivity of the notification of a vehicle behind approaching too closely can be easily adjusted by the user. For example, in the initial setup process performed when the power is first turned on, the third set of images shown on the right side of Figure 10 is displayed (the rear image is displayed), and the speaker 29 outputs the voice message "Please trace the area where a vehicle behind is approaching too closely and warn you. When you have finished tracing, please say "Done." The area where a finger touches the touch panel before the voice message "Done" is recognized is stored (set) as the position to be determined as approaching. Then, if the system detects that a vehicle has entered a stored position in the video footage captured by the second camera 27, it will issue an audible warning from speaker 29 saying, "Caution: Approaching vehicle from behind!"

[0221] Furthermore, in a configuration equipped with a rear camera, the rear camera's image includes footage of the area behind the vehicle, and the system includes a function to provide notification based on the approaching status of a vehicle behind in the image as a predetermined process, and the notification includes an audio notification such as "Behind vehicle, beware of weaving!" indicating that the vehicle behind is weaving, and the system should also include a function to change the position of the criteria for determining weaving in the image according to the user's operation. In this way, the frequency and sensitivity of the notification of weaving in the vehicle behind can be easily adjusted by the user's operation. For example, in the initial setup process performed when the power is first turned on, the third set of images shown on the right side of Figure 10 is displayed (the rear image is displayed), and the speaker 29 outputs the voice message "Please trace the area where the vehicle behind is not considered to be weaving. When you have finished tracing, please say "Done". The area where a finger touches the touch panel before the voice message "Done" is recognized is stored (set) as the position for determining weaving. Then, when the following vehicle enters a memorized position for detecting serpentine driving in the video captured by the second camera 27, and subsequently the number of times the vehicle's position deviates to the right or left of the position for detecting serpentine driving exceeds a predetermined number (preferably 3 times), the speaker 29 outputs the voice message, "Behind vehicle, beware of serpentine driving!"

[0222] The system should have a function to perform multiple different types of notifications (e.g., rear vehicle approach warning and rear vehicle swerving warning) based on the approaching state of the vehicle behind in the video, and the recording time range should be different for each type of notification based on the approaching state of the vehicle behind in the video. For example, the rear vehicle approach warning should record 20 seconds before and after the detection of the approaching vehicle behind, while the rear vehicle swerving warning should record 5 minutes before and after the detection of the swerving of the vehicle behind. In this way, video can be obtained with different recording time ranges for each type of notification based on the approaching state of the vehicle behind in the video. It is also good to have a function to record "swerving" and "rapid approach" as different types of events and display them separately on the viewer. The recording time ranges for rapid approach / swerving events and impact events should be different.

[0223] The system should have a function to display images captured by the first camera 26 and the second camera 27 on a display screen, a function to change the predetermined range as an operation by the user, and a function to record images including the moment when the user inputs an instruction to change the predetermined range. For example, the system should record images for 20 seconds before and after the camera display state set is switched based on the user's instruction. In this way, images including the moment when the user inputs an instruction to change the predetermined range can be obtained. Therefore, it is useful in proving that the user's switching operation was not the cause of the accident.

[0224] In this embodiment, the system includes a function to select a predetermined range of the input video as the target for display on the display screen or the target for recording. The system also includes an operation by the user to switch the predetermined range. When the system is first powered on after being shipped from the factory, it is preferable to have a function that instructs the user to switch the predetermined range and check whether there are any problems with the video captured by the camera within the predetermined range of the input video that is to be displayed on the display screen or the target for recording. For example, in the initial setup process performed when the system is first powered on, the system displays four sets, from the first to the fourth set, for 5 seconds each, and switches between them sequentially in a cyclic manner. At the same time, it outputs a voice message from the speaker 29 saying, "Please install the system in a position where there are no missing parts in the camera image in all display modes. When you have finished installing it, please say 'complete'." The system repeats the cyclic display mode changes until "complete" is recognized by voice recognition. In this way, when installing the drive recorder 10 in a vehicle, etc., it is easy to check whether there are any problems with the video in any state that can be switched by the user's operation.

[0225] The aforementioned video captures an area that includes at least one of the driver's side or the passenger's side, and it is preferable that the video includes a function to convert the background of the driver or passenger in the video into a pre-stored image.

[0226] The system includes a function to incorporate and display images captured by the first camera 26 and the second camera 27 on the screen in a predetermined layout as images to be displayed on the display screen, and includes a plurality of such predetermined layouts, and a function to switch between the plurality of layouts based on user operation, and includes a function to incorporate and play back images recorded by the recording function in the predetermined layout, and the order in which the layouts are switched based on user operation during playback should be the same as the order in which the layouts for incorporating and displaying images captured by the first camera 26 and the second camera 27 on the screen in a predetermined layout are switched based on user operation. In this way, the user can switch layouts during playback in the same order as the layouts for screen display are switched, making it user-friendly. For example, the system includes a function to incorporate and display images captured by the first camera 26 and the second camera 27 on the screen using a selected camera display state set, and provides a plurality of such camera display state sets, and a function to switch between the plurality of camera display state sets based on user operation, and a function to incorporate and play back images recorded by the recording function using a predetermined camera display state set, and the order in which the camera display state sets are switched based on user operation during playback should be the same as the order in which the camera display state sets are switched based on user operation to display images captured by the first camera 26 and the second camera 27 on the screen. For example, the viewer software that runs on a personal computer, as described later, should be provided with a button that has the same function as the switch unit 28 of the drive recorder described above. In this way, the user can switch the camera display state sets during playback in the same order as the camera display state sets for screen display, making it user-friendly.

[0227] The system may consist only of the drive recorder 10, with both recording and playback functions provided by the drive recorder 10. However, it is preferable for the system to include both the drive recorder 10 and a separate playback device (e.g., a computer), with the drive recorder 10 providing the recording function and the separate playback device providing the playback function. For example, the order in which the video display layout is switched on the drive recorder 10 itself should be the same as the order in which the video display layout is switched on a viewer running on a computer. For example, the order in which the camera display state set is switched on the drive recorder 10 itself should be the same as the order in which the camera display state set is switched on a viewer running on a computer.

[0228] The system includes a plurality of layouts incorporating the images from the first camera 26 and the second camera 27 as predetermined layouts, and at least one layout incorporating the image from the rear camera (third camera). It also includes a first operation unit for switching between these plurality of layouts in a predetermined order based on user operation, and a second operation unit different from the first operation unit, which has a function to switch to a layout of a third camera different from the camera whose image is incorporated into the currently displayed layout when a predetermined operation is performed on the second operation unit. In this embodiment, a plurality of camera display state sets incorporating the images from the first camera 26 and the second camera 27 are provided as camera display state sets by short-pressing the switch unit 28 (second set, fourth set). Furthermore, it is preferable to include at least one camera display state set incorporating the image from the rear camera (third camera), and to have a configuration that switches between these plurality of camera display state sets based on the user's operation of short-pressing the switch unit 28, as well as a second operation unit different from the switch unit 28, which has a function to switch to a layout of a third camera different from the camera whose image is incorporated into the currently displayed layout when a predetermined operation is performed on the second operation unit. The second operation unit may, for example, be a voice recognition unit that detects the voice of "rear camera," or it may be a button separate from the switch unit 28, or it may detect three consecutive presses of the switch unit 28, etc.

[0229] In this way, the user can switch between camera display state sets incorporating the images from the first camera 26 and the second camera 27 in a predetermined order by short-pressing the switch unit 28, and if they want to see the rear camera image immediately, they can switch to a camera display state set that includes the rear camera image by operating the second control unit. In particular, if the system is configured with a drive recorder 10, for example, it is preferable to provide a button to switch between the first camera 26 and the second camera 27 on the drive recorder unit, separate from the display mode switching button.

[0230] The switch unit 28 should be provided with a separate operation unit distinct from a short-press operation, and when a predetermined operation is performed on the separate operation unit, it is preferable to have a switching function that switches to a predetermined layout based on the user's operation, rather than switching the layout in a predetermined order. For example, when a predetermined operation is performed on the separate operation unit, it is preferable to have a switching function that switches to a predetermined camera display state set based on the user's operation, rather than switching the camera display state set in a predetermined order. In this way, the user can switch between multiple layouts incorporating images captured by the first camera 26 and the second camera 27 in a predetermined order by operating the first operation unit, and can also instantly view a display incorporating images captured by the first camera 26 and the second camera 27 in a predetermined layout by operating the separate operation unit. For example, the main unit of the drive recorder 10 or a viewer on a separate device (e.g., a personal computer) should be provided with a button that changes to a single preset mode in addition to the button that changes the display mode sequentially.

[0231] In this embodiment, the drive recorder 10 is provided with an event recording button on the housing side (camera unit 12), and a separate button operation unit connected to the drive recorder 10 is provided, which can be installed in a location that is difficult to see from outside the vehicle. When the button operation unit is operated, it is preferable to have a function to record video for a predetermined period of time, including before and after the time the button operation unit was operated, with a recording time different from the event recording time. In this way, the user can perform event recording by operating the event recording button on the housing side of the drive recorder 10, and can also record video for a predetermined period of time, including before and after the time the button operation unit was operated, with a recording time different from the event recording time, by operating the button operation unit installed in a location that is difficult to see from outside the vehicle. For example, the drive recorder 10 main unit equipped with a manual event recording button is provided with a separate button that can be installed in a location that is hidden from view from outside the vehicle, which is a manual recording start button for road rage, and the recording time for road rage should be longer than the recording time for manual event recording. The button control unit, which is separate from the drive recorder 10 and installed in a location that is difficult to see from the outside of the vehicle, should be configured as a button on the remote control of the radar detector connected to the drive recorder 10. For example, the button control unit should be assigned to the radar detector's remote control as a button for aggressive driving.

[0232] The functions described above may be provided in the drive recorder 10, but they may also be provided in another electronic device. Both should have functions that produce the same effect. The other electronic device may, for example, have a function to play back the video data recorded by the drive recorder 10. The other electronic device may consist of, for example, a personal computer, tablet, or smartphone. These functions may be configured as a program to be implemented on a computer. [Display device: PC viewer]

[0233] The system according to the present invention can be configured, for example, as a display device for a drive recorder. One embodiment of this system is configured using a personal computer. Although not shown in the figures, the hardware configuration of the display device for a drive recorder includes an arithmetic processing unit, a memory unit, an input unit, a display unit, and a card reader. The memory unit includes a non-volatile memory for storing application programs executed by the arithmetic processing unit, a work memory used by the arithmetic processing unit during calculations, and an internal or external storage device (hard disk) for recording video, audio, and other information recorded while driving. The input unit is a pointing device such as a mouse or a keyboard. The card reader is a device for reading and writing data to the inserted memory card 23. The memory card 23 contains, by the drive recorder 10, first video data which is a circular fisheye image, which is raw video footage captured by at least the first camera 26, and second video data which is a circular fisheye image, which is raw video footage captured by the second camera 27, each with its recording date and time data. By simultaneously playing back and displaying videos with the same recording date and time data, the first video data and the second video data can be played back in sync.

[0234] By launching an application program installed in the memory unit (referred to as "PC Viewer" in this embodiment), the personal computer operates as a display device for the drive recorder. As described above, the drive recorder 10 records video and audio captured while driving or parked, as well as various information related to the recorded video, such as date and time information and speed information, onto the memory card 23. When the user wants to play back the video etc. recorded on the memory card 23, they remove the memory card 23 from the memory card slot 22 and insert it into the card reader of the personal computer. They then run the launched PC Viewer and display the video etc. recorded while driving etc. on the display unit. The specific functions of the PC Viewer are as follows.

[0235] Figure 12 shows an example of a display layout displayed on the display unit of a personal computer after launching the PC viewer, selecting recorded video, and starting playback. A menu bar is located near the top edge of the display screen 60, and a display area 62 for displaying the video of the selected data is located in a large area below the menu bar. Below the display area 62, from left to right, are a map display unit 63, a related information display unit 64, and a playlist list display unit 70.

[0236] The menu bar buttons 61, from left to right, consist of a folder selection button 61a, a still image conversion button 61b, a print button 61c, a video conversion button 61d, a backup button 61e, a log data conversion button 61f, a recording settings change button 61g, and a drive recorder switch emulation button 62h. The folder selection button 61a is used to specify the data to be played back. When the folder selection button 61a is clicked, the PC viewer displays a list of folders recorded on the memory card inserted into the personal computer. The user clicks to select the folder containing the data to be played back from the displayed list of folders.

[0237] This form of PC viewer includes a function to convert the video displayed in the display area 62, for example, into a still image in a predetermined file format, such as JPEG, and save it. When the still image conversion button 61b is clicked, the PC viewer converts the video of the screen displayed in the display area 62 into a still image and records it in a predetermined storage area of ​​the personal computer. According to the settings, the PC viewer creates and records still images by dividing the currently displayed image or the video in the display area 62 into a specified number of frames over a specified time range.

[0238] This form of PC viewer has a function to print, for example, the video displayed in the display area 62. When the print button 61c is clicked, the PC viewer prints the video displayed in the display area 62 according to the set conditions. The set conditions include, for example, printing the displayed video as a still image, similar to the still image conversion described above, or printing still images obtained by dividing the video in the display area 62 into a specified number of frames over a specified time range.

[0239] This PC viewer has a function to convert and save recorded data into a predetermined file format, such as AVI video. When the user selects and loads the recorded data to be converted, and the video conversion button 61d is clicked, the PC viewer displays a condition setting screen and converts the loaded video data into the predetermined video format according to the settings on that screen. The condition setting screen has input areas for specifying items such as file name, save location, range, subtitles, and compression format, as well as a [Start] button. The user sets the conditions using the input area and clicks the [Start] button. By converting to AVI video, the converted and saved file can be viewed using various video playback software, or uploaded and published on homepages and other sites.

[0240] When the backup button 61e is clicked, the PC viewer backs up the video recorded on the memory card 23 to the personal computer. The video recorded on the memory card is not deleted after the backup. If deletion is required, a separate deletion process is performed. When the log data conversion button 61f is clicked, the PC viewer converts the accumulated history data into a KML file and records it as log data. When the recording settings change button 61g is clicked, the PC viewer displays the recording settings screen (not shown). The user inputs various recording conditions, etc., using the recording settings screen and confirms the contents, thereby storing the recording conditions on the memory card. When the memory card is inserted into the drive recorder 10, the drive recorder 10 updates the recording conditions and operates according to the updated conditions thereafter.

[0241] The drive recorder switch unit emulate button 62h is a button that emulates the operation of the switch unit 28 on the drive recorder 10 on the PC viewer. On the PC viewer, instead of the video from the first camera 26 as described in the switch unit 28, the first video data recorded by the first camera 26 is played back, instead of the video from the second camera 27 as described in the switch unit 28, the second video data recorded by the first camera 26 is played back, and the content displayed on the second display 200 of the drive recorder 10 is the content displayed as the display area 62. Similar to the switch unit 28, the drive recorder switch unit emulate button 62h has three states when pressed: "double press" when two consecutive presses within 0.5 seconds are detected, "short press" when one consecutive press of less than 2 seconds is detected without a double press, and "long press" when a consecutive press of 2 seconds or more is detected, and different functions are assigned to each state. If a "short press" is detected, the current "camera display state set" is switched to the next "camera display state set" and displayed in display area 62.

[0242] Similar to the drive recorder 10, the "camera display state set" includes the following first to fourth sets. When a "short press" is detected, the display switches to the next set after the one currently displayed in the display area 62. The order of these sets is from the first set to the fourth set, and after the fourth set, it returns to the first set, performing a cyclical switch. In this way, the camera display state sets can be switched in a predetermined order by a short press. As described later, by performing a predetermined operation from the initial state of each set, the screen display content can be changed from the state of each set. If a short press is detected while the screen is in a state changed from each set by this operation, the screen is returned to the state of the set before the change. For example, if the display position, etc., is changed in the state of the first set and a short press is detected, the screen is returned to the state of the first set.

[0243] The first set is a combination of the following: the first layout, which has a single rectangular area in the shape of a horizontal rectangle within the layout screen as shown on the left side of Figure 10(a); the playback video of the first video data (forward); and the video area, which is a circular video as shown in Figure 8(b), and is the rectangular area (first area) extracted where the origin of the circle of the camera video area R1 in Figure 8(b) is the intersection of the diagonals of the rectangle, as shown in Figure 10.

[0244] The second set, as shown in Figure 19, has a second layout where different video areas can be assigned to two square areas on the screen: a left square area and a right square area. The camera displays the playback video of the first video data (front) in the left square area of ​​the second layout, and the playback video of the second video data (rear) in the right square area of ​​the second layout. The video area for both the playback video of the first and second video data is a square region (second area) that includes the R2 area in Figure 8 (the area with the circular fisheye image). Note that in the display state of Figure 19, the text "360°" is superimposed at the bottom of each square area. This indicates that each video captures an area of ​​360° or more, and this display mode can be switched on or off in the settings screen.

[0245] As shown on the right side of FIG. 10(a), the third set is a combination of videos in which the layout is the aforementioned first layout, the camera uses the reproduced video (rear view) of the second video data, and among the circular video shown in FIG. 8(c), a rectangular range (first range) where the origin of the circle of the camera image region R1 in FIG. 8(c) serves as the intersection of the diagonal lines of the rectangle is extracted as shown in FIG. 10.

[0246] As shown in FIG. 11, the fourth set adopts a third layout in which the screen is divided into an approximately upper two-thirds region and a lower one-third region in the vertical direction, the upper region is further divided into two approximately half regions in the left-right direction, and the lower region is further divided into two approximately quarter regions in the left-right direction, providing a total of six regions. For the camera, the upper right region uses the reproduced video (rear view) of the second video data, and all other regions use the reproduced video (front view) of the first video data. Regarding the video ranges: the upper left region and the right region each adopt a rectangular range at the center of the corresponding camera (the first range which is the same camera region as in FIG. 10(a)), and the lower regions from left to right sequentially adopt the third range (referred to as upper range), fourth range (referred to as lower range), fifth range (referred to as left range), and sixth range (referred to as right range) described below. The third range is a rectangular range inside the circle in FIG. 8(b), which is an upper range divided with the left and right straight lines passing through the origin of the circle as a part of the lower side. The fourth range is a rectangular range inside the circle in FIG. 8(b), which is a lower range divided with the left and right straight lines passing through the origin of the circle as a part of the upper side. The fifth range is a rectangular range inside the circle in FIG. 8(b), which is a left range divided with the upper and lower straight lines passing through the origin of the circle as a part of the right side, and the center of the right side of this rectangular range coincides with the origin of the circle in FIG. 8(b). The sixth range is a rectangular range inside the circle in FIG. 8(b), which is a right range divided with the upper and lower straight lines passing through the origin of the circle as a part of the left side, and the center of the left side of this rectangular range coincides with the origin of the circle in FIG. 8(b). According to the display of the fourth set, as shown in FIG. 11, the front and rear videos can be checked in the wide display area of the upper two-thirds of the screen, and the videos at respective positions can be checked at a glance via the upper, lower, left and right videos in the lower section.

[0247] When "double pressing" is detected, if the "camera display state set" displayed in the display area 62 is a camera display state set (first set) that displays the reproduced video of the first video data and does not display the reproduced video of the second video data, switching is performed to a camera display state set (third set) that displays only the reproduced video of the second video data; on the other hand, if the "camera display state set" displayed in the display area 62 is a camera display state set (third set) that displays the reproduced video of the second video data and does not display the reproduced video of the first video data, switching is performed to a camera display state set (first set) that displays only the reproduced video of the first video data. When the "camera display state set" displayed in the display area 62 is any set other than the above (second set, fourth set) and "double pressing" is detected, switching is performed to a specific set (the third set in the present embodiment).

[0248] When "long pressing" is detected, for the video being reproduced and displayed, recording identical to event recording is performed by generating a new file on a personal computer. This allows a person who manages and supervises a driver, such as an operation manager, to easily record a problematic scene encountered during reproduction as a new event record on the personal computer. It is preferable that this event record is recorded and displayed after adding information that distinguishes it as a different type of event record (PC viewer event record) from the event records recorded by the drive recorder.

[0249] The map display unit 63 displays a map 63a of a predetermined area and the vehicle's position on the map 63a. The PC viewer acquires map data of the surrounding area where the vehicle is located based on the vehicle's location information associated with the loaded video, displays a map 63a of the set scale on the map display unit 63, and draws a vehicle position icon 63b at the vehicle's current location on the map 63a (see Figures 12(a), (c), etc.). Map data can be acquired, for example, from a server where maps are recorded via the Internet. If data is acquired from the Internet, the map display unit 63 will not display the map if the personal computer is not connected to the Internet. Also, selecting "Do not display map" in the settings will put the map display unit 63 into an operating mode where the map is not displayed.

[0250] Furthermore, if the GPS positioning is unavailable and the current location is unknown, it is preferable to display information instead of a map, for example, as shown in Figure 12(b). For example, it is possible to display the map 63a while not displaying the vehicle's position icon 63b when GPS positioning is unavailable. However, if the vehicle's position icon 63b is not displayed, there is a risk that the user may search for the vehicle's position icon on the map or mistakenly think that there is a malfunction. In contrast, displaying another image or the like instead of the map 63a, as in this embodiment, makes it easy to understand that GPS positioning is unavailable, which is preferable.

[0251] The related information display unit 64 has a timeline display unit 74 at its top, a volume switch button 66 at the upper left below it, a date and time information display unit 73 at the upper right, a playback button display unit 65 below that, a driving speed display unit 67, an acceleration display unit 68, and a latitude and longitude display unit 69 at the lower left of the playback button display unit 65, and an acceleration sensor graph display unit 71 at the lower right of the playback button display unit 65. The timeline display unit 74 shows the position of the video displayed in the display area 62 within a single recording data. The entire timeline of the recording data's playback time is represented by a red bar, and as playback progresses, the position of the knob 74a is moved to the right. When the position of the knob 74a is slid, playback starts from that position. During continuous recording, the location where an event was recorded is displayed with a yellow vertical line 74b (see Figure 12(c), etc.).

[0252] The volume control button 66 is used for muting and adjusting the volume, and has a mute button 66a and a knob 66b (see Figure 16(c)). When the mute button 66a is clicked, the PC viewer mutes the audio being played, and when the mute button 66a is clicked again while the audio is muted, the mute is released. When the knob 66b is slid by operating the pointing, the PC viewer adjusts the volume according to the position of the knob 66b.

[0253] The date and time information display unit 73 is an area that displays the date and time the video being played back was recorded. The time can be either the device time recorded based on the drive recorder 10's internal clock or the GPS time obtained through GPS positioning. In this configuration, the time is changed depending on the recording conditions of the video being played back. If the video being played back is based on continuous recording, the PC viewer displays the device time in the date and time information display unit 73. If the video being played back is based on event recording, the PC viewer displays the GPS time in the date and time information display unit 73 if GPS positioning occurred at the time of the event, or the device time if GPS positioning was not obtained. Furthermore, when the recorded data is displayed using the device time during playback (see Figure 12(b)), the display is updated to the GPS time when GPS positioning is performed (see Figure 12(c)).

[0254] The playback button display section 65 is a group of buttons for performing operations such as playback and fast forward. From left to right, it includes buttons for "rewind," "previous frame," "reverse playback," "stop," "play," "next frame," and "fast forward." When each button is clicked, the PC viewer performs the corresponding action. If the "rewind," "reverse playback," "play," or "fast forward" buttons are clicked multiple times, the PC viewer changes the playback speed. For example, clicking "play" or "reverse playback" once will play at the normal speed of 1x, while clicking it twice will play or reverse at a slower speed, such as 0.5x. Similarly, clicking "rewind" or "fast forward" once will play at 2x speed, clicking it twice will play at 4x speed, clicking it three times will play at 8x speed, and clicking it four times will play at 16x speed. The "Play / Reverse Playback" function adjusts the playback speed in the slower direction, while the "Fast Forward / Rewind" function adjusts the playback speed in the faster direction. This makes it easy to switch abruptly from high-speed playback to slow playback, or vice versa. Furthermore, by combining the speed adjustment function with buttons that already perform high-speed playback, such as "Fast Forward," users can intuitively understand the assignment, which is a good feature. As shown in an enlarged view in Figure 16(a), the driving speed display unit 67 displays the driving speed recorded by GPS.

[0255] This is the area for displaying degrees. The acceleration display unit 68 is the area that displays the recorded impact and acceleration values ​​in the forward / backward (X direction: e.g., red), left / right (Y direction: e.g., yellow-green), and up / down (Z direction: e.g., blue) directions. The latitude / longitude display unit 69 is the area that displays the latitude (N) and longitude (E) recorded by GPS. These driving speed, acceleration, and longitude / latitude are all information about the current location of the video displayed in display area 62. The acceleration sensor graph display unit 71 is the area that displays the acceleration sensor graph in time series. The recorded data is displayed as a graph with acceleration on the vertical axis and time on the horizontal axis. In this embodiment, the X-axis acceleration graph 71a, Y-axis acceleration graph 71b, and Z-axis acceleration graph 71c are displayed, and the display colors of the graphs are the same as the display colors in the acceleration display unit 68. This makes it easier to understand the correspondence between the two. When an area is clicked, the PC viewer moves the cursor 71d to the clicked location and displays the driving speed, acceleration, and latitude / longitude in each display unit, with the cursor 71d's position as the current location. When the play button is clicked, the PC viewer plays the video from the cursor 71d's position. The PC viewer retrieves various information stored in association with the video being played and displays it in the corresponding display unit.

[0256] Below the graph is a time display unit 71e. From left to right, the time display unit 71e shows the recording release time of the recorded data to be played back, the current time at the cursor position, and the recording end time. If there is an impact with acceleration exceeding the standard value, the time at which the testimony occurred is displayed on the graph as the event time 71f. On the right side of the graph are a + button 71g, a back button 71h, and a - button 71i. When the + button 71g is clicked, the PC viewer enlarges the acceleration sensor scale, and when the - button 71i is clicked, the PC viewer reduces the acceleration sensor scale. When the back button 71h is clicked, the PC viewer returns to the standard scale.

[0257] The playlist display unit 70 displays the name of the selected data. In Figure 12, the data name "2016 / 09 / 06 11:47:28 [48 minutes]" is displayed. In the case of continuous recording, the data name is a combination of the date and time the recording started and the recording time. In the case of event recording, the data name is the date and time the event occurred and the type of event that occurred. The types of events that occurred include "impact" and "sudden acceleration / sudden braking" based on the acceleration sensor, and "one-touch" based on the operation of the switch unit 28.

[0258] Display area 62 is the area where the recorded video is displayed. As described above, the drive recorder 10 in this form records omnidirectional video of 720 degrees, 360 degrees horizontally and 360 degrees vertically. Therefore, the PC viewer has the function of displaying, for example, a portion of the omnidirectional video in display area 62, or displaying the omnidirectional video as a single image. When displaying a portion of the video, the display area 62 can be changed to display video of a desired range in any direction (front, back, left, right, up, or down) by changing the display range, direction, etc. The changes to the display range, etc., are configured as follows.

[0259] For example, as shown in Figure 13(a), when a predetermined range in front is displayed, the user uses a pointing device such as a mouse to drag the left button at any position in the display area 62. When the PC viewer detects that such a left-button drag operation has been performed, it moves the displayed image in the display area 62 in the direction of the drag. For example, as shown by arrow 75 in Figure 13(a), if the user drags a predetermined distance to the right in the display area 62, the PC viewer moves the displayed image to the right by that distance, and the image that was outside the left edge of the display area 62 in Figure 13(a) is drawn in the display area 62, while the image that was displayed on the right side of the display area 62 in Figure 13(a) is outside the display area and is no longer displayed (Figure 13(b)). As a result, the image displayed in the display area 62 changes as if the gaze is rotating to the left, and in the example shown in the figure, the scenery to the left front is displayed.

[0260] By dragging, the displayed image rotates horizontally counterclockwise around the position of the camera unit 12 of the drive recorder 10, showing the view from directly to the left, then to the rear (inside the vehicle), then to the right, and finally returning to the original display direction shown in Figure 13(a) facing forward. By dragging in the opposite direction, to the left, the view seen while rotating clockwise is displayed in the display area 62. This shifting of the displayed image to the right / left is like stretching a 360-degree horizontal image horizontally like a panoramic photograph, and then moving the display area 62 left or right to display the image within the display area 62 (see Figure 20). In the case of a layout with multiple areas on the screen, such as the fourth set in Figure 11 and the second set in Figure 19, the movement process is performed separately for each area where an operation instruction is detected within the display area 62. Similarly, wherever "display area 62" is written below, in the case of a layout with multiple areas, the operation should be interpreted as "the area within the display area 62 where an operation instruction is detected."

[0261] The drag direction is not limited to horizontal; it can be moved in any direction within the display area 62, such as up, down, or diagonally, and the PC viewer changes the displayed image according to the direction of movement. The user can display and view the desired image by dragging the left mouse button and moving the pointer to the part they want to display.

[0262] When the mouse right-clicks while the pointer is within display area 62, the PC viewer displays the image display area menu shown in Figure 13(b). This screen display area menu is drawn, for example, overlaid on display area 62. This image display area menu has an "Image Status" item at the top that displays the current orientation of the image, and below it are three operation items: "Return to Normal," "Flip," and "Zoom In / Out." In the figure, "Image Status" displays "Forward Rotation," which is the state shown in Figure 13(a).

[0263] When "Restore to default" is clicked and selected, the PC viewer returns the inverted, enlarged, or reduced image to its initial display and displays the restored image in display area 62. "Invert" has three submenu items: "Invert horizontally," "Invert vertically," and "Invert front to back." When "Invert horizontally" is clicked, the PC viewer inverts the displayed image horizontally (see Figure 13(d)). When "Invert vertically" is clicked, the PC viewer inverts the displayed image vertically (see Figure 13(e)). When "Invert front to back" is clicked, the PC viewer inverts the front to back of the displayed image and displays an image rotated 180 degrees. For example, when the video of the front is displayed as shown in Figure 13(a), clicking "Invert front to back" will display the image of the interior of the car behind the dashcam as shown in Figure 13(f). "Enlarge / Reduce" has two submenu items: "Enlarge" and "Reduce." When "Zoom In" is clicked, the PC viewer displays the image enlarged by 200% from the center of the displayed image (see Figure 14(a)). When "Zoom Out" is clicked, the PC viewer displays the image reduced by 50% from the center of the display screen (see Figure 14(a)). By changing the viewing direction as needed in this way, the driving situation can be checked from all directions.

[0264] To play back recorded data, the user selects the desired video list from the playlist display unit 70 and executes the playback. In this configuration, the data is grouped into event recordings, continuous recordings, and history recordings, and the user selects one of these groups to play back. Therefore, the user clicks either the event recording tab 70a, the continuous recording tab 70b, or the history recording tab 70c. For example, Figure 15 shows the state when the event recording tab 70a is clicked.

[0265] When the Event Recording tab 70a is clicked, the PC viewer creates and displays a list of event recording data recorded on the memory card. The user selects the video data they want to view by clicking the checkbox 70d associated with that data name. When a checkbox 70d is clicked, the PC viewer displays a check mark "✓" next to it. Multiple data can be selected at once. When the Load button 70e is clicked, the PC viewer loads the selected recording data, displays the data name in the playlist, and displays the video in the display area 62. If multiple data are selected, the playlist lists multiple data names and displays the topmost video.

[0266] The video displayed in display area 62 along with the recording playback shall be a predetermined main image. The main image shall be the first set, an image facing the desired direction such as the front of the vehicle, and shall be a standard-sized image set as the initial display (see Figure 17(a), etc.). The standard size shall be, for example, a range of 120 degrees horizontally and 70 degrees vertically. Since this range corresponds to the field of view used in a normal dashcam, it shall be a familiar image to users of a normal dashcam, and they shall be able to obtain the same necessary information as with a normal dashcam. This main image shall show the entire windshield.

[0267] In this embodiment, when the drive recorder 10 is mounted on a vehicle, in the normal installation state with the camera unit 12 adjusted to the desired orientation, the first camera 26 faces directly forward. Therefore, assuming that the center of the image captured by the first camera 26 is facing directly forward, the first set crops a predetermined area to a standard size and displays it in the display area 62.

[0268] It is also preferable to provide a function of calculating the front position for display on a PC viewer from the installation angle obtained during installation angle correction by the acceleration sensor, and determining the standard position of the display image as the calculated front position. This assumes that the vertical direction relative to the acceleration sensor is parallel to the front of the camera. Then, based on the angle between the direction of gravity at the time of installation and the vertical direction of the acceleration sensor, an angle that aligns the direction of gravity to directly below is obtained, and it is determined that the direction in which the vertical direction of the acceleration sensor and the front of the camera are orthogonal to the direction where the direction of gravity is directly below is set as the center of the displayed image. This is advantageous because, for example, even if a user mistakenly installs the camera sideways instead of on the windshield, the front position can be detected based on the direction of gravity and displayed as the standard position.

[0269] Although a specific illustration is omitted, when the continuous recording tab 70b is clicked, the PC viewer creates and displays a list of continuous recording data stored in the memory card. The PC viewer acquires the recording data selected by the user, displays the data name in the playlist of the playlist list display section 70, and displays the video in the display area 62. When the trigger list display button 70f is clicked, the PC viewer displays an event trigger list 70h in the playlist of the playlist list display section 70 (see FIG. 16(b)). When an item in the trigger list 70h is clicked, the PC viewer jumps to the recorded event and plays the video. By this means, the video of the portion where an event occurred can be efficiently played back and the content can be checked.

[0270] Furthermore, the processing based on the playback button display unit 65 and the volume switching button 66 described above are also performed based on the playback button 72a on the menu bar. For example, as shown in Figure 16(d), when the playback button 72a on the menu bar is clicked, the PC viewer displays a pull-down list of menu items 72b as shown in the figure. When a desired item in the menu list 72b is clicked, the PC viewer performs the playback operation for that item. In addition, although not shown in detail, the system also has a function to display a pull-down menu of items that perform the above-mentioned processing based on the click of the buttons for "File," "View," and "Tools" on the menu bar, and to perform similar processing based on that menu. [A function that displays the driver and passengers' reactions along with the scenery outside the car on a single screen, with the scenery flowing smoothly.]

[0271] As mentioned above, at the start of playback, a predetermined reference image is displayed, and thereafter, the user can change the viewing direction, zoom in / out to change the field of view, etc., allowing them to view any image in any direction. For example, by zooming out to widen the field of view, the image can be viewed in front of or behind the reference image.

[0272] It is preferable to display the rearward-facing image captured by the second camera 27 by inverting the image or changing the viewing direction by 180 degrees horizontally. Such a display configuration would be as shown in Figure 17(b), for example, with the driver and the interior of the vehicle displayed in the central part 81 of the display area 62, and the scenery outside the vehicle displayed in the surrounding part 82. If further reduced, the entire 360-degree image would be displayed as a single screen, as shown in Figure 18, for example. Note that, as is clear from comparing Figure 17(b) and Figure 18, the subjects captured are different, and these figures are intended to help understand the image of the display configuration due to the difference in scale.

[0273] This display mode is good because it shows the outside scenery flowing from the center outwards to the left and right rear, creating an interesting image that is not normally seen. Simply looking at the standard image from the front, although this is the original function of a dashcam, shows only the scenery and vehicles in front, which is not very interesting and is not very engaging. However, with the above display mode, you can see scenery that you wouldn't normally see, which is good. For example, recently, travel programs on television have been showing footage of the inside of the car, such as the driver and passengers, filmed with a camera placed on the dashboard, but the footage and display only shows the driver and passengers, and the outside scenery is not captured, or if it is captured, it is only a small part visible through the rear window of the driver and passengers. With this mode, the driver and passengers in the front and rear seats are displayed in the central part 81, and the outside scenery on the left and right sides flows around the periphery, which is interesting. And it is good because it can simultaneously provide viewers with images of celebrities having fun inside the car and beautiful scenery outside.

[0274] Furthermore, in this display mode, the images displayed in the peripheral area 82 show not only the scenery to the left and right of the vehicle, but also a wide range of scenery to the left and right of the front of the vehicle, as captured by the first camera 26 and the second camera 27. Thus, a characteristic feature is that the front and rear parts are displayed within a single screen. Behind the user, the image captured by the second camera 27 is displayed behind the user, while the outside scenery captured by the first camera 26 and the second camera 27 slides sideways and flows around to the rear. This can be described as a view as if there were a virtual camera outside the vehicle, or a virtual viewpoint outside the vehicle, giving the impression that the vehicle has become transparent and is viewed from a distance. In this way, scenery that would not normally be visible can be seen. [Viewer's composition function]

[0275] As described above, in this embodiment, a 360-degree spherical image is created by stitching together two images captured by the first camera 26 and the second camera 27, respectively. The field of view of both cameras is set to 210 degrees horizontally when mounted and fixed in their normal positions, and the surrounding areas captured by each camera become overlapping areas where the same scenery, etc., is captured. When superimposing these overlapping areas, a gradient is applied for synthesis. That is, for example, as shown in the second area R2 in Figures 8(b) and (c), the display in the overlapping connecting area becomes lighter towards the periphery. For example, if the second area R2 is the area to be processed with a gradient, then, for example, the boundary with the first area R1 is set to 100% at 0% at the periphery, and the density in the intermediate area is gradually changed. Since the resolution also decreases towards the periphery, it is made less visible and the impact on the display is reduced. In addition, as described above, there is a risk that the same person or other object may be displayed as a separate object in the images from each camera, but by applying a gradient, even if they are displayed as separate objects, this is less noticeable. [Mask function, etc.]

[0276] The drive recorder 10 in this configuration, which captures and records a 360-degree view, also captures the appearance of the driver and passengers, as shown in Figures 17(b), 18(a), and 19. For example, while it is good to capture and record the scenery and the interior of the car, there is a desire to avoid being captured in the footage oneself. The PC viewer in this configuration is equipped with a masking function, and the masked area 62b is output in a display manner that is less visible than the normal display area 62a. The setting of the masked area 62b to be made less visible can be fixed, for example, or it can be set based on user specifications. In the case of a fixed setting, for example, it is good to set the masked area 62b to an area in the video corresponding to an area in the car interior where the approximate position is determined, such as near the driver's seat or near the passenger seat. Alternatively, the function to set an arbitrary masked area 62b based on user specifications can be used, for example, by keeping the display area 62 still with the person to be masked in it, and specifying the position to identify the area with a mouse or the like. When a designated mouse button is clicked, the PC viewer memorizes its position and sets the area inside the shape with the clicked position as the mask region 62b. When playing back the video, the PC viewer sets the area corresponding to the memorized clicked position in the video captured by the second camera 27 as the mask region and plays back the video with the corresponding area masked. It is preferable to have a function to set the mask region 62b by user specification, as this allows masking to be applied to any arbitrary area.

[0277] Displaying within the mask area 62b can be done in various ways, such as applying a mosaic effect, reducing the resolution, or filling it with a predetermined color. When filling it with color, it is best to adjust the transparency appropriately so that it is still faintly visible rather than completely filling it with a solid color.

[0278] It is preferable to have a function to automatically set the mask area 62b. The automatic setting function can be as follows, for example. For example, images of faces of people to be masked, such as users, can be registered in advance, and the system can recognize the registered people, such as users, inside the vehicle using image recognition, and set a predetermined area including their faces as the mask area. However, it is preferable to set it based on the movement speed and displacement speed within the image. For example, while the vehicle is moving, the relative movement speed of people and objects outside the vehicle is fast, while the movement speed of people inside the vehicle is slow. Also, seats and other installed objects inside the vehicle do not move. It is preferable to set the mask area for things within a certain speed range based on this difference in movement speed. In this way, no prior registration is required, masking can be done with simple processing without image recognition, and even if unregistered people are in the vehicle, masking can be done for passengers, making it versatile and desirable. [Specific Image Display Function]

[0279] As mentioned above, the PC viewer allows users to pause the video at any point, change the viewing direction, invert the image vertically, zoom in and out, and display any direction in any direction at a desired field of view, according to user input. While changing the viewing direction and field of view during playback can create interesting and engaging video, there is a risk of losing track of which direction the currently displayed video is facing. Therefore, it would be beneficial to include a function that allows for one-touch display of a specific direction. For example, clicking the "Restore to Default" item in the screen display area menu shown in Figure 13(b) resets the display area 62 to its initial display. Similarly, clicking a button or item located in a specific place, such as the menu bar or another arbitrary location, would allow for one-touch display of a specific direction, such as front, back, left, or right. Having such a function would be beneficial because it would allow for one-touch display of the desired direction, regardless of the current display direction. Furthermore, the specific direction should not be the front, back, left, or right directions centered on the dashcam, as mentioned above. For example, when displaying the rear view, it's better to display it diagonally behind rather than directly behind. Diagonally behind should be facing towards the driver's seat. This way, the situation inside the car is captured with the driver at the center, which is good. In addition to the masking function mentioned above, this is preferable for users who want to see themselves, as it displays the view from a self-centered perspective.

[0280] Furthermore, as mentioned above, the function is not limited to displaying a predetermined direction with a single touch. In addition to this function, or as an alternative to this function, it would be desirable to have a function that allows users to register the viewing area during playback in a bookmark-like manner, and then display the saved image with the same direction and angle of view with a single touch or other simple operation during subsequent playback. [A function that displays a specific direction or orientation so that it aligns with a specific location.] A dashcam that captures a full 360-degree image, as in this form, can widen the field of view as shown in Figure 18.

[0281] One of its features is the spherical display, as shown in the image. When a PC viewer displays the image as a sphere in this way, with the center of the circle representing the ground and the outer circumference representing the sky, it is advisable to store and associate positional information, for example, from a geomagnetic sensor, and then display the image so that north is at the top during playback.

[0282] In the embodiments described above, the standard display is set so that the vehicle's bonnet is in a specific position and the view ahead while driving is centered. In addition to this display mode, it is desirable to have a function that displays a specific direction (e.g., north) in a specific position (e.g., top), as described above. Displaying north at the top, for example, is preferable because it improves matching with the map. For example, when displaying a map with North Head and displaying footage taken by a dashcam at a corresponding location on the map side by side, if the footage is also displayed with north at the top, the upper part of the footage will be north, making it easy to match buildings and other landmarks in the footage with buildings and other landmarks on the map. Thus, setting a specific direction to "north" is particularly convenient when viewing it together with a map. Furthermore, it is beneficial because it makes it easy to record situation reports, such as "collision with a vehicle approaching from the south," when creating an accident report. It is also beneficial because it makes it easier to correlate footage taken by multiple dashcams. Whether using a circular display or a 360-degree panoramic view, it's best to ensure that the north side is positioned correctly.

[0283] Furthermore, the direction you choose to face is not limited to compass directions; for example, you could choose a destination or a specific landmark. However, setting it to a direction, especially "north," is preferable because it allows for better matching with the map.

[0284] Furthermore, when a specific direction such as "North" is displayed at the top, it is beneficial not only for its good matching with the map, but also because, for example, the vehicle's direction of travel can be easily inferred from the flow of images during video playback. For example, if "North" is displayed at the top and all directions are displayed on one screen as in Figure 18, when traveling north, the scenery outside displayed in the surrounding area R11 on both sides of the circle will flow from top to bottom during playback. On the other hand, when traveling south, it will flow from bottom to top, the opposite of the above, and in the east-west direction, the upper and lower parts of the circle will flow horizontally. In this way, it is good because it is easy to understand which direction the vehicle is traveling from the flow of images. Also, the direction displayed at the top is not limited to "North"; by displaying another specific direction at the top, the direction of travel of the vehicle can be determined from the flow of images.

[0285] For example, with sports cameras and action cameras that capture a full 360-degree view, it's best to display the subject, such as a child, in the center. However, with dashcams, if the primary purpose is to record accidents, the subject becomes non-unique because it's impossible to predict where the danger will come from—such as a rear-end collision with a vehicle in front, or a collision from the side or rear. Therefore, focusing on direction and assigning a specific direction (e.g., "north") to a specific position (e.g., "up") is beneficial because it provides various advantages, as mentioned above, such as "the direction of what's being filmed is immediately clear," "the direction of travel of the vehicle can be easily inferred from the flow of images during video playback," "the matching with maps improves," and "it becomes easier to correlate footage from multiple dashcams or footage previously filmed at the same location." [A variation of the spherical representation]

[0286] For example, when a spherical display is used as shown in Figure 18, a region without an image is created outside the circular display area 62a where the image is displayed within the display area 62. Therefore, the PC viewer should provide an additional information display unit 78 in this region without an image, and display various information such as the direction of travel of the vehicle, road information such as the name of the road being traveled, and pedestrian information on this additional information display unit 78 (see Figure 18(b)). In Figure 18(b), the additional information display unit 78 is placed in the lower left, but the placement position is arbitrary, and multiple units may be placed. Placing multiple units is beneficial because it allows for the display of more information.

[0287] For example, the PC viewer performs image recognition processing on the displayed image to extract people. If people are extracted, the PC viewer displays text information indicating the presence of people, such as "There was a person." In addition, it is advisable to draw marks such as arrows on the parts of people displayed within the display area 62a of the display area 62 to make their location clearer. This is beneficial because it makes it easy to confirm, for example, whether a person was approaching or moving away from a vehicle. Furthermore, instead of displaying all people when they are recognized, it is advisable to use image recognition or other personal authentication to detect specific people and then display information that identifies the detected person, such as their name.

[0288] In this case, it would be good to display people outside the vehicle and people inside the vehicle separately. For example, if a person is outside the vehicle, their presence should be displayed to determine whether there is a risk of contact, etc. If a person is inside the vehicle, they should be identified as an acquaintance, and that information should be reported. [Multiple screen display function]

[0289] In the embodiments described above, the display area 62 displays one image based on a single viewpoint, such as the entire 360-degree image or an image cropped from it. However, the present invention is not limited to this, and it is preferable to display multiple different images simultaneously. This allows users to view images from multiple different directions, eliminating blind spots and providing a more engaging viewing experience.

[0290] For multiple images from different directions, it is preferable to display the forward scenery on the first image display unit 76 and the interior of the vehicle on the second image display unit 77, as shown in Figure 19. This is beneficial because it allows for a linked confirmation of the driver's and passengers' reactions when they see the forward scenery. For example, if there is footage of the driver or passengers being impressed or happy when they see a beautiful landscape, the correlation with the scenery becomes clear, which is helpful for recalling the itinerary of the road trip. The first image display unit 76 and the second image display unit 77 may be the same size as shown in the figure, but it is preferable to have a difference in size to create a main image display unit and a sub-image display unit. Varying the sizes of the main and sub displays makes the image displayed on the main image display unit easier to see, which is beneficial. When dividing into main and sub in this way, the main image should be a frontal image showing the view ahead, and the sub-image should be footage of the interior of the vehicle showing the driver, etc. This allocation is preferable for the dashcam to perform its intended function. The sub-image may also be, for example, the left or right side of the vehicle. This method is good because it allows us to identify accidents such as those caused by collisions from the side. [Automatic editing and playback function]

[0291] When the entire panoramic image is displayed, it appears as a circular image, as shown in Figure 18. The PC viewer has a function to enlarge a portion of the image and project it onto a flat surface for display. As mentioned above, the PC viewer allows users to zoom in and out of the panoramic image and move the display range based on mouse operations such as dragging and button operations while the image is playing. This user operation is cumbersome and inconvenient. Therefore, it would be beneficial to have a function that automatically extracts and displays an appropriate portion of the overall image without user intervention. It would also be beneficial to have a function that automatically changes the angle and field of view displayed on the screen during playback of the panoramic image.

[0292] For example, it would be good to have a function that automatically changes the visible range (viewport) in the video in conjunction with vehicle information. Changing the range can be done through actions such as zooming in, zooming out, and panning.

[0293] For example, while driving, the viewer can enlarge and display the area directly ahead. If there are viewpoints to admire nearby, such as Mount Fuji, the viewport can automatically pan towards those viewpoints during playback. This function can, for instance, store the location information of the viewpoint, determine the direction of the viewpoint from the vehicle's position during playback, automatically move the cropping position, and pan towards that direction during playback.

[0294] Furthermore, for example, when driving on a highway, the video captured by the first camera 26 continuously displays the vehicle in front, and the scenery remains unchanged, especially in sections of the highway where sound barriers are installed on both sides or inside tunnels. Continuously watching such video in the same direction becomes boring and is generally not something one wants to watch, creating a problem where even if continuous recording is performed, there is little incentive to play it back. Therefore, it would be good to have a function that cuts out such unnecessary parts, skips them, and plays back only the parts that are likely to be interesting. For example, if the location where the video was taken is a highway according to the map information, it would be good to skip and play back only the part after exiting the highway at an interchange. Moreover, this should not be limited to highways; it would be good to also skip within registered areas such as around one's home.

[0295] Furthermore, if the vehicle stops while driving, it will continue recording the same video while stopped. This means that during the pause, the playback video may display the same image like a still image, which is undesirable. Therefore, it would be acceptable to skip the display while stopped, as is done on highways, and resume playback from the point when driving resumes. Alternatively, if the vehicle comes to a stop while driving, it would be better to automatically rotate the display as if the camera were turning its head from side to side around the sky. When stopping, drivers often want to check their surroundings, and this would simulate that checking action. The rotation also makes it clear that the vehicle has stopped, which is beneficial.

[0296] This approach is beneficial because it automatically plays back interesting scenery, providing an incentive to review recorded footage. It would also be good to include a function to record the played-back footage. Furthermore, it would be beneficial to include a function to record the viewport footage as a separate video file. This would allow the viewport information to be exported to a separate file and uploaded to the internet for public sharing, which is a good feature.

[0297] Furthermore, there are television programs that switch between, for example, footage of the scenery inside a train, overhead shots taken from above using drones, and views of the outside from inside the train. As mentioned above, if it were possible to automatically play back interesting scenery from the footage of one's own journey, videos like the television programs described above could be created and played back, which would be great to watch after a trip.

[0298] For example, with sports cameras and action cameras that capture a full 360-degree view, the photographer holds the camera by hand and operates it, so one lens is pointed towards the subject they want to photograph. Therefore, even if the recorded footage is played back as is, it is the desired image, and there are relatively few problems even if the viewport is fixed and editing is not required. In contrast, dashcams are mounted in the vehicle and record continuously, so there is a high risk of playback including unnecessary footage that is not of interest or footage that is not facing the desired direction, which is likely to cause the aforementioned problems. This form solves this problem. [Drive recorder with display]

[0299] It is desirable to equip the drive recorder with a display device that has the functions of the PC viewer described above. In the embodiment described above, the drive recorder does not have a display unit, and the video captured by the camera is recorded on the memory card 23 and viewed on a personal computer's PC viewer. However, as in this embodiment, equipping the drive recorder with a display device allows the video to be viewed in real time, which is desirable. It is also desirable to be able to move, enlarge / reduce, etc., the area of ​​the 360-degree image that is cropped and displayed by the PC viewer.

[0300] For example, displaying images of the sides and rear of the vehicle while driving is beneficial because the driver can see the surroundings of the vehicle simply by shifting their gaze slightly towards the display device while still looking straight ahead. Also, for example, displaying images of the interior of the vehicle captured by the second camera 27 on the display device is beneficial because the driver can check on things like infants or children in the back seat, or other passengers, without having to turn around. In particular, the area behind the driver's seat is difficult for the driver to see directly, but for example, by mounting the drive recorder 10 in the center and upper part of the windshield, the area behind the driver's seat can be clearly captured and displayed, which is beneficial.

[0301] Furthermore, in cases where a zoom function like that of a PC viewer is not available, for example, if the images captured by either the first camera 26 or the second camera 27, or both, are displayed in a circular shape, it is advisable to provide an additional information display unit 78 in the area outside the circle, as shown in Figure 18(b), to display various types of information. [Dashcam with a function to notify the situation inside the vehicle]

[0302] It would be beneficial to have a function that uses the video footage from the second camera 27 to determine the condition of passengers and provide notifications. For example, it would be good to determine if an infant or child sleeping in the back seat is about to wake up or is sleeping soundly, and provide notifications if they seem about to wake up or become fussy. This would eliminate the need to periodically check the back seat, allowing the driver to concentrate more on driving.

[0303] Furthermore, it would be beneficial to have a function that extracts people from the video footage captured by the second camera 27 using image recognition processing, counts the number of passengers, and notifies the system. This is preferable because it allows for immediate confirmation of whether everyone is on board. This is especially beneficial because it ensures that people behind the driver's seat, which is particularly difficult to see, are not overlooked and can be identified reliably and smoothly. This is particularly desirable for vehicles with a large number of passengers, such as buses, where the number of passengers can be quickly confirmed.

[0304] In this way, it would be good to have a function that focuses on and counts people inside the vehicle, recognizes their status, etc., and notifies the results by display or sound. Whether or not someone is inside the vehicle can be easily distinguished by, for example, performing person recognition processing within the area corresponding to the inside of the vehicle, or by determining the degree of movement (for example, if the vehicle is moving, those with less movement are inside the vehicle). [A dashcam with only one of its two cameras capable of capturing a hemispherical region.]

[0305] In the embodiments described above, the first camera 26 and the second camera 27 are both cameras that capture an area of ​​hemisphere or larger, but the present invention is not limited to this. In one invention, one of the two cameras may be a third camera that captures an area of ​​hemisphere or larger, and the other may be a fourth camera that captures an area smaller than the hemisphere, and the two cameras may be configured to have different shooting areas. The third camera may be, for example, a hemispherical camera with a full 180 degrees, and the fourth camera may be a wide-angle camera used in conventional dashcams, for example, a wide-angle camera with a horizontal of 120 degrees and a vertical of 70 degrees.

[0306] The third camera, for example, when the dashcam is mounted and fixed to the roof of the vehicle, has its lens facing downwards and captures a 360-degree horizontal and 180-degree vertical area. The fourth camera, when the dashcam is mounted on the vehicle, captures the area in front of the vehicle.

[0307] While specific diagrams are omitted, it is preferable to place the third and fourth cameras in a single housing. When placing them in a single housing, for example, a rectangular box-shaped body with a hemispherical section protruding from one side.

[0308] The device has a rectangular housing, with a third camera mounted in the hemispherical section and a fourth camera mounted in the rectangular section. The lens of the fourth camera is positioned at the vertex of the hemispherical section, and the lens of the third camera is positioned to be exposed on one side adjacent to the hemispherical section. When the drive recorder is mounted on the roof of the vehicle via a mounting member, the hemispherical section is positioned downwards, and the side with the lens of the fourth camera faces directly forward.

[0309] For example, the hemispherical camera that constitutes the third camera captures the lower half of the hemisphere, but the image of distant objects outside the vehicle is too small, making it difficult to understand the situation, for example, in the event of an accident. Also, traffic lights are located diagonally above the vehicle, so they are often not included in the shooting range. Therefore, in this configuration, a fourth camera that constitutes the forward camera is provided to enable shooting of areas in front of the vehicle that are difficult or impossible to capture with the third camera.

[0310] It would be good to switch the operation of the two cameras depending on the situation. For example, while driving, the third and fourth cameras can be operated to capture the hemispherical area in front of and below the vehicle, and the footage from both cameras can be recorded simultaneously to the memory card. In this way, for example, in the event of an accident, if the collision occurs on the front side of the vehicle, a clear and sharp image can be recorded based on the footage from the fourth camera, just like with a conventional dashcam. If the collision occurs on the side or rear of the vehicle, which is a blind spot for the fourth camera, a clear and sharp image can be recorded based on the footage from the third camera.

[0311] Furthermore, for example, when parked, only the third camera is activated for security monitoring. While 360-degree dashcams operate both cameras even when parked, this configuration allows only the third camera to operate, which reduces power consumption and enables longer recording and security monitoring, thus improving performance. Parking is detected based on criteria such as engine off, no one in the driver's seat, the handbrake being engaged, speed at 0 km / h, and current location being the home parking lot.

[0312] Furthermore, while driving, it is acceptable to operate only the fourth camera, but it is preferable to use both the third and fourth cameras in combination, as this allows for recording of the vehicle's surroundings, especially collisions from the side or rear. The operation of both cameras can be switched as follows: for example, while traveling on a highway or to a destination, the fourth camera can be used to record the view ahead as a precaution against accidents. As you approach your destination, the surrounding scenery is often beautiful, so the third camera can also be activated to record the scenery.

[0313] Alternatively, the third camera may be used for monitoring while parked, and the fourth camera may be used to capture the view ahead while driving; in other words, only one of the cameras may be operated at a time. This usage configuration allows switching between forward-focused video and video focused on the area around the vehicle, depending on the purpose.

[0314] Sending real-time video from one of the cameras to a smartphone or server is beneficial for real-time monitoring. While it's possible to fix the transmission to one camera, a good approach would be to use the fourth camera's footage while driving and the third camera's footage while parked.

[0315] Furthermore, the idea of ​​using a single camera for security monitoring while parked to extend the operating time can also be applied to, for example, a drive recorder that captures a 360-degree view. In this case, for example, a wide-angle camera could be installed in place of the switch unit 28 of the drive recorder 10 to create a three-camera system, and only the wide-angle camera could be configured to operate while the vehicle is parked. [Dashcam with one camera]

[0316] In the embodiments described above, multiple cameras were combined to capture an area wider than the hemisphere, but in this embodiment, a single camera is used to capture an area wider than the hemisphere. A 180-degree hemispherical camera is used and is attached and fixed to the ceiling to capture the lower part When attempting to photograph a hemisphere, the following problems arise.

[0317] Resolution is best in the center of the captured circular image and lowest at the edges. Therefore, for example, in parking surveillance, it is desirable that one camera can capture 360 ​​degrees horizontally, but the forward scenery, such as the vehicle in front, is located at the edge of the captured circular image, resulting in poor resolution. Furthermore, if the camera is attached to the ceiling, for example, it is possible to capture the vehicle in front and the driver in a full 180 degrees, but in addition to the low resolution mentioned above, it is not possible to capture traffic lights located above the vehicle. In particular, capturing traffic lights is essential in order to identify the route traveled and the color of surrounding traffic lights in the event of an accident, and the inability to capture them presents a problem.

[0318] In this configuration, for example, a 240-degree panoramic camera is used, and one of these cameras is mounted facing downwards to capture the lower hemisphere and the area diagonally above it, creating a dashcam. This allows the camera to capture not only the vehicle in front and the driver and passengers inside, but also traffic lights.

[0319] If we assume an angle of 210 degrees, there is a risk that the traffic lights will not be photographed, so the lower limit is 220 degrees. On the other hand, while a larger angle ensures that the traffic lights can be photographed, a larger angle means that more area is captured within the same circle, resulting in smaller objects being photographed. If the traffic lights are not photographed at a certain size, the colors of the signals cannot be distinguished, rendering the recording meaningless. Therefore, 260 degrees is the upper limit, ensuring a suitable size for discrimination. A more preferable range is 230 to 240 degrees, and in this embodiment, we set it to 240 degrees.

[0320] Furthermore, this configuration incorporates a microwave sensor and LTE communication capabilities. The device is activated when the microwave sensor detects approaching a vehicle. In other words, to conserve the vehicle's battery, the CPU, camera, and LTE are kept in sleep mode during standby. When the microwave sensor detects movement, the device is activated from sleep mode. Since activation takes 5 to 10 seconds, the device is activated by the microwave sensor, and when the accelerometer or door open sensor detects movement, images are transmitted via LTE to notify the user carrying a smartphone.

[0321] Since microwave sensors react to all moving objects, in this configuration, notifications should be based on accelerometer or door open sensor detection to suppress frequent notifications. It would be beneficial to include a mode setting that sends real-time video to a smartphone, allowing users in remote locations to view it on their phones. [Other features] The camera body and GPS should be separate units, and the vehicle should have a GPS tracking function that allows tracking even if the camera is destroyed or stolen. In each of the embodiments described above, the drive recorder should preferably have a function to automatically upload video footage taken around a mobile speed camera or the like to a server. It would be good to have a feature that connects the dashcam to an in-car device such as a car navigation system, and displays the video captured by the camera on the car navigation system.

[0322] In the embodiments described above, the drive recorder equipped with two cameras was configured to mount the two cameras in a single housing, but the present invention is not limited to this, and the cameras may be mounted in separate housings. In that case, it is preferable to mount them to the vehicle with a single common mounting member. Furthermore, the two cameras provided in separate housings may be mounted separately

[0323] While it is possible to mount the two cameras to the vehicle using mounting components and connect them via wired or wireless communication using a cable, it is preferable to mount them to the vehicle using a single common mounting component to achieve the desired positional relationship between the two cameras. Furthermore, it is even more preferable to implement them in a single housing with the desired positional relationship in advance, as in the embodiment described above. [Application to ADAS (Advanced Driver-Assistance Systems)]

[0324] When using video footage captured by a 360-degree drive recorder 10, or video footage captured by a 360-degree camera, in ADAS processing, the following challenges arise. For example, when used for lane departure warning, there are two 360-degree videos, so it is necessary to identify which lane is the one to be prevented from deviating from. Also, with a 360-degree camera, not only vehicles and traffic lights in front but also vehicles and traffic lights to the sides and behind are included in the 360-degree video, so it is necessary to identify the target ADAS area, for example, which is the traffic light in front.

[0325] For example, to ensure that the position of the image is fixed, the camera is designed to be fixed in the same way as the drive recorder 10, so that its orientation cannot be changed. Then, when the camera is mounted on the vehicle, the part that you want to use for ADAS is set to a location that does not overlap with the joints of multiple cameras.

[0326] Another configuration involves not fixing the camera but allowing its direction to be adjusted. From the moving parts (parts with optical flow) and stationary parts such as pillars in the video, the areas of the windshield and the passenger compartment are estimated, and the area used for ADAS is extracted from the windshield area. Alternatively, an area used for detecting user drowsiness, distraction, etc., may be extracted from the passenger compartment area. Also, with a dashcam, you should point the area with the highest resolution (for example, the center) straight ahead, but it's better to point it in the direction of the white lines, for example. [Mounted on the outside of the vehicle]

[0327] In the embodiment described above, the camera is installed inside the vehicle cabin, but it is also preferable to have the following configuration, either by installing it inside the vehicle cabin or by not installing it inside the vehicle cabin: It is preferable to have a hemispherical camera that photographs the outside of the vehicle (preferably a camera capable of photographing an area of ​​more than 180 degrees all around, especially a camera capable of photographing more than 210 degrees all around).

[0328] It is particularly good to install the camera facing outwards from the side of the vehicle, or facing downwards from the side of the vehicle. For example, it is good to install such a camera on the side mirror so that it captures the downwards from the underside of the side mirror. It is especially good to have such cameras on both the left and right sides of the vehicle.

[0329] Furthermore, the installation location is not limited to this; for example, it is good to install such cameras at at least one of the four corners (front right, front left, rear right, rear left) when viewing the vehicle from above (especially the front left is preferable) (it is especially good to install them at all four corners). In particular, it is good to install them in the area where the front and side of the vehicle body meet, so as to capture the outside from the vehicle side. In this case, the shooting direction of the center of the camera should be directed outward to the side relative to the straight-ahead direction, at an angle of more than 45 degrees. In other words, it is good to install them so that the area of ​​the captured image is larger on the sides than on the front.

[0330] These cameras allow drivers to more easily check than before whether their vehicle will run onto a curb, fall into a ditch, fall into a ravine, or hit a guardrail. They are particularly effective when driving on narrow roads such as mountain roads, when avoiding oncoming traffic or stopping, or when parking as far to the left as possible.

[0331] It is especially important to install the camera so that the area around the tires is included in the field of view. The small mirror, typically located below the left side mirror, should be positioned to include the area visible from the driver's seat. These small mirrors are often small and difficult to see, and are almost completely invisible at night, but this solution can address these issues.

[0332] Furthermore, as mentioned above, by installing cameras at the front or rear of the vehicle, such as at the four corners, when exiting onto the roadway from an area enclosed by a wall or similar structure on one side (or especially both sides), it becomes possible to easily check a wide area with fewer cameras, taking into account the situation of bicycles, pedestrians, etc. approaching from the left and right.

[0333] Furthermore, it would be beneficial to include a function that allows the user to change the display range of the 360-degree camera. In particular, it would be beneficial to include a function that magnifies the area where a touch is detected within the 360-degree camera image displayed on the screen. Specifically, it would be good to move the touched location to the center of the display area on the screen and draw it there.

[0334] Furthermore, although the panoramic camera was fixed in the embodiment described above, a mechanism may be provided to change the shooting direction of the panoramic camera based on user operation. For example, a remotely controllable motorized panoramic head could be attached to the vehicle, the camera could be fixed to the panoramic head, and the shooting direction could be changed by remotely controlling the panoramic head.

[0335] The switch unit 28 is designed to detect three operations: "double press," "long press," and "short press," and perform the corresponding processing. However, it would be better to assign the functions of "double press," "long press," and "short press" to different switches. For example, as described above, the switch unit 28 is provided at the bottom of the camera unit 12, and similar switches are also provided on the left and right sides, with the right switch assigned to the "double press" function and the left switch assigned to the "long press" function. The drive recorder 10 described in the embodiment is a system that can improve the user experience compared to conventional drive recorders 10.

[0336] In this embodiment, a lamp is mounted on the switch unit 28 so that the surface of the switch unit 28 emits light. However, instead, as shown in Figure 23, the indicator 1001 may be provided on a side of the drive recorder 10 that is not the side with the first camera 26, and is not the side opposite to the side with the first camera 26.

[0337] Furthermore, it is preferable to provide a portion on the side to prevent light from the indicator 1001 from leaking to the side with the first camera 26. Light leaking outwards from the front (first camera 26 side) is undesirable as it could obstruct traffic. Attaching it to the inside (second camera 27 side) or bottom (switch section 28 side) has been done in previous products. Attaching it to the side, as in the system shown in Figure 23, is preferable. It is especially preferable to install it in a position on the side that is visible but not easily seen. Also, to prevent light leakage from the front, which faces the outside of the vehicle, it is preferable to attach a light leakage prevention member such as a cover or protrusion to the part of the indicator 1001 that faces the front. This system is particularly suitable for vehicles carrying passengers, such as buses, trucks, and trains. The light should be able to illuminate in a way that does not overly attract the attention of passengers and also softens the driver's awareness of being monitored. In particular, it is preferable to display the status in a way that makes it clear that recording is taking place, but is not apparent unless one looks closely. This system is especially suitable for installation near the driver's seat. Even if the drive recorder is not a full-spherical type as shown in Figure 23, but rather a hemispherical drive recorder that records the front view without a second camera, the indicator 1001 should be placed in the same position. Furthermore, even if the first camera is positioned not at the position shown in Figure 23, but at the lower end position of the switch section 28, and a hemispherical camera is installed with the optical axis of the camera centered downwards, the indicator 1001 should be placed in the same position.

[0338] Furthermore, for example, by modifying the above-described embodiment, a system is provided that includes a drive recorder 10 equipped with a function to record video captured by a first camera 26 installed in the vehicle, wherein the bracket 17 between the main body of the drive recorder 10 and the part attached to the vehicle is equipped with a connector for receiving power from the vehicle and means for wirelessly supplying the received power to the main body 11, and the main body 11 is equipped with a configuration for receiving wireless power supply, and the bracket 17 is equipped with a light-emitting means on the side that faces the vehicle when the bracket 17 is fixed to the vehicle to indicate the power reception status from the vehicle. For example, the side indicated by reference numeral 17 of the bracket 19 in Figure 2(b) is further extended to the right, so that it extends beyond the right end of the main body 11 in Figure 1(a). In this case, the vehicle interior side of the bracket 19 will be exposed and visible from the left end of the main body 11 in Figure 1(b). It is preferable to provide an LED or the like, which is a light-emitting means, on this surface exposed to the vehicle interior. Furthermore, it is advisable to provide a connector on the upper side of the exposed bracket 19 that receives power from the vehicle. Alternatively, the connector can be omitted and the wiring can be directly routed. In this way, it is advisable to provide a power connector on the bracket side and a lamp on the bracket side to indicate whether power is being supplied. The lamp should be placed on the front side. This is particularly effective in solving the problem of not being able to tell if the drive recorder 10 is working due to the lack of a monitor, especially when the drive recorder 10 is a system without a monitor.

[0339] In this embodiment, a memory card slot 22 mounted inside the main body case 13 is exposed on one short side of the first case 14 via a notched window 14c, and a memory card 23 is detachably inserted into this memory card slot 22. However, the following configuration may also be used.

[0340] Regarding a drive recorder 10 equipped with a function to record video captured by a first camera 26 installed in a vehicle, the slot for inserting the recording medium for recording video is located on the side of the drive recorder 10 that faces the interior of the vehicle when it is installed, indicated by the arrow of reference numeral 13 in Figure 1. It is preferable to provide an access lamp near the slot on this interior side to indicate that the recording medium is being accessed. Thus, the slot is located on the front side of the vehicle interior, and the lamp indicating that writing to the recording medium is in progress is located around the slot on the front side. The lamp is preferably located inside the cover of the slot into which the recording medium is inserted. This way, it is not dazzling when the cover is closed, and visible when it is open. For example, an SD card slot is located on the front side, and the lamp indicating that writing to the SD card is in progress is preferably located around the SD card slot on the front side. The lamp is preferably located inside the SD card slot cover.

[0341] Furthermore, the drive recorder 10, which is equipped with a function to record video captured by the first camera 26 installed in the vehicle, has a motion detection recording function that records the video when it detects motion, The system includes a time-lapse recording function that records the aforementioned video for a predetermined period of time at regular time intervals, and it is preferable that the motion detection recording function and the time-lapse function operate simultaneously.

[0342] The video in the time-lapse recording function is a still image, and this predetermined time is one frame, while the video in the motion detection function is preferably a video. For example, the time-lapse and motion detection functions should be operated simultaneously, with the time-lapse recording being a still image and the motion detection recording being a video.

[0343] While time-lapse recording and motion detection are processed separately as events, it's best to record each video in the same folder without distinguishing between them. For example, time-lapse and motion detection can be performed simultaneously, and while they are detected separately as events, it's best to record them in the same folder without distinguishing between them.

[0344] Furthermore, the drive recorder 10 should have an HDR function. It should also have a function to record video in a way that allows for the distinction between video recorded with HDR and video recorded without HDR. Various HDR formats can be used. For example, it may include something called WDR. DOL-HDR is particularly good. It should also have a function to select the type of HDR automatically or through user settings, and a function to record the selected type of HDR in association with the video being recorded. It should record information in association with the video that distinguishes whether the video was recorded with HDR on or off. In particular, it should record information in association with the video that identifies whether the video was recorded with DOL-HDR on or off. It should also have a function for the user to set whether or not to use DOL-HDR.

[0345] The first camera 26 captures circular fisheye images, but it would be good to have a function to disable DOL-HDR. In particular, at night, it would be good to have a function to use Long Exposure and disable DOL-HDR.

[0346] The first camera 26 should have a function to extract both short-exposure and long-exposure images and record both onto a recording medium. The viewer should have a function to perform what is known as "developing" using both images individually or in combination.

[0347] The image sensor of the first camera 26 of the drive recorder 10 should have a function to binn multiple pixels into a single pixel. It should also have a function to allow the user to set whether or not to binn, and a function to perform binning when binning is enabled. In particular, when binning is enabled by the user, it should have a function to prioritize the user's setting and decide whether or not to perform binning, regardless of other binning-related functions. The setting for whether or not to enable binning in the dashcam 10 should be configured as a separate setting from the recording resolution setting.

[0348] The drive recorder 10 should have a function to store information indicating whether or not binning is being performed, associated with the video data. For example, it should have a function to store information indicating whether or not binning is being performed, associated with each video frame.

[0349] The first camera 26 should have a function to bin multiple pixels together into a single pixel, and a function to determine whether or not to perform binning depending on the remaining capacity of the memory card 23 for recording the video from the first camera 26, or the total capacity.

[0350] It would be good to have a function that determines whether it is currently daytime or nighttime, and that does not binning during the day and binning during the night. It would also be good to have a function that does not binning even at night if the headlights are on.

[0351] The system should include a front-facing first camera 26 for photographing the area in front of the vehicle and a rear-facing first camera 26 for photographing the area behind the vehicle. The front-facing first camera 26 should not binn even at night, while the rear-facing first camera 26 should have a binning function. The front-facing first camera 26 should not binn at night, while the rear-facing first camera 26 should have a function to binn at night.

[0352] It would be good to have a function to detect whether or not you are inside a tunnel, and if you are inside a tunnel, a function to perform binning. When you are inside a tunnel, even if there is a function to determine whether or not to perform binning, or if these functions have determined that binning should not be performed, it would be good to perform binning.

[0353] The drive recorder 10 should have a function to warn the driver about forgetting to turn on the headlights, and it would be good to have a function to control the system so that the headlight-on-forgetting-forget-turn-on warning is not issued more than once a day. Alternatively, it would be good to have a function to control the system so that the headlight-on-forgetting-forget-turn-on warning is issued only once per drive. It would be good to be able to set which of these functions to use, and whether to use an AND condition or an OR condition for both.

[0354] In this embodiment, the example of mounting the drive recorder 10 on the windshield was described, but it is also possible to mount it on the rear window. Furthermore, it is desirable to have multiple drive recorders 10 in one vehicle and to have a function to receive and display the video from the first drive recorder 10 on a second drive recorder 10 that is different from the first drive recorder 10. Alternatively, for example, a 360° drive recorder that shoots circular panoramic video without a monitor may be installed on the rear, and a regular drive recorder with a monitor may be installed on the front. In this way, the video from the rear 360° drive recorder can be viewed on the monitor of the regular front drive recorder.

[0355] A drive recorder 10 has a function to convert a circular fisheye image captured by the first camera 26 into an image in another coordinate system and display it on a display means, and it is preferable that the drive recorder 10 also has a function to receive a circular fisheye image captured by another drive recorder 10 using wireless communication, convert the received image into an image in the other coordinate system and display it on a display means.

[0356] The system includes a drive recorder 10 equipped with a function to record video captured by a first camera 26 installed in the vehicle, wherein the first camera 26 captures a circular fisheye image, transmits the captured circular fisheye image to a smartphone, and the smartphone has a function to convert the circular fisheye image into an image in another coordinate system and display it. For example, the drive recorder 10 sends the circular fisheye image to the smartphone, and the smartphone can select from several types of view modes such as "panorama," "2-split," "4-split," and "cropped" to play it back in various views.

[0357] The system includes a drive recorder 10 equipped with a function to record video footage captured by a first camera 26 installed in the vehicle, and it is preferable that the system also includes a function to generate and record video data in which a predetermined area outside the circumference of a circular fisheye image captured by the first camera 26 is filled with a single color.

[0358] When recording a circular fisheye image, it is desirable to have a function that generates and records image data in which the area outside a predetermined circumference is filled with a single color (masked). This reduces the amount of image data and prevents the reproduction of unwanted reflections, such as reflections outside the circumference. Even if physical measures are taken inside the lens barrel, etc., faint brown rings or other reflections may appear around the edge of the circular image area, but this method prevents such reflections from being recorded in the image. The predetermined circumference may be the range in which the circular fisheye image is formed on the sensor, but it is preferable to set it to a range inside this range by a predetermined width. For example, when recording a circular fisheye image, it is desirable to have a function that generates and records image data in which the area slightly inside the circumference is filled with a single color (masked).

[0359] The system includes a drive recorder 10 equipped with a function to record video footage captured by a first camera 26 installed in the vehicle, wherein the first camera 26 has a rectangular imaging area and is equipped with a function to record video data of a square area within the rectangular imaging area, the vertical width of which is greater than the diameter of the circumference of the circular fisheye image captured by the first camera 26 by a predetermined range. It is preferable to include a selection means for selecting whether to record the image of the rectangular imaging area captured by the first camera 26 or to record the image of the square area.

[0360] A viewer for playing back a rectangular or square area of ​​video, including a circular fisheye image, recorded by a drive recorder 10, wherein when playing back the circular fisheye image, the circular fisheye image is played back within a predetermined circumference, and the area outside the predetermined circumference is filled with black.

[0361] A viewer for playing back video of a square area recorded by a drive recorder 10 may include a function to play back the video with black rectangular areas added to the left and right of the square area.

[0362] When recording a circular fisheye image formed on a rectangular image sensor area, it is desirable to have a function that records only the image data of a square area whose vertical width is slightly (within a few tens of pixels) larger than the diameter of the circumference.

[0363] A video viewer should have a function that adds black areas to the left and right of the area outside the circumference, so that the video inside the circumference is centered within the long rectangular area in the horizontal direction.

[0364] It would be beneficial to have a function that allows the user to set whether to record using the above configuration or within the rectangular area of ​​the image sensor, and then perform recording according to that setting. It would also be beneficial to have a function that records which of these two methods was selected for recording the video. Recording should be done in a square or rectangular area, but during playback, it would be good to have a function that masks the area outside the circular region with a single color.

[0365] The system includes a first camera 26, the first camera 26 which images a circular fisheye image into a non-square image sensor area, the imaging means of the first camera 26 which has a function to output an image of a cropped area, and the system is equipped with a means to perform precise alignment so that the entire diameter of the exercise fisheye image fits within the short side of the image sensor area, while the system is equipped with a means to fix the image in the long side of the image sensor area with less precise alignment than in the short side, and it is preferable to actually measure the range of the exercise fisheye image in the long side that is imaged in the image sensor area (for example, by measuring with the image output in All-pxiel scan mode) and perform a process to output an image cropped with that range as one side (for example, output in Window Cropping Mode).

[0366] This eliminates the need for precise longitudinal alignment during assembly. For example, using Sony's IMX415 CMOS image sensor and setting its Readout Mode to Window cropping mode would be a good approach.

[0367] The system includes a first camera 26, the first camera 26 which images a circular fisheye image into a rectangular image sensor area, wherein the center of the circular area where the circular fisheye image is imaged by the first lens is offset from the longitudinal center of the rectangular area, and an image is formed by a lens other than the first lens in the area other than the circular area in the longitudinal direction of the rectangle. For example, with a 4K resolution image sensor, the horizontal dimension of the image sensor is 3840 pixels, but the vertical dimension is 2160 pixels, so in a circular fisheye image, at most only the diameter of 2160 pixels in the horizontal direction is used. As a result, a black area of ​​up to 1680 x 2160 pixels is wasted. It is good to forcibly image this area with another lens. For example, if the area of ​​the circular fisheye image is shown as ○ and the area to be forcibly imaged is shown as □, then the images can be formed side by side in the left-right direction, for example, □○□. Alternatively, the images can be formed by arranging them horizontally, like a square and a circle. In this case, it is advisable to place a shielding plate between the square and the circle. The square itself may be imaged using a refractive optical system, but it is also acceptable to simply place the lenses diagonally. This will result in blurring, but it is particularly useful for sensing whether there are suspicious individuals. The other lens side should have a larger F-number than the first lens side. For example, the F-number of the square side should be larger (stopped down) than the F-number of the circle side. Even if the image of the square side is formed diagonally to the sensor, depth of field can be ensured, blurring of the image can be reduced, and the image of the circle side can be recorded relatively brightly.

[0368] A PC viewer, a smartphone app, or another drive recorder 10 can acquire video recorded by the drive recorder 10 via wireless communication and display a list of its titles, and the system can have a function to display a download icon for inputting a download instruction paired with the title, and a function to display a share icon for inputting a sharing instruction to SNS paired with the title, and when displaying the list of titles, the system can display the Char icon paired with the titles of videos already downloaded from the drive recorder 10, and when displaying the list of titles, the system can display the download icon instead of the Char icon paired with the titles of videos not yet downloaded from the drive recorder 10. For example, when displaying a list of video files recorded by the drive recorder on a smartphone, the system can display a download button for files not yet downloaded to the smartphone, but not a share button, and display a share button instead of a download button for files already downloaded to the smartphone.

[0369] A PC viewer, a smartphone app, or another drive recorder 10 equipped with a function to share video recorded by the drive recorder 10 to social media, etc., is preferable. The system should include a function to display a screen to specify the sharing range when a user inputs an instruction to share video to social media, and a function to upload the specified range to a predetermined social media server. For example, when a user presses the share button, the system should include a function to display a screen to specify the sharing range from the total time range of the video file, and a function to upload the specified range to a predetermined server.

[0370] The system includes a smartphone app that operates on a smartphone equipped with a function to share video recorded by the drive recorder 10 to social media, etc., and the drive recorder 10 has two types of video recordings: a continuously recorded video file and an event-recorded video file. The event-recorded video file can be uploaded to social media servers, etc., using the sharing function, while the continuously recorded video file cannot be uploaded to social media servers, etc., using the sharing function. For example, there could be an event-recorded file and a continuously recorded file, with the event-recorded file being shareable but the continuously recorded file not being shareable.

[0371] A PC viewer, a smartphone app, or other drive recorder 10 that displays video and shows the location where the video was taken on a map, is preferable to have a system that displays a mark on the map indicating the location of the video and draws a graphic shape indicating the display range of the video from the location of the mark.

[0372] For example, in the map display unit 63 of Figures 12 and 20, the location currently being played in the display area 62 can be displayed as a pin-shaped icon on the map, and the driving trajectory to that location can also be displayed on the map. As shown in Figure 20, the display area 62 is a narrower area than the entire recorded video, and the display area of ​​the video can be changed by user operation. The direction indicated by the currently displayed display area should be displayed at the current location on the map display. In particular, the direction currently being displayed should be reflected in real time as an arrow or fan shape. It is also good to have a function to change the display direction of the video by user operation, and a function to change the direction of the graphic in accordance with the change in the display direction of the video.

[0373] The app or other dashcam 10 that operates on a smartphone has the function of displaying video and showing the location of the video on a map, and it is preferable that it has the function of displaying a mark on the map location that indicates the location of the video being played back in the display area 62, and drawing a graphic shape that indicates an area narrower than the display range of the video, which varies according to the vehicle speed, from the position of the mark. For example, the angle of the fan narrows according to the speed as the speed increases, or another fan with an angle according to the speed may be drawn inside the fan graphic that indicates the range being displayed in the display area 62. This angle should generally correspond to the angle that narrows the driver's field of view as the speed increases.

[0374] The app or other dashcam 10 that operates on a smartphone has the function of displaying video and showing the location of the video on a map, and it is preferable that it also has the function of displaying a mark on the map indicating the location of the video and drawing a graphic indicating the video display mode from the position of the mark. For example, the graphic indicating the video display mode may be an icon in a shape corresponding to the view mode and displayed on the map. The shape may change depending on the view mode, such as a circle for round, a fan shape indicating the range of the panorama for panorama, a fan for the front and rear shooting range for 2-split, a fan for front, back, left and right for 4-split, and a fan for the cropped range for crop. Alternatively, if the configuration allows setting view modes as shown in Figure 24, the icon of the selected display method (the selected one from the icons lined up vertically on the right side in Figure 24) may be displayed in place of the pin indicating the current location on the map, or near the pin. If the display area 62 has multiple view mode areas for display, the corresponding icons may be displayed at the current location on the map in the same order as the areas, or near the pin (for example, around it).

[0375] The embodiments described above can also be applied to configurations that are not full-spherical drive recorders like the one shown in Figure 23, but rather hemispherical drive recorders that record the front view without a second camera. Furthermore, the embodiments can also be applied to configurations where the first camera is located at the lower end position, which is the switch section 28, rather than the position shown in Figure 23, and a hemispherical camera is installed with the optical axis of the camera centered downwards.

[0376] While various aspects of the present invention have been described above using embodiments and modifications, it should be noted that these embodiments and descriptions are not intended to limit the scope of the present invention, but rather to facilitate understanding of the invention. The scope of the present invention is not limited to the configurations explicitly described in the specification, but also includes combinations of the various aspects of the present invention disclosed herein. Although the configurations for which patent protection is sought are specified in the claims attached to the application, it should be noted that even configurations not currently specified in the claims may be claimed in the future. The applicant intends to obtain rights for such parts and combinations through amendments, divisional applications, or changes to design registration applications.

[0377] Furthermore, the scope of the present invention is not limited to the configurations explicitly described in the specification, but also includes combinations of various aspects of the present invention disclosed herein. While the configurations for which patent protection is sought are specified in the appended claims, we intend to include configurations disclosed herein that are not currently specified in the claims in the future.

[0378] The present invention is not limited to the configuration described in the embodiments above. The components of each embodiment and modification described above can be arbitrarily selected and combined. Furthermore, any component of each embodiment and modification can be arbitrarily combined with any component described in the means for solving the invention, or any component that embodies any component described in the means for solving the invention. The present application intends to obtain rights to these as well through amendments or divisional applications. Even if there is a description such as "in the case of..." or "when...", it is not meant to be a configuration that is limited to that case or time. Configurations that do not fall under these cases or times are also disclosed, and the present application intends to obtain rights to them. Also, even if there is a sequence of descriptions, it is not limited to that order. Configurations with some parts deleted or the order rearranged are also disclosed, and the present application intends to obtain rights to them.

[0379] Furthermore, although the drawing depicts the entire device with solid lines, it is a drawing that includes not only the overall design but also partial designs claimed for parts of the device. For example, it is a drawing that includes not only partial designs for some components of the device, but also partial designs for parts of the device that are unrelated to any components. Parts of the device may be components of the device, or parts of those components. [Explanation of symbols]

[0380] 2 Windshield 3 Pillar 4 Dashboard 10. Dashcam 11 Main body 12 Camera section 13 Main unit case 25 cabinets 26 First Camera 27 Second Camera 28 Switch section 50 Angle adjustment mechanism 60 display screen 62 Display Area 62b Mask region

Claims

1. A system that displays video footage and also has a function to display the location where the video was taken on a map, A function to display a mark on a map indicating the location of the aforementioned video, and to draw a graphic shape indicating the display range of the video from the location of the mark, It features a function that allows the user to change the display direction of the video. The system includes a function to change the orientation of the graphic shape indicating the display range of the aforementioned video in accordance with the user's operation to change the display direction of the video. The graphic shape indicating the display range of the aforementioned video is a fan shape, and within that fan shape, there is a function to draw another fan at an angle corresponding to the vehicle's speed. A system characterized by the following.

2. A program for a computer to implement the functions of the system described in claim 1.

Images