Drive recorder, drive recorder display device and program

Abstract

We provide a dashcam with a wide recording range and few blind spots, a display device for the dashcam, and a program. [Solution] The drive recorder 10 includes a main body case 13 that houses a control unit and recording means, and is equipped with a first camera 26 and a second camera 27 that capture an area of ​​more than a hemisphere. The two cameras are mounted in the housing 25 so as to capture opposite directions. When the main body case 13 that houses the control unit, etc., is attached and fixed to the windshield, the vehicle's dashboard and pillars are captured at the edges of the images captured by the two cameras.

Description

Technical Field

[0004] , , , , , , , , , , , ,

[0005] , , , , , , ,

[0003]

[0001] The present invention relates to, for example, a drive recorder, a display device for a drive recorder, a program, and the like.

Background Art

[0002] For example, Patent Document 1 discloses a drive recorder attached adjacent to a rearview mirror fixed to the upper part of a windshield in a passenger compartment of a vehicle such as an automobile. In this drive recorder, an in-vehicle monitoring camera is provided in a third case body, and a front monitoring camera is provided in a first case body.

[0003] In Patent Document 1, as an explanation of the drive recorder, for example, in paragraph

[0002] , it is described that "an image of the host vehicle and the surrounding situation is captured from the driver's field of view, and the captured image data is stored in a temporary storage memory.", and for example, in paragraph

[0006] , it is described that "not only a predetermined time before and after the occurrence of a vehicle accident is recorded, but also, for example, the surrounding situation is constantly imaged and the captured image data is recorded".

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] The drive recorder disclosed in Patent Document 1 has a relatively narrow field of view, capturing only a certain range in front of the vehicle, as shown in Figure 8 of Patent Document 1, which depicts a vehicle in front as an example of the image captured by the forward-facing camera. Paragraph

[0077] of Patent Document 1 indicates that the in-car surveillance camera is composed of a lens with a narrower field of view than the forward-facing surveillance camera. Thus, conventional drive recorders have a narrow field of view, and the range of the recorded image is insufficient.

[0006] Furthermore, the object of the present invention is not limited thereto, and aims to obtain the effects derived from the components of the structure disclosed in this specification and the drawings. For example, a problem is disclosed in this specification that can be reinterpreted as "~is a problem" where "~can be done". Solving this problem is also an object of the present invention. The applicant intends to include a part of the structure described in this specification in the claims through an amendment or divisional application. [Means for solving the problem]

[0007] (1) The device includes a shooting means that captures a wider area than the hemisphere and a mounting means that attaches the shooting means to the vehicle so that a portion of the area captured by the shooting means is in the area in front of the vehicle. Since it can capture a wider area than the hemisphere, the range that can be captured is wider than before, which is good. The mounting means has the function of attaching the drive recorder to the vehicle and fixing the shooting direction of the shooting means. Since a wider area than the hemisphere, including the area in front of the vehicle, is captured, for example, the range that is captured in the event of an accident is wider, and in addition to collisions on the front side of the vehicle, collisions from other directions can also be captured, and blind spots are reduced, which is good. The area wider than the hemisphere should be a continuous space. Since this drive recorder captures a wider area than the hemisphere, including the area in front, for example, when attached to a predetermined position inside the vehicle using the mounting means, it becomes a device that outputs or records video of the outside and inside of the vehicle from inside the vehicle.

[0008] (2) The photographic means comprises a plurality of cameras, one of which is a hemisphere or One camera captures a range greater than or equal to a hemisphere, and the other camera captures a range narrower than a hemisphere. It is preferable that the two cameras have different shooting areas. The shooting areas may partially overlap, but by capturing different parts, the other camera can capture areas that are not covered by the shooting area of ​​the camera capturing the hemisphere or a larger range. Having different areas means that the shooting areas may include overlapping parts or not, but it is preferable that they include overlapping parts. The resolution of the camera capturing the hemisphere or a larger range decreases towards the periphery. For example, if the shooting area of ​​the camera capturing a range narrower than a hemisphere overlaps with a part of the shooting area at the periphery where the resolution decreases, it is preferable that the camera capturing a range narrower than a hemisphere can capture clearly. In this embodiment, this drive recorder corresponds to a drive recorder equipped with a third camera and a fourth camera. The camera capturing the hemisphere or a larger range corresponds to the third camera, and the camera capturing a range narrower than a hemisphere corresponds to the fourth camera.

[0009] Furthermore, for example, if the system is configured such that one camera captures a hemispherical or larger area while mounted in a predetermined position on the vehicle using mounting means, and the other camera captures the area in front of the vehicle, then the first camera can be used to monitor the entire 360-degree surroundings of the vehicle's horizontal plane, while the other camera functions as a regular dashcam. For example, if one camera captures a hemispherical area with a 180-degree field of view, the surroundings can be captured efficiently and clearly. If the field of view is greater than 180 degrees, unnecessary scenery such as the vehicle's roof will be captured, resulting in a smaller image and reduced resolution, but this problem is eliminated with a 180-degree field of view. On the other hand, with a 180-degree field of view, objects diagonally above, such as traffic lights in front, cannot be captured, but this can be handled by the other camera capturing the area in front, so it is acceptable.

[0010] (3) The imaging means may include a single camera that, when mounted on the vehicle by the mounting means, captures an area wider than the hemisphere, including the lower hemisphere. This allows for capturing images in all directions, front, rear, left, and right of the vehicle, so that, for example, objects approaching the vehicle from all directions around it can be captured. Because it captures an area wider than the hemisphere, the space of the imaging means diagonally above, for example, also becomes part of the shooting area. Therefore, for example, when photographing the front of the vehicle, vehicles and traffic lights in front can also be clearly captured.

[0011] By utilizing the function that captures images in all directions—front, back, left, and right—the likelihood of capturing the situation, for example, in the event of a collision from the side or rear while driving increases, resulting in fewer blind spots compared to conventional dashcams. Furthermore, when operated while parked, it allows for effective security monitoring, which is a significant advantage.

[0012] A wider range than a 180-degree hemisphere, for example, a range of 220 to 260 degrees, is preferable because it allows for the photographing of traffic lights and confirmation of the signal colors of the photographed traffic lights. A range of 230 to 240 degrees is even preferable because it allows for the photographing of traffic lights with more reliable confirmation of the signal colors, while also capturing the image without reducing the resolution of other elements such as the vehicle in front of the vehicle or other scenery.

[0013] (4) The shooting means comprises two cameras that capture a hemisphere or larger area, and the two cameras are configured to shoot in opposite directions, and when mounted inside the vehicle using the mounting means, the vehicle's dashboard and pillars are visible at the edges of the images captured by the two cameras.

[0014] This allows a single dashcam to capture a full 720-degree (360 degrees horizontal + 360 degrees vertical) spherical image. Conventional dashcams can only capture a predetermined area in front of the vehicle, leaving blind spots on the sides and rear, and failing to record the situation in the event of an accident. Although it may not always be recorded, by filming in all directions—front, back, left, right, up, and down—blind spots are eliminated. That's fine. In this embodiment, the two cameras correspond to the first camera 26 and the second camera 27.

[0015] When the dashcam is installed inside the vehicle, one of the two cameras primarily captures the area in front of the dashcam, while the other primarily captures the area behind it. The dashboard and pillars are positioned so that they are visible around the edges of the images captured by each camera, allowing the dashcam to be mounted in front of the driver depending on the mounting method. Since one camera captures the area in front of the vehicle in the direction of travel, and the other captures the rear and the interior of the vehicle, the center of the images captured by each camera will show the view ahead and the driver inside the vehicle, respectively. When the edges of the images captured by the two cameras are joined to create a full 360-degree image (a continuous image covering the front, back, left, right, up, and down), the connection / boundary between the front and rear can be positioned to the side of the driver, so that the connection does not obstruct the view of the front scenery or the center of the interior image. The central area captured by each camera has higher resolution than the peripheral areas, which is advantageous because it allows for capturing the vehicle ahead, the scenery in the center of the foreground, and the driver and passengers inside the vehicle. The forward scenery, which is the primary function of a dashcam, can be captured using only one camera's footage.

[0016] Furthermore, in the example above, the dashboard and pillars were reflected in the joint area, but it would be better to fix the joint area in a specific position, so that the area in that specific position is less likely to be reflected and the other areas are more likely to be reflected.

[0017] Alternatively, for example, the housing that implements the shooting mechanism and the main case that implements the processing circuits and various sensors that perform various processes can be made of separate materials, and the two can be connected by an angle adjustment mechanism. The angle adjustment mechanism can rotate around the horizontal axis, allowing for forward and backward swaying, but it should not rotate around the vertical axis, thus preventing sideways movement.

[0018] (5) The shooting means comprises two cameras that capture a hemisphere or larger area, the two cameras each capturing in opposite directions, and the two cameras are used to combine the edges of the images captured by each camera to form a single image, and it is preferable to provide means to make the seams between the peripheral areas captured by each of the two cameras less noticeable.

[0019] When two images are stitched together to create a single 360-degree image, and then a portion of that image is cropped and displayed, and the cropped area is moved, the cropped area may include the seam. However, since there are methods to make the seam less noticeable, the seam becomes less visible, and the entire 360-degree image connects seamlessly, which is desirable.

[0020] One way to make the transition less noticeable is to adjust the brightness during shooting. This means, for example, ensuring that both cameras shoot at the same brightness. To achieve the same brightness, one can use an exposure control function to set the exposure conditions to be the same. Normally, when two cameras each have an exposure control function, they measure the light and shoot at the appropriate exposure conditions based on the metering results. In this case, for example, if one camera mainly shoots the scenery outside the vehicle, the subject is bright, and if the other camera mainly shoots the interior of the vehicle, the subject is dark. If the optimal exposure conditions are set based on the metering results of each camera, they will shoot at different brightness levels. When shot in this way, the difference in brightness at the transition point is noticeable and creates an unnatural feeling. By using a brightness adjustment function to control both cameras to shoot at the same brightness, this unnatural feeling at the transition point is eliminated.

[0021] When images captured by two cameras at the same brightness are stitched together to create a single image and displayed, the seam is not noticeable. When the brightness of the two cameras is adjusted separately, normally For example, it controls the camera to capture both the bright outside scenery and the relatively dark interior of the car clearly. For example, if there is a difference in brightness at the part where the video of a camera shooting the front while rotating the video changes to the video of a camera shooting the rear, the connecting part will be prominent and a sense of discomfort will occur. For the interior of the vehicle which is dark and difficult to see, it is good to shoot it as it is difficult to see, so that the state as seen can be reproduced.

[0022] When making the whole the same brightness, for example, if it is done based on the photometry result of one camera shooting the front, it is preferable because the front scenery can be clearly shot. However, it is more preferable if it is also done taking into account the photometry result of the other camera shooting the rear, because it can suppress the interior of the vehicle from becoming completely dark and difficult to see. Also, for photometry in each camera, since the video to be seen is in the central part of the image, it is good to perform it based on center-weighted photometry. Furthermore, since the lower side of the image captures the dashboard, floor, seat, etc., it is good to perform center-weighted photometry especially on the upper area of the central part. Furthermore, if split photometry is performed on the whole of two sheets including the joint, it is good because the whole can be shot without becoming too dark or having overexposure. Also, it is good to extract the moving part, perform spot photometry on that part, and adjust the brightness based on the photometry result. For example, the pillars and the dashboard do not move, while the outside scenery and the people in the vehicle interior move. Therefore, by performing photometry on the moving part, it is possible to shoot the desired part clearly and easily.

[0023] Also, the brightness adjustment means may make the whole the same, or may adjust the central part individually and make the brightness of the peripheral part the same. In that case, since there may be a difference between the individually adjusted brightness of the central part and the brightness of the peripheral part, it is good to apply correction such as gradation in the intermediate part between the central part and the periphery. Shooting with the same brightness for the whole screen is more preferable because the control on the shooting means, the camera side, is simple, and also the process of connecting the two captured images is simple.

[0024] (6) The photographing means includes two cameras that photograph a hemispherical sky or a range greater than that, and the two cameras are arranged such that the areas photographed by the two cameras overlap at the peripheral portion. When the two cameras are attached to the vehicle by the attachment means, the overlapping area may be configured to photograph a predetermined position inside the vehicle cabin.

[0025] Objects existing in the overlapping area are photographed by each of the two cameras. When combining the images of the two cameras, the same object may be split into two and displayed at different positions. However, if the overlapping area is near a predetermined position inside the vehicle cabin, even if the object is hidden at the predetermined position inside the vehicle cabin and not photographed at all, or even if it is photographed and displayed at different positions, the predetermined position inside the vehicle cabin will stand out, and the fact that it is split into two and displayed will not be noticeable, eliminating the sense of discomfort.

[0026] (7) The predetermined position is preferably at least one of the pillars and the dashboard of the vehicle. The pillar and the dashboard are relatively close to the cameras installed inside the vehicle cabin compared to objects existing outside the vehicle, with a distance of about 1 to 3 m. When connecting the images of the two cameras, there is little deviation, so even if there is deviation, it is not noticeable. Also, the dashboard is generally of the same color tone and is often dark overall. In view of this, even if there is deviation, it may not be noticeable. Also, the dashboard and the pillar are not originally things to be focused on and looked at, so even if there is deviation, it won't be noticed. Furthermore, although there are people or other objects outside the vehicle located behind the pillar, part or all of them are hidden by the pillar, so the deviation may not be noticeable.

[0027] (8) The two cameras are those that photograph a range greater than a hemispherical sky, and the two cameras are mounted in one housing. The outer shape of the housing is spherical, and the lenses of the two cameras may be arranged in a state where they are respectively exposed on the surfaces on the opposite sides in the diameter direction of the sphere.

[0028] Since the housing for mounting the cameras is spherical, it is envisioned as a camera that photographs the entire sky It's good because it's inexpensive. The lens is positioned so that it's exposed and protrudes from the surface of the sphere, which is good because it prevents the casing from appearing in the image, even for cameras that capture a range greater than a hemisphere. The spherical shape also makes it look smaller and gives it the appearance of a full-spherical dashcam, which is good.

[0029] (9) The housing, which includes a main body case for mounting the control unit and the two cameras, is positioned below the main body case when mounted by the mounting means, and the main body case is shaped to be less likely to be reflected in the camera's view. As the main body case is less likely to be reflected in the image captured by the camera, the scenery outside the vehicle and the interior of the vehicle can be easily seen. The shape that is less likely to be reflected should be such that the part of the main body case that is in the camera's field of view is minimized. For example, the corners of the main body case may be tapered, the dimensions and shape of the main body case may be made as small as possible, or the blind spot of the camera may be conical, so the main body case may be shaped to be close to that cone shape.

[0030] (10) The control unit and the main body case that houses the recording means are provided, and the housing that houses the two cameras is arranged separately from the main body case, and a switch may be provided on the housing. The recording means is for collecting ambient sounds, for example, for collecting and recording sounds such as the sound of a collision, sounds associated with braking, and the voices of the driver and passengers in the event of an accident. This is useful for analyzing the accident after it has occurred. When the switch is operated, the sound of the operation reverberates inside the housing, and if this is recorded and played back later, it can be unpleasant to the ear and may be bothersome when analyzing an accident, etc. However, since the recording means is installed in a main body case separate from the housing, the reverberated sound is not transmitted to the main body case and the operation sound is not recorded, which is good. In this embodiment, the recording means corresponds to a microphone, for example. The switch may be for example, to give instructions to record information based on the video captured by the camera when the switch is operated.

[0031] (11) The main unit case, which houses the control unit and recording means, is mounted inside the vehicle using the mounting means. The housing that houses the two cameras is located below the main unit case, and a switch is provided on the bottom of the housing. The housing is placed below the main unit case, and the switch is located on the bottom of the housing. The switch is close to the driver and easy to press. Furthermore, if the housing is spherical as described in (8) above, the switch can be pressed while holding the sphere from above and below, making it easy to press and reducing the amount of force applied to the main unit case.

[0032] (12) The housing is rotatably attached to the lower side of the main body case via a coupling mechanism when the housing is installed inside the vehicle using the mounting means, and the coupling mechanism is designed to allow rotation in the front-rear direction of the vehicle in the installed state, but to prevent swaying in the left-right direction.

[0033] (13) A dashcam display device should have a function to display the combined video footage from two cameras on a single screen. For example, by widening the field of view and displaying it in the opposite direction, the interior of the car, including the driver and passengers, can be displayed in the center, while the scenery outside on the left and right can be displayed flowing around the periphery. This creates a virtual viewpoint outside the vehicle, giving the impression that the vehicle has become transparent and the view is from a distance, offering a novel and interesting perspective that is not visible to the human eye.

[0034] (14) A display device for a dashcam should be provided that displays the video footage captured by two cameras in a stitched state, has a function to change the viewpoint, and has a function to display a reference screen with one-touch operation.

[0035] When viewing from a different perspective, it's possible to quickly return to the reference screen regardless of the orientation. This is good because it allows you to do so. For example, if you crop a portion of a 360-degree screen and then move or resize that cropped portion, you may lose track of which direction you are facing. However, even if this happens, you can return to the reference screen to understand the situation, which is good. Also, even if you know which direction you are currently looking, it is preferable that you can return to the original reference screen all at once if you want to. The reference screen can be, for example, the front or the driver (not directly behind, but diagonally behind), and in the embodiment, it can be a specific screen such as the front, back, left or right, or even bookmarks registered during playback.

[0036] (15) A display device for a dashcam should be equipped with a masking function that makes a predetermined part of the video footage captured by each of the two cameras less visible than other normal display parts. This is good because, for example, by making the part showing at least the driver's face less visible, it can meet the demand of the driver who does not want to be filmed or feels embarrassed. Making it less visible can be done by making it so that it is not filmed clearly, covering it with a masking material to make it completely invisible, applying a mosaic effect, or displaying it faintly. The area to be masked can be specified by automatic setting or manual setting. For automatic setting, for example, it is good to recognize a specific location such as the driver's seat, or a registered person (yourself, family, etc.) and set the area including that person's face.

[0037] (16) A drive recorder display device equipped with a main display unit and a sub-display unit, and having a function to display different images on each display unit, is preferable because different images can be viewed simultaneously. For example, if the main display unit displays the scenery in front and the sub-display unit displays the situation inside the vehicle, it is preferable because the driver can understand the situation in relation to the scenery. Also, when the vehicle is parked, a circular or panoramic image of the horizontal 360 degrees is displayed on the main display unit, and if the approach of a person is detected, an enlarged image of that person is displayed on the main display unit, and the entire image is continuously displayed on the sub-display unit. In the event of a collision, if the image from the direction of the impact is displayed on the main display unit and the scenery outside in a different direction, or the situation of the driver and passengers inside the vehicle is displayed on the sub-display unit, it is preferable because the accident analysis can be performed more accurately. It is preferable to have a function to switch between the main display unit and the sub-display unit depending on the driving situation and circumstances. In this case, for example, the necessary images are played back according to the driving situation, etc.

[0038] (17) A display device for a dashcam should have a function to display a specific direction so that it faces a predetermined position on the screen. For example, since a specific direction is displayed so that it faces a predetermined position on the screen, the user can recognize and understand the playback video in relation to the direction when looking at the screen, which is good. For example, if the specific direction is "north" and the predetermined position is "top of the screen", it is good because the user can intuitively understand it by comparing it with a map.

[0039] (18) The drive recorder display device should have an editing and playback function that automatically skips unnecessary footage and plays back the video footage captured by the two cameras, rather than simply playing it back in chronological order. For example, the user will not be forced to continue playing back footage that is not interesting or that they do not want to see, and only footage that is interesting will be played back, which is desirable as it will encourage the user to want to watch the recorded footage later.

[0040] The aforementioned display devices for dashcams include, for example, viewers implemented in a computer, display devices connected to or implemented in the dashcam, and display devices for in-vehicle equipment linked to the dashcam. In-vehicle equipment includes, for example, car navigation systems.

[0041] (19) The program is characterized by causing the computer to implement the function of a drive recorder display device as described in any of (13) to (18).

[0042] (20) The drive recorder described in any of (4) to (12) is a drive recorder that has the function of a drive recorder display device described in any of (13) to (17).

[0043] The inventions described in (1) to (12) and (20) above can be combined in any way. For example, one invention may have at least one of the other (2) to (12) and (20) without having all or part of (1). However, it is particularly desirable to have all or part of the configuration of (1) and to have a combination with at least one of the configurations of (2) to (12) and (20). Alternatively, any component may be extracted from at least one of (1) to (12) and (20) and combined. Furthermore, the inventions described in (13) to (18) can be combined in any way. Alternatively, any component may be extracted from at least one of (13) to (18) and combined. The applicant intends to obtain patent rights, design rights, etc., for such configurations through amendments, divisional applications, or changes to design registration applications. [Effects of the Invention]

[0044] According to the present invention, the range that can be photographed is wider than in the conventional invention, which is an advantage. Furthermore, it is possible to provide things that produce the effects described herein as "~can be done," etc. [Brief explanation of the drawing]

[0045] [Figure 1] This is a perspective view showing a preferred embodiment of the drive recorder according to the present invention. [Figure 2] This is a diagram illustrating the procedure for installing the dashcam on the windshield. [Figure 3] (a) and (b) are perspective views showing parts of the main body case of the dashcam, and (c) is a bottom view of the dashcam. [Figure 4] This is a perspective view of the main body case of this type of dashcam, with a portion omitted. [Figure 5] This is an exploded perspective view showing the lens section. [Figure 6] This diagram shows the dashcam installed in a vehicle. [Figure 7] This is a perspective view of the dashcam, with some parts of the main case, housing, and circuit board omitted. [Figure 8] This diagram explains the field of view, angle of view, etc., of the camera unit. [Figure 9] This diagram illustrates the blinking state of the indicator light on the switch. [Figure 10] This diagram illustrates the images captured by the first and second cameras. [Figure 11] (a) is a diagram illustrating an example of how captured video is displayed, and (b) is a diagram illustrating the exposure control function. [Figure 12] This is a diagram illustrating the functions of the PC viewer. [Figure 13] This is a diagram illustrating the functions of the PC viewer. [Figure 14] This is a diagram illustrating the functions of the PC viewer. [Figure 15] This is a diagram illustrating the functions of the PC viewer. [Figure 16] This is a diagram illustrating the functions of the PC viewer. [Figure 17] This is a diagram illustrating the functions of the PC viewer. [Figure 18] This is a diagram illustrating the functions of the PC viewer. [Figure 19] This is a diagram illustrating the functions of the PC viewer. [Figure 20] This is a diagram illustrating the functions of the PC viewer. [Figure 21] This is a six-view drawing showing an example of a dashcam. [Figure 22] This is a perspective view showing an example of a dashcam. [Modes for carrying out the invention]

[0046] Embodiments of the present invention will be described below with reference to the drawings. These drawings are based on the present invention. This is used to describe the technical features that may be adopted. The configuration and shape of the described apparatus are merely illustrative examples, and the present invention is not to be construed as being limited thereto. Various changes, modifications, and improvements may be made based on the knowledge of those skilled in the art, as long as they do not depart from the scope of the present invention.

[0047] Figures 1 to 8, 21, 22, etc., show an external view of a preferred embodiment of the drive recorder according to the present invention. The drive recorder 10 of this embodiment is capable of recording and outputting a 360-degree panoramic image obtained by capturing all directions in a horizontal plane and a vertical plane. The drive recorder 10 comprises a main unit 11 that performs various processes and a camera unit 12 that is positioned below the main unit 11 when installed in a vehicle.

[0048] The main body 11 has a flat rectangular main body case 13, and various circuit boards and devices are mounted inside the main body case 13. The main body case 13 is constructed by connecting a first case 14 and a second case 15. The first case 14 and the second case 15 are box-shaped with their opposing surfaces open, and are connected by a connecting means with their front ends touching. The connecting means may consist, for example, of a projection provided on one of the first case 14 and the second case 15 and a recess provided on the other that is linked to the projection, with the projection and recess being fitted together.

[0049] The first case 14 has a shallow bottom, and the periphery of the opening surface is roughly rectangular with rounded corners, and the depth is almost uniform throughout. When the drive recorder 10 is installed in the vehicle, this first case 14 is located on the front side of the vehicle. Therefore, the surface of the first case 14 opposite to the opening surface becomes the front surface 13a of the main case 13. A joint rail 16 is provided on this front surface 13a. Two joint rails 16 are provided vertically along the longitudinal direction of the first case 14 at a predetermined interval. A bracket 17 is detachably attached between these two joint rails 16.

[0050] The second case 15 is a deeper box shape than the first case 14, and the periphery of the opening surface is roughly rectangular with rounded corners, similar to the first case 14. When the drive recorder 10 is installed in the vehicle, this second case 15 is located on the rear side of the vehicle. Therefore, the surface of the second case 15 opposite to the opening surface becomes the rear surface 13b of the main case 13. The rear surface 13b has a flat surface 13b' adjacent to one of the pair of long sides of the rectangle, which is a plane parallel to the front surface 13a of the main case 13, and an inclined surface 13b'' adjacent to the other of the pair of long sides. The inclined surface 13b'' is formed so that it gradually approaches the opening surface of the second case 15 as it moves from the middle of the short side toward the outer long side. Therefore, the depth of the second case 15 is uniform in the first region including the flat surface 13b', and in the second region including the inclined surface 13b'', it is formed to gradually become shallower towards the longer side. By including the inclined surface 13b'', the external shape of the main case 13 is like a rectangular parallelepiped with one of its longer sides chamfered. The one longer side that is chamfered is the rear upper side when the drive recorder 10 is installed in the vehicle. When the first case 14 and the second case 15 are connected, the front surface 13a on the first case 14 side and the flat surface 13b' on the second case 15 side are parallel.

[0051] The bracket 17 has a flat plate 17a, and grooves 17b are formed along the longitudinal direction on a pair of sides of its long edge. These grooves 17b are configured to correspond with the joint rail 16. The user attaches or detaches the bracket 17 to the main body case 13 by aligning the grooves 17b with the joint rail 16 and sliding the bracket 17 and the main body case 13 relative to each other (see Figure 2, etc.).

[0052] When the bracket 17 is attached to the main body case 13, the surface of the plate 17a facing the main body case 13 has a projection 17c (see Figures 2(a) and 2(b), etc.). 17c is when bracket 17 is attached between joint rails 16, first case 14 The leaf spring portion 14a is fitted into the hole 14b provided in it, preventing it from coming loose. An adhesive material such as double-sided tape 19 is attached to the surface of the bracket 17 opposite to the surface facing the main body case 13. When installing the drive recorder 10 in a vehicle, the bracket 17 is removed from the main body case 13, and the removed bracket 17 is attached and fixed to the windshield 2 of the car via the double-sided tape 19 (see Figure 2(b), etc.). At this time, the bracket 17 is in a horizontal position, with the pair of long sides being horizontal. By attaching the main body case 13 to the bracket 17 attached to the windshield 2 in this state (see Figure 2(c), etc.), the drive recorder 10 is installed and fixed in the predetermined position on the vehicle. In this installed state, the front surface 13a and the flat surface 13b' of the main body case 13 are arranged parallel to the mounting surface of the windshield 2, the long side of the main body case 13 is located in a horizontal plane, and the short side of the main body case 13 is located in a vertical plane. Therefore, the main body case 13 is fixed to the front glass 2 in a horizontally elongated state, and the camera unit 12 is positioned suspended from the bottom side of the main body case 13.

[0053] As shown in Figures 1(a) and 3, a notched window 14c is formed on one of the shorter sides of the first case 14, and a cover member 20 is attached to close the notched window 14c. The cover member 20 is positioned to close the notched window 14c and is fastened and secured with screws 21. When the cover member 20 is removed, the memory card slot 22, which is mounted inside the main case 13, is exposed through the notched window 14c. A memory card 23 is detachably inserted into this memory card slot 22.

[0054] On the side opposite to the side with the notched window 14c, a window opening 13c is provided that spans the second case 15 of the first case 14, and a DC jack 24 is placed behind this window opening 13c. A connector attached to one end of a power cable is attached to this DC jack 24 to receive power from an external source. External power can be supplied, for example, from the vehicle's battery. This can be done by, for example, attaching the other end of the power cable attached to the DC jack 24 to the vehicle's cigarette lighter socket or directly connecting it to the vehicle's battery power line. Alternatively, a separate power supply device may be provided, and the drive recorder may receive power from this power supply device. This power supply device is capable of supplying power from its internal battery even when the vehicle is parked or when power is not supplied from the vehicle's battery. The internal battery may be, for example, a rechargeable battery, and when this power supply device is installed in the vehicle, the power supply device is placed between the vehicle's battery and the drive recorder in the power line. When the vehicle is running or when power can be supplied from the vehicle's battery, power is supplied from the vehicle's battery to the drive recorder 10 via the power supply unit. In this state, the power supply unit's built-in battery is charged by the power supply from the vehicle's battery. When the power supply from the vehicle's battery is turned OFF, the drive recorder 10 operates by receiving power from the power supply unit.

[0055] A hole 13d is provided at a predetermined position on the inclined surface 13b″ of the first case 14. A microphone 18 is placed inside the main case 13 near this hole 13d. The microphone 18 collects ambient sound. Multiple holes 13e are provided at predetermined positions on the flat surface 13b′ of the first case 14. A speaker 29 is placed inside the main case 13 near these holes 13e.

[0056] Various processing circuits and power supply circuits are mounted inside the main case 13. As shown in Figure 4, these processing circuits and power supply circuits are mounted on the main circuit board 40 and the sub-circuit board 41. The main circuit board 40 and the sub-circuit board 41 are mechanically integrated by connecting the connectors 42 attached to each board, and the signal lines and power lines formed on each circuit board are connected. The main circuit board 40 and the sub-circuit board 41 are connected in a parallel, stacked state and mounted inside the main case 13 in that state. In this mounted state, the main The circuit board 40 is located on the second case 15 side, and the sub-circuit board 41 is located inside the first case 14. The sub-circuit board 41 is equipped with a GPS antenna unit 43 and a battery 44 on the side not facing the main circuit board 40. The memory card slot 22 is mounted on the side of the sub-circuit board 41 facing the main circuit board 40. The main circuit board 40 is equipped with a CPU that controls various functions, as well as the aforementioned DC jack 24 and speaker 29. Although not shown in the diagram, an acceleration sensor is also built into the main case 13.

[0057] As shown in Figure 5, the camera unit 12 comprises a housing 25, a first camera 26 and a second camera 27 mounted inside the housing 25, and a switch unit 28. The housing 25 has an overall spherical shape and is constructed by connecting a hemispherical first camera case 30 and a second camera case 31 that are divided into two parts and joined together. The first camera case 30 and the second camera case 31 are fixed together in the same way as the fixing of the first case 14 and the second case 15 described above, by using the fitting of a projection 30a provided on the first camera case 30 and a recess 31a provided on the second camera case 31.

[0058] The first camera 26 and the second camera 27 are positioned back-to-back and fixed and connected so that they each shoot in opposite directions to form a camera unit 35. The camera unit 35 is formed by erecting a flat rectangular holder 36, fixing the first camera 26 to its front, and fixing the second camera 27 to its rear, thereby integrating them. This fixing is done, for example, by screws.

[0059] The first camera 26 is constructed by placing a first lens unit 26b on a first circuit board 26a. The first circuit board 26a is equipped with an image sensor and processing circuits for shooting. The second camera 27 is constructed by placing a second lens unit 27b on a second circuit board 27a. The second circuit board 27a is equipped with an image sensor and processing circuits for shooting. The first camera 26 and the second camera 27 are of the same specifications and performance. Same specifications and performance means, for example, that the angle of view, the optical system from the front lens to the image sensor, and the sensor size of the image sensor are the same. For example, when shooting the same subject under the same shooting conditions, such as exposure conditions, the captured images will be the same. In this embodiment, there is no physical aperture, and the brightness of the image is adjusted by changing the exposure time by changing the shutter speed.

[0060] As shown in Figure 5, when the first camera 26 and the second camera 27 are mounted on the holder 36, the optical axes L of the first lens section 26b and the second lens section 27b are set to lie on the same straight line. As a result, the first camera 26 and the second camera 27 each capture images in opposite directions. A circular window opening 30b is provided in the center of the first camera case 30, and a circular window opening 31b is provided in the center of the second camera case 31. When the camera unit 35 is mounted inside the housing 25, the tip of the first lens section 26b of the first camera 26 and the tip of the second lens section 27b of the second camera 27 are located inside the window openings 30b and 31b, respectively, and are exposed to the outside.

[0061] The housing 25 of the camera unit 12 is connected to the main body case 13 via an angle adjustment mechanism 50. The angle adjustment mechanism 50 rotates the housing 25 only around a rotation axis provided along the long side on the front of the bottom surface of the main body case 13, allowing for forward and backward swaying (see Figure 6), but preventing sideways swaying. For example, it is configured as shown in Figure 5. The housing 25 is provided with a first bearing piece 51 that protrudes above the first camera case 30 and a second bearing piece 52 that protrudes above the second camera case 31. The first bearing piece 51 has a wall portion 51a that extends upward and two first bearing portions 51b formed on the rear surface of the wall portion 51a that protrude backward. The second bearing piece 52 has a wall portion 52a that faces the wall portion 51a of the first bearing piece 51 and second bearing portions 52b arranged on both the left and right sides of the wall portion 52a. These four bearing portions 51b, 52b have through holes of the same diameter, and when the first camera case 30 and the second camera case 31 are connected, these four through holes are arranged concentrically.

[0062] The second case 15 of the main case 13 has a recess 15d at a predetermined position on its bottom surface. The recess 15d is formed in the central part of the front long side of the bottom surface of the second case 15 and has through holes 15e on a pair of inner surfaces perpendicular to that long side. The through holes 15e formed on the pair of inner surfaces are formed coaxially, and the inner diameter of one of them is larger than the shaft portion of the bolt 53 and smaller than the outer diameter of the nut 54 that is attached to the threaded portion of the bolt 53. On the inner side of the second case 15 with the through hole 15e that is smaller than the outer diameter of the nut 54, a small chamber 55 for attaching the nut 54 is provided, and the nut is set in this small chamber. The inner diameter of the other through hole 15e is larger than the outer diameter of the head of the bolt 53. The other through hole 15e connects to an opening 15g on the side surface 15f of the second case 15.

[0063] The bolt 53 described above is inserted from the opening 15g side with the threaded portion leading, with the first bearing piece 51 and the second bearing piece 52 inserted into the recess 15d. The shaft of the bolt 53 passes through the first bearing piece 51b and the second bearing piece 52b, and the threaded portion of the bolt 53 is inserted into one of the through holes 15e to position it in the small chamber. The bolt 53 is rotated using a fastening tool such as a hex wrench to fasten the threaded portion and the nut. In this state, one side of the recess 15d is sandwiched between the nut and one of the second bearing pieces 52b, preventing the bolt 53 and housing 25 from separating. When the bolt 53 is tightened firmly, the head of the bolt 53 biases the other second bearing piece 52b, preventing rotation. When the bolt 53 is loosened, the housing 25 rotates within a predetermined angular range with the bolt 53 as the center of rotation.

[0064] The bolt 53 is positioned parallel to the long side of the second case 15 and, consequently, the main case 13. Since the long side of the main case 13, which is attached and fixed to the windshield 2, is located on a horizontal plane, the angle adjustment mechanism 50, which consists of the bolt 53 and the first bearing piece 51, second bearing piece 52, etc., is allowed to rotate around the horizontal axis but not around the vertical axis, and the camera unit 12 is only allowed to swivel in the forward and backward direction.

[0065] When using the drive recorder 10, as described above, it is attached and fixed to the windshield 2, and the housing 25 and, consequently the camera unit 12, is rotated back and forth to the desired position, and the nuts are tightened to fix the orientation of the camera unit 12. The desired position is such that the first camera 26 faces forward and the second camera 27 faces backward, and the optical axes L of the first lens unit 26b and the second lens unit 27b are parallel to the direction of travel of the vehicle. In this position, as shown in Figure 6(a), the joint surface M of the first camera case 30 and the second camera case 31 is located in a vertical plane and in a plane perpendicular to the direction of travel of the vehicle.

[0066] As shown in Figure 8, the first camera 26 and the second camera 27 are cameras that can capture the entire surrounding area by setting the field of view θ perpendicular to the plane to a predetermined angle greater than 180 degrees, with a field of view of 360 degrees in the plane parallel to the lens. The predetermined angle is the same for both the first camera 26 and the second camera 27. Since the first camera 26 and the second camera 27 are positioned back to back and facing opposite directions, there is a predetermined gap between the tip of the first lens section 26b and the tip of the second lens section 27b. For example, if the field of view of both cameras is set to 180 degrees, a band-shaped uncaptured area will be generated around the entire perimeter equal to the width of the predetermined gap between the two lens sections. By increasing the field of view θ to more than 180 degrees, the area behind the plane perpendicular to the optical axis at the tip of the lens becomes part of the shooting range. For example, as shown in Figure 8, an overlapping area occurs in the areas that can be captured by both cameras (see hatched area in Figure 8), making it possible to capture a 720-degree (360 degrees horizontal + 360 degrees vertical) full-spherical image with a single drive recorder 10 (see Figure 8(d), etc.).

[0067] The images captured by the first camera 26 and the second camera 27 are circular, as shown in Figures 8(b) and (c), and are in a 360-degree direction parallel to the lens. The first region captures the hemispherical portion in front of the lens, within a 180-degree field of view in orthogonal directions. There is a second region R2, which captures the area behind the lens section with a field of view of 180 degrees or more in directions perpendicular to R1.

[0068] Areas beyond a predetermined angle are blind spots that cannot be captured by each camera. Therefore, the area from the point where the shooting areas of the two cameras overlap (shown by hatching in Figure 8) to the vicinity of the camera unit 12 becomes a blind spot R3 that cannot be captured by either camera. The closer the predetermined angle is to 180 degrees, the further the point where the shooting areas begin to overlap is from the camera unit 12, and the larger the blind spot R3 becomes. On the other hand, increasing the predetermined angle reduces the blind spot R3, but it also reduces the first region R1, which captures the hemispherical portion in front of the lens unit. This reduces the resolution of the image captured in the first region R1, making it difficult to see. Therefore, in this embodiment, the predetermined angle is set to 210 degrees, so that the blind spot R3 can be appropriately reduced while maintaining high resolution of the forward view of the vehicle and the interior captured in the first region R1.

[0069] The switch unit 28 is mounted below the camera unit 35 and integrated with it. Semicircular notches 30c and 31c are provided below the joining edges of the first camera case 30 and the second camera case 31. The radii of the notches 30c and 31c are equal, and when the first camera case 30 and the second camera case 31 are joined together, the two notches 30c and 31c connect to form a circular hole. The switch unit 28 is located within this circular hole and is exposed to the outside.

[0070] The switch unit 28 is mounted within the housing 25 for the camera unit 12 and is housed in a separate housing from the main unit 11 which has a built-in speaker 29. The switch unit 28 is a push button type, and when the switch unit 28 is pressed, an operation sound is produced. However, since the microphone 18 is built into the main unit case 13, which is separate from the housing 25, even if the operation sound resonates within the housing 25, the operation sound will not be transmitted into the main unit case 13, and therefore will not be picked up by the microphone 18 and recorded. In contrast, if the switch unit were provided on the main unit case 13 side, for example, the operation sound produced when the switch unit is pressed would be picked up by the microphone 18 and recorded, resulting in the problem of the operation sound becoming a significant noise. However, this embodiment avoids this problem. Furthermore, if the microphone and the switch unit are mounted on the same circuit board, the circuit board may vibrate when the switch unit is operated, and the sound from that vibration may also be recorded as noise. However, in this embodiment, the mounting circuit boards are separate, so this situation does not occur.

[0071] This switch unit 28 is for pressing when performing event recording. The drive recorder 10 in this configuration has a continuous recording function that records video to the memory card from engine start (ACC ON) to engine stop (ACC OFF), and an event recording function that records a certain period of time before and after an event when the event conditions are met. Event conditions include, for example, when the acceleration sensor detects an impact above a certain level, or when the switch unit 28 is pressed. Detection of an impact above a certain level is used to record video and audio before and after an accident, and pressing the switch unit 28 is used for one-touch recording, which records video and audio for a certain period of time when passing through a specified point. The control unit of the drive recorder, for example, performs continuous recording, and when the event conditions are met, it records video and audio for a certain period of time before and after the event as separate data. Both the continuous recording data and the separate event data are recorded to the memory card 23. Furthermore, if continuous recording is not performed, the control unit of the drive recorder normally temporarily records video and audio for a certain period of time in buffer memory, etc., and when an event condition is met, it uses the temporarily recorded data, etc., to record video and audio for a certain period before and after the event occurs onto the memory card 23.

[0072] As described above, in this configuration, even when the vehicle is powered off, such as when the ignition switch is OFF and power cannot be supplied from the vehicle's battery, the drive The iBreCorder 10 operates by receiving power from a separate power supply unit provided separately from the vehicle. Therefore, the system includes a mode for recording while parked, utilizing the aforementioned functions. In parking recording mode, power is supplied to the drive recorder 10 from the power supply unit for a set period of time even after the vehicle's power is turned off, such as when the vehicle is parked, allowing for continuous recording and event recording even while parked.

[0073] This configuration includes a GPS antenna unit 43 and has the function of acquiring location information, date and time information, and speed information. Therefore, when recording the above information, it is preferable to record each of these pieces of information in association with it.

[0074] In this configuration, the switch unit 28 is located in the center of the lower surface of the spherical housing 25. Therefore, the switch unit 28 is in the closest position to the driver and passenger in the front seat, making it easy to reach and operate, easy to press, and easy to see, thus making it easy to confirm the location of the switch unit. In this configuration, the camera unit 12 is located on the lower side of the main body case 13, and there is a risk that the user may accidentally touch the lens when operating the switch, but by placing the switch unit 28 on the lower side as in this configuration, the risk of touching the lens can be minimized as much as possible.

[0075] Furthermore, when the switch unit 28 is pressed upwards, a load is applied to the angle adjustment mechanism 50 that rotates the camera unit 12, and the load is received there, so it can be pressed firmly. In addition, to prevent the direction of the lens from changing when pressed, the bolt 53 and nut 54 are securely fastened to fix it in place.

[0076] Since the housing 25 is spherical, it is clear that the camera unit 12 captures a full 360-degree omnidirectional image centered on the housing 25, which is good. Because the housing 25 is spherical, it is located in the blind spot of the first lens unit 26b and the second lens unit 27b and does not appear in the image. In addition, in order to prevent the main body case 13 from appearing in the image captured by the first camera 26 and the second camera 27 as much as possible, for example, the main body case 13 and the housing 25 are placed close together, and even if there is no gap between the top of the housing 25 and the bottom of the main body case 13, a space can be secured between the housing 25 and the main body case 13 as you move towards the left and right sides of the housing 25, making it easier to hold the housing 25 with your fingers. Then, when pressing the switch unit 28, for example, you can touch the top of the housing with your index and middle fingers as if you were holding a ball, and grip it with your thumb touching the switch unit 28, which allows you to press the switch unit. Performing this pressing operation is good because it does not put any load on the main body case 13 or the angle adjustment mechanism 50, or puts little load on them.

[0077] Furthermore, in this configuration, a lamp is mounted on the switch unit 28, causing the surface of the switch unit 28 to illuminate. Since the switch unit 28 illuminates, its location is easy to see even at night, which is good. By positioning the switch unit 28 on the underside of the housing 25, it illuminates downwards. Therefore, the driver will be looking up from below, making it easier to see the illumination, but from outside the vehicle, the view may be from diagonally above, so the illumination will not be visible, which is good. The illuminated parts, including the switch unit 28, should be positioned in the camera's blind spot so that the illuminated state is not recorded and is not visible from the outside.

[0078] Furthermore, the lamp is capable of emitting different colors, such as red and blue. This capability is achieved by incorporating light-emitting elements that emit different colors, such as a tricolor LED. By enabling the emission of different colors, the operating status can be indicated by appropriately changing the emitted color and pattern (see Figure 9).

[0079] As described above, in this configuration, the first camera 26 and the second camera 27 shoot in opposite directions, both with a field of view of 210 degrees, and the peripheral regions of the captured images overlap. As will be described later, the images captured by the first camera 26 and the second camera 27 are combined to generate a 360-degree spherical image, which is then recorded or output. The images to be joined when combining the images from the two cameras. The boundary is the vertical plane that includes the joint surface of the first camera case 30 and the second camera case 31. Therefore, the region of a predetermined width that includes that vertical plane becomes the overlapping region.

[0080] The bracket 17 is attached to the desired position on the windshield 2, the main body case 13 is mounted on the bracket 17, and the angle and orientation of the camera unit 12 is adjusted so that the joint surface M of the first camera case 30 and the second camera case 31 is positioned on a vertical plane, and then the bolt 53 is tightened to secure it. In the normal installation and mounting state, with the bolt 53 tightened and the camera unit 12 adjusted to the desired orientation, the first camera 26 captures the area in front of the drive recorder 10 in a 210-degree range (360 degrees vertically and 210 degrees horizontally), and the second camera 27 captures the area behind the drive recorder 10 in a 210-degree range (360 degrees vertically and 210 degrees horizontally). The peripheral areas of the images captured by the first camera 26 and the second camera 27 are designed to capture a predetermined position inside the vehicle, which is close to the camera. When the drive recorder 10 is fixed in a designated position inside the vehicle, the point where the images captured by the first camera 26 and the second camera 27 are joined is positioned in a designated location inside the vehicle that is close to the camera. This designated location inside the vehicle includes, for example, the pillar 3, the dashboard 4, or the ceiling.

[0081] In this configuration, the first camera 26 and the second camera 27 have a field of view θ of 210 degrees all around, so in the peripheral region of the image captured by each camera, the same surrounding objects are captured by both cameras. For example, as shown in Figure 10(b), suppose there are objects at positions P1, P2, and P3 in the peripheral region captured by both cameras. These positions P1, P2, and P3 are near the boundary K2 of the region captured by the second camera 27, and are at different distances from the camera unit 12. Even though the distances are different, because they are near the boundary K2, they are at similar positions in the circular image captured by the second camera 27, as shown on the right side of Figure 10(c). On the other hand, since the distances from the boundary K1 of the region captured by the first camera 26 are different for positions P1, P2, and P3, their positions within the circular region captured by the first camera 26 are different, as shown on the left side of Figure 10(c). Therefore, when compositing the boundary between two images containing the same object, there is a risk that the object present in each image may appear separately, making it impossible to recognize them as the same object. In particular, the amount of discrepancy increases as the distance from the camera, i.e., the vehicle, increases, as seen in P2 and P3. For example, if the object is a person, there is a risk that it may appear as if there are two people, rather than the same person.

[0082] In this configuration, fixed objects inside the vehicle, such as pillar 3 and dashboard 4, are used as objects that appear at the boundary between the two cameras. As a result, the outside scenery located behind these fixed objects is not captured, or only appears minimally at the boundary. Since the vehicle parts such as pillar 3 and dashboard 4 are located about 1 to 3 meters from the cameras, there is little discrepancy even if these vehicle parts appear on both boundary points. In contrast, outside the vehicle, objects are often 10 to 30 meters or more away, resulting in a large discrepancy in the positions captured by each camera, making it impossible to combine them into a single image. On the other hand, in this configuration, as mentioned above, the seam between the images from the two cameras is positioned at an object inside the vehicle that is at the same or close distance, making it less likely for people or other objects located behind the object to be captured. Furthermore, in this configuration, instead of simply obscuring the rear with a nearby pillar 3, etc., the system cleverly utilizes the human cognitive behavior that if there is a stationary object, people and objects behind it blend in and the sense of incongruity diminishes. Even if the images are displayed separately, they are not conspicuous and do not bother the viewer. Furthermore, since users tend to only look at the front, back, or sides, they don't pay much attention to pillars located in the middle, and therefore their attention to the scenery behind them is also reduced, which makes the overall impression less jarring and is therefore a good thing.

[0083] In contrast, if, for example, the housing 25 of the camera unit 12 is rotated 90 degrees in the horizontal plane from the standard position described above, and the first camera 26 and the second camera 27 are positioned to capture the left and right areas, respectively, then the boundary or seam between the shooting areas of both cameras would be, for example, located in the central part of the left and right sides of the windshield, extending vertically. The two areas are separated, and what is reflected in each is clear, resulting in an image that feels unnatural, which is good. No.

[0084] [Camera 26 and Camera 27 were both set to the same brightness for shooting.] In this configuration, the exposure control functions of the first camera 26 and the second camera 27 are controlled to shoot under the same exposure conditions. Furthermore, as mentioned above, since the apertures of the first camera 26 and the second camera 27 in this configuration are fixed to the same value, the exposure conditions, which adjust the brightness during shooting, are adjusted by adjusting the shutter speed. In this configuration, the exposure control function is a function that adjusts the shutter speed. By setting the shutter speeds of the first camera 26 and the second camera 27 to the same value, the first camera 26 and the second camera 27 shoot under the same exposure conditions and brightness. Thus, this configuration is characterized by treating the two cameras as if they were a single camera and shooting with a common brightness.

[0085] This method is good because it prevents abrupt changes in brightness at the transition points between the images captured by the first camera 26 and the second camera 27, making the transitions less noticeable and resulting in a seamless, continuous image across the entire perimeter. For example, in the case of a dark and hard-to-see interior of a car, capturing the image in its current state allows for playback that accurately reflects what was seen, which is beneficial.

[0086] As described above, in the correct installation and mounting state, the first camera 26 captures the area in front of the drive recorder 10 in a range of more than a hemisphere, with a vertical range of 360 degrees and a horizontal range of 210 degrees, and the second camera 27 captures the area behind the drive recorder 10 in a range of more than a hemisphere, with a vertical range of 360 degrees and a horizontal range of 210 degrees. By combining the images captured by the first camera 26 and the second camera 27, an image is constructed that captures the entire 360-degree horizontal and 360-degree vertical view of the drive recorder 10 (see Figure 8(d), etc.). When playing back the forward-facing image, the display screen can either show the entire 360-degree view or display a portion of the 360-degree view. As an example of how to crop a portion of the entire field of view, as shown in Figure 11(a), it is possible to display the front of the vehicle in front of the drive recorder 10 captured by the first camera 26, the interior of the vehicle in the rear of the drive recorder 10 captured by the second camera 27, or display images from any direction, such as diagonally upward, diagonally downward, left side, or right side.

[0087] The images displayed on the display screen are based on either images captured by only one of the first camera 26 or the second camera 27, or on images created by stitching together images captured by both cameras, depending on the direction of the viewpoint. Furthermore, the omnidirectional full-spherical image created by stitching together the two images is a continuous image in any direction, and as will be described later, the display area can be gradually moved by spanning to gradually change the viewpoint. In this case, during the movement, there are states where only the image from one camera is displayed, and states where the stitched portion of the images from both cameras is present on the display screen, and images from different cameras are displayed on the same display screen.

[0088] The first camera 26 and the second camera 27 are equipped with metering and exposure control functions, respectively, and depending on the surrounding conditions, they capture the shooting range with the same exposure conditions and, in this configuration, the same shutter speed. In this case, when the edges of the images captured by the two cameras are joined together to form a single image, the joined portion will not be noticeable. In contrast, if, for example, the exposure control functions of the two cameras adjust the exposure conditions separately based on the brightness of the subject measured by their respective metering functions, typically, for example, a short shutter speed will be used to reduce brightness when shooting a bright outdoor scene, and a long shutter speed will be used to capture a bright image when shooting a relatively dark car interior, thus shooting with different exposure conditions so that each image is clearly visible. When two images captured in this way are joined together, for example, if the joined portion of the images from the first camera 26 and the second camera 27 is present on the display screen, and images from different cameras are displayed on the same display screen, the brightness of the displayed images will differ, the joined portion will be noticeable, and it will look unnatural. There is a problem in that a feeling arises. In response to this, in this form, the exposure conditions and brightness are kept the same. Taking photos this way is good because it avoids the problems associated with it.

[0089] For example, when two images are stitched together to form a 360-degree spherical image, and this spherical image is viewed while rotating 360 degrees horizontally, the displayed content may change from a bright and clear outdoor scene to a dark and difficult-to-see indoor scene, but the seam between the images from the two cameras is not noticeable. On the other hand, if the brightness is adjusted during shooting so that the indoor scene is also clearly visible, when rotated 360 degrees as described above, both the outdoor scenery and the interior of the car will be bright and clear, but an unnatural feeling will arise at the seam. With a normal camera, each image is captured and displayed brightly and clearly, but in this embodiment, because of the concept of capturing and displaying a 360-degree spherical image, if an image of a portion of the 360-degree spherical area is displayed while moving in an arbitrary direction, an unnatural feeling will arise if the space is not displayed as continuous when viewed in all 720 degrees. Therefore, as one solution to prevent an unnatural feeling at the seam in this embodiment, the exposure conditions of the first camera 26 and the second camera 27 are made equal, so that they are captured at the same brightness. For example, at night, the outside can be filmed, but the inside of a moving car is dark and difficult to see because the interior lights are off. By filming in the dark, the connection between the images filmed by the first camera 26 and the second camera 27 can be seamlessly joined. In the real world, if the outside is visible but the inside is not visible or is difficult to see, the system is characterized by filming in that state.

[0090] As described above, the exposure control function of the first camera 26 and the second camera 27 shoots at the same shutter speed, but the shutter speed is determined as follows: The brightness is determined based on the image from the first camera 26, which shoots the area in front of the vehicle. One of the functions of the drive recorder 10 is to photograph and record the situation outside the vehicle, such as in the event of an accident. In this configuration, by determining the exposure conditions, such as the shutter speed, based on the image taken by the first camera 26, the area including the area in front of the vehicle can be photographed clearly, and the above-mentioned function of the drive recorder can be performed, which is good.

[0091] As shown in Figure 11(b), an area spot R10 is provided in the upper half of the circular image captured by the first forward-facing camera 26. The metering function of the first camera 26 measures the brightness of the subject within the area spot R10, and the exposure control function takes pictures based on the exposure conditions determined based on the brightness of the subject, which in this embodiment is based on the shutter speed. The peripheral area R11 of the upper half is not used when determining the exposure conditions. The view ahead seen through the windshield 2 is within the range of the area spot R10, and the lower half often contains objects inside the vehicle, such as the dashboard 4. Also, the peripheral area R11 includes scenery behind the lens part with a vertical field of view of 180 degrees or more, so it is not used when determining the exposure conditions. This is advantageous because it allows for capturing and recording scenery in front of the vehicle, such as the vehicle in front. For example, while a typical camera might use center-weighted metering, this system is characterized by metering only the upper half of the image, excluding the lower half. Furthermore, unlike multi-pattern metering which meter the entire screen, it also excludes the peripheral area R11 from metering.

[0092] Furthermore, the lower half and peripheral area R11 are areas where unimportant parts of the car's interior, such as the ceiling and dashboard, are captured. Therefore, even if the metering in these areas is not reflected and they become invisible, it has little impact, which is acceptable. Also, the main body case 13 of the drive recorder 10 may be captured in the peripheral area R11, but since the main body case 13 is not something we want to capture in the first place, it is not a problem if it is not visible. For these reasons, it is best not to use the peripheral area R11 or the lower half of the area to determine the exposure conditions. For example, sports cameras and action cameras that capture a full 360-degree view are used outdoors, so the surrounding area is uniformly bright. Therefore, unlike the exposure control function of a normal camera, the front and rear cameras measure light individually and adjust the exposure based on the metering results. Even if you set the exposure conditions and brightness individually for each, you can take beautiful photos in all directions, and the connecting part No sense of incongruity occurs even within minutes. In contrast, in the installation and operating environment of a dashcam as in the present invention, the brightness of the view in front and the interior of the vehicle at the rear differ significantly, which causes the above-mentioned problems, and this embodiment solves these problems.

[0093] [Differences with the same brightness] In the embodiment described above, exposure conditions such as shutter speed are determined based solely on the metering result of the metering function of the front-facing first camera 26. However, the present invention is not limited to this, and for example, it is preferable to consider the metering result of the metering function of the second camera 27 to some extent when determining exposure conditions. Considering it to some extent means, for example, giving more weight to the metering result of the front-facing first camera 26. By evaluating the metering result of the second camera 27 in this way, it is possible to prevent situations where the image of the car interior captured by the second camera 27 is completely dark and no people are captured. The metering function of the second camera 27 should be similar to that of the first camera 26, with an area spot in the upper center, and should be metered on the area of ​​that area spot. Since this area is where passengers are captured, metering on this area spot and determining the exposure conditions based on that will allow passengers to be captured clearly. Also, since the lower area includes the dashboard, the floor and seats of the car interior, etc., this area is not affected in determining the exposure conditions. The weighting is determined by assigning, for example, +5 to the area spot on the first camera 26 side and +2 to the area spot on the second camera 27 side to determine the brightness.

[0094] Alternatively, contrary to the above modification, the exposure conditions may be determined by prioritizing the metering result of the second camera 27. In this case, the interior of the vehicle can be clearly captured and recorded. For example, in applications where it is necessary to clearly capture the faces of passengers, such as in taxis and buses, this modified configuration is preferable. However, if the metering result of the second camera 27 is prioritized as in this modified configuration, the shutter speed will be longer, and the brightness of the front camera will also be set based on that, which may cause the scenery outside in front to be overexposed and appear white. Therefore, considering the original function of the drive recorder 10, it is better to prioritize the first camera 26, as in the above-described embodiment and modification.

[0095] Furthermore, it is preferable to determine the exposure conditions by treating the metering results of the first camera 26 and the second camera 27 equally without weighting them. This prevents the interior of the vehicle from becoming too dark when the first camera 26 is prioritized, or the scenery in front from being overexposed when the second camera 27 is prioritized, and allows for shooting in all directions. However, in order to record the interior of the vehicle while recording the external situation such as before and after an accident, which is the original function of the drive recorder 10, it is preferable to modify the system to prioritize the forward view from the first camera 26 and also partially incorporate the metering results of the second camera 27.

[0096] Furthermore, it would be beneficial to have a mode setting function that allows users to choose whether to prioritize the metering results of the first camera 26 or the second camera 27. This would allow users to prioritize the view ahead or the interior of the vehicle, depending on their usage. The mode setting function should ideally allow users to choose whether to use only one metering result or both metering results but to set which camera to prioritize, and it would be even better if the degree of weighting could be set.

[0097] In the embodiments and modifications described above, it is assumed that the video captured by a single camera is shot with the same settings throughout without any image processing. However, for example, measures may be taken during shooting to ensure that there is no unnaturalness at the transition points, and the brightness of the transition points may be made the same. However, in such cases, it is necessary to set which area the correction should begin from, and it is preferable to shoot the entire image with the same brightness as in the embodiments and modifications described above because it is easy to configure. Alternatively, the brightness may be adjusted when compositing the images using a PC viewer or the like, as described later, so that the transition points are not noticeable.

[0098] [The main unit case and other components are designed to be difficult to photograph.] The mounting position of the housing 25 to the main body case 13 was shifted from the center of the bottom surface in the front-to-back direction to the rear surface 13b. The angle adjustment mechanism 50 was positioned along the rear surface 13b of the bottom surface. For example, as shown in Figure 6, the flat rectangular main body case 13 is attached and fixed to the windshield 2, so when attached, it is positioned diagonally along the slope of the windshield 2, and the edge of the bottom surface of the main body case 13 on the rear surface 13b side is at the lowest position. By attaching the housing 25 of the camera unit 12 via the angle adjustment mechanism 50 at that lower position, the area in which the main body case 13 is reflected in the first camera 26 and the second camera 27 is reduced.

[0099] The main body case 13 is configured to be positioned close to the lens body. The blind spot area R3, which is not visible to either the first camera 26 or the second camera 27, is conical in shape and narrows as it moves away from the camera unit 12. Therefore, the further the main body case 13 is from the lens unit, the wider the area in which the main body case 13 is visible to both the first camera 26 and the second camera 27, so it is best to position it closer.

[0100] The shape of the main body case 13 is designed to include inclined surfaces 13b'', etc., so that it is as far as possible in the camera's blind spots. Making the camera unit 12 spherical is also good because it will not be reflected in the image. The camera captures images with a 210-degree field of view all around, and since the rearview mirror is near the lens, it is best to make sure that the rearview mirror is in the camera's blind spot and not visible in the image. There are no components such as a GPS antenna inside the camera unit 12.

[0101] [Display device: PC viewer] One embodiment of the drive recorder display device according to the present invention is configured using a personal computer. Although not shown in the figures, the hardware configuration of the drive recorder display device includes an arithmetic processing unit, a memory unit, an input unit, a display unit, and a card reader, etc. The memory unit includes a non-volatile memory for storing application programs executed by the arithmetic processing unit, a work memory used by the arithmetic processing unit during calculations, and an internal or external storage device (hard disk) for recording video, audio, and other information recorded while driving, etc. The input unit is a pointing device such as a mouse or a keyboard. The card reader is a device for reading and writing data to the inserted memory card 23.

[0102] By launching an application program installed in the memory unit (referred to as "PC Viewer" in this embodiment), the personal computer operates as a display device for the drive recorder. As described above, the drive recorder 10 records video and audio captured while driving or parked, as well as various information related to the recorded video, such as date and time information and speed information, onto the memory card 23. When the user wants to play back the video etc. recorded on the memory card 23, they remove the memory card 23 from the memory card slot 22 and insert it into the card reader of the personal computer. They then run the launched PC Viewer and display the video etc. recorded while driving etc. on the display unit. The specific functions of the PC Viewer are as follows.

[0103] Figure 12 shows an example of a display layout displayed on the display unit of a personal computer after launching the PC viewer, selecting recorded video, and starting playback. A menu bar is located near the top edge of the display screen 60, and a display area 62 for displaying the video of the selected data is located in a large area below the menu bar. Below the display area 62, from left to right, are a map display unit 63, a related information display unit 64, and a playlist list display unit 70.

[0104] The menu bar's button group 61, from left to right, consists of a folder selection button 61a, a still image conversion button 61b, a print button 61c, a video conversion button 61d, a backup button 61e, a log data conversion button 61f, and a recording settings change button 61g. 61a is used to specify the data to be played, etc., and the folder selection button 61a is clicked. When clicked, the PC viewer displays a list of folders stored on the memory card inserted into the personal computer. The user clicks to select the folder containing the data they want to play from the displayed list.

[0105] This form of PC viewer includes a function to convert the video displayed in the display area 62, for example, into a still image in a predetermined file format, such as JPEG, and save it. When the still image conversion button 61b is clicked, the PC viewer converts the video of the screen displayed in the display area 62 into a still image and records it in a predetermined storage area of ​​the personal computer. According to the settings, the PC viewer creates and records still images by dividing the currently displayed image or the video in the display area 62 into a specified number of frames over a specified time range.

[0106] This form of PC viewer has a function to print, for example, the video displayed in the display area 62. When the print button 61c is clicked, the PC viewer prints the video displayed in the display area 62 according to the set conditions. The set conditions include, for example, printing the displayed video as a still image, similar to the still image conversion described above, or printing still images obtained by dividing the video in the display area 62 into a specified number of frames over a specified time range.

[0107] This PC viewer has a function to convert and save recorded data into a predetermined file format, such as AVI video. When the user selects and loads the recorded data to be converted, and the video conversion button 61d is clicked, the PC viewer displays a condition setting screen and converts the loaded video data into the predetermined video format according to the settings on that screen. The condition setting screen has input areas for specifying items such as file name, save location, range, subtitles, and compression format, as well as a [Start] button. The user sets the conditions using the input area and clicks the [Start] button. By converting to AVI video, the converted and saved file can be viewed using various video playback software, or uploaded and published on homepages and other sites.

[0108] When the backup button 61e is clicked, the PC viewer backs up the video recorded on the memory card 23 to the personal computer. The video recorded on the memory card is not deleted after the backup. If deletion is required, a separate deletion process is performed. When the log data conversion button 61f is clicked, the PC viewer converts the accumulated history data into a KML file and records it as log data. When the recording settings change button 61g is clicked, the PC viewer displays the recording settings screen (not shown). The user inputs various recording conditions, etc., using the recording settings screen and confirms the contents, thereby storing the recording conditions on the memory card. When the memory card is inserted into the drive recorder 10, the drive recorder 10 updates the recording conditions and operates according to the updated conditions thereafter.

[0109] The map display unit 63 displays a map 63a of a predetermined area and the vehicle's position on the map 63a. The PC viewer acquires map data of the surrounding area where the vehicle is located based on the vehicle's location information associated with the loaded video, displays a map 63a of the set scale on the map display unit 63, and draws a vehicle position icon 63b at the vehicle's current location on the map 63a (see Figures 12(a), (c), etc.). Map data can be acquired, for example, from a server where maps are recorded via the Internet. If data is acquired from the Internet, the map display unit 63 will not display the map if the personal computer is not connected to the Internet. Also, selecting "Do not display map" in the settings will put the map display unit 63 into an operating mode where the map is not displayed.

[0110] Furthermore, if the GPS positioning is unavailable and the current location is unknown, it is preferable to display information instead of a map, for example, as shown in Figure 12(b). For example, it is possible to display the map 63a while not displaying the vehicle's position icon 63b when GPS positioning is unavailable. However, if the vehicle's position icon 63b is not displayed, there is a risk that the user may search for the vehicle's position icon on the map or mistakenly think that there is a malfunction. In contrast, displaying another image or the like instead of the map 63a, as in this embodiment, makes it easy to understand that GPS positioning is unavailable, which is preferable.

[0111] The related information display unit 64 has a timeline display unit 74 at its top, a volume switch button 66 at the upper left below it, a date and time information display unit 73 at the upper right, a playback button display unit 65 below that, a driving speed display unit 67, an acceleration display unit 68, and a latitude and longitude display unit 69 at the lower left of the playback button display unit 65, and an acceleration sensor graph display unit 71 at the lower right of the playback button display unit 65. The timeline display unit 74 shows the position of the video displayed in the display area 62 within a single recording data. The entire timeline of the recording data's playback time is represented by a red bar, and as playback progresses, the position of the knob 74a is moved to the right. When the position of the knob 74a is slid, playback starts from that position. During continuous recording, the location where an event was recorded is displayed with a yellow vertical line 74b (see Figure 12(c), etc.).

[0112] The volume control button 66 is used for muting and adjusting the volume, and has a mute button 66a and a knob 66b (see Figure 16(c)). When the mute button 66a is clicked, the PC viewer mutes the audio being played, and when the mute button 66a is clicked again while the audio is muted, the mute is released. When the knob 66b is slid by operating the pointing, the PC viewer adjusts the volume according to the position of the knob 66b.

[0113] The date and time information display unit 73 is an area that displays the date and time the video being played back was recorded. The time can be either the device time recorded based on the drive recorder 10's internal clock or the GPS time obtained through GPS positioning. In this configuration, the time is changed depending on the recording conditions of the video being played back. If the video being played back is based on continuous recording, the PC viewer displays the device time in the date and time information display unit 73. If the video being played back is based on event recording, the PC viewer displays the GPS time in the date and time information display unit 73 if GPS positioning occurred at the time of the event, or the device time if GPS positioning was not obtained. Furthermore, when the recorded data is displayed using the device time during playback (see Figure 12(b)), the display is updated to the GPS time when GPS positioning is performed (see Figure 12(c)).

[0114] The playback button display section 65 is a group of buttons for performing operations such as playback and fast forward. From left to right, it includes buttons for "rewind," "previous frame," "reverse playback," "stop," "play," "next frame," and "fast forward." When each button is clicked, the PC viewer performs the corresponding action. If the "rewind," "reverse playback," "play," or "fast forward" buttons are clicked multiple times, the PC viewer changes the playback speed. For example, clicking "play" or "reverse playback" once will play at the normal speed of 1x, while clicking it twice will play or reverse at a slower speed, such as 0.5x. Similarly, clicking "rewind" or "fast forward" once will play at 2x speed, clicking it twice will play at 4x speed, clicking it three times will play at 8x speed, and clicking it four times will play at 16x speed. The "Play / Reverse Playback" function adjusts the playback speed in the slower direction, while the "Fast Forward / Rewind" function adjusts the playback speed in the faster direction. This makes it easy to switch abruptly from high-speed playback to slow playback, or vice versa. Furthermore, by combining the speed adjustment function with buttons that already perform high-speed playback, such as "Fast Forward," users can intuitively understand the assignment, which is a good feature.

[0115] As shown in an enlarged view in Figure 16(a), the driving speed display unit 67 displays the driving speed recorded by GPS. This is the area for displaying degrees. The acceleration display unit 68 is the area that displays the recorded impact and acceleration values ​​in the forward / backward (X direction: e.g., red), left / right (Y direction: e.g., yellow-green), and up / down (Z direction: e.g., blue) directions. The latitude / longitude display unit 69 is the area that displays the latitude (N) and longitude (E) recorded by GPS. These driving speed, acceleration, and longitude / latitude are all information about the current location of the video displayed in display area 62. The acceleration sensor graph display unit 71 is the area that displays the acceleration sensor graph in time series. The recorded data is displayed as a graph with acceleration on the vertical axis and time on the horizontal axis. In this embodiment, the X-axis acceleration graph 71a, Y-axis acceleration graph 71b, and Z-axis acceleration graph 71c are displayed, and the display colors of the graphs are the same as the display colors in the acceleration display unit 68. This makes it easier to understand the correspondence between the two. When an area is clicked, the PC viewer moves the cursor 71d to the clicked location and displays the driving speed, acceleration, and latitude / longitude in each display unit, with the cursor 71d's position as the current location. When the play button is clicked, the PC viewer plays the video from the cursor 71d's position. The PC viewer retrieves various information stored in association with the video being played and displays it in the corresponding display unit.

[0116] Below the graph is a time display unit 71e. From left to right, the time display unit 71e shows the recording release time of the recorded data to be played back, the current time at the cursor position, and the recording end time. If there is an impact with acceleration exceeding the standard value, the time at which the testimony occurred is displayed on the graph as the event time 71f. On the right side of the graph are a + button 71g, a back button 71h, and a - button 71i. When the + button 71g is clicked, the PC viewer enlarges the acceleration sensor scale, and when the - button 71i is clicked, the PC viewer reduces the acceleration sensor scale. When the back button 71h is clicked, the PC viewer returns to the standard scale.

[0117] The playlist display unit 70 displays the name of the selected data. In Figure 12, the data name "2016 / 09 / 06 11:47:28 [48 minutes]" is displayed. In the case of continuous recording, the data name is a combination of the date and time the recording started and the recording time. In the case of event recording, the data name is the date and time the event occurred and the type of event that occurred. The types of events that occurred include "impact" and "sudden acceleration / sudden braking" based on the acceleration sensor, and "one-touch" based on the operation of the switch unit 28.

[0118] Display area 62 is the area where the recorded video is displayed. As described above, the drive recorder 10 in this form records omnidirectional video of 720 degrees, 360 degrees horizontally and 360 degrees vertically. Therefore, the PC viewer has the function of displaying, for example, a portion of the omnidirectional video in display area 62, or displaying the omnidirectional video as a single image. When displaying a portion of the video, the display area 62 can be changed to display video of a desired range in any direction (front, back, left, right, up, or down) by changing the display range, direction, etc. The changes to the display range, etc., are configured as follows.

[0119] For example, as shown in Figure 13(a), when a predetermined range in front is displayed, the user uses a pointing device such as a mouse to drag the left button at any position in the display area 62. When the PC viewer detects that such a left-button drag operation has been performed, it moves the displayed image in the display area 62 in the direction of the drag. For example, as shown by arrow 75 in Figure 13(a), if the user drags a predetermined distance to the right in the display area 62, the PC viewer moves the displayed image to the right by that distance, and the image that was outside the left of the display area 62 in Figure 13(a) is drawn in the display area 62, while the image that was displayed on the right side of the display area 62 in Figure 13(a) is outside the display area and is no longer displayed (Figure 13(b)). As a result, the image displayed in the display area 62 changes as if the line of sight is rotating to the left, and in the example shown in the figure, the left front The scenery will be displayed. You can increase the drag distance or repeatedly drag in the same direction. By dragging, the displayed image rotates horizontally counterclockwise around the position of the camera unit 12 of the drive recorder 10, showing the view from directly to the left, then to the rear (inside the vehicle), then to the right, and finally returning to the original display direction shown in Figure 13(a) facing forward. By dragging in the opposite direction, to the left, the view seen while rotating clockwise is displayed in the display area 62. Moving the displayed image to the right / left in this way is like stretching a 360-degree horizontal image horizontally like a panoramic photograph, and then moving the display area 62 left or right to display the image within the display area 62 (see Figure 20).

[0120] The drag direction is not limited to horizontal; it can be moved in any direction within the display area 62, such as up, down, or diagonally, and the PC viewer changes the displayed image according to the direction of movement. The user can display and view the desired image by dragging the left mouse button and moving the pointer to the part they want to display.

[0121] When the mouse right-clicks while the pointer is within display area 62, the PC viewer displays the image display area menu shown in Figure 13(b). This screen display area menu is drawn, for example, overlaid on display area 62. This image display area menu has an "Image Status" item at the top that displays the current orientation of the image, and below it are three operation items: "Return to Normal," "Flip," and "Zoom In / Out." In the figure, "Image Status" displays "Forward Rotation," which is the state shown in Figure 13(a).

[0122] When "Restore to default" is clicked and selected, the PC viewer returns the inverted, enlarged, or reduced image to its initial display and displays the restored image in display area 62. "Invert" has three submenu items: "Invert horizontally," "Invert vertically," and "Invert front to back." When "Invert horizontally" is clicked, the PC viewer inverts the displayed image horizontally (see Figure 13(d)). When "Invert vertically" is clicked, the PC viewer inverts the displayed image vertically (see Figure 13(e)). When "Invert front to back" is clicked, the PC viewer inverts the front to back of the displayed image and displays an image rotated 180 degrees. For example, when the video of the front is displayed as shown in Figure 13(a), clicking "Invert front to back" will display the image of the interior of the car behind the dashcam as shown in Figure 13(f). "Enlarge / Reduce" has two submenu items: "Enlarge" and "Reduce." When "Zoom In" is clicked, the PC viewer displays the image enlarged by 200% from the center of the displayed image (see Figure 14(a)). When "Zoom Out" is clicked, the PC viewer displays the image reduced by 50% from the center of the display screen (see Figure 14(a)). By changing the viewing direction as needed in this way, the driving situation can be checked from all directions.

[0123] To play back recorded data, the user selects the desired video list from the playlist display unit 70 and executes the playback. In this configuration, the data is grouped into event recordings, continuous recordings, and history recordings, and the user selects one of these groups to play back. Therefore, the user clicks either the event recording tab 70a, the continuous recording tab 70b, or the history recording tab 70c. For example, Figure 15 shows the state when the event recording tab 70a is clicked.

[0124] When the Event Recording tab 70a is clicked, the PC viewer creates and displays a list of event record data recorded on the memory card. The user selects the video data they want to view by clicking the checkbox 70d corresponding to the data name. When a checkbox 70d is clicked, the PC viewer displays a check mark "✓" next to it. Multiple data can be selected at once. When the Load button 70e is clicked, the PC viewer loads the selected recording data. The data name is displayed in the playlist, and the video is displayed in display area 62. If you select data, multiple data names will be listed in the playlist, and the top video will be displayed.

[0125] The video displayed in display area 62 along with the recorded video playback will be a predetermined main image. The main image is, for example, an image facing a desired direction, such as the front of the vehicle, and is a standard-sized image set as the initial display (see Figure 17(a), etc.). The standard size should be, for example, a range of 120 degrees horizontally and 70 degrees vertically. This range corresponds to the field of view used in typical dashcams, so it will be a familiar image to users of typical dashcams, and they will be able to obtain the same necessary information as with a typical dashcam. This main image should show the entire windshield.

[0126] In this embodiment, when the drive recorder 10 is mounted on a vehicle, in the normal installation state with the camera unit 12 adjusted to the desired orientation, the first camera 26 faces directly forward. Therefore, assuming that the center of the image captured by the first camera 26 is facing directly forward, a predetermined area is cropped to a standard size and displayed in the display area 62.

[0127] Furthermore, it would be beneficial to have a function that calculates the front position when displayed on a PC viewer from the installation angle obtained when correcting the installation angle using the accelerometer, and sets the standard position of the displayed image to the calculated front position. This assumes that the vertical direction to the accelerometer and the front of the camera are parallel. Then, from the angle between the direction of gravity at the time of installation and the vertical direction of the accelerometer, an angle is determined such that the direction of gravity is directly downwards, and the vertical direction of the accelerometer and the front of the camera are determined to be perpendicular to this direction in which the direction of gravity is directly downwards, with the center of the displayed image being set. This is beneficial because, for example, even if the user mistakenly installs the camera to the side instead of on the windshield, the front can be detected from the direction of gravity and displayed as the standard position.

[0128] Although a detailed illustration is omitted, when the continuous recording tab 70b is clicked, the PC viewer creates and displays a list of continuously recorded data stored on the memory card. The PC viewer imports the recording data selected by the user, displays the data name in the playlist of the playlist display unit 70, and displays the video in the display area 62. When the trigger list display button 70f is clicked, the PC viewer displays the event trigger list 70h in the playlist of the playlist display unit 70 (see Figure 16(b)). When an item in this trigger list 70h is clicked, the PC viewer jumps to the recorded event and plays the video. In this way, the video of the part where the event occurred can be efficiently played back and its contents can be checked.

[0129] Furthermore, the processing based on the playback button display unit 65 and the volume switching button 66 described above are also performed based on the playback button 72a on the menu bar. For example, as shown in Figure 16(d), when the playback button 72a on the menu bar is clicked, the PC viewer displays a pull-down list of menu items 72b as shown in the figure. When a desired item in the menu list 72b is clicked, the PC viewer performs the playback operation for that item. In addition, although not shown in detail, the system also has a function to display a pull-down menu of items that perform the above-mentioned processing based on the click of the buttons for "File," "View," and "Tools" on the menu bar, and to perform similar processing based on that menu.

[0130] [A function that displays the driver and passengers' reactions along with the scenery outside the car on a single screen, with the scenery flowing smoothly.] As mentioned above, at the start of playback, a predetermined reference image is displayed, and thereafter, the user can change the viewing direction, zoom in / out to change the field of view according to their actions, allowing for viewing in any direction. You can view the video. For example, by reducing the size to widen the field of view, the front and back of the reference image can be viewed. It is preferable to display the rearward-facing image captured by the second camera 27 by inverting the image or changing the viewing direction by 180 degrees horizontally. Such a display configuration would be as shown in Figure 17(b), for example, with the driver and the interior of the vehicle displayed in the central part 81 of the display area 62, and the scenery outside the vehicle displayed in the surrounding part 82. If further reduced, the entire 360-degree image would be displayed as a single screen, as shown in Figure 18, for example. Note that, as is clear from comparing Figure 17(b) and Figure 18, the subjects captured are different, and these figures are intended to help understand the image of the display configuration due to the difference in scale.

[0131] This display mode is good because it shows the outside scenery flowing from the center outwards to the left and right rear, creating an interesting image that is not normally seen. Simply looking at the standard image from the front, although this is the original function of a dashcam, shows only the scenery and vehicles in front, which is not very interesting and is not very engaging. However, with the above display mode, you can see scenery that you wouldn't normally see, which is good. For example, recently, travel programs on television have been showing footage of the inside of the car, such as the driver and passengers, filmed with a camera placed on the dashboard, but the footage and display only shows the driver and passengers, and the outside scenery is not captured, or if it is captured, it is only a small part visible through the rear window of the driver and passengers. With this mode, the driver and passengers in the front and rear seats are displayed in the central part 81, and the outside scenery on the left and right sides flows around the periphery, which is interesting. And it is good because it can simultaneously provide viewers with images of celebrities having fun inside the car and beautiful scenery outside.

[0132] Furthermore, in this display mode, the images displayed in the peripheral area 82 show not only the scenery to the left and right of the vehicle, but also a wide range of scenery to the left and right of the front of the vehicle, as captured by the first camera 26 and the second camera 27. Thus, a characteristic feature is that the front and rear parts are displayed within a single screen. Behind the user, the image captured by the second camera 27 is displayed behind the user, while the outside scenery captured by the first camera 26 and the second camera 27 slides sideways and flows around to the rear. This can be described as a view as if there were a virtual camera outside the vehicle, or a virtual viewpoint outside the vehicle, giving the impression that the vehicle has become transparent and is viewed from a distance. In this way, scenery that would not normally be visible can be seen.

[0133] [Viewer's composition function] As described above, in this embodiment, a 360-degree spherical image is created by stitching together two images captured by the first camera 26 and the second camera 27, respectively. The field of view of both cameras is set to 210 degrees horizontally when mounted and fixed in their normal positions, and the surrounding areas captured by each camera become overlapping areas where the same scenery, etc., is captured. When superimposing these overlapping areas, a gradient is applied for synthesis. That is, for example, as shown in the second area R2 in Figures 8(b) and (c), the display in the overlapping connecting area becomes lighter towards the periphery. For example, if the second area R2 is the area to be processed with a gradient, then, for example, the boundary with the first area R1 is set to 100% at 0% at the periphery, and the density in the intermediate area is gradually changed. Since the resolution also decreases towards the periphery, it is made less visible and the impact on the display is reduced. In addition, as described above, there is a risk that the same person or other object may be displayed as a separate object in the images from each camera, but by applying a gradient, even if they are displayed as separate objects, this is less noticeable.

[0134] [Mask function, etc.] The drive recorder 10 in this configuration, which captures and records a 360-degree view, also captures the appearance of the driver and passengers, as shown in Figures 17(b), 18(a), and 19. For example, while it is good to capture and record the scenery and the interior of the car, there is a desire to avoid being captured in the image oneself. The PC viewer in this configuration is equipped with a masking function, and the masked area 62b is output in a display mode that is less visible than the normal display area 62a. The setting for the masked area 62b, which is made less visible, can be fixed, for example, or it can be set based on user specifications. In the case of fixed locations, for example, the approximate position within the vehicle interior, such as near the driver's seat or near the passenger seat, is determined. It is preferable to set the area in the video corresponding to the area being masked as the mask area 62b. Furthermore, a function to set an arbitrary mask area 62b based on user specification is possible, for example, by having the person to be masked appear in the display area 62, and then specifying the location to identify the area using a mouse. When a designated mouse button is clicked, the PC viewer memorizes that location and sets the inside of the shape with the clicked location as the mask area 62b. When playing back the video, the PC viewer sets the area in the video captured by the second camera 27 corresponding to the memorized clicked location as the mask area, and then plays back and displays the video with the corresponding area masked. Having a function to set a mask area 62b by user specification is preferable because it allows masking to be applied to any arbitrary area.

[0135] Displaying within the mask area 62b can be done in various ways, such as applying a mosaic effect, reducing the resolution, or filling it with a predetermined color. When filling it with color, it is best to adjust the transparency appropriately so that it is still faintly visible rather than completely filling it with a solid color.

[0136] It is preferable to have a function to automatically set the mask area 62b. The automatic setting function can be as follows, for example. For example, images of faces of people to be masked, such as users, can be registered in advance, and the system can recognize the registered people, such as users, inside the vehicle using image recognition, and set a predetermined area including their faces as the mask area. However, it is preferable to set it based on the movement speed and displacement speed within the image. For example, while the vehicle is moving, the relative movement speed of people and objects outside the vehicle is fast, while the movement speed of people inside the vehicle is slow. Also, seats and other installed objects inside the vehicle do not move. It is preferable to set the mask area for things within a certain speed range based on this difference in movement speed. In this way, no prior registration is required, masking can be done with simple processing without image recognition, and even if unregistered people are in the vehicle, masking can be done for passengers, making it versatile and desirable.

[0137] [Specific Image Display Function] As mentioned above, the PC viewer allows users to pause the video at any point, change the viewing direction, invert the image vertically, zoom in and out, and display any direction in any direction at a desired field of view, according to user input. While changing the viewing direction and field of view during playback can create interesting and engaging video, there is a risk of losing track of which direction the currently displayed video is facing. Therefore, it would be beneficial to include a function that allows for one-touch display of a specific direction. For example, clicking the "Restore to Default" item in the screen display area menu shown in Figure 13(b) resets the display area 62 to its initial display. Similarly, clicking a button or item located in a specific place, such as the menu bar or another arbitrary location, would allow for one-touch display of a specific direction, such as front, back, left, or right. Having such a function would be beneficial because it would allow for one-touch display of the desired direction, regardless of the current display direction. Furthermore, the specific direction should not be the front, back, left, or right directions centered on the dashcam, as mentioned above. For example, when displaying the rear view, it's better to display it diagonally behind rather than directly behind. Diagonally behind should be facing towards the driver's seat. This way, the situation inside the car is captured with the driver at the center, which is good. In addition to the masking function mentioned above, this is preferable for users who want to see themselves, as it displays the view from a self-centered perspective.

[0138] Furthermore, as mentioned above, the function is not limited to displaying a predetermined direction with a single touch. In addition to this function, or as an alternative to this function, it would be desirable to have a function that allows users to register the viewing area during playback in a bookmark-like manner, and then display the saved image with the same direction and angle of view with a single touch or other simple operation during subsequent playback.

[0139] [A function that displays a specific direction or orientation so that it aligns with a specific location.] A dashcam that captures a full 360-degree image, as in this form, can widen the field of view as shown in Figure 18. One of its features is the spherical display, as shown in the image. When a PC viewer displays the image as a sphere in this way, with the center of the circle representing the ground and the outer circumference representing the sky, it is advisable to store and associate positional information, for example, from a geomagnetic sensor, and then display the image so that north is at the top during playback.

[0140] In the embodiments described above, the standard display is set so that the vehicle's bonnet is in a specific position and the view ahead while driving is centered. In addition to this display mode, it is desirable to have a function that displays a specific direction (e.g., north) in a specific position (e.g., top), as described above. Displaying north at the top, for example, is preferable because it improves matching with the map. For example, when displaying a map with North Head and displaying footage taken by a dashcam at a corresponding location on the map side by side, if the footage is also displayed with north at the top, the upper part of the footage will be north, making it easy to match buildings and other landmarks in the footage with buildings and other landmarks on the map. Thus, setting a specific direction to "north" is particularly convenient when viewing it together with a map. Furthermore, it is beneficial because it makes it easy to record situation reports, such as "collision with a vehicle approaching from the south," when creating an accident report. It is also beneficial because it makes it easier to correlate footage taken by multiple dashcams. Whether using a circular display or a 360-degree panoramic view, it's best to ensure that the north side is positioned correctly.

[0141] Furthermore, the direction you choose to face is not limited to compass directions; for example, you could choose a destination or a specific landmark. However, setting it to a direction, especially "north," is preferable because it allows for better matching with the map.

[0142] Furthermore, when a specific direction such as "North" is displayed at the top, it is beneficial not only for its good matching with the map, but also because, for example, the vehicle's direction of travel can be easily inferred from the flow of images during video playback. For example, if "North" is displayed at the top and all directions are displayed on one screen as in Figure 18, when traveling north, the scenery outside displayed in the surrounding area R11 on both sides of the circle will flow from top to bottom during playback. On the other hand, when traveling south, it will flow from bottom to top, the opposite of the above, and in the east-west direction, the upper and lower parts of the circle will flow horizontally. In this way, it is good because it is easy to understand which direction the vehicle is traveling from the flow of images. Also, the direction displayed at the top is not limited to "North"; by displaying another specific direction at the top, the direction of travel of the vehicle can be determined from the flow of images.

[0143] For example, with sports cameras and action cameras that capture a full 360-degree view, it's best to display the subject, such as a child, in the center. However, with dashcams, if the primary purpose is to record accidents, the subject becomes non-unique because it's impossible to predict where the danger will come from—such as a rear-end collision with a vehicle in front, or a collision from the side or rear. Therefore, focusing on direction and assigning a specific direction (e.g., "north") to a specific position (e.g., "up") is beneficial because it provides various advantages, as mentioned above, such as "the direction of what's being filmed is immediately clear," "the direction of travel of the vehicle can be easily inferred from the flow of images during video playback," "the matching with maps improves," and "it becomes easier to correlate footage from multiple dashcams or footage previously filmed at the same location."

[0144] [A variation of the spherical representation] For example, when a spherical display is used as shown in Figure 18, a region without an image is created outside the circular display area 62a where the image is displayed within the display area 62. Therefore, the PC viewer should provide an additional information display unit 78 in this region without an image, and display various information such as the direction of travel of the vehicle, road information such as the name of the road being traveled, and pedestrian information on the additional information display unit 78 (see Figure 18(b)). In Figure 18(b), the additional information display unit 78 is provided in the lower left, but The placement is arbitrary, and multiple items can be placed. Placing multiple items will display more information. It's good because it's possible.

[0145] For example, the PC viewer performs image recognition processing on the displayed image to extract people. If people are extracted, the PC viewer displays text information indicating the presence of people, such as "There was a person." In addition, it is advisable to draw marks such as arrows on the parts of people displayed within the display area 62a of the display area 62 to make their location clearer. This is beneficial because it makes it easy to confirm, for example, whether a person was approaching or moving away from a vehicle. Furthermore, instead of displaying all people when they are recognized, it is advisable to use image recognition or other personal authentication to detect specific people and then display information that identifies the detected person, such as their name.

[0146] In this case, it would be good to display people outside the vehicle and people inside the vehicle separately. For example, if a person is outside the vehicle, their presence should be displayed to determine whether there is a risk of contact, etc. If a person is inside the vehicle, they should be identified as an acquaintance, and that information should be reported.

[0147] [Multiple screen display function] In the embodiments described above, the display area 62 displays one image based on a single viewpoint, such as the entire 360-degree image or an image cropped from it. However, the present invention is not limited to this, and it is preferable to display multiple different images simultaneously. This allows users to view images from multiple different directions, eliminating blind spots and providing a more engaging viewing experience.

[0148] For multiple images from different directions, it is preferable to display the forward scenery on the first image display unit 76 and the interior of the vehicle on the second image display unit 77, as shown in Figure 19. This is beneficial because it allows for a linked confirmation of the driver's and passengers' reactions when they see the forward scenery. For example, if there is footage of the driver or passengers being impressed or happy when they see a beautiful landscape, the correlation with the scenery becomes clear, which is helpful for recalling the itinerary of the road trip. The first image display unit 76 and the second image display unit 77 may be the same size as shown in the figure, but it is preferable to have a difference in size to create a main image display unit and a sub-image display unit. Varying the sizes of the main and sub displays makes the image displayed on the main image display unit easier to see, which is beneficial. When dividing into main and sub in this way, the main image should be a frontal image showing the view ahead, and the sub-image should be footage of the interior of the vehicle showing the driver, etc. This allocation is preferable for the dashcam to perform its intended function. The sub-image may also be, for example, the left or right side of the vehicle. This method is good because it allows us to identify accidents such as those caused by collisions from the side.

[0149] [Automatic editing and playback function] When the entire panoramic image is displayed, it appears as a circular image, as shown in Figure 18. The PC viewer has a function to enlarge a portion of the image and project it onto a flat surface for display. As mentioned above, the PC viewer allows users to zoom in and out of the panoramic image and move the display range based on mouse operations such as dragging and button operations while the image is playing. This user operation is cumbersome and inconvenient. Therefore, it would be beneficial to have a function that automatically extracts and displays an appropriate portion of the overall image without user intervention. It would also be beneficial to have a function that automatically changes the angle and field of view displayed on the screen during playback of the panoramic image.

[0150] For example, it would be good to have a function that automatically changes the visible range (viewport) in the video in conjunction with vehicle information. Changing the range can be done through actions such as zooming in, zooming out, and panning.

[0151] For example, while driving, the area directly ahead is magnified and displayed, such as Mount Fuji or other points of interest. - If there are points of interest nearby, it is desirable to automatically pan the viewport in the direction of those points during playback. Such a function would, for example, store the position information of the viewpoint, determine the direction of the viewpoint from the position information of the vehicle being played back, automatically move the cropping position, and pan in that direction during playback.

[0152] Furthermore, for example, when driving on a highway, the video captured by the first camera 26 continuously displays the vehicle in front, and the scenery remains unchanged, especially in sections of the highway where sound barriers are installed on both sides or inside tunnels. Continuously watching such video in the same direction becomes boring and is generally not something one wants to watch, creating a problem where even if continuous recording is performed, there is little incentive to play it back. Therefore, it would be good to have a function that cuts out such unnecessary parts, skips them, and plays back only the parts that are likely to be interesting. For example, if the location where the video was taken is a highway according to the map information, it would be good to skip and play back only the part after exiting the highway at an interchange. Moreover, this should not be limited to highways; it would be good to also skip within registered areas such as around one's home.

[0153] Furthermore, if the vehicle stops while driving, it will continue recording the same video while stopped. This means that during the pause, the playback video may display the same image like a still image, which is undesirable. Therefore, it would be acceptable to skip the display while stopped, as is done on highways, and resume playback from the point when driving resumes. Alternatively, if the vehicle comes to a stop while driving, it would be better to automatically rotate the display as if the camera were turning its head from side to side around the sky. When stopping, drivers often want to check their surroundings, and this would simulate that checking action. The rotation also makes it clear that the vehicle has stopped, which is beneficial.

[0154] This approach is beneficial because it automatically plays back interesting scenery, providing an incentive to review recorded footage. It would also be good to include a function to record the played-back footage. Furthermore, it would be beneficial to include a function to record the viewport footage as a separate video file. This would allow the viewport information to be exported to a separate file and uploaded to the internet for public sharing, which is a good feature.

[0155] Furthermore, there are television programs that switch between, for example, footage of the scenery inside a train, overhead shots taken from above using drones, and views of the outside from inside the train. As mentioned above, if it were possible to automatically play back interesting scenery from the footage of one's own journey, videos like the television programs described above could be created and played back, which would be great to watch after a trip.

[0156] For example, with sports cameras and action cameras that capture a full 360-degree view, the photographer holds the camera by hand and operates it, so one lens is pointed towards the subject they want to photograph. Therefore, even if the recorded footage is played back as is, it is the desired image, and there are relatively few problems even if the viewport is fixed and editing is not required. In contrast, dashcams are mounted in the vehicle and record continuously, so there is a high risk of playback including unnecessary footage that is not of interest or footage that is not facing the desired direction, which is likely to cause the aforementioned problems. This form solves this problem.

[0157] [Drive recorder with display unit] It is preferable to equip the drive recorder with a display device that has the functions of the PC viewer described above. In the embodiment described above, the drive recorder does not have a display unit, and the video captured by the camera is recorded on the memory card 23 and viewed on a personal computer's PC viewer. However, as in this embodiment, equipping the drive recorder with a display device allows the video to be viewed in real time, which is advantageous. A portion of the 360-degree image provided by the PC viewer can be cropped and displayed. It would be helpful if the displayed area could be moved, enlarged, or reduced.

[0158] For example, displaying images of the sides and rear of the vehicle while driving is beneficial because the driver can see the surroundings of the vehicle simply by shifting their gaze slightly towards the display device while still looking straight ahead. Also, for example, displaying images of the interior of the vehicle captured by the second camera 27 on the display device is beneficial because the driver can check on things like infants or children in the back seat, or other passengers, without having to turn around. In particular, the area behind the driver's seat is difficult for the driver to see directly, but for example, by mounting the drive recorder 10 in the center and upper part of the windshield, the area behind the driver's seat can be clearly captured and displayed, which is beneficial.

[0159] Furthermore, in cases where a zoom function like that of a PC viewer is not available, for example, if the images captured by either the first camera 26 or the second camera 27, or both, are displayed in a circular shape, it is advisable to provide an additional information display unit 78 in the area outside the circle, as shown in Figure 18(b), to display various types of information.

[0160] [Dashcam with a function to notify the situation inside the vehicle] It would be beneficial to have a function that uses the video footage from the second camera 27 to determine the condition of passengers and provide notifications. For example, it would be good to determine if an infant or child sleeping in the back seat is about to wake up or is sleeping soundly, and provide notifications if they seem about to wake up or become fussy. This would eliminate the need to periodically check the back seat, allowing the driver to concentrate more on driving.

[0161] Furthermore, it would be beneficial to have a function that extracts people from the video footage captured by the second camera 27 using image recognition processing, counts the number of passengers, and notifies the system. This is preferable because it allows for immediate confirmation of whether everyone is on board. This is especially beneficial because it ensures that people behind the driver's seat, which is particularly difficult to see, are not overlooked and can be identified reliably and smoothly. This is particularly desirable for vehicles with a large number of passengers, such as buses, where the number of passengers can be quickly confirmed.

[0162] In this way, it would be good to have a function that focuses on and counts people inside the vehicle, recognizes their status, etc., and notifies the results by display or sound. Whether or not someone is inside the vehicle can be easily distinguished by, for example, performing person recognition processing within the area corresponding to the inside of the vehicle, or by determining the degree of movement (for example, if the vehicle is moving, those with less movement are inside the vehicle).

[0163] [A dashcam with only one of its two cameras capable of capturing a hemispherical region.] In the embodiments described above, the first camera 26 and the second camera 27 are both cameras that capture an area of ​​hemisphere or larger, but the present invention is not limited to this. In one invention, one of the two cameras may be a third camera that captures an area of ​​hemisphere or larger, and the other may be a fourth camera that captures an area smaller than the hemisphere, and the two cameras may be configured to have different shooting areas. The third camera may be, for example, a hemispherical camera with a full 180 degrees, and the fourth camera may be a wide-angle camera used in conventional dashcams, for example, a wide-angle camera with a horizontal of 120 degrees and a vertical of 70 degrees.

[0164] The third camera, for example, when the dashcam is mounted and fixed to the roof of the vehicle, has its lens facing downwards and captures a 360-degree horizontal and 180-degree vertical area. The fourth camera, when the dashcam is mounted on the vehicle, captures the area in front of the vehicle.

[0165] While I will omit specific diagrams, it is preferable to place the third and fourth cameras in a single housing. When arranged in a single enclosure, for example, the enclosure may have a rectangular box shape with a hemispherical portion protruding from one side. The third camera is mounted on the hemispherical portion, and the fourth camera is mounted on the rectangular portion. The lens of the fourth camera is positioned at the apex of the hemispherical portion, and the lens of the third camera is positioned so as to be exposed on one side adjacent to the hemispherical portion. When the drive recorder is mounted on the roof of the vehicle via a mounting member, the hemispherical portion is positioned downwards, and the side with the lens of the fourth camera faces directly forward towards the vehicle.

[0166] For example, the hemispherical camera that constitutes the third camera captures the lower half of the hemisphere, but the image of distant objects outside the vehicle is too small, making it difficult to understand the situation, for example, in the event of an accident. Also, traffic lights are located diagonally above the vehicle, so they are often not included in the shooting range. Therefore, in this configuration, a fourth camera that constitutes the forward camera is provided to enable shooting of areas in front of the vehicle that are difficult or impossible to capture with the third camera.

[0167] It would be good to switch the operation of the two cameras depending on the situation. For example, while driving, the third and fourth cameras can be operated to capture the hemispherical area in front of and below the vehicle, and the footage from both cameras can be recorded simultaneously to the memory card. In this way, for example, in the event of an accident, if the collision occurs on the front side of the vehicle, a clear and sharp image can be recorded based on the footage from the fourth camera, just like with a conventional dashcam. If the collision occurs on the side or rear of the vehicle, which is a blind spot for the fourth camera, a clear and sharp image can be recorded based on the footage from the third camera.

[0168] Furthermore, for example, when parked, only the third camera is activated for security monitoring. While 360-degree dashcams operate both cameras even when parked, this configuration allows only the third camera to operate, which reduces power consumption and enables longer recording and security monitoring, thus improving performance. Parking is detected based on criteria such as engine off, no one in the driver's seat, the handbrake being engaged, speed at 0 km / h, and current location being the home parking lot.

[0169] Furthermore, while driving, it is acceptable to operate only the fourth camera, but it is preferable to use both the third and fourth cameras in combination, as this allows for recording of the vehicle's surroundings, especially collisions from the side or rear. The operation of both cameras can be switched as follows: for example, while traveling on a highway or to a destination, the fourth camera can be used to record the view ahead as a precaution against accidents. As you approach your destination, the surrounding scenery is often beautiful, so the third camera can also be activated to record the scenery.

[0170] Alternatively, the third camera may be used for monitoring while parked, and the fourth camera may be used to capture the view ahead while driving; in other words, only one of the cameras may be operated at a time. This usage configuration allows switching between forward-focused video and video focused on the area around the vehicle, depending on the purpose.

[0171] Sending real-time video from one of the cameras to a smartphone or server is beneficial for real-time monitoring. While it's possible to fix the transmission to one camera, a good approach would be to use the fourth camera's footage while driving and the third camera's footage while parked.

[0172] Furthermore, the idea of ​​using a single camera for security monitoring while parked to extend the operating time can also be applied to, for example, a drive recorder that captures a 360-degree view. In this case, for example, a wide-angle camera could be installed in place of the switch unit 28 of the drive recorder 10 to create a three-camera system, and only the wide-angle camera could be configured to operate while the vehicle is parked.

[0173] [Dashcam with one camera] In the embodiments described above, multiple cameras were combined to capture an area wider than the hemisphere, but in this embodiment, a single camera captures an area wider than the hemisphere. We decided to take pictures. We used a 180-degree hemispherical camera and attached it to the ceiling to capture the lower part. When attempting to photograph a hemisphere, the following problems arise.

[0174] Resolution is best in the center of the captured circular image and lowest at the edges. Therefore, for example, in parking surveillance, it is desirable that one camera can capture 360 ​​degrees horizontally, but the forward scenery, such as the vehicle in front, is located at the edge of the captured circular image, resulting in poor resolution. Furthermore, if the camera is attached to the ceiling, for example, it is possible to capture the vehicle in front and the driver in a full 180 degrees, but in addition to the low resolution mentioned above, it is not possible to capture traffic lights located above the vehicle. In particular, capturing traffic lights is essential in order to identify the route traveled and the color of surrounding traffic lights in the event of an accident, and the inability to capture them presents a problem.

[0175] In this configuration, for example, a 240-degree panoramic camera is used, and one of these cameras is mounted facing downwards to capture the lower hemisphere and the area diagonally above it, creating a dashcam. This allows the camera to capture not only the vehicle in front and the driver and passengers inside, but also traffic lights.

[0176] If we assume an angle of 210 degrees, there is a risk that the traffic lights will not be photographed, so the lower limit is 220 degrees. On the other hand, while a larger angle ensures that the traffic lights can be photographed, a larger angle means that more area is captured within the same circle, resulting in smaller objects being photographed. If the traffic lights are not photographed at a certain size, the colors of the signals cannot be distinguished, rendering the recording meaningless. Therefore, 260 degrees is the upper limit, ensuring a suitable size for discrimination. A more preferable range is 230 to 240 degrees, and in this embodiment, we set it to 240 degrees.

[0177] Furthermore, this configuration incorporates a microwave sensor and LTE communication capabilities. The device is activated when the microwave sensor detects approaching a vehicle. In other words, to conserve the vehicle's battery, the CPU, camera, and LTE are kept in sleep mode during standby. When the microwave sensor detects movement, the device is activated from sleep mode. Since activation takes 5 to 10 seconds, the device is activated by the microwave sensor, and when the accelerometer or door open sensor detects movement, images are transmitted via LTE to notify the user carrying a smartphone.

[0178] Since microwave sensors react to all moving objects, in this configuration, notifications should be based on accelerometer or door open sensor detection to suppress frequent notifications. It would be beneficial to include a mode setting that sends real-time video to a smartphone, allowing users in remote locations to view it on their phones.

[0179] [Other features] The camera body and GPS should be separate units, and the vehicle should have a GPS tracking function that allows tracking even if the camera is destroyed or stolen.

[0180] In each of the embodiments described above, the drive recorder should preferably have a function to automatically upload video footage taken around a mobile speed camera or the like to a server.

[0181] It would be good to have a feature that connects the dashcam to an in-car device such as a car navigation system, and displays the video captured by the camera on the car navigation system.

[0182] In each of the embodiments described above, the drive recorder equipped with two cameras was configured to mount the two cameras in a single housing, but the present invention is not limited to this, and the cameras may be mounted in separate housings. In that case, preferably a single common mounting member is used. It is preferable to mount them on the vehicle. Alternatively, two cameras, each housed in a separate enclosure, may be mounted on the vehicle separately using mounting components, and the two cameras may be connected via a wired or wireless cable. However, in order to achieve the desired positional relationship between the two cameras, it is preferable to mount them on the vehicle using a single common mounting component, and even more preferable to implement them in a single enclosure with the desired positional relationship in advance, as in the embodiment described above.

[0183] [Application to ADAS (Advanced Driver-Assistance Systems)] When using video footage captured by a 360-degree drive recorder 10, or video footage captured by a 360-degree camera, in ADAS processing, the following challenges arise. For example, when used for lane departure warning, there are two 360-degree videos, so it is necessary to identify which lane is the one to be prevented from deviating from. Also, with a 360-degree camera, not only vehicles and traffic lights in front but also vehicles and traffic lights to the sides and behind are included in the 360-degree video, so it is necessary to identify the target ADAS area, for example, which is the traffic light in front.

[0184] For example, to ensure that the position of the image is fixed, the camera is designed to be fixed in the same way as the drive recorder 10, so that its orientation cannot be changed. Then, when the camera is mounted on the vehicle, the part that you want to use for ADAS is set to a location that does not overlap with the joints of multiple cameras.

[0185] Another configuration involves not fixing the camera but allowing its direction to be adjusted. From the moving parts (parts with optical flow) and stationary parts such as pillars in the video, the areas of the windshield and the passenger compartment are estimated, and the area used for ADAS is extracted from the windshield area. Alternatively, an area used for detecting user drowsiness, distraction, etc., may be extracted from the passenger compartment area.

[0186] Also, with a dashcam, you should point the area with the highest resolution (for example, the center) straight ahead, but it's better to point it in the direction of the white lines, for example.

[0187] [Mounted on the outside of the vehicle] In the embodiment described above, the camera is installed inside the vehicle cabin, but it is also preferable to have the following configuration, either by installing it inside the vehicle cabin or by not installing it inside the vehicle cabin: It is preferable to have a hemispherical camera that photographs the outside of the vehicle (preferably a camera capable of photographing an area of ​​more than 180 degrees all around, especially a camera capable of photographing more than 210 degrees all around).

[0188] It is particularly good to install the camera facing outwards from the side of the vehicle, or facing downwards from the side of the vehicle. For example, it is good to install such a camera on the side mirror so that it captures the downwards from the underside of the side mirror. It is especially good to have such cameras on both the left and right sides of the vehicle.

[0189] Furthermore, the installation location is not limited to this; for example, it is good to install such cameras at at least one of the four corners (front right, front left, rear right, rear left) when viewing the vehicle from above (especially the front left is preferable) (it is especially good to install them at all four corners). In particular, it is good to install them in the area where the front and side of the vehicle body meet, so as to capture the outside from the vehicle side. In this case, the shooting direction of the center of the camera should be directed outward to the side relative to the straight-ahead direction, at an angle of more than 45 degrees. In other words, it is good to install them so that the area of ​​the captured image is larger on the sides than on the front.

[0190] These cameras allow drivers to more easily check than before whether their vehicle will run onto a curb, fall into a ditch, fall into a ravine, or hit a guardrail. They are particularly effective when driving on narrow roads such as mountain roads, when avoiding oncoming traffic or stopping, or when parking as far to the left as possible.

[0191] It is especially important to install the camera so that the area around the tires is included in the field of view. The small mirror, typically located below the left side mirror, should be positioned to include the area visible from the driver's seat. These small mirrors are often small and difficult to see, and are almost completely invisible at night, but this solution can address these issues.

[0192] Furthermore, as mentioned above, by installing cameras at the front or rear of the vehicle, such as at the four corners, it becomes easy to check a wide area with fewer cameras when exiting onto the roadway from an area enclosed on one side (or especially both sides) by a wall or similar structure, allowing for easy monitoring of bicycles, pedestrians, and other objects approaching from the left or right.

[0193] Furthermore, it would be beneficial to include a function that allows the user to change the display range of the 360-degree camera. In particular, it would be beneficial to include a function that magnifies the area where a touch is detected within the 360-degree camera image displayed on the screen. Specifically, it would be good to move the touched location to the center of the display area on the screen and draw it there.

[0194] Furthermore, although the panoramic camera was fixed in the embodiment described above, a mechanism may be provided to change the shooting direction of the panoramic camera based on user operation. For example, a remotely controllable motorized panoramic head could be attached to the vehicle, the camera could be fixed to the panoramic head, and the shooting direction could be changed by remotely controlling the panoramic head.

[0195] While various aspects of the present invention have been described above using embodiments and modifications, it should be noted that these embodiments and descriptions are not intended to limit the scope of the present invention, but rather to facilitate understanding of the invention. The scope of the present invention is not limited to the configurations explicitly described in the specification, but also includes combinations of the various aspects of the present invention disclosed herein. Although the configurations for which patent protection is sought are specified in the claims attached to the application, it should be noted that even configurations not currently specified in the claims may be claimed in the future. The applicant intends to obtain rights for such parts and combinations through amendments, divisional applications, or changes to design registration applications.

[0196] The present invention is not limited to the configuration described in the embodiments above. The components of each embodiment and modification described above may be arbitrarily selected and combined. Furthermore, any component of each embodiment and modification may be arbitrarily combined with any component described in the means for solving the invention or any component that embodies any component described in the means for solving the invention. We intend to obtain rights to inventions with these configurations as well, through amendments to or divisional applications of this application.

[0197] Furthermore, although the drawing depicts the entire device with solid lines, it is a drawing that includes not only the overall design but also partial designs claimed for parts of the device. For example, it is a drawing that includes not only partial designs for some components of the device, but also partial designs for parts of the device that are unrelated to any components. Parts of the device may be components of the device, or parts of those components. [Explanation of Symbols]

[0198] 2 Windshield 3 Pillar 4 Dashboard 10 Live Recorder 11 Main body 12 Camera section 13 Main unit case 25 cabinets 26 First Camera 27 Second Camera 28 Switch section 50 Angle adjustment mechanism 60 display screen 62 Display Area 62b Mask region

Claims

1. A dashcam equipped with multiple cameras, The images captured by the aforementioned multiple cameras are used in ADAS processing. The aforementioned multiple cameras are fixed in a way that ensures their position is fixed and their orientation cannot be changed. When the aforementioned camera is mounted on the vehicle, the part that ADAS wants to use is set to a part that does not coincide with the connection points of multiple cameras. A dashcam characterized by the following features.

2. The aforementioned video is footage captured by a dashcam that captures a full 360-degree view, or footage captured by a camera that captures a full 360-degree view. The dashcam according to feature 1.

3. The ADAS processing described above is used for lane departure warnings. It has a function to identify which lanes are targeted to prevent deviations. A drive recorder according to claim 1 or 2.

4. The ADAS processing described above includes a function to identify the target ADAS region, The ADAS region in question is a forward signal. A drive recorder according to any one of the features 1 to 3.

5. It has a continuous recording function that records video to a memory card from engine start (ACC ON) to engine stop (ACC OFF), The event recording function records a certain period of time before and after an event condition is met. A drive recorder according to any one of claims 1 to 4, characterized by comprising the following features.

6. The aforementioned event conditions include when the acceleration sensor detects an impact exceeding a certain level, or when the switch is pressed. The dashcam according to feature 5.

7. Pressing the aforementioned switch is used for one-touch recording, which records video and audio for a set period of time as the user passes through a specified point. The dashcam according to feature 6.

8. If the continuous recording function is not performed, the video and audio for a certain period of time are temporarily recorded in buffer memory, etc. If the aforementioned event conditions are met, the system uses temporarily recorded data to record video and audio for a certain period before and after the event onto the memory card. A drive recorder according to any one of claims 5 to 7.

9. Even when the vehicle is powered off and cannot receive power from the vehicle's battery, It operates by receiving power from a separate power supply unit provided separately from the vehicle. A drive recorder according to any one of claims 5 to 8.

10. Equipped with a parking recording mode, The aforementioned parking recording mode is a mode in which power is supplied from the power supply device for a set period of time even after the vehicle's power is turned off, such as when the vehicle is parked, and continuous recording and event recording are performed even while the vehicle is parked. The dashcam according to feature 9.

Images