Systems and programs, etc.

Abstract

To provide systems and programs that are superior to those of the past. [Solution] System 1 includes a control unit 11 that displays images acquired from imaging devices 100 and 200 installed in the vehicle 400 on a display surface 131 inside the vehicle. The display surface 131 can display images in F+R, F zoom, R zoom 1, and R zoom 2 display modes. When a screen display switching signal is received while an image is being displayed in any of the F+R, F zoom, or R zoom 1 display modes, the image is displayed in R zoom 2 mode.

Description

Technical Field

[0001] The present invention relates to, for example, systems and programs.

Background Art

[0002] Conventionally, there is a system having a function of displaying an image captured by a camera.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a conventional system having a function of displaying an image captured by a camera, there were various problems.

[0005] One object of the present invention is to provide a system and a program that are superior to the prior art. The object of the present invention is not limited to this, and the applicant also intends to obtain rights by divisional application, amendment, etc. for a configuration that aims to obtain an effect resulting from a part of the configuration disclosed in this specification and drawings. For example, in this specification, the problems obtained by reading the parts described as "can" or "is possible" as "is a problem" are disclosed in this specification. The problems are described as independent ones, and the applicant also intends to obtain rights by divisional application, amendment, etc. alone for the configurations for solving each problem. Even if the problems are implicitly grasped from the description of the specification, the applicant intends to make a part of the configuration described in this specification the scope of claims by amendment or divisional application. Also, a configuration for solving a problem combining these independent problems is disclosed, and the applicant intends to obtain rights.

Means for Solving the Problems

[0006] (1) The system includes a display control unit that displays images acquired from a shooting unit installed on a mobile body on a display means within the mobile body, and the display control unit is capable of displaying the images in a first display mode and a second display mode based on user operation, and the system preferably displays the images in the second display mode in response to the reception of a specific signal while the images are being displayed in the first display mode.

[0007] Users can view images in a second display mode that suits their preferences, depending on the reception of a specific signal.

[0008] The "mobile entity" may be, for example, a ship, but is particularly likely to be a vehicle, and is particularly likely to be a four-wheeled or two-wheeled automobile, but is especially likely to be a four-wheeled automobile. The "mobile entity" may be, for example, a vehicle that travels on a road, but is also likely to be a vehicle that travels on rails.

[0009] Regarding "installed on the mobile unit," it is preferable that the device is not installed on the mobile unit when it is sold by the manufacturer, but is added to the mobile unit after it has been delivered to the user. While it is preferable to install it inside the mobile unit, it may also be installed outside the mobile unit. The phrase "installed on a moving object" means that the device may be installed so as to capture the inside of the moving object, but it is more preferable to install it so as to capture the outside of the moving object. If the moving object is a vehicle, and "installed on the moving object" means "installed on the vehicle," then it is preferable that the device is not installed on the vehicle when it is sold by the vehicle manufacturer, but is retrofitted and installed on the vehicle after it has been delivered to the user. "Installed on the vehicle" is more preferably installed inside the vehicle, but may also be installed outside the vehicle. "Installed on the vehicle" may be installed so as to show the interior of the vehicle, but more preferably so as to show the exterior. In addition, the terms "vehicle" and "car" may be replaced with "mobile object" below. For example, in an example where the imaging unit is located inside a mobile body, in a mobile body equipped with a window glass on the front, the imaging unit may be located on the inner surface of the window glass inside the mobile body, and more preferably on the upper center of the inner surface of the window glass inside the mobile body. For example, in the case of an automobile, the imaging unit may be located on the inner surface of the windshield, but more preferably on the rearview mirror itself or in the vicinity of the rearview mirror. For example, in an example where the imaging unit is located inside a mobile body, in a mobile body having a window glass on its rear surface, the imaging unit may be located on the inner surface of the window glass inside the mobile body, and more preferably, on the upper center of the inner surface of the window glass inside the mobile body. For example, in the case of an automobile, the camera unit is installed at the upper center of the inner surface of the rear window glass (hereinafter referred to as the "back door glass") of the vehicle, and does not necessarily have to be installed on the inner surface of the windshield, the rearview mirror itself, or in the vicinity of the rearview mirror. However, it is preferable to install it at both the upper center of the inner surface of the back door glass and the rearview mirror itself or in the vicinity of the rearview mirror. "Installed on a moving object" means, for example, in a car, the camera unit can be installed on the rearview mirror itself or near the rearview mirror. In this example, the camera unit may be installed in a position that overlaps with the rearview mirror, but it is more preferable to install it slightly (for example, 5 mm) outside the edge of the rearview mirror. More specifically, for example, in a car where the driver's seat is on the right side, the camera unit may be installed slightly (for example, 5 mm) outside the right edge of the rearview mirror, but it is more preferable to install it slightly (for example, 5 mm) outside the left edge of the rearview mirror. By installing the camera unit on the opposite side from the driver's seat, the camera unit is less likely to obstruct the driver. For example, in cases where the imaging unit is located outside the moving body, the imaging unit may be located at the rear center of the moving body. For example, if the moving body is an automobile, the imaging unit may be located at the lower center of the outer surface of the back door glass, but more preferably at the upper center of the outer surface of the back door glass or on the back door itself. The back door may be a door that covers the rear opening of the automobile, and for example, it may be a door that has a hinge at its upper end and rotates around the hinge so that its lower end moves upward. For example, in cases where the imaging unit is located outside the moving body, in a vehicle equipped with side mirrors that show the left and right sides of the vehicle, the imaging unit may be located on the side mirror itself or in the vicinity of the side mirror.

[0010] The "imaging unit" may be, for example, a camera. The "imaging unit" may have, for example, an image sensor (for example, a CMOS sensor or a CCD sensor) for photographing the subject, and convert the light that hits the image sensor into an electrical signal and output it. The "imaging unit" may be a single imaging unit, but it is more preferable to have multiple (for example, two) imaging units.

[0011] While a still image is acceptable, a video would be preferable.

[0012] For "acquisition," it is preferable to acquire the data via wired or wireless communication (for example, wireless communication compliant with standards such as IEEE 802.11). For "acquisition," in cases where the imaging unit has an image sensor, it is preferable to acquire image data corresponding to the electrical signal output by the image sensor.

[0013] The display means may be, for example, a dot matrix display. It is especially good if it can display in color. The "display means" can be anything that displays an image, for example, a liquid crystal display or an organic EL display, but it may also be a plasma display or a CRT display. The "display means" may be a display of 17 inches or larger, but it is especially good if it is a display of less than 17 inches. As an example of the "display means", it is especially good if it is a small display of 4 inches or less. As an example of the "display means", it is especially good if it is a display that is about the same size as a car's rearview mirror (for example, about 9 to 10 inches) and has a shape that mimics the shape of a rearview mirror. Regarding the "display means," it is preferable that they are not installed on the mobile device when it is sold by the manufacturer, but are added to the mobile device after it has been delivered to the user. Regarding the "display means," it is preferable that they be removed from the mobile device when the user is not using the system, but be fixed inside the mobile device when the user is using the system. For example, if the mobile device is an automobile, the display means should be fixed in a position that is easily visible to the driver, and more preferably installed on or near the rearview mirror (for example, attached to the rearview mirror).

[0014] The "display control unit that displays on the display means" may be, for example, a display control unit that controls the display means to display something. The "display control unit that displays on the display means" may be, for example, a display control unit that has the function of displaying something on the display means. Hereafter, where it says "display," it may say "make the display means display." The "display control unit" may, for example, perform some processing on an image acquired from a shooting unit installed on a moving body and display at least a part of the image.

[0015] It is preferable that the "first display mode" and the "second display mode based on user operation" be different display modes. The "first display mode" may be a predetermined display mode that is not based on user operation, but it is preferable that it be a display mode based on user operation. In an example where the first display mode is a display mode based on user operation, the user operation corresponding to the first display mode may be the same as the user operation corresponding to the second display mode, but it is preferable that it be partially or entirely different from the user operation corresponding to the second display mode. It is preferable that the operation corresponding to the second display mode includes more content that the user instructs through operation than the operation corresponding to the first display mode.

[0016] "Based on user operation" may refer to operations on input means connected to the display control unit (e.g., touch panel, buttons, etc. provided on the display means), but more preferably, it should refer to operations on input means connected to the display control unit and operations via an external device connected to the display control unit (e.g., a smartphone, etc.).

[0017] The "second display mode" may be a display mode in which at least a portion of the image acquired from the shooting unit installed on the mobile body is processed in some way according to settings based on user operation and then displayed. The second display mode may be at least one of the following: a display mode that displays a portion of the image acquired from the shooting unit; a display mode that displays the image enlarged; a display mode that displays the image reduced; a display mode that displays the image with its brightness changed; a display mode that displays the image with its hue changed; a display mode that displays at least a portion of the image emphasized; a display mode that displays multiple images on the display means, etc. For example, in the case of a display mode that displays multiple images on the display means, it may be a display mode in which multiple (e.g., two) images acquired from one shooting unit are displayed on the display means in different display modes, but it is more preferable to be a display mode in which images acquired from multiple (e.g., two) shooting units are displayed simultaneously on the display means.

[0018] The phrase "the image can be displayed in a first display mode and a second display mode based on user operation" means, for example, that both the image in the first display mode and the image in the second display mode based on user operation may be displayed simultaneously, but it is preferable to allow switching between displaying either the image in the first display mode or the image in the second display mode based on user operation. Hereafter, where it says "can be displayed", it is preferable to say "to make it display".

[0019] The "specific signal" is more preferably a signal from a moving object, but may also be a signal from a device other than the moving object (for example, a sensor included in the above system, an external sensor connected to the above system, a security device attached to the moving object for preventing theft of the moving object, a smartphone, etc.). The "specific signal" may be, for example, simply a signal that changes from no signal to having a signal, a signal that changes from no connection to being connected to a predetermined voltage (for example, 12V or 24V) or ground, or the reverse of these, etc. For example, in the case where a moving object (or a device other than the moving object) includes a switching element that transitions from an off state to an on state when current reaches the gate, when the gate is in the off state, it is a no signal, and when current reaches the gate and it becomes the on state, it may be regarded as a signal with a signal. For example, as the "specific signal", when a lamp of a moving object (for example, a blinker or a taillight of the moving object) is turned off, it is a no signal, and when the lamp is turned on, it may be regarded as a signal with a signal. For example, in the case of an automobile, as the "specific signal", when the user puts the shift lever in a range other than the reverse range (hereinafter referred to as "R"), it is a no signal, and when the user puts the shift lever in R, it may be regarded as a signal with a signal. For example, in the case of an automobile, as the "specific signal", when the user puts the shift lever in a range other than the parking range (hereinafter referred to as "P"), it is a no signal, and when the user puts the shift lever in P, it may be regarded as a signal with a signal. For example, as the "specific signal", when the door of a moving object is closed, it is a no signal, and when the door is opened, it may be regarded as a signal with a signal. For example, in the case of starting a car security that alarms when the vehicle is stolen by locking the vehicle door in a state where the vehicle power is off and the engine is stopped, when the car security is not alarming, it is a no signal, and when it alarms, it may be regarded as a signal with a signal. As the "specific signal", for example, in the case of a mobile body equipped with a sensor (such as an acceleration sensor, etc.) that detects an impact in response to the mobile body receiving some impact, when the sensor does not detect an impact, it is a no-signal state, and when the sensor detects an impact, it may be a signal state where a signal appears. As the "specific signal", for example, in the case of a vehicle equipped with an accident recording device that records the operation status of the accelerator and brake of the vehicle in response to an ECU that controls an airbag detecting a rapid speed change, when the ECU does not detect a rapid speed change, it is a no-signal state, and when the ECU detects a rapid speed change, it may be a signal state where a signal appears. As the "specific signal", for example, in the case of a vehicle equipped with a brake-by-wire technology (hereinafter referred to as "BBW") where a driver replaces the amount of brake pedal depression with an electric signal and transmits it to an ECU that controls the vehicle via a brake line, and the ECU performs brake control, it may be a signal state where a signal appears when the brake line reaches a predetermined voltage (for example, 12V). Particularly, if the brake for obtaining braking force in BBW is a disc brake, a brake command is transmitted as an electric signal from the ECU to a hydraulic pressure generating device connected to the disc brake via a wire (electric wire, optical cable, etc.). This wire may be used as the brake line. Particularly, if the method of transmitting the operation of the brake pedal to the brake in BBW is an air brake (specifically, a method of transmitting the force of the brake pedal to the brake by high-pressure air), the amount of depression of the brake pedal is transmitted as an electric signal from a stroke sensor (or pressure sensor) to the ECU via a wire. This wire may be used as the brake line. Particularly, as the "specific signal", it may be a signal regarding the state of the vehicle based on information flowing through an in-vehicle LAN such as CAN or a K line output from the ECU. The "specific signal" may be a single signal, but it is more preferable to have multiple signals (for example, two types). For example, in an example where multiple specific signals are provided, if the image is displayed in a second display mode corresponding to the type of specific signal, the user can view the image in a second display mode corresponding to the type of specific signal when they receive that signal. A "specific signal" may be, for example, a signal containing some kind of information, such as one composed of packets.

[0020] "Reception" may simply mean going from no signal to a signal, going from no connection to a state connected to a predetermined voltage (e.g., 12V or 24V) or ground, or the reverse of these.

[0021] The system may consist of a single enclosure or multiple enclosures. The system may include an imaging unit, but it may also be configured without one. The system may include a display means, but it may also be configured without one.

[0022] It is recommended to do as described above in all of the following documents.

[0023] (2) The first display mode is a display mode in which a first display range, which is a part of the image, can be displayed on the display means, and the second display mode is a display mode in which a second display range, which is a part of the image and different from the first display range, can be displayed on the display means.

[0024] The user can simply receive a specific signal and, based on user operation, display a second display range on a display means within the mobile body, which is different from a first display range that is a part of the image acquired from an imaging unit installed on the mobile body.

[0025] The "second display range, which is different from the first display range" may be a range in which the first and second display ranges do not overlap at all, or it may be a range in which they partially overlap but not in other parts. This allows the user to see the second display range, which partially overlaps but not in other parts, when the display switches from the first to the second display range in response to the reception of a specific signal. This allows the user to see the other parts they particularly want to see, while also seeing the part that is visible even when the specific signal is not being received. The "second display range, which is different from the first display range" may be a range that completely includes the first display range, but it is more preferable that the first display range completely includes the second display range. For example, suppose the first display range is displayed so that it is not cut off from the entire display means, and during the display of the image in the first display mode, the second display range is displayed so that it is not cut off from the entire display means in response to the reception of a specific signal. In this example, if the first display range completely includes the second display range, the area corresponding to the second display range will be displayed larger when displayed in the second display mode than when displayed in the first display mode, so the user can easily see the second display range.

[0026] (3) The display control unit is configured to be able to switch to displaying the image in the second display mode in response to a user switching operation while the image in the first display mode is being displayed, and to switch back to displaying the image in the first display mode in response to a user switching operation while the image in the second display mode is being displayed.

[0027] Users can view images in the second display mode by switching while viewing images in the first display mode, and can view images in the first display mode by switching while viewing images in the second display mode.

[0028] The "user switching operation" may be an operation in which the user touches a software button displayed on a display means with their finger, but it is more preferable to operate a physical button or to operate by the user's voice. The "user switching operation" may be a long press operation in which the physical button is pressed for a relatively long time (e.g., 3 seconds), but it is preferable for the user to operate if the physical button is pressed for a relatively short time (e.g., 0.1 seconds).

[0029] "Switching" could mean, for example, deleting the image before the switch and displaying the image after the switch, but it is better to display the image after the switch superimposed on the front of the image before the switch. In the example of displaying the image after the switch superimposed on the front of the image before the switch, if the size of the image after the switch is the same as or larger than the image before the switch, it is good that the image before the switch is hidden after the switch. On the other hand, if the size of the image after the switch is smaller than the image before the switch, it is good that the image before the switch continues to be displayed from before to after the switch in the display area outside the range where the image after the switch is displayed. The above should be applied to all instances of "switching" in the following documents.

[0030] (4) The imaging unit includes a first imaging unit that images the rear of the moving body and a second imaging unit that images the front of the moving body. The display control unit can display a first image acquired from the first imaging unit in a first display mode and a second display mode, and can display a second image acquired from the second imaging unit in a third display mode. The first, second, and third display modes can be switched according to a user's switching operation. The display control unit may be configured to switch to the first image in the second display mode when a specific signal is received while the first image in the first display mode is being displayed, and to switch back to the first image in the second display mode when a specific signal is received while the second image in the third display mode is being displayed.

[0031] The user can switch display modes in response to a switching operation, and when an image is displayed in a display mode other than the second display mode, the user can view the first image in the second display mode in response to receiving a specific signal.

[0032] As for the "first imaging unit," in the case of an automobile, for example, the imaging unit may be provided on the rearview mirror itself or in the vicinity of the rearview mirror, but more preferably it is provided on the upper center of the inner surface of the back door glass, the upper center of the outer surface of the back door glass, or on the back door itself.

[0033] As for the "second imaging unit," in the case of an automobile, for example, the imaging unit may be provided at the upper center of the inner surface of the back door glass, at the upper center of the outer surface of the back door glass, or on the back door itself, but it is more preferable to provide it on the rearview mirror itself or in the vicinity of the rearview mirror.

[0034] "Switchable in response to user switching operation" means that the display mode can be switched sequentially, such as first display mode → second display mode → third display mode, but more preferably, at least one display mode should be displayed from the first, second, and third display modes. "Switchable in response to user switching operation" means that the display mode can be switched between an ON state in which an image acquired from a shooting unit installed on a mobile body is displayed on the display means, such as the first to third display modes, and an OFF state in which an image acquired from a shooting unit installed on a mobile body is not displayed on the display means. Specifically, for example, in an example in which the system has a setting mode set by the user and a usage mode in which the system is used by the user, in the setting mode, the display mode can be switched sequentially, such as third display mode → first display mode → second display mode → OFF state → third display mode → first display mode → ... Then, in the usage mode, the display mode can be switched sequentially, such as first display mode → second display mode → OFF state → first display mode → second display mode → ... This improves the usability of the system. "Switchable in response to user switching operations" means that the user should switch between the first display mode, second display mode, third display mode, and off state in a user-defined order. Specifically, for example, in a system with a setting mode and a usage mode, the setting mode should repeatedly switch in the order of third display mode → first display mode → second display mode → off state, while the usage mode should switch between the first display mode, second display mode, third display mode, and off state in a user-defined order. This will improve the usability of the system.

[0035] (5) The display control unit is configured to change the second display mode based on the user's operation while the image in the second display mode is being displayed, to display the image in the first display mode when a predetermined termination condition is met while the image in the second display mode is being displayed, and to display the image in the second display mode as it was when the most recent predetermined termination condition was met, in response to receiving the specific signal while the image in the first display mode is being displayed.

[0036] The user can change to a second display mode based on the user's operation, and even if a predetermined termination condition is met and the image of the first display mode is displayed while the image of the second display mode is being displayed, the user can view the image of the second display mode as it was when the most recent predetermined termination condition was met, in response to receiving a specific signal.

[0037] The "predetermined termination condition" may be, for example, the cessation of receiving a specific signal. More specifically, it may be the transition from a signal to no signal, the transition from a predetermined voltage (e.g., 12V or 24V) to a state of no connection or disconnection from ground, or the reverse of the above. The "predetermined termination condition" could be, for example, the elapsed time (e.g., 10 seconds) after receiving a specific signal. As for the "predetermined termination conditions," for example, in an example where the display mode of this system is switched according to a user's switching operation, the condition may be that the user has performed the switching operation. The phrase "specified termination conditions" should be changed as described above in all of the following documents.

[0038] (6) The display control unit may be configured to display a change operation image that indicates that it is possible to change the second display mode while the image in the second display mode is being displayed.

[0039] The user can recognize that they can change the second display mode by viewing the change operation image.

[0040] The "change operation image" may, for example, be an image displaying the words "Setting Mode," "Checking Settings," or "Adjustable," and should be displayed while the image in the second display mode is being displayed. The "change operation image" may, for example, be an image that is displayed while the image in the second display mode is being displayed, but not while the image in the first display mode is being displayed. The "change operation image" may, for example, be an image that remains displayed while the image of the second display mode is being displayed by default, and may be displayed continuously or intermittently until the user performs an operation to hide the change operation image. The operation to hide the change operation image may, for example, be an operation in which the user touches a software button showing an "X" mark (or a software button showing the word "OK") on the display means, in the case where the display means is equipped with a touch panel. After the user performs an operation to hide the change operation image, the change operation image may not be displayed again until the conditions for redisplaying the change operation image are met (for example, an operation to display the change operation image is performed, the display switches from the second display mode to another mode and then returns to the second display mode, the system is restarted, the system is initialized, etc.). In the example where the change operation image is not redisplayed after the user performs an operation to hide the change operation image until the system is initialized, the following effect can be achieved, for example. Specifically, the user can recognize that it is possible to change the second display mode by changing the change operation image when using the system for the first time, so the user can be prompted to change the second display mode when using the system for the first time in the initial state. The "change operation image" could be, for example, an image that disappears after a relatively short time (e.g., 2 seconds) has elapsed since the start of display. This reduces the risk that the change operation image may interfere with the operation to change the second display mode, thereby improving the usability of this system.

[0041] (7) The second display mode is a mode in which a portion of the image can be displayed on the display means, and the display control unit is configured to display a range-indicating image that indicates the range of the image displayed on the display means while the image in the second display mode is being displayed.

[0042] By viewing the range-indicating image while the image in the second display mode is being displayed, users can easily recognize which part of the image is being shown.

[0043] A "range-indicating image" would be, for example, an image that indicates the location (or range) of the displayed area within the entire image. The "range indication image" may be, for example, an image of a predetermined colored frame (for example, a red frame) that indicates the displayed range, superimposed on a reduced image of the image acquired from the imaging unit. In this example, the "range indication image" may be an image with a significantly reduced amount of information from the image acquired from the imaging unit, not showing detailed features, and a red frame indicating the position of the displayed range may be displayed superimposed on this image. The "range indication image" may also be, for example, a predetermined colored frame (for example, a red frame) that indicates the position of the displayed range may be superimposed on the same image regardless of what kind of image was acquired from the imaging unit. Depending on the display position of the frame, the "range indication image" may indicate the central part if the displayed range is the central part of the image, the lower part if the displayed range is the lower part of the image, and the right side if the displayed range is the right side of the image. For example, a "range indication image" could be a pre-prepared icon that shows which part of the image acquired from the imaging unit the displayed area corresponds to. In this example, regardless of what kind of image was acquired from the imaging unit, for example, if the displayed area is the central part of the image, an icon that emphasizes the central part should be displayed; if the displayed area is the lower part of the image, an icon that emphasizes the lower part should be displayed; and if the displayed area is the right side of the image, an icon that emphasizes the right side should be displayed. The "range-indicating image" may, for example, be displayed smaller than the image in the second display mode, perhaps in the corner of the display means.

[0044] (8) The display control unit is configured to change the first display mode based on user operation while the image in the first display mode is being displayed, to display the image in the second display mode when a specific signal is received while the image in the first display mode is being displayed, and to display the image in the first display mode as it was when the most recent specific signal was received when a predetermined termination condition is met while the image in the second display mode is being displayed.

[0045] The user can change the first display mode based on the user's operation, and even if an image of the second display mode is displayed after receiving a specific signal while an image of the first display mode is being displayed, the user can view the image of the first display mode as it was when the most recent specific signal was received, depending on whether a predetermined termination condition has been met.

[0046] The phrase "the first display mode can be changed based on user operation" may, for example, be the same operation as the "user operation" in the "second display mode based on user operation," but more preferably it may be an operation that is partially or entirely different from the "user operation" in the "second display mode based on user operation."

[0047] (9) The display control unit is capable of displaying a first suggestion image indicating that the first display mode is being displayed while the image in the first display mode is being displayed, and is capable of displaying a second suggestion image indicating that the second display mode is being displayed while the image in the second display mode is being displayed. The display control unit is configured to highlight the second suggestion image when displaying the image in the second display mode in response to the receipt of the specific signal.

[0048] Users can easily recognize which display mode the image is being displayed in by looking at the suggestive image. Since the second suggestive image is highlighted in response to the reception of a specific signal, users can easily recognize that the image in the second display mode has been displayed in response to the reception of a specific signal.

[0049] The "first suggestive image" may be a symbol that suggests the first display mode, and more preferably a character that suggests the first display mode. The first suggestive image may be displayed, for example, in the corner of the display means, smaller than the image of the first display mode.

[0050] The "second suggestive image" may be a symbol that suggests the second display mode, and more preferably a character that suggests the first display mode. The second suggestive image may be displayed, for example, in the corner of the display means, smaller than the image of the second display mode. For example, the second suggestive image may be displayed in the same display area as the first suggestive image.

[0051] (10) The system includes a detection unit for detecting a predetermined object, and the display control unit is configured to display an object suggestion image superimposed on at least a portion of the image in the second display mode on the foreground side, based on the detection unit detecting the predetermined object while the image in the second display mode is being displayed, to indicate that the predetermined object has been detected.

[0052] When an image in the second display mode is displayed, the user is more likely to notice the intended object because an image suggesting the object is displayed.

[0053] The "specified target" may, for example, be an object or living being approaching a moving object, but more preferably it should be a person approaching a moving object. The phrase "specified target" should be used in the above manner in all of the following documents.

[0054] The "detection unit" may be, for example, a human presence sensor or an infrared sensor, but more preferably a distance sensor. The "detection unit" may, for example, emit microwaves or other radio waves, receive reflected waves reflected from an object (or living organism), detect a Doppler signal, and detect the approach, departure, and movement speed of the object (or living organism). The "detection unit" may, for example, detect a predetermined target based on an image acquired from a camera installed on a moving body, and as an example, detect a predetermined target by image processing of an image acquired from a camera installed on a moving body. The term "detection unit" should be used as described above in all of the following documents.

[0055] The "target suggestion image" may be, for example, a predetermined colored border (e.g., a red border) displayed around the periphery of the image in the second display mode, but more preferably, a predetermined colored arrow (e.g., a red arrow) that suggests the direction in which a predetermined target was detected.

[0056] (11) The system includes a brightness acquisition unit that acquires the brightness of the image, and the display control unit is configured to change the second display mode based on the brightness acquired by the brightness acquisition unit while the image in the second display mode is being displayed.

[0057] When a user is viewing an image in the second display mode, if the second display mode is changed based on the brightness of that image, the user can view the image in the second display mode that has been modified based on the brightness of that image.

[0058] The "luminance acquisition unit that acquires the luminance of the image" may, for example, be an image that is acquired from a shooting unit installed on a moving object and processed to obtain the luminance value of the image. The "luminance acquisition unit that acquires the luminance of the image" may, for example, be a sensor that detects the amount of light incident from within the detection range.

[0059] (12) The second display mode is a display mode in which a predetermined display range, which is a part of the image, can be displayed on the display means, and the system is preferably configured to store the image acquired from the imaging unit in the storage unit.

[0060] Since the user can store the images acquired from the camera, they can check the stored images to view parts of the image that were not visible on the display device.

[0061] The "memory unit" may be, for example, a recording medium such as a microSD card, flash memory, or EEPROM (Electrically Erasable Programmable Read-Only Memory). The "memory unit" may also be, for example, a magnetic recording medium, an optical recording medium, a semiconductor recording medium, or other recording media. The "memory unit" may also be, for example, cloud computing. The above interpretation should be applied to all instances of "memory unit" in the following documents.

[0062] (13) The second display mode is a display mode in which, from the image acquired from the imaging unit installed on the mobile body, a range based on user operation is displayed on the display means within the mobile body, and the system is configured to associate the image acquired from the imaging unit with information indicating the range based on user operation and store it in a storage unit so that it can be retrieved from the outside.

[0063] The user can associate the image acquired from the imaging unit with information indicating the range based on the user's operation, and store it in a storage unit so that it can be retrieved from the outside. This allows the user to recognize how the image was displayed on the display means based on the stored image and the above information using the first function.

[0064] "Information indicating the range based on the user's operation" could, for example, be information that allows a viewer to later analyze and view how images acquired from a shooting unit installed on a mobile device were displayed on the display means. The viewer should, for example, be equipped with a function to synchronize and play back images acquired from the shooting unit and images within a predetermined display range based on the records in the memory unit. "Information indicating the range based on the user's operation" may include, for example, range coordinate information or magnification. This allows the user to store the image acquired from the camera unit and the information indicating the predetermined display range without having to store the image itself displayed on the display unit, and later analyze it with a viewer to confirm the display range that was displayed on the display unit. For example, in the event of a traffic accident, the user can use the image acquired from the camera unit and the information indicating the predetermined display range as evidence showing the circumstances of the traffic accident.

[0065] (14) The display control unit can change the reflectance of a mirror that covers the front of the display means and transmits and reflects a portion of the light, and can control the display state to display the image, a non-glare state in which the image is not displayed and the reflectance of the mirror is a first reflectance, and an anti-glare state in which the image is not displayed and the reflectance of the mirror is a second reflectance lower than the first reflectance, and it is preferable that the display control unit transitions to the display state and displays the image in the second display mode in response to receiving the specific signal while being controlled in the non-glare state or the anti-glare state.

[0066] Even when controlled in a non-glare or anti-glare state, the display can be switched to a display state in response to the reception of a specific signal, allowing the user to view the image in the second display mode.

[0067] The "mirror" could be, for example, a mirror, but it could also be a mirror LCD, and more preferably a half-mirror. For the mirror LCD, for example, a liquid crystal, a reflective polarizing plate, and a polarizing plate could be arranged in that order from the front, and the mirror state and the transparent state could be switched by controlling the liquid crystal. For example, the "mirror" may have the same shape as the display means. In the case of an automobile, the "mirror" may be a side mirror type, but it is more preferable to use a rearview mirror type. Wherever you write "Mirror," you should use the above format in all of the following documents.

[0068] For example, a "non-glare state" would be a state where there is a liquid crystal on the front side of the mirror (specifically, on the opposite side of the display means relative to the mirror), and the liquid crystal is not controlled to make it difficult for external light to be reflected. In the case where the mirror is a mirror LCD, a "non-glare state" would be a state where the liquid crystal constituting the mirror LCD is not controlled to make it difficult for external light to be reflected. For example, in a display system that includes both a touch panel and a liquid crystal display, an anti-glare liquid crystal sheet is not attached between the touch panel and the liquid crystal display, and the liquid crystal sheet is not used to control the system so that it is difficult for external light to be reflected.

[0069] For example, an "anti-glare state" could be defined as a state where there is a liquid crystal on the front side of the mirror, and this liquid crystal controls the reflection of external light to a state that is less likely to reflect than in a non-anti-glare state. For example, in a display system that includes both a touch panel and a liquid crystal display, an anti-glare liquid crystal sheet is placed between the touch panel and the liquid crystal display, and the liquid crystal sheet controls the reflection of external light to a state that is less likely to reflect than in a non-anti-glare state.

[0070] (15) The display means is covered on its front with a mirror that transmits and reflects a portion of the light, and the display control unit is configured to display at least a portion of the image in a predetermined display area set based on user operation within the display area of ​​the display means, while hiding the image in areas other than the predetermined display area.

[0071] The user can arbitrarily set the display area for displaying images, and the display means covered by the mirror can be used to differentiate between the part that displays images and the part that hides images and is used as a mirror, for example.

[0072] The "user operation" in the "predetermined display area set based on user operation" may be the same operation content as the user operation corresponding to the second display mode, but more preferably it may be an operation content that is partially or entirely different from the user operation content corresponding to the second display mode. The "predetermined display area" may be, for example, the lower area (or upper area) of the display area of ​​the display means, but more preferably it is the left area (or right area) of the display area of ​​the display means.

[0073] (16) The display control unit may be configured to change the first display mode based on time information when the image in the first display mode is displayed.

[0074] The user can view the image in the first display mode, which has been modified based on time information.

[0075] For example, the image reflected on the display means changes depending on factors such as the user's eye level, the orientation of the display means relative to the user, the area of ​​the display means, and whether the display means is a flat mirror or a curved mirror. Also, for example, the image of the first display mode displayed on the display means does not change depending on the user's eye level or the orientation of the display means relative to the user, but it does change depending on the installation position of the shooting unit, the angle of view of the shooting unit, and the scaling ratio of the image. Here, a person's height may change by several centimeters (for example, 2 centimeters) between when they are awake and after they have been active, and their eye level changes according to their height. The image reflected on the display means will be in a higher range when the eye level is low compared to when the eye level is high. For this reason, even if the user adjusts the display so that the above image and the above picture match at a certain point in time, the appearance of the above picture remains constant regardless of the eye level, whereas the appearance of the above picture changes depending on the eye level, so the above image and the above picture may become inconsistent over time. Therefore, "the first display mode can be changed based on time information" means, for example, that the display range of the image in the first display mode is slightly shifted based on the time information (for example, whether it is morning or evening) when displaying the image in the first display mode. "The first display mode can be changed based on time information" means, for example, that if it is morning when displaying the image in the first display mode, it is assumed that the user is tall and has a high eye level, and the display range that is lower than the display range that was displayed at night is displayed as the image in the first display mode. "The first display mode can be changed based on time information" means, for example, that if it is night, it is assumed that the user is short and has a low eye level, and the display range that is higher than the display range that was displayed in the morning is displayed as the image in the first display mode. This makes it easier for the user to match the image with the display mode without having to go through the trouble of adjusting the image reflected on the display mode to match the image in the first display mode by changing the installation position of the display means or the seat position in the mobile body.

[0076] (17) The system includes a detection unit for detecting a predetermined object, and the display control unit is controllable between a display state in which the image is displayed and a hidden state in which the image is hidden. The system is configured such that, based on the detection unit detecting the predetermined object while in the hidden state, the display means displays an image including the predetermined object as the image.

[0077] During control in a hidden state, it is possible to display an image containing a predetermined object based on the detection of that object. For example, if the predetermined object is a person approaching a moving object, it is possible to display an image containing that person based on the detection of, for example, a person looking into the moving object from the outside during control in a hidden state, which could potentially act as a deterrent against theft of the moving object.

[0078] As for "the image including the predetermined object," for example, in the case where the detection unit detects a person approaching a moving object while peeking at it from behind, it would be appropriate to use an image in which the person's face is clearly visible.

[0079] (18) The system is equipped with an operating unit operated by a user, and is configured to allow the user to assign a function selected from among a first function that sets matters related to the display of the image by the display control unit, and a second function different from the first function, as a function corresponding to the operation of the operating unit.

[0080] The user can assign a function to the control unit that corresponds to the operation of the control unit, either a first function that sets matters related to the display of images by the display control unit, or a second function different from the first function. This allows the user to assign a function to the control unit that suits their preferences.

[0081] The "operating section" should preferably be a physical button, but it may also be a software button displayed on a display device. The "operation unit" is preferably an input means connected to the display control unit (for example, a touch panel, buttons, etc. provided on the display means), but it may also be an external device connected to the display control unit (for example, a smartphone, etc.). The term "operating unit" should be used in the same way as above in all of the following documents.

[0082] The "operation of the aforementioned operating part of 1" is preferably a short press operation, where the physical button is pressed for a relatively short time (e.g., 0.1 seconds), as this is easier for the user to operate. However, it may also be a long press operation, where the physical button is pressed for a relatively long time (e.g., 3 seconds). "Operation of the aforementioned operating unit of 1" is preferably a short press operation, such as pressing a physical button once, as this is easier for the user to operate, but it may also be an operation where the physical button is pressed more than a predetermined number of times (for example, two or more times).

[0083] The "first function" should be a function that sets setting values ​​used to perform some kind of processing on images acquired from a shooting unit installed on a mobile device, based on user operations. The "first function" may be at least one of the following: a function to set a setting value for displaying a portion of an image acquired from the shooting unit; a function to set a setting value for displaying the image enlarged; a function to set a setting value for displaying the image reduced; a function to set a setting value for displaying the image with changed brightness; a function to set a setting value for displaying the image with changed color tone; a function to set a setting value for displaying at least a portion of the image with emphasis; a function to set a setting value for displaying multiple images on the display means; a function to set a setting value for displaying images acquired from different shooting units, etc.

[0084] (19) The system comprises an operating unit operated by the user and a current location information acquisition unit that acquires the current location information of the moving object. The system is configured to display a map of the area around the current location of the moving object on the display means based on the current location information in response to the user operating the operating unit.

[0085] In response to the user's operation of the control unit, the display unit can display a map of the area around the mobile object's current location based on the current location information acquired by the current location information acquisition unit, allowing the user to recognize their current location.

[0086] "Current location information" can be considered equivalent to the position of the moving object, the position of the camera unit installed on the moving object, and the position of the driver or other people riding in the moving object. The "Current Location Information Acquisition Unit" acquires current location information (latitude and longitude information) based on signals from, for example, GPS (Global Positioning System), which is one of the GNSS (Global Navigation Satellite Systems). The "Current Location Information Acquisition Unit" may also utilize Michibiki as part of the QZSS (Quasi-Zenith Satellite System).

[0087] The "map of the area around the current location" may be a map that displays the current location of a moving object on the display means based on the current location information acquired by the current location information acquisition unit, but it may also be a map that does not display the current location of a moving object on the display means. A "map of the area around the current location" should ideally be a map centered on the current location of the moving object, but it is also acceptable to have the current location of the moving object at an edge (for example, the bottom center).

[0088] (20) The system includes a detection information acquisition unit that acquires predetermined detection information, and the display control unit is controllable between a display state in which the image is displayed and a hidden state in which the image is hidden. The system is configured such that, when the detection information acquisition unit acquires the detection information during control in the hidden state, the display means does not display a suggestive image that suggests the detection information, and when the detection information acquisition unit acquires the detection information during control in the display state, the display means displays the suggestive image.

[0089] Since the user does not see a suggestive image on the display means based on the detection information acquisition unit acquiring detection information while the system is in the hidden state, it is possible to prevent the user from being distracted by the suggestive image while the system is in the hidden state. On the other hand, since the user sees a suggestive image on the display means based on the detection information acquisition unit acquiring detection information while the system is in the displayed state, the user can see the suggestive image and know that detection information has been acquired while the system is in the displayed state.

[0090] "Detection information" can include, for example, information about the surroundings of a moving object, particularly information warning of the risk of an accident, information about road signs, or information related to the control of the moving object (for example, control to stop the object, control to make the object perform evasive maneuvers, or control to make the object follow another object).

[0091] The "detection information acquisition unit" can, for example, acquire signals from ADAS (Advanced Driver-Assistance Systems). The "detection information acquisition unit" can, for example, acquire signals from BSD (Blind Spot Detection). The "detection information acquisition unit" may be, for example, Luxus Teammate (registered trademark), ProPilot (registered trademark), Honda SENSING (registered trademark), EyeSight (registered trademark), Autopilot, SuperCruise, IQ.DRIVE, or BMW Personal CoPilot.

[0092] For example, a "suggestive image" could be a pre-defined icon that indicates the type of detected information. As a "suggestive image," for example, if there is another moving object approaching the right rear of the moving object, an icon emphasizing the right side should be displayed, and if there is another moving object approaching the left rear of the moving object, an icon emphasizing the left side should be displayed. The "suggestive image" may be, for example, an image displayed in the corner of the display means, smaller than the image in the first or second display mode.

[0093] (twenty one) The display control unit may be configured to hide the image without displaying on the display means that the image was not acquired from the imaging unit, in response to the fact that the image was not acquired from the imaging unit.

[0094] When an image is not acquired from the camera unit, the user can recognize that there is a problem with the system because the image is hidden without any indication on the display device that an image is not being acquired from the camera unit.

[0095] (twenty two) The program should be designed to enable a computer to perform any of the functions of the system described in (1) through (21).

[0096] The system configuration described above may also be configured as follows.

[0097] <1> The system is characterized by comprising a display control unit that displays at least a portion of an image acquired from a shooting unit installed on a mobile body on a display means within the mobile body, and the display control unit having at least one of the following functions: a first function which displays a range of the image acquired from the shooting unit installed on the mobile body on the display means within the mobile body based on user operation, associates the image acquired from the shooting unit with information indicating the range based on user operation and stores it in a storage unit so that it can be retrieved from the outside; and a second function which allows at least a portion of the image to be displayed in a predetermined display area set based on user operation within the display area of ​​the display means, while hiding the image outside the predetermined display area.

[0098] The first function allows the user to associate images acquired from the imaging unit with information indicating the range based on the user's operation, and store this information in a storage unit so that it can be retrieved from the outside. This allows the user to recognize how the image was displayed on the display means based on the stored image and the above information, using the first function. Furthermore, the user can arbitrarily set the display area for displaying the image using the second function, and it is possible to divide the display area of ​​the display means into a predetermined display area for displaying the image and an area outside the predetermined display area where the image is not displayed.

[0099] <2> The mobile body is equipped with a display control unit that displays the image acquired from the imaging unit installed on the mobile body onto the display means, which has its front surface covered by a mirror that transmits and reflects a portion of the light. The second function of the display means is to display at least a portion of the image in a predetermined display area set based on user operation, while hiding the image in areas other than the predetermined display area.

[0100] The second function allows the user to arbitrarily set the display area for displaying images, and the display means covered by the mirror can be used to display images in one area and to hide images in another, for example, as a mirror.

[0101] <3> The system comprises an operating unit operated by the user and a touch sensor positioned superimposed on the front side of the display means. The system is configured such that the touch sensor is disabled while the image is being displayed, and is enabled when a predetermined operation is performed using the operating unit while the touch sensor is disabled.

[0102] The user can disable the touch sensor, which is superimposed on the front side of the display means while an image is being displayed. When the user performs a predetermined operation using the control unit while the touch sensor is disabled, the touch sensor is enabled. This reduces the opportunities for the user to touch the display means while an image is being displayed when the touch sensor is disabled. This prevents the recognition of the display means from being reduced by the user's fingerprints while an image is being displayed.

[0103] The "user-operated control unit" is more preferably a physical button, but it may also be a touch sensor provided in addition to the display means. The "user-operated control unit" may be an external device (such as a smartphone) connected to the display control unit. The "user-operated control unit" may be a single control unit, but it is more preferable to have multiple control units. The phrase "user-operated control panel" should be changed to the above format in all of the following documents.

[0104] <4> The system may be configured to include an operating unit operated by a user, and when the setting value for displaying the image by the display control unit is changed in response to the operation of the operating unit, the system may display the image on the display means based on the changed setting value, while simultaneously storing the image acquired from the shooting unit in a storage unit so that it can be retrieved from the outside.

[0105] When the user changes the settings related to image display by the display control unit in response to the operation of the control unit, the display means can display the image based on the changed settings, and the storage unit can store the image acquired from the shooting unit so that it can be retrieved from the outside.

[0106] <5> On the computer, <1> from <4> It is recommended that the program be designed to implement the functionality of one of the systems described in the following.

[0107] As described above in (1) to (22) and <1> from <5> The inventions shown can be combined in any way. For example, all or part of the configuration of the invention shown in (1) can be combined with (2) to (22) and <1> from <5> The configuration may include at least a part of the configuration of at least one of the inventions. In particular, the invention shown in (1) may include (2) to (22) and <1> from <5> It is preferable that the invention be an addition of at least one of the features of the above inventions. Also, (1) to (22) and <1> from <5> You may extract any configuration from the invention shown and combine the extracted configurations. The applicant of this application intends to obtain rights to the invention including these configurations. Furthermore, even if there are descriptions such as "in the case of..." or "when...", these do not mean that the configuration is limited to that case or time. These are merely examples of better configurations, and the applicant intends to obtain rights to configurations other than those cases or times. Also, even if there is a sequence of descriptions, it is not limited to that order. Configurations with some parts deleted or the order rearranged are also disclosed, and the applicant intends to obtain rights to them as well. [Effects of the Invention]

[0108] According to the present invention, it is possible to provide systems and programs that are superior to those of the conventional era.

[0109] Furthermore, the effects of the present invention are not limited to those described herein. Effects derived from the components disclosed in this specification and the drawings are also disclosed, and the applicant intends to obtain rights to such components through divisional applications, amendments, etc. For example, phrases such as "can do" or "is possible" in this specification are descriptions that clearly indicate the effects to be achieved, and there are components that demonstrate effects even without such descriptions. Moreover, there are effects that can be grasped by the component even without such descriptions. [Brief explanation of the drawing]

[0110] [Figure 1] This is a diagram illustrating the system configuration of this embodiment. [Figure 2] This figure shows an example of the external configuration of the imaging device 100. [Figure 3] This diagram shows the configuration of bracket 600. [Figure 4] This is a block diagram showing the electrical configuration of the imaging device 100. [Figure 5] This is an example of an image to be displayed on the display surface 131 when the middle portion of the original image acquired from the imaging device 100 (or imaging device 200) is divided into three vertical sections, and the cropped image position 132 is the cropped image position. [Figure 6] This is an example of an image displayed on the display surface 131 when the original image acquired from the imaging device 100 (or imaging device 200) is enlarged and the central part of the image is the cropped image position 132. [Figure 7] This is an example of an image displayed on the display surface 131 when the original image acquired from the imaging device 100 (or imaging device 200) is reduced in size and the central part of the image is the cropped image position 132. [Figure 8] This is an example of how, when the original image acquired from the imaging device 100 (or imaging device 200) has overexposure, the brightness adjustment function suppresses the overexposure and displays the resulting image on the display surface 131. [Figure 9] This is an example of how, when the original image acquired from the imaging device 100 (or imaging device 200) contains unimportant red, the color tone change function suppresses the red and displays the resulting image on the display surface 131. [Figure 10] This is an explanatory diagram illustrating how images on the display surface 131 switch. [Figure 11] This is an explanatory diagram illustrating a modified example of how images switch on the display surface 131. [Figure 12] This is an explanatory diagram illustrating an example of an image displayed on the display surface 131. [Figure 13] This is an explanatory diagram illustrating an example of a guide display G1 that shows the location (or range) of the original image where the cropped image position 132 corresponds. [Figure 14]This is an explanatory diagram illustrating an example of a guide display G2 that shows the location (or range) of the original image where the cropped image position 132 is located. [Figure 15] This is an explanatory diagram illustrating an example of a configuration in which an image is displayed on a portion of the display surface 131, and the remaining portion is used as a mirror. [Figure 16] This is a six-view drawing showing an example of the external configuration of the imaging device 100. [Figure 17] Figure 16 is a perspective view showing an example of the external configuration of the imaging device 100 illustrated in the diagram. [Figure 18] Figure 16 shows a six-view drawing and a perspective drawing illustrating an example of the external configuration of the imaging unit 15 in the embodiment shown. [Figure 19] Figure 16 shows a six-view drawing and a perspective view illustrating an example of the external configuration of the imaging device 200 in the embodiment shown. [Figure 20] This is an explanatory diagram showing an example of the external configuration of the imaging device 100. [Figure 21] This is a six-view drawing showing an example of the external configuration of the imaging device 100, which is fixed with a ball joint. [Figure 22] This is an explanatory diagram illustrating examples of functions that can be assigned to the free button. [Figure 23] This is an example of a front view of a camera 100 having a light-emitting element that notifies ADAS (or BSD) detection information. [Figure 24] This is an explanatory diagram illustrating an example of how areas are determined based on overlapping rectangles. [Figure 25] This is an explanatory diagram illustrating the method for determining an area when there are non-overlapping rectangles. [Figure 26] This is an explanatory diagram illustrating how to define an area by increasing the number of vertices that define the area, starting from the default rectangular shape. [Figure 27] This is an explanatory diagram to illustrate the difference between an unblurred image and an image where the entire blurred area is blurred. [Figure 28] This is an explanatory diagram for describing a method of not blurring faces. [Figure 29]This is an explanatory diagram illustrating an embodiment in which a person is detected when a foot (for example, the entire foot from the ankle to the toes) enters from the front, and in response to the detection, the process of blurring the bounding box area of ​​the person recognition is canceled. [Figure 30] This is an explanatory diagram illustrating a parking area image that suggests the area where 400 vehicles are concentrated, and the blue zone with little displacement and the red zone with a large displacement. [Figure 31] This is an explanatory diagram showing an example of the external configuration of a camera 100 having a touch panel switch. [Figure 32] This is an explanatory diagram illustrating a configuration in which the housing (and display surface 131) of the camera 100 is of the type of a car's rearview mirror, and the camera 100 is a mirror drive recorder, in which the power to the display surface 131 is turned off in response to the interruption of the video signals output from the camera 100 and camera 200, and the display surface 131 is used as a mirror for reflection. [Figure 33] This is an explanatory diagram illustrating a configuration in which the housing (and display surface 131) of the camera 100 is of the type of a car's rearview mirror, and the camera 100 is used as a mirror drive recorder, displaying and reflecting a black image on the display surface 131 in response to the interruption of video signals output from the camera 100 and camera 200. [Modes for carrying out the invention]

[0111] Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. Note that the embodiments described below are just one example of the present invention, and the content of the present invention should not be interpreted as being limited based on the following description.

[0112] [1. Overall System Configuration] Figure 1 is a diagram illustrating the system configuration of this embodiment. Figure 1 shows a schematic diagram of the vehicle 400 as viewed from the side. The vehicle 400 is, for example, an internal combustion engine vehicle with an engine as a power source, a hybrid vehicle with an engine and a traction motor as power sources, an electric vehicle with a traction motor as a power source, etc. System 1 has a first imaging device, an imaging device 100, and a second imaging device, an imaging device 200, which are installed on the vehicle 400. The vehicle 400 is, for example, a four-wheeled automobile, but is not limited to a four-wheeled automobile; any vehicle capable of installing the imaging device 100 and the imaging device 200 is acceptable. The vehicle may be, for example, a large transport vehicle with four or more wheels such as an automobile, bus, or truck, or a two-wheeled vehicle such as a motorcycle or bicycle, or other vehicles. The vehicle may also be a vehicle of a transportation system such as a train, monorail, or maglev train. The vehicle 400 may be a mobile object, for example, a ship that navigates on water.

[0113] The camera 100 and camera 200 are devices (also called aftermarket products) that are retrofitted to the vehicle 400, such as by being purchased separately by the user. However, at least one of the camera 100 and camera 200 may be a device that is pre-installed in the vehicle 400 (i.e., is standard equipment). The camera 100 is a front camera positioned on the front side of the vehicle 400. For example, the camera 100 is mounted at a predetermined position on the front side of the passenger compartment of the vehicle 400 and takes pictures of the area in front of the vehicle 400 through the windshield. The camera 100 is a drive recorder. Specifically, the camera 100 has a function to take pictures, a function to record image data showing the pictures taken, and a function to record image data acquired from the camera 200.

[0114] The imaging device 200 is a rear camera positioned on the rear side of the vehicle 400. The imaging device 200 is, for example, mounted at a predetermined position on the rear side of the passenger compartment of the vehicle 400 and captures images of the rear of the vehicle through the rear window. The imaging device 200 has the function of capturing images and the function of outputting image data showing the captured images to the imaging device 100.

[0115] The imaging device 100 and the imaging device 200 are connected via a cable 300. The cable 300 is a wired communication path connecting the imaging device 100 and the imaging device 200. The cable 300 includes, for example, a power line for supplying power for operation from the imaging device 100 to the imaging device 200, and a signal line for transmitting various signals between the imaging device 100 and the imaging device 200. The cable 300 is preferably configured to digitally transmit signals between the imaging device 100 and the imaging device 200, but analog transmission is also possible. The imaging device 200 operates by receiving power from the imaging device 100 via the cable 300. The imaging device 100 and the imaging device 200 may be connected by a wireless communication path of Wi-Fi®, Bluetooth®, or other standards instead of a wired communication path. Furthermore, the imaging device 100 may be used without being connected to the imaging device 200 by communication. Cable 300 should, for example, be a thin and flexible coaxial digital cable (e.g., 2.5mm in diameter). This makes wiring easier for the user.

[0116] [2. External configuration of the imaging device 100] Figure 2 shows an example of the external configuration of the imaging device 100. Figure 2(A) is a view of the imaging device 100 from the front, diagonally upward to the right. Figure 2(B) is a view of the imaging device 100 from the rear, diagonally upward to the right. The imaging device 100 has a housing 101. The housing 101 is a rectangular parallelepiped that is longer in the left-right direction than in the up-down direction and has a relatively small thickness. The housing 101 has an upper surface 1011 that faces upward when attached to the vehicle 400, a first side surface 1012, a second side surface 1013, a third side surface 1014 located opposite the second side surface 1013, and a fourth side surface 1015 located opposite the first side surface 1012.

[0117] The upper surface 1011 is provided with a joint rail 102 and a camera jack 191. The joint rail 102 is detachable from a bracket (for example, a bracket 600 described later) for attaching the imaging device 100 to a predetermined mounting position on the vehicle 400. The mounting position may be, for example, the windshield of the vehicle 400 (for example, near the upper edge of the windshield), or the rearview mirror or the ceiling inside the vehicle 400. When the imaging device 100 is attached to the vehicle 400, the first side surface 1012 faces the front of the vehicle 400. At this time, the second side surface 1013 faces to the right when viewed from the rear of the vehicle 400. The third side surface 1014 faces to the left when viewed from the rear of the vehicle 400. The fourth side surface 1015 faces the rear of the vehicle 400.

[0118] The camera jack 191 is a terminal to which one end of the cable 300 is connected. The camera jack 191 may, for example, be compatible with the USB Type-C standard and may also serve as a terminal for the imaging device 100 to communicate with the imaging device 200 using the Ethernet standard.

[0119] The first side surface 1012 is provided with an imaging lens 151, a sound emission hole 103, and a microphone hole 104. The imaging lens 151 is a light-gathering lens of the imaging unit (imaging unit 15, described later) of the imaging device 100. The sound emission hole 103 is located above the imaging lens 151 and is a hole that allows sound output by the audio output unit (audio output unit 14, described later) of the imaging device 100 to pass from the inside to the outside of the housing 101. The microphone hole 104 is located below the imaging lens 151 and is a hole that allows sound from the outside to pass from the outside to the inside of the housing 101. The sound that has passed through to the inside of the housing 101 is input to the microphone (microphone 121, described later) of the imaging device 100.

[0120] An event recording button 122 is provided on the second side 1013. The event recording button 122 is an operating means for instructing the start or end of recording of images captured by the shooting unit 15. When the user operates the event recording button 122 when event recording is not in progress, the shooting device 100 starts event recording. More details about event recording will be described later. The event recording button 122 is located on the second side 1013 facing the driver's seat so that it is easy for the driver of a right-hand drive vehicle 400 to operate. The third side 1014 is provided with a terminal 192 and a storage medium insertion slot 181. Terminal 192 is a terminal for receiving power from an external device. Terminal 192 is, for example, a DC jack. One end of a power cord (for example, a cigarette lighter plug cord) is connected to terminal 192. The other end of the power cord is connected to a power supply terminal (for example, a cigarette lighter socket) provided on the vehicle 400 side.

[0121] Terminal 192 may be connected to an OBDII adapter that can be connected to the OBDII connector (where "II" is the Roman numeral for "2") of the vehicle 400. The OBDII connector, also called a fault diagnosis connector, is connected to the vehicle's ECU (Engine Control Unit) and is a terminal that outputs various vehicle information at predetermined intervals (for example, every 0.5 seconds). By connecting terminal 192 to the OBDII connector using an OBDII adapter, the imaging device 100 can receive power for operation and acquire vehicle information.

[0122] Vehicle information refers to information about the status of vehicle 400. Vehicle information should include at least one of the following: vehicle speed, engine speed, engine load percentage, throttle position, ignition timing, percentage of remaining fuel, intake manifold pressure, intake air volume (MAF), injection opening time, engine coolant temperature, intake air temperature, ambient temperature, fuel tank volume, fuel flow rate, instantaneous fuel consumption, accelerator pedal position, turn signal information (operation of left and right turn signals (ON / OFF)), brake position, steering wheel rotation angle, gear position, and door open / closed status.

[0123] The storage medium insertion slot 181 is an insertion slot for inserting a storage medium 500, which serves as an external storage means, into the inside of the imaging device 100. The storage medium 500 is a storage medium on which images captured by the imaging device 100 or imaging device 200 are recorded, and is, for example, an SD card. The SD card includes any of the following forms, such as an SD memory card, a miniSD card, and a microSD card. The storage medium 500 may also store a program for a viewer (for example, a dedicated viewer) for playing back the stored images on an information display terminal such as a personal computer.

[0124] The fourth side 1015 is provided with an operating section 123, a display surface 131, and a light-emitting section 21. The operating section 123 has a first button 1231, a second button 1232, a third button 1233, and a fourth button 1234. The first button 1231, the second button 1232, the third button 1233, and the fourth button 1234 are arranged vertically along the right edge of the display surface 131. The functions that can be assigned to each of these buttons include, for example, the following:

[0125] The first button 1231 functions as a button to switch images when pressed and held, and as a button to instruct the formatting of the storage medium 500 when pressed briefly. The image displayed on the display surface 131 is, for example, one or both of the image currently being captured by the camera 100 and the image currently being captured by the camera 200. Formatting the storage medium 500 is understood as initializing the storage medium 500, and is understood as at least one of the following: erasing data such as images stored in the storage medium 500, writing setting information indicating the contents of the operation settings to the storage medium 500 in order to make the camera 100 able to use the storage medium 500 (for example, to make it possible to record and read images), and putting the storage medium 500 into a specific file state.

[0126] The second button 1232 is for displaying a selection screen for selecting the image to be played back by the camera 100. The third button 1233 is for displaying a menu related to the settings of the camera 100 and the camera 200. The fourth button 1234 is for instructing the start and stop of image recording. For example, if the fourth button 1234 is briefly pressed while recording is being done using the continuous recording function described later, the recording will be paused. If the fourth button 1234 is briefly pressed during this pause, image recording using the continuous recording function will resume. If the fourth button 1234 is long-pressed, the frame rate when recording images can be changed.

[0127] The display surface 131 is the area where the image displayed by the display unit (display unit 13, described later) of the imaging device 100 is displayed. The display surface 131 is, for example, a rectangular or square area. A touch sensor 124 for detecting user touch operations is provided superimposed on the display surface 131.

[0128] The light-emitting unit 21 is located above the first button 1231 and emits light in a predetermined color.

[0129] Furthermore, the camera 200 may also function as a drive recorder, and may have a configuration similar to that of the camera 100. In addition, one or more cameras that capture other directions may be used as cameras connected to the camera 100 by communication, instead of or in addition to the camera 200. Other directions include the right rear, left rear, and width of the vehicle (side) of the vehicle 400.

[0130] [3. Bracket Configuration] Figure 3 shows the configuration of the bracket 600. Figure 3(A) is a view of the bracket 600 from the front, diagonally upward right. Figure 3(B) is a view of the bracket 600 from the side. Figure 3(C) is a view of the bracket 600 from the front, diagonally downward right. The bracket 600 is an example of a mounting member for attaching the imaging device 100 to the vehicle 400.

[0131] The bracket 600 is a mounting member that uses a ball joint mechanism. In the bracket 600, the flat base portion 610 has a mounting surface 611 that is attached to the windshield of the vehicle 400. The base portion 610 is inclined by a predetermined angle with respect to the support column of the ball stud 620. An adhesive member such as double-sided tape is attached to the mounting surface 611, and the bracket is attached to the windshield of the vehicle 400 via the adhesive member.

[0132] The ball stud 620 is the portion of the base portion 610 that rises from the side opposite to the mounting surface 611. The ball portion 621 of the ball stud 620 is mounted on the socket portion 630. The nut 640 is detachably attached around the socket portion 630. Screw threads are formed on the outer circumference of the socket portion 630. The nut 640, which fits into these screw threads, is mounted on the outer circumference of the socket portion 630. With the ball portion 621 of the ball stud 620 mounted inside the socket portion 630, before the nut 640 is tightened, the socket portion 630 can rotate along the circumferential surface of the ball portion 621 in the desired direction, thereby displacing the posture and position of the base portion 650. Once the nut 640 is tightened, the posture and position of the base portion 650 are fixed.

[0133] The base portion 650 is formed in conjunction with the socket portion 630 and is the part for attaching to the imaging device 100. The base portion 650 has a pair of guide rails 651 on its underside. The pair of guide rails 651 are configured to slide along the joint rail 102 of the imaging device 100. The tip of the base portion 650 is provided with a claw-shaped tip portion 652. The bracket 600 is attached to the imaging device 100 by hooking the tip portion 652 near the front end of the joint rail 102 of the imaging device 100.

[0134] [4. Electrical configuration of the imaging device 100] Figure 4 is a block diagram showing the electrical configuration of the imaging device 100. The control unit 11 controls each part of the imaging device 100. The control unit 11 is a computer including, for example, a processor 111 and a memory 112. The processor 111 has, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application-Specific Integrated Circuit), and an FPGA (Field Programmable Gate Array). The memory 112 is a main memory having, for example, RAM (Random Access Memory) and ROM (Read Only Memory). The processor 111 temporarily stores the program read from the ROM of the memory 112 in the RAM. The RAM of the memory 112 provides the processor 111 with a workspace. The processor 111 performs various controls by performing arithmetic processing while temporarily storing data generated during program execution in the RAM. The control unit 11 further includes a timing unit 113 for measuring time. The timing unit 113 is, for example, a real-time clock. The timing unit 113 may be mounted on the motherboard of the processor 111, or it may be externally connected to the processor 111.

[0135] The input unit 12 receives information input from the user. The input unit 12 includes, for example, the microphone 121, event recording button 122, operation unit 123, and touch sensor 124. The microphone 121 converts sound incident through the microphone hole 104, etc., into an electrical signal. The microphone 121 is, for example, a condenser microphone. The touch sensor 124 detects the position touched by the user on the display surface 131. The touch sensor 124 is, for example, a capacitive type.

[0136] The display unit 13 displays an image on the display surface 131. The display unit 13 is, for example, a liquid crystal display (LCD). The display unit 13 is preferably a high-brightness LCD (800 CD / cm²), which reduces the influence of reflected images.

[0137] The audio output unit 14 outputs sound. This sound may include, for example, notification sounds, background music, or voice messages. The audio output unit 14 includes, for example, an audio processing circuit and a speaker.

[0138] The imaging unit 15 captures images and generates image data obtained from the images. The imaging unit 15 includes, for example, an imaging lens 151 and an image sensor that captures the light focused by the imaging lens 151. The image sensor is, for example, a CMOS (Complementary MOS) or a CCD (Charge Coupled Device). The imaging unit 15 generates a color (multicolor) image consisting of, for example, red (R), green (G), and blue (B) color components.

[0139] The communication unit 16 communicates with external devices. The communication unit 16 has a communication circuit for wireless communication with external devices, for example, by Wi-Fi (registered trademark), Bluetooth (registered trademark), other wireless LAN (Local Area Network) communication, or short-range wireless communication. The communication unit 16 may also have a communication circuit for performing communication compliant with standards for mobile communication systems such as LTE (Long Term Evolution), 4G, 5G, etc.

[0140] The sensor unit 17 has various sensors. The sensor unit 17 has, for example, at least one of an acceleration sensor, a gyro sensor, a barometric pressure sensor, and an illuminance sensor. The acceleration sensor is, for example, a three-axis acceleration sensor that detects the acceleration of the vehicle in the forward / backward, left / right, and up / down directions. By equipping the imaging device 100 with an acceleration sensor, vibration detection with less blurring is possible. The gyro sensor is a sensor that detects the tilt of the imaging device 100. The acceleration sensor and gyro sensor may be used, for example, to estimate the position of the vehicle 400 by autonomous navigation when signals from GNSS satellites cannot be received. The barometric pressure sensor measures atmospheric pressure. The barometric pressure sensor is used, for example, to detect differences in elevation and determine whether it is a highway or a regular road. The illuminance sensor is a sensor that detects the illuminance, which indicates the brightness inside the vehicle interior, around the imaging device 100. The illuminance sensor is used, for example, to adjust the brightness of the display on the display unit 13.

[0141] The reader / writer 18 functions as a media holder that holds the storage medium 500 inserted into the imaging device 100 through the storage medium insertion slot 181. The reader / writer 18 writes data to the storage medium 500 and reads data from the storage medium 500. The reader / writer 18 may hold only one storage medium 500, but it may also be configured to hold two or more storage mediums 500 simultaneously.

[0142] The terminal section 19 has terminals for electrically connecting to external devices. The terminal section 19 has the camera jack 191 and terminal 192 described above. As a device connected to the terminal section 19, an external battery may be used so that the camera 100 and camera 200 can operate even without power supply from the vehicle 400. The device connected to the terminal section 19 may be, for example, a device that has a function to support the user's safe driving. Such devices include, for example, a device that has a function to photograph the driver (e.g., face) and detect and notify the driver's state, such as distracted driving and drowsy driving, or a device that has a function to detect and notify obstacles around the vehicle 400 (for example, a device used for vehicle detection for a Forward Vehicle Collision Warning System (FCWS)). Other devices connected to the terminal section 19 may be in-vehicle devices such as a radar detector, laser detector, car navigation system, or display device.

[0143] The position information acquisition unit 20 acquires position information indicating the position of the imaging device 100 (more specifically, its current position). The position of the imaging device 100 can be considered equivalent to the position of the vehicle 400 on which the imaging device 100 is located, the position of the imaging device 200 located on the vehicle 400, and the positions of the driver and other people riding in the vehicle 400. The position information acquisition unit 20 acquires position information (latitude information and longitude information) of the imaging device 100 based on signals from GPS (Global Positioning System), which is one of the GNSS (Global Navigation Satellite Systems). The position information acquisition unit 20 may also use Michibiki as a QZSS (Quasi-Zenith Satellite System). By incorporating GPS into the imaging unit 15, the influence of obstacles is reduced and sensitivity is improved.

[0144] The light-emitting unit 21 emits light in a predetermined color. The light-emitting unit 21 includes, for example, a light-emitting diode.

[0145] The power control unit 22 controls the supply of power to each part of the imaging device 100 and to the imaging device 200. The power control unit 22 includes, for example, a power switch and a power control circuit. The power control unit 22 supplies power supplied from the vehicle 400 side via the terminal section 19 to each part of the imaging device 100 and to the imaging device 200. The power control unit 22 may also have a secondary battery, a button battery, or an electric double-layer capacitor (also called a supercapacitor) as a means of power storage.

[0146] The imaging device 100 may further have an auxiliary storage device as an internal storage means, such as flash memory (e.g., eMMC, SSD). Various storage media, such as optical storage media, magnetic storage media, and semiconductor storage media, can be used as the auxiliary storage device.

[0147] [5. Image recording function of the imaging device 100] The imaging device 100 has one or more of the following image recording functions. The image recording function is a function that records images captured by the imaging device 100 as image data in a predetermined file format. The image data is often in a video format, such as MPEG (Moving Picture Experts Group) format (e.g., MPEG2, MPEG4), but also AVI, MOV, WMV, etc.

[0148] <5-1. Continuous Recording Function> The continuous recording function (also called the continuous video recording function) is a function that continuously (i.e., continuously) records images captured by either or both of the camera 100 and the camera 200 while the camera 100 is in operation. When the control unit 11 is executing the continuous recording function, it stores video data captured from the start to the stop of the vehicle 400's engine. Engine start is detected, for example, by turning on the accessory power of the vehicle 400, and engine stop is detected by turning off the accessory power.

[0149] <5-2. Event Recording Function> The event recording function is a function that records images captured by either or both of the camera 100 and camera 200 in response to the occurrence of a specific event. An event is an occurrence for which images captured by camera 100 or camera 200 should be recorded, such as when the user performs sudden steering or braking operations while the vehicle 400 is in motion, or when the vehicle 400 collides with another object. The control unit 11 determines that an event has occurred, for example, based on the measured value from the acceleration sensor of the sensor unit 17. Specifically, the control unit 11 determines that an event has occurred when the measured value from the acceleration sensor exceeds a predetermined threshold or shows a predetermined temporal change. The conditions for determining the occurrence of an event are not limited to these. The control unit 11 may also determine that an event has occurred based on vehicle information, for example, when the state of the vehicle 400, such as vehicle speed or steering state, meets predetermined conditions. The control unit 11 may analyze the images captured by the imaging unit 15 or the imaging device 200 and determine that an event has occurred if it detects dangerous driving by the vehicle 400 or another vehicle (e.g., aggressive driving, approaching, or dangerously close approach). The control unit 11 also determines that an event has occurred if the event recording button 122 is operated.

[0150] When the control unit 11 determines that an event has occurred, it records images captured during a predetermined period before and after the event (hereinafter referred to as the "event recording period") onto the storage medium 500. The control unit 11 may, for example, temporarily store images captured by the imaging unit 15 and the imaging device 200 in the memory 112 (e.g., RAM), and when it determines that an event has occurred, it may read the images from the memory 112 for the event recording period and record them onto the storage medium 500. For example, the control unit 11 may create a single file containing images from 20 seconds before the event and 20 seconds after the event, for a total of 40 seconds. The event recording period is just an example and may vary depending on the type of event, and may also be changeable by the user. The control unit 11 may record images consisting of multiple files onto the storage medium 500 for each event. The control unit 11 may also record values ​​measured by the sensor unit 17 during the event recording period (e.g., acceleration in each of the three axes) and position information acquired by the position information acquisition unit 20, in association with the images, onto the storage medium 500.

[0151] <5-3. Parking Surveillance Function> The parking surveillance function is a function that records images taken by either or both of the camera 100 and the camera 200 while the vehicle 400 is parked. The parking surveillance function is a function for monitoring the interior of the parked vehicle 400 or the exterior surrounding the vehicle 400. When the engine of the vehicle 400 is off, the control unit 11 receives power from an external battery and records images to the storage medium 500. The control unit 11 determines whether or not the vehicle 400 is parked based on one or more of the following: for example, the accessory power is turned off, the engine is turned off, power supply from the external battery has started, the vehicle speed is 0 km / h or below a predetermined speed, and the location information acquired by the location information acquisition unit 20 is predetermined location information (for example, location information of home, workplace, or parking lot).

[0152] The parking surveillance function may include a time-lapse mode and a motion detection mode. Specifically, when the time-lapse mode is selected by the user, the control unit 11 records images at a lower frame rate than other image recording functions such as the continuous recording function and the event recording function. For example, while the frame rate of other image recording functions is 20 to 30 frames / second, the frame rate of the time-lapse mode is 1 frame / second. The motion detection mode is a mode that records images in response to the detection of a moving object. Specifically, when the motion detection mode is selected by the user, the control unit 11 detects a moving object from changes in images captured by the shooting device 100 and the shooting device 200, and records the images captured during a predetermined period before and after the detection to the storage medium 500. The frame rate may be the same as that of the continuous recording function and the event recording function.

[0153] Furthermore, the imaging devices 100 and 200 may be imaging devices that capture celestial images such as a full sphere or a hemisphere. Also, the imaging device 100 may be an imaging device that does not have a display unit 13. In addition, the housing of the imaging device 100 does not have to be a rectangular parallelepiped, but may be a cylindrical imaging device, for example.

[0154] [Image processing function of the imaging device 100] The imaging device 100 is a device that takes original images acquired from imaging devices 100 and 200, processes at least a portion of those images in some way (hereinafter referred to as "image processing"), and displays them. The control unit 11 of the imaging device 100 processes the images acquired from imaging devices 100 and 200 and displays them on the display surface 131 inside the vehicle 400. The control unit 11 does not display the images acquired from imaging devices 100 and 200 without image processing. The control unit 11 may have a function to process and display the images acquired from imaging devices 100 and 200, and a function to display the original images without image processing. In addition, the control unit 11 may display the images acquired from imaging devices 100 and 200 inside the vehicle 400 on the display surface of an external device (e.g., a smartphone) connected to imaging device 100.

[0155] The imaging device 100 has one or more of the following image processing functions for image processing.

[0156] <Cropping function> The cropping function displays a portion of the original image acquired from the imaging device 100 and imaging device 200 on the display surface 131. Hereinafter, the position of the image cropped from the original image acquired from the imaging device 100 and imaging device 200 and displayed on the display surface 131 will be referred to as the "cropped image position 132". As will be described in detail later, the display surface 131 displays move icons T1~4 (see Figure 12(B)) that the user uses to change the cropped image position 132. The cropped image position 132 can be freely set up, down, left, or right by displaying the image on the display surface 131 and tapping the screen (specifically, tapping the move icon). If one person prefers a certain cropped image position 132, but another person might prefer a different cropped image position 132, System 1 allows each person to individually set their cropped image position 132. Also, for example, the cropped image position 132 can be freely set depending on the camera orientation, so a person who has the camera pointed slightly downwards can set the upper part of the image as the cropped image position 132. In this way, System 1 allows users to freely select the position 132 of the cropped image to be displayed on the display surface 131. Users can set the cropped image position 132 to the top if they prefer the top of the original image, to the bottom if they prefer the bottom of the original image, and to the right if they prefer the right side of the original image.

[0157] Figure 5 shows an example of an image displayed on the display surface 131 when the middle portion of the original image acquired from the imaging device 100 (or imaging device 200) is divided into three vertical sections, and the cropped image position 132 is that section. In Figure 5, the movement icons have been omitted for clarity. In the example in Figure 5(A), the size of the original image is longer vertically than the size of the cropped image position 132, and the same length horizontally. As illustrated in Figure 5(B), in the state of Figure 5(A), the image of the portion at the cropped image position 132 is displayed in full screen on the display surface 131.

[0158] As illustrated in Figure 5(B), it is preferable that the size of the display surface 131 be longer in the left-right direction than in the up-down direction, but the up-down and left-right directions may be the same length, or the up-down direction may be longer than the left-right direction. In the following explanation, the size of the display surface 131 will be described assuming that the left-right direction is longer than the up-down direction.

[0159] Here, a characteristic unique to dashcams is that in the event of an accident, knowing which cropped image position 132 the user was viewing from the image acquired by the recording device 100 (or recording device 200) serves as evidence that the user was not at fault. Therefore, it is preferable to record the image that has been modified by the cropping function. For this reason, when recording image data using the image recording function, it is preferable to record the original image data that has not been modified by the cropping function, while not recording the image displayed on the display surface 131. However, it is preferable to record the original image data in association with information that allows the viewer to later analyze how it was displayed on the display surface 131 by the cropping function. It is preferable not to record the image displayed on the display surface 131 because it would increase the amount of data, but the image displayed on the display surface 131 may be recorded instead of (or in addition to) the above information.

[0160] As a cropping function, it may be possible to set the display range for each GPS location. For example, when parking vehicle 400 in the company parking lot, the cropped image position 132 is used, but since cats often pass through the parking lot at home, the bottom position can be set as the cropped image position 132. For example, the camera 100 stores the location information of the cropped image position 132 set by the user, and when the vehicle arrives at that location and starts backing up, it displays an image on the display surface 131 using the cropped image position 132 setting for that location.

[0161] For example, the camera 100 may have text on its packaging or on its display surface 131 stating, "Adjust the cropped image position 132 to a place where you frequently put the vehicle's shift lever in R (for example, your home garage)," or "It's a good idea to adjust the cropped image position 132 for parking." It is preferable to simply state, "You can adjust the cropped image position 132," as listing specific locations would become unreasonable, although specific locations may be indicated as text as described above.

[0162] <Zoom function> The magnification function is a function that enlarges the original image acquired from the imaging device 100 and imaging device 200 and displays it on the display surface 131. As will be described in detail later, the display surface 131 displays a magnification icon T5 (see Figure 12(B)) that the user uses to change the magnification of the image. The imaging devices 100 and 200 may be configured to include, for example, 1 to 4x optical zoom and 40 steps of digital zoom (with coarse / fine switching).

[0163] Figure 6 is an example of an image displayed on the display surface 131 when the original image acquired from the imaging device 100 (or imaging device 200) is enlarged and the central part of the image is the cropped image position 132. In Figure 6, the enlargement icon has been omitted for clarity. The size of the cropped image position 132 in Figure 6(A) is the same as the size of the display surface 131. In the example in Figure 6(A), the size of the enlarged image is longer vertically and horizontally than the size of the cropped image position 132. As illustrated in Figure 6(B), in the state of Figure 6(A), the image of the portion at the cropped image position 132 is displayed in full screen on the display surface 131.

[0164] Here, a characteristic unique to dashcams is that, in the event of an accident, the image position 132 that the user was viewing from the image acquired by the recording device 100 (or recording device 200) serves as evidence that the user was not at fault, so it is preferable to record the image after it has been modified by the zoom function. For this reason, when recording image data using the image recording function, it is preferable to record the original image data that has not been modified by the zoom function, and not to record the image displayed on the display surface 131. However, it is preferable to record the original image data in association with information that allows the viewer to later analyze and view how it was displayed on the display surface 131 after it was modified by the zoom function. It is preferable not to record the image displayed on the display surface 131 because it would increase the amount of data, but the image displayed on the display surface 131 may be recorded instead of (or in addition to) the above information.

[0165] <Reducing function> The reduction function reduces the original image acquired from the imaging device 100 and imaging device 200 and displays it on the display surface 131. As will be described in detail later, the display surface 131 displays a reduction icon T6 (see Figure 12(B)) that the user uses to change the reduction ratio of the image.

[0166] Figure 7 shows an example of an image displayed on the display surface 131 when the original image acquired from the imaging device 100 (or imaging device 200) is reduced in size and the center of the image is the cropped image position 132. In Figure 7, the reduction icon is omitted for clarity. The size of the cropped image position 132 in Figure 7(A) is the same as the size of the display surface 131. As illustrated in Figure 7(B), in the state of Figure 7(A), the image of the portion at the cropped image position 132 is displayed in full screen on the display surface 131. In the example of Figure 7(A), the size of the reduced image is longer vertically and shorter horizontally than the size of the cropped image position 132. Therefore, as illustrated in Figure 7(B), blank areas where no image is displayed occur on the left and right sides of the display surface 131.

[0167] Here, a characteristic unique to dashcams is that, in the event of an accident, the image position 132 that the user was viewing from the image acquired by the recording device 100 (or recording device 200) serves as evidence that the user was not at fault, so it is preferable to record the image after it has been modified by the reduction function. For this reason, when recording image data using the image recording function, it is preferable to record the original image data that has not been modified by the reduction function, while not recording the image displayed on the display surface 131. However, it is preferable to record the original image data in association with information that allows the viewer to later analyze and view how it was displayed on the display surface 131 after the reduction function. It is preferable not to record the image displayed on the display surface 131 because it would increase the amount of data, but the image displayed on the display surface 131 may be recorded instead of (or in addition to) the above information.

[0168] <Brightness adjustment function> The brightness adjustment function displays the original images acquired from the camera 100 and camera 200 on the display surface 131 in a display mode that suppresses overexposure or underexposure. Overexposure may occur, for example, when driving out of a tunnel during the day, or when the headlights of a following vehicle hit the camera 100 or camera 200 at night. Underexposure may occur when driving at night. The brightness adjustment function may suppress overexposure or underexposure according to the illuminance measured by the illuminance sensor described above, but it is especially good to use HDR (High Dynamic Range) technology. Here, HDR technology is a technology that suppresses overexposure (or underexposure) by combining multiple images with different brightness levels. Since there are not many luminous objects inside the vehicle 400, if the camera 100 were to display images without considering the brightness inside and around the vehicle 400, the camera 100 may become an extremely bright light source. The brightness adjustment function is especially important in configurations where the display surface 131 is a half-mirror.

[0169] In this case, for example, illumination detection using a CMOS sensor is greatly affected by the headlights of oncoming vehicles, causing significant and distracting changes in the brightness of the display surface 131 (more specifically, the backlight). Therefore, by integrating the CMOS sensor into the imaging unit 15 and positioning it downwards, the influence of the headlights of oncoming vehicles can be minimized, and the brightness of the display surface 131 can be adjusted to match the ambient illumination.

[0170] Figure 8 shows an example of how an image with overexposure suppressed by the brightness adjustment function is displayed on the display surface 131 when overexposure occurs in the original image acquired from the imaging device 100 (or imaging device 200). The size of the cropped image position 132 in Figure 8(A) is the same as the size of the original image and the size of the display surface 131. As illustrated in Figure 8(B), in the state shown in Figure 8(A), the image with overexposure suppressed is displayed in full screen on the display surface 131.

[0171] In System 1, it is preferable to equip the camera 100 with an illuminance sensor in order to distinguish between three states: day, night, and inside a tunnel (i.e., the overall brightness around the vehicle 400). The illuminance sensor (also called a brightness sensor) is not limited to the camera 100; it may also be equipped in the camera 200. If only the camera 100 has an illuminance sensor, it is difficult to determine whether the intense light is momentary or not. In contrast, if both the camera 100 and the camera 200 have illuminance sensors, it is possible to determine whether it is nighttime or not. A problem with equipping the camera 200 with an illuminance sensor is that the cable from the camera 200 to the camera 100 becomes thicker when various signal lines are included. However, considering the issue of preventing glare when the display surface 131 is used as a rearview mirror, the phenomenon of headlights from the vehicle behind being reflected is a phenomenon that the camera 100 cannot detect, so it is preferable to equip the camera 200 with an illuminance sensor.

[0172] Alternatively, the illuminance sensor may be installed on the rearview mirror of the vehicle 400 instead of the camera 100, or on a camera that captures the area behind the rearview mirror.

[0173] As for the brightness adjustment function, if the camera 100 detects that it is bright, it is preferable to automatically dim (or not brighten) the display surface 131 compared to when both the camera 100 and the camera 200 detect that it is dark. As for the brightness adjustment function, if both the camera 100 and the camera 200 detect that it is dark, it is preferable to dim the display surface 131 compared to when both the camera 100 and the camera 200 detect that it is bright.

[0174] Regarding the brightness adjustment function, if the camera 100 detects darkness and the camera 200 detects brightness, it is possible that light from a vehicle behind is shining on the display surface 131, so it is preferable to leave the brightness of the display surface 131 as is (or to gradually reduce the amount of brightness adjustment compared to when both the camera 100 and camera 200 detect darkness). Even if the intense light from behind does not reach the camera 100, the display surface 131 will display white, which is dazzling.

[0175] Here, when it is dark, the pupils are more dilated than when it is bright, so light is dazzling. For this reason, when the backlight of the vehicle behind reaches the camera 100 at night, it is preferable to increase the brightness of the display surface 131 (i.e., make the display brighter) compared to when both the camera 100 and the camera 200 detect that it is bright. When the backlight of the vehicle behind reaches the camera 100, the display surface 131 is difficult to see due to the intense light from behind, so increasing the brightness of the display surface 131 can improve visibility. If the surroundings are bright, the display surface 131 must also be made brighter, otherwise the display surface 131 will appear dark.

[0176] As a brightness adjustment function, the imaging device 100 should be equipped with an auto-dimmer function that automatically adjusts the brightness of the display surface 131, and it is preferable that the user be able to set the upper and lower limits for brightness adjustment. For example, the brightness adjustment range should be 0 to 100% by default, and it is preferable that the upper and lower limits can be set in increments of about 10%. Since the user looks at the display surface 131 every day, it is preferable that the brightness can be adjusted. In the case of the auto-dimmer function, the above upper and lower limits are controlled including the time of day (specifically night, day, tunnel), so it is preferable that they be applied regardless of the time of day. It is also possible to set upper and lower limits for day, night, and tunnel separately. Furthermore, it is also possible to set upper and lower limits for R zoom 1 and R zoom 2, which will be described later. In addition, it is possible to have a function that makes the brightness (and color tone) when R zoom 1 is different from the brightness (and color tone) when R zoom 2 is used. For example, when R zoom 1 is selected, the image may be displayed in color, but when R zoom 2 is selected, the image may be displayed in monochrome (any monochrome color scheme is acceptable, but grayscale using black and white is particularly preferable).

[0177] As a brightness adjustment function, the system could use GPS coordinates to correct for the time of sunset (or sunrise) and determine whether it is day or night.

[0178] The brightness of the imaging devices 100 and 200 can be changed by image processing without controlling the camera side, or the brightness can be changed by controlling the camera side. For example, the camera is a camera without an aperture, and the brightness can be changed by adjusting the electronic exposure time. For example, if the exposure time is relatively short, the time that light hits the image sensor is short, and if the time that light hits the image sensor is short, the image will be dark. Conversely, if the exposure time is relatively long, the time that light hits the image sensor is long, and if the time that light hits the image sensor is long, the image will be bright.

[0179] Here, a characteristic unique to dashcams is that in the event of an accident, the image the user viewed from the image acquired by the recording device 100 (or recording device 200) serves as evidence that the user was not at fault. Therefore, it is preferable to record the image after it has been modified by the brightness adjustment function. For this reason, when recording image data using the image recording function, it is preferable to record the original image data that has not been modified by the brightness adjustment function, while not recording the image displayed on the display surface 131. However, it is preferable to record the original image data in association with information that allows the viewer to later analyze how it was displayed on the display surface 131 after the brightness adjustment function was applied. It is preferable not to record the image displayed on the display surface 131 because it would increase the amount of data, but the image displayed on the display surface 131 may be recorded instead of (or in addition to) the above information.

[0180] The brightness adjustment function should preferably be a function that changes the brightness of the backlight (i.e., the overall brightness), but it may also be a function that changes the brightness of the displayed image itself. For example, the brightness adjustment function may include a function that changes the brightness of the displayed image itself based on the reading of the illuminance sensor, and a function that allows the user to set upper and lower limits for the brightness of the displayed image itself. This would allow the displayed image to be made somewhat brighter during the day, and at night, although it is darker than during the day, the displayed image itself would also be made somewhat brighter. Here, the brightness of the backlight and the brightness of the image itself are different things. The brightness of the image itself is its whiteness, and when displaying dark areas, increasing the brightness makes them clearer and easier to see. In contrast, the brightness of the backlight is the brightness of the screen (i.e., the system in which the bits with color are illuminated from behind), so if the screen is bright, various things can be made easier to see, and if the screen is dark, the saturation is low and it appears grayish.

[0181] <Shift function> The shift function changes the range of the image displayed on the display surface 131 when, for example, the brightness of the camera devices 100 and 200 is extremely high (specifically, when the sun is present, or when the headlights of a vehicle behind are directly visible in the image). For example, in a situation where a vehicle behind is not approaching from nearby but from a distance, the headlights of the vehicle behind appear as a point light source in the image of the camera device 200, and if only a part of the image has high brightness, that part will appear dazzling, so the shift function smoothly shifts the display range. The shift function is independent of the brightness adjustment function, which corrects the brightness of the entire image, as it only slightly shifts the image if there is an extremely bright area at the edge of the visible range. For example, if the shift function shifts too much, it will confuse the user, so it is best for the user if it only shifts a few pixels at a time.

[0182] For the shifting function, if you want to block out extremely bright areas by slightly enlarging the image, then it's best to implement a function that slightly enlarges the image. In such cases, since only the display position has shifted slightly, extremely bright areas may reappear in the image. Therefore, it is preferable to maintain the display state after shifting for a certain period of time (for example, 10 minutes). If you immediately return to the state before applying the shifting function, the frequent switching caused by the shifting function may make it difficult to view. Therefore, although it is acceptable to immediately return to the original state after applying the shifting function, it is preferable to maintain it for a while (for example, 10 minutes). You may also implement a display that makes it immediately clear that the display range has been changed by the shifting function (for example, by displaying a red frame with a thick line around the image).

[0183] As a shifting function, for example, if the brightness of the camera 100 becomes significantly high while the image from the camera 100 is being displayed on the display surface 131, the display surface 131 could switch to displaying the image from the camera 200. However, such a shifting function can confuse the user, so it is better to limit the shifting function to simply shifting the display position slightly.

[0184] The shift function may, for example, be a function that switches between display states with different brightness levels while displaying the same image, in response to the operation of the first button 1231.

[0185] Here, a characteristic unique to dashcams is that, in the event of an accident, the image the user viewed from the image acquired by the recording device 100 (or recording device 200) serves as evidence that the user was not at fault. Therefore, it is preferable to record the image after it has been modified by the shifting function. For this reason, when recording image data using the image recording function, it is preferable to record the original image data that has not been modified by the shifting function, while not recording the image displayed on the display surface 131. However, it is preferable to record the original image data in association with information that allows the viewer to later analyze how it was displayed on the display surface 131 due to the shifting function. It is preferable not to record the image displayed on the display surface 131 because it would increase the amount of data, but the image displayed on the display surface 131 may be recorded instead of (or in addition to) the above information.

[0186] <Color change function> The color tone adjustment function displays the original image acquired from the imaging device 100 and imaging device 200 in a display mode that suppresses the presence of unimportant red when such red is present in the original image.

[0187] Here, the important red I'm referring to is the red of a traffic light or the red of a lamp that is flashing red intermittently or continuously. For example, if the user is the one who caused the accident, blue is important for a dashcam, but red, whether it's a traffic light or a flashing red light, is a danger signal, so basically, red is a more important color than blue for a dashcam.

[0188] In contrast, the following are examples of red that are not important: For example, in a case where the camera 200 is mounted near the brake lights, there is a risk that the red light from the brake lights will enter the camera 200 when the user applies the brakes at night. In such a case, the camera 200 takes a wide-angle image of the area behind the vehicle, but as illustrated in Figure 9(A), it has the characteristic that the entire image becomes red due to the user's own brake lights. For example, when backing up, the user may enlarge and crop the lower rear portion of the image to view. If the cropped image position 132 set by the user enlarges the lower part, the brake lights will illuminate the nearby area, and the camera 200 will display a narrow image taken in telephoto mode. As a result, red will be detected more frequently and the image may appear particularly red compared to when the cropped image position 132 is not set to the bottom. Furthermore, in another example where the camera 200 is installed inside the vehicle at the upper edge of the back door glass, there is a risk that the light from the high-mounted stop lamp located at the upper edge of the back door glass may be guided by the back door glass and enter the camera 200. For example, the camera 200 is installed in close proximity to the high-mounted stop lamp (specifically, 3-5 cm below). In such a case, the back door glass guides the light, and the surface fogging or other factors cause it to diffuse, resulting in the upper part (or the entire screen) of the display surface 131 appearing red. If the user-set cropping image position 132 is not at the bottom, red will be detected compared to when it is at the bottom. If the cropping image position 132 is at the bottom and the display surface 131 shows the lower part of the rear of the vehicle, no red will be detected. Thus, when the brakes are applied at night, red may enter the image, potentially causing the display surface 131 to turn red. Depending on the mounting positions of the camera 100 and camera 200, and the position of the vehicle 400's lamps, the image may appear particularly red. The red color in this case is not important to the user because the user knows they are applying the brakes themselves, and it makes the image displayed on the display surface 131 difficult to see, so it is better not to make the display on the display surface 131 red.

[0189] When at least a portion of the display surface 131 becomes red due to unimportant red, this can be resolved, for example, by using a color tone change function to remove the red. Figure 9 shows an example of how an image with suppressed red due to the color tone change function is displayed on the display surface 131 when unimportant red is present in the original image acquired from the imaging device 100 (or imaging device 200). The size of the cropped image position 132 in Figure 9(A) is the same as the size of the original image and the size of the display surface 131. As illustrated in Figure 9(B), in the state shown in Figure 9(A), the display surface 131 displays the entire screen with the unimportant red suppressed.

[0190] One example of a method to implement a color-changing function is to reduce the redness when it is detected that the brake wire (or the wire connected to the brake light) has reached a predetermined voltage (e.g., 12V) (hereinafter referred to as "brake detection"). Specifically, this method improves the image's visibility through signal processing, such as reducing the value of the red parameter in the camera or display surface 131.

[0191] Another way to implement a color adjustment function is to slightly reduce the red in the white balance. In a color adjustment function that relies solely on white balance, the brake wire (or the wire connected to the brake light) is not a necessary component.

[0192] Completely removing red results in a grayscale image (hereinafter referred to as a "black and white image"). Therefore, another way to implement a color-changing function is to control the display by switching from a color image to a black and white image.

[0193] Here, a characteristic unique to dashcams is that when an accident occurs, the red that appears when the user applies the brakes serves as evidence that the user applied the brakes. Therefore, it is preferable to record the original image data without altering the red color. For this reason, when recording image data using the image recording function, it is best to record the original image data that has not been altered by the color adjustment function. The image displayed on the display surface 131 does not need to be recorded, but more preferably, the original image data and information that allows the viewer to later analyze how it was displayed on the display surface 131 using the color adjustment function should be recorded in association with each other. It is preferable not to record the image displayed on the display surface 131 because it increases the amount of data, but the image displayed on the display surface 131 may be recorded in place of (or in addition to) the above information.

[0194] The Image Signal Processor (ISP) adjusts the color of the raw data, which is the signal output from the camera 100 (and camera 200), so that humans can see it as red, yellow, and green. At the same time, it adjusts the brightness. In a dashcam, dark areas are made gray instead of black so that, for example, the presence or absence of lines can be seen. As a result of the above, black becomes gray and looks dirty. Also, shadows are removed, so the sense of depth is lost. Camera 100 stores the data output by the ISP. Raw data is a bitmap consisting of points. Each point contains all the information about what signal, what color, and what percentage it represents. Storing raw data would require an enormous amount of memory. Compression is applied during storage, which eliminates all the aforementioned information, making it impossible to perform the same processing as with an ISP after storage. Therefore, by changing the parameters of the imaging device 100 (and imaging device 200) as a way to implement the color change function, the stored image data will also become the adjusted image data. Therefore, in order to restore the stored image data to its original state, adjustments must be made on the LCD side. When implementing a color change function, it is sufficient to adjust only the screen display on the display surface 131.

[0195] As a method to achieve a different color correction function than the one described above, a filter that cuts the red band, such as an electromagnetic shutter, may be inserted in front of the lens of the camera (or between the lens and the CMOS sensor) as the camera (camera 100 and camera 200). Security cameras generally have the above filter, and it is inserted during the day. For example, in an IR camera (infrared camera), an IR light cut-off filter is inserted during the day because IR light is not needed. This allows sunlight and colors to be captured clearly (i.e., colors that humans can see). At night, IR light is used, so the above filter is removed as it would be in the way.

[0196] There are two methods for applying the color adjustment function to an image: one that applies it to the entire original image regardless of whether it is displayed on the display surface 131 or not, and another that applies it to the display area that is displayed on the display surface 131, but not to areas that are not displayed on the display surface 131. When adjusting the entire original image before displaying it on the display surface 131, the amount of red in the image can be determined by looking at the entire image, allowing for the reduction of areas with excessive red. For example, if the top is white and the bottom is red, adjusting the entire image will eliminate the red you want to remove (red from brake lights) while retaining the red you want to keep. When viewing only the display area on the display surface 131 to see how red is represented, the colors of the displayed objects can be precisely controlled. For example, if the top is white and the bottom is red, adjusting the entire image may not work well, so viewing within the display area is preferable. However, since the entire image cannot be seen when viewing only the display area on the display surface 131, adjustment is relatively difficult.

[0197] Here, the imaging device 100 is equipped with, for example, a GPS, which can accurately determine the time from satellites (note that one GPS unit is sufficient to determine the time, and three or more units (five or six are preferable) are needed to determine the position). For this reason, control may be performed to determine whether or not to remove the red based on the time information. Since the imaging device 100 is equipped with a GPS, it is easier to adjust the amount of red to be removed than by viewing the entire image. Note that the clock from which the imaging device 100 acquires time information is not limited to a GPS; it may also be a clock set manually by the user.

[0198] When a user puts the shift lever into R, they will definitely look behind them, so we want to adjust the color at that time. Since the 400 vehicle is often backed into dark, narrow parking lots, there may be situations where the area around the 400 is darker when backing up than when moving forward. For example, when parking in a small garage like a shed, the surroundings are dark and the brake lights reflect off various surfaces, which may make the red color noticeable. For this reason, it would be good to implement a control that turns off the red color when both the reverse lights and brake lights are on. When moving forward, the brakes are applied, so the red color is not noticeable. For this reason, it is not necessary to implement a control that turns off the red color when moving forward.

[0199] For example, an IR camera (infrared camera) picks up IR light in red. Therefore, when using an IR camera as the shooting device 100 or 200, the original image acquired from the IR camera will be red when the surroundings are completely dark, so the color correction function should convert the original image to grayscale. When using an IR camera as the shooting device 100 or 200, it is desirable to capture images in color as much as possible during the daytime (specifically when the surroundings are bright), so the color correction function should weaken only the red parts of the original image in a white balance manner to make it whiter. This suppresses red to a certain extent even under sunlight. When the color is changed in this way, if the histogram of the RGB components of the pixels of the entire image is taken, only the red will be high. Therefore, when using an IR camera as the shooting device 100 or 200, it is preferable to correct more strongly than when using a normal shooting camera other than an IR camera, but it is preferable not to correct to the point where red is no longer visible as red. This allows important red to be retained while unimportant red to be suppressed. Thus, the degree of correction in the color correction function should preferably differ depending on the camera and the lens. When using an IR camera as the shooting device 100 or shooting device 200, the color change function may be used to convert the original image to grayscale regardless of whether the surroundings are completely dark or not, but more preferably, regardless of whether the surroundings are completely dark or not, the red parts of the original image should be weakened in a white balance manner to make them appear whiter.

[0200] The degree of correction in the color tone change function preferably varies depending on the brightness surrounding the vehicle 400. Specifically, for example, if braking is detected when it is dark around the vehicle 400, it is preferable to reduce the red more strongly than when braking is detected in bright conditions. As for the color tone change function, the camera 100 should have a function to automatically adjust the color tone of the display surface 131, and it is preferable that the user be able to set the upper and lower limits for adjusting the color tone. For example, the adjustment range in the color tone change function should be 0 to 100% by default, and it is preferable that the upper and lower limits can be set in increments of about 10%.

[0201] While it is possible to suppress red by placing a PL (polarizing) filter in front of the camera lens (or between the lens and the CMOS sensor), the color correction function is preferable because it allows for more situation-specific correction.

[0202] <Emphasis function> The highlighting function is a function that indicates to the user that a dangerous object (e.g., a person approaching vehicle 400) has been captured within the shooting range of the camera 100 or camera 200. Preferably, the highlighting function operates from the time the dangerous object is captured within the shooting range of the camera 100 or camera 200 until it is no longer captured. The highlighting function may also be terminated after a predetermined time (e.g., 5 seconds) has elapsed since the start of the function.

[0203] The emphasis function may, for example, display the direction of a dangerous object as an indicator on the display surface 131 when it is captured within the shooting range of the shooting device 100 or shooting device 200. For example, if the sensor unit 17 detects that there is a person approaching the vehicle 400 on the right side of the screen, a red line (not shown) may be displayed flashing on the right side of the screen. As an emphasis function, the screen showing the dangerous object may be cropped and displayed on the display surface 131, but more preferably, the screen display on the display surface 131 remains as is, and the message "dangerous" is simply indicated with an icon such as the red line mentioned above.

[0204] Another example of a highlighting function is to display an icon (not shown) that indicates whether a dangerous object is a person who should be seen in the mirror (a visible position) or a person who is not visible in the mirror. For example, as the above icon, a frame image could be displayed that surrounds the entire edge of the display surface 131 with a square red straight or dashed line, and this frame image could be flashed repeatedly at predetermined time intervals (e.g., every 0.5 seconds) to suggest "Please look in the mirror." When the user sees the above frame image and quickly looks in the mirror, for example, there is a child right behind vehicle 400. However, if there is a person in front of vehicle 400 (i.e., an approaching person from the front of the vehicle), it is preferable not to display the above frame image because the user can already see it. Thus, it is preferable that the highlighting function does not suggest to the user when an approaching person is captured within the range of the shooting device 100 or shooting device 200 that indicates the front of vehicle 400. When a person approaches from the front of the vehicle, the above frame image may not be displayed by flashing it rapidly at predetermined time intervals (e.g., every 0.5 seconds). Instead, the above frame image may be displayed continuously from the time the approaching person comes within a predetermined range in front of the vehicle (e.g., less than 1 meter away) until they move out of the predetermined range from the vehicle 400 (e.g., 1 meter or more).

[0205] As an emphasis function, for example, if a dangerous object (e.g., an object approaching vehicle 400) is within the shooting range of the shooting device 100 and shooting device 200 when the screen display range is enlarged by the zoom function, an icon (not shown) may be displayed on the display surface 131 to indicate that the dangerous object is outside the screen display area. On the other hand, when neither the cropping function nor the zoom function has been used for adjustment, the above icon may be displayed, but it is preferable not to display it. For example, in a case where the housing (and display surface 131) of the camera 100 is shaped like a car's rearview mirror, the shooting range of the camera 100 and camera 200 is wider than that of an actual vehicle 400's rearview mirror, so the user will zoom in more and more to enlarge the image. This can lead to problems such as not being able to capture something outside the screen display, such as a child. The above icon can inform the user in such cases and warn them that it would be safer to widen the range of the image displayed on the display surface 131 (i.e., it would be safer to reduce the image). As an example of the icons mentioned above, to indicate that there is something dangerous outside the adjusted range (specifically, the area that the user cannot see when viewing the image displayed on the display surface 131), for example, a red arrow (hereinafter referred to as "warning display") pointing off-screen may be displayed. Displaying the above icons when adjusting using the cropping function or the zoom function is a groundbreaking invention, and the key point is to display a warning when adjusting the image displayed on the display surface 131. Adjustment should be considered as when the move icon, zoom icon, or zoom icon mentioned above is displayed. It is preferable not to display a warning when no adjustment is being made, but it is also acceptable to display a warning even when no adjustment is being made.

[0206] Another example of the emphasis function is that the camera 100 may have an image recognition function for dangerous objects (such as people) and change the range displayed on the display surface 131 to the location of the dangerous object. For example, when the camera 100 or 200 detects a person (specifically, when an event occurs in which a person is in front of the vehicle 400, or when an event occurs in which a person is behind the vehicle 400), the emphasis function may be used to zoom in on the person. Also, for example, if there is an impact on one side of the vehicle 400, the emphasis function may be used to display the entire image on the side where the impact occurred on the display surface 131. Alternatively, after detecting a person, the emphasis function may be used to prioritize the display of the area in front of the person using Picture in Picture (PinP).

[0207] It is preferable that the imaging device 100 performs image processing on the device itself to change the position, magnification, reduction ratio, brightness, and color of the cropped image. However, the position, magnification, reduction ratio, brightness, and color of the cropped image may also be changed using an external device (such as a smartphone) connected to the imaging device 100.

[0208] Furthermore, a characteristic unique to dashcams is that, in the event of an accident, the images the user viewed from the recording device 100 (or recording device 200) serve as evidence that the user was not at fault. Therefore, regardless of any changes made to the original image data, it is preferable to record the modified image. For this reason, when recording image data using the image recording function, it is acceptable to record the original image data that has not been modified, while not recording the image displayed on the display surface 131. However, it is preferable to record the original image data in association with information that allows for later analysis using a viewer to see how it was displayed on the display surface 131. It is preferable not to record the image displayed on the display surface 131 because it would increase the data size, but the image displayed on the display surface 131 may be recorded in place of (or in addition to) the above information. It is preferable to do as described above in all the following documents.

[0209] [Screen switching function of the shooting device 100] Figure 10 is an explanatory diagram illustrating how the image on the display surface 131 switches. As illustrated in Figure 10(A), the control unit 11 of the imaging device 100 displays the image in Display mode 1 in its initial state. In Display mode 1, the image acquired from the imaging device 100 is displayed on the left half of the display surface 131, and the image acquired from the imaging device 200 is displayed on the right half of the display surface 131 (hereinafter, the display mode of Display mode 1 is referred to as "F+R").

[0210] F+R, which displays the screen in a split 2-way format, allows for adjustment of brightness and color tone, but not of zoom level; however, it would be preferable to allow zoom level adjustment as well. F+R displays images from both the front and rear cameras to fill the entire screen of the display surface 131 (specifically, for example, displaying the entire field of view without cropping). In F+R, the front camera is displayed on the left half of the display surface 131, and the rear camera is displayed on the right half of the display surface 131. It is preferable that when the screen is split in two, F+R is sized to display exactly the entire area of ​​the original image.

[0211] Furthermore, because the aspect ratio of the images acquired from the camera devices 100 and 200 differs from the aspect ratio of the display surface 131, if the image is displayed without cropping to the maximum extent, blank areas where the image is not displayed (hereinafter also referred to as "black bars") may appear on the display surface 131. Thus, F+R is designed to display the entire original image, although black bars will appear. It is possible to enlarge the original image and crop a portion of it to avoid black bars in F+R. However, while F+R is displayed to adjust the camera angle of the entire screen when the camera devices 100 and 200 are installed, it is unlikely that the vehicle will continue to drive with the display on. For this reason, it is preferable for F+R to display the entire screen without cropping.

[0212] In F+R, the front camera may be displayed on the right half of the display surface 131 and the rear camera on the left half of the display surface 131, or the front camera may be displayed on the upper half (or lower half) of the display surface 131 and the rear camera on the lower half of the display surface 131 (or the upper half if the front camera is displayed on the lower half).

[0213] If any image processing is performed in Display mode 1 and the display mode of the image is changed, the control unit 11 will display the image in the last modified display mode in Display mode 1 when displaying the image again in Display mode 1 later.

[0214] As illustrated in Figure 10(B), the control unit 11 switches to Display mode 2 when the first button 1231 (hereinafter also referred to as the "DISP button") is pressed and held (or briefly pressed) while displaying an image in Display mode 1. The DISP button is a one-touch button for switching between images, and it can switch not only between images from different cameras, but also between images from the same camera that display different areas.

[0215] In Display mode 2, images acquired from the imaging device 100 are displayed across the entire display surface 131, while images acquired from the imaging device 200 are hidden (hereinafter, the display mode in Display mode 2 is referred to as "F zoom").

[0216] Display mode 2 allows the image to be adjusted by changing the cropped image position, magnification, reduction ratio, brightness, and color tone. If any image processing is performed in Display mode 2 and the display mode of the image is changed, the control unit 11 will display the image in the last modified display mode in Display mode 2 when the image is displayed again in Display mode 2 later.

[0217] As illustrated in Figure 10(C), the control unit 11 switches to Display mode 3 when the first button 1231 is pressed and held (or briefly pressed) while an image is being displayed in Display mode 2. In Display mode 3, the image acquired from the imaging device 200 is displayed across the entire display surface 131, while the image acquired from the imaging device 100 is hidden (hereinafter, the display mode in Display mode 3 is referred to as "R zoom 1").

[0218] Display mode 3 allows for image adjustment by changing the cropped image position, magnification, reduction ratio, brightness, and color tone. When image processing is performed in Display mode 3 and the display mode of the image is changed, the control unit 11 will display the image in the last modified display mode in Display mode 3 when the image is displayed again in Display mode 3 later. For example, Display mode 3 may be used for the rear view displayed when the vehicle is moving forward. In Display mode 3, the cropped image position, magnification, reduction ratio, brightness, and color tone can be changed, and if the power of the shooting device 100 is turned off in Display mode 3 after the change, the Display mode 3 can be set to the last modified state, such as the cropped image position, when the shooting device 100 is started up again, provided that the screen display switching signal has not been received. The screen display switching signal is a signal used to switch the display mode of the display surface 131. Specific examples of the screen display switching signal will be described later.

[0219] As illustrated in Figure 10(D), the control unit 11 switches to Display mode 4 when the first button 1231 is pressed and held (or briefly pressed) while an image is being displayed in Display mode 3. In Display mode 4, the image acquired from the imaging device 200 is displayed across the entire display surface 131, while the image acquired from the imaging device 100 is hidden (hereinafter, the display mode of Display mode 4 is referred to as "R zoom 2"). R zoom 2 allows for adjustment of the image by changing the cropped image position, magnification, reduction ratio, brightness, and color tone, but in this embodiment, R zoom 2 initially has the same display mode as R zoom 1. Initially, R zoom 2 may have a different display mode than R zoom 1.

[0220] Regardless of whether or not a screen display switching signal is received, if any image processing is performed in Display mode 4 and the display mode of the image is changed, the control unit 11 will display the image in the last modified display mode in Display mode 4 when displaying the image again in Display mode 4 later.

[0221] As illustrated in Figure 10(E), the control unit 11 switches to Display mode 5 when the first button 1231 is pressed and held (or briefly pressed) while displaying an image in Display mode 4. In Display mode 5, the power to the display surface 131 is off, and the image is not displayed. Hereinafter, Display mode 5 will be referred to as the "off state". In the example in Figure 10, when the first button 1231 is pressed and held (or briefly pressed) while in Display mode 5, the power to the display surface 131 is turned on, and the control unit 11 switches to Display mode 1.

[0222] As illustrated in Figure 10, the control unit 11 switches to Display mode 4 when it receives a screen display switching signal while displaying an image in Display mode 1 to 3.

[0223] It is preferable that the control unit 11 remains in the off state when the power to the display surface 131 is off and a screen display switching signal is received, and does not turn on the power to the display surface 131 or switch to Display mode 4. However, the control unit 11 may turn on the power to the display surface 131 and display an image in Display mode 4 when the power to the display surface 131 is off and a screen display switching signal is received.

[0224] The control unit 11 transitions to Display mode 4 when it receives a screen display switching signal, and when it is displaying an image in Display mode 4 and the screen display switching signal is no longer received, it transitions back to the mode it was in immediately before receiving the screen display switching signal. For example, when it is displaying an image in Display mode 3 and the screen display switching signal is received, it transitions to Display mode 4, and when it is displaying an image in Display mode 4 and the screen display switching signal is no longer received, it transitions back to Display mode 3.

[0225] Thus, the imaging device 100 includes a control unit 11 that displays images acquired from the imaging device of System 1 on a display surface 131 inside the vehicle, and the control unit can display images in Display modes 1 to 4. The control unit then displays an image in Display mode 4 in response to receiving a screen display switching signal while displaying an image in Display modes 1 to 3. The theme of System 1 is that it is easy to see and easy to use. System 1 can change the cropped image position, magnification, reduction ratio, brightness, and color tone of images acquired from the imaging device of System 1, and displays the image in the display mode of the last modified state in response to receiving a screen display switching signal. System 1 separately stores the cropped image position, magnification, reduction ratio, brightness, and color tone of the last modified state for each display image state: Display mode 3 (e.g., rear view when moving forward), Display mode 4 (e.g., rear view when reversing), and Display modes 1 and 2 (e.g., other images). Then, it displays using the cropped image position, magnification, reduction ratio, brightness, and color tone of the last modified state stored for each mode.

[0226] Furthermore, when the control unit 11 receives a screen display switching signal while displaying an image in Display mode 4, it continues to display the image in Display mode 4. In this case, when the screen display switching signal is not received while displaying an image in Display mode 4, it continues to display the image in Display mode 4.

[0227] The control unit 11 stores the display mode if the cropped image position, magnification, reduction ratio, brightness, and hue are changed when the screen display switching signal is not detected. After that, the power of the camera 100 is turned off, and when the camera 100 is started up again and the screen display switching signal is not detected, the image is automatically displayed in the display mode that was in place when the camera 100 was turned off, with the cropped image position and other settings of the last modified state. Therefore, if the user operates the field of view screen when the screen display switching signal is not detected, the control unit 11 stores that field of view screen, and when the camera 100 is turned off and then started up again without a screen display switching signal, it automatically returns to the field of view screen described above.

[0228] The display modes that the control unit 11 switches between are not limited to Display modes 1 to 5. For example, there may be multiple display modes (e.g., two) that display the image acquired from the camera 100 across the entire display surface 131, to meet the user's request to display a specific area. For example, a user could set the display mode to show the upper part of the image acquired from the camera 100 and another to show the lower part, which could be useful in situations such as car security.

[0229] The destination when the screen display switching signal is received is not limited to Display mode 4. The control unit 11 may switch to any of the Display modes 1 to 4 that the user has pre-set, depending on when the screen display switching signal is received. That is, System 1 has a function to switch to an image other than the rear view of the vehicle 400 in response to the reception of the screen display switching signal, and the cropped image position, magnification, reduction ratio, brightness, and color tone of that image can also be changed, and when switching to the above image again, it is preferable to display the image with the cropped image position, magnification, reduction ratio, brightness, and color tone of the last modified state. In addition, the control unit 11 may switch to an off state depending on when the screen display switching signal is received.

[0230] The control unit 11 may change the degree of color correction for R zoom 1 and R zoom 2 (for example, it may be changed automatically or by user setting). For example, the user can switch between taking a picture directly behind (e.g., R zoom 1) and taking a picture directly behind and below (e.g., R zoom 2). Depending on the camera mounting position and the position of the car's lights, it is preferable to take a downward image when backing up the vehicle 400, so the image will be particularly red. For this reason, the control unit 11 may change the degree of correction so that red is suppressed more in R zoom 2 than in R zoom 1. Also, for example, the control unit 11 may change the degree of color correction for each of the Display modes 1 to 4. Specifically, for example, the control unit 11 may change the degree of correction so that red is suppressed more in Display modes 3 and 4 than in Display modes 1 and 2.

[0231] The control unit 11 has a function to display multiple images on one screen. The display mode for displaying multiple images on one screen may include a display mode that displays images from different cameras, such as F+R, or a display mode that displays images from different ranges of one camera, or a combination of these. The control unit 11 may have a function to maintain and reproduce the state of the above combination for each display mode.

[0232] The control unit 11 may be provided with a function of displaying a plurality of videos on one screen by PinP (Picture in Picture) in any display mode. For example, the control unit 11 may be provided with a function of PinP-displaying a downward video portion preset by the user in a wide-angle video. The system 1 is provided with a function that allows the user to individually select the cutout image position 132 of the video to be PinP-displayed and the cutout image position 132 of the wide-angle video, and it is preferable to display them in the final selection state at the next time (for example, when the imaging device 100 is activated or when the display mode is redisplayed).

[0233] For example, since people and luggage in the rear seat do not move much, it is sufficient to know even a slight state of the rear seat. Therefore, for example, the screen of the rear seat may be displayed small in PinP. Such a configuration is particularly preferable in a taxi. Specifically, in a taxi, the rear seat is viewed through a mirror, so a digital mirror that does not show the rear seat cannot basically be used. However, in the case of a digital mirror adopting the system 1, the rear seat is reflected on the display surface 131, which helps to deter crime.

[0234] [Regarding the screen display switching signal] The imaging device 100 is a device that changes the display mode on the display surface 131 depending on whether there is a screen display switching signal and what kind of signal the screen display switching signal is. Here, the signals include a signal from the vehicle 400 and a signal from a device other than the vehicle 400 (for example, a sensor provided in the system 1, an external sensor connected to the system 1, a security device for preventing vehicle theft attached to the vehicle 400, a smartphone, etc.). As the screen display switching signal, it is more preferable to use a signal from the vehicle 400, but it may also be a signal from a device other than the vehicle 400. The screen display switching signal may be, for example, simply a signal that changes from no signal to having a signal, a signal that changes from no connection to being connected to a predetermined voltage (for example, 12V or 24V) or ground, or the reverse of these.

[0235] In the following explanation, the line that transmits the screen display switching signal will be referred to as the "switching line." There can be any number of switching lines, from one to three. The rear wire is one example of a switching line, but it is preferable to use a general-purpose line rather than just the rear wire.

[0236] <Screen display switching signal from vehicle 400> For example, the signals shown below could be used as screen display switching signals from vehicle 400.

[0237] As a screen display switching signal, for example, in an example where the vehicle 400 (or a device other than the vehicle 400) is equipped with a switching element that transitions from an off state to an on state when current reaches the gate, the signal should be no signal when the gate is off, and a signal should be present when current reaches the gate and it turns on. In this example, the imaging device 100 is equipped with a switching element in the vehicle 400 (or a device other than the vehicle 400) that transitions from an off state to an on state when current reaches the gate, and receives a signal when current reaches the gate and it turns on, thereby changing the display mode on the display surface 131.

[0238] As a screen display switching signal, for example, a rear wire signal is preferable, which is silent when the vehicle 400's lamps (e.g., turn signals or taillights) are off, and becomes active when the lamps are illuminated. The rear wire signal is preferably taken from the brake light wire, but it can also be taken from the brake pedal input or from information flowing on the in-vehicle network (e.g., brake signal). For example, when the taillights of vehicle 400 are turned on, the camera 100 receives a rear line signal and changes the display mode on the display surface 131 to R zoom 2. Here, when backing vehicle 400 into a parking space while turning, it is possible to miss a child suddenly running into the blind spot on the front left or right. As another example, the camera 100 may receive a rear line signal when the taillights of vehicle 400 are turned on and the camera is in the ON state, and change the display mode on the display surface 131 to F+R. As another example, the camera 100 may set the display mode to show an upward-facing image when it receives a rear line signal when the taillights of the vehicle 400 are lit and the camera is turned on, and then look upwards. Alternatively, it may be changed to F+R. If the cropped image position, magnification, reduction ratio, brightness, or hue of R zoom 2 is changed while a rear wire signal is detected, the control unit 11 stores that display mode. Then, the next time a rear wire signal is detected (or when the display mode is switched by operating the first button 1231), R zoom 2 automatically reverts to the display mode of the last modified state.

[0239] Incidentally, electric vehicles or hybrid vehicles sometimes have an autopilot system that automatically applies the brakes to charge the battery when the accelerator is released, even if the brake pedal is not pressed. For this reason, it may be preferable to take the rear brake signal from the brake lights or a brake signal running inside the vehicle, rather than from the brake pedal itself. However, brake signals are sometimes encrypted and not publicly disclosed. In contrast, brake light wires are used to illuminate the lights to signal to the outside, regardless of whether the vehicle has autopilot or not. Therefore, it is preferable to take the rear signal from the brake light wire.

[0240] Here, if the signal that illuminates the brake lights when the emergency stop signal (specifically, a function that automatically flashes the brake lights (specifically, brake lamps or stop lamps) to warn following vehicles of sudden braking in order to reduce the possibility of being rear-ended when the brakes are applied suddenly) is activated is used as the screen display switching signal, it may result in an incorrect display. Therefore, it is preferable to use the signal that illuminates the brake lights when the emergency stop signal is not activated as the screen display switching signal, while not using the signal that illuminates the brake lights when the emergency stop signal is activated as the screen display switching signal.

[0241] In turn signals where the illuminated parts are sequential, it is preferable to switch the display mode on the display surface 131 in accordance with a signal that illuminates a specific lamp (for example, the lamp that lights up first), and it is even more preferable to switch the display mode on the display surface 131 in accordance with a "signal that causes multiple lamps to light up in a sequential manner."

[0242] There may be several brake lights, and some brake lights may not illuminate under certain conditions. In such a configuration, it is preferable for the user to select a brake light from among the multiple brake lights and take the rear wire signal from the selected brake light's wire as the screen display switching signal.

[0243] As a screen display switching signal, for example in the case of an automobile, it is preferable to have a signal that is silent when the user has the shift lever in a position other than R, and becomes active when the user puts the shift lever in R. As an example, the camera 100 receives a signal when the user puts the shift lever in R and changes the display mode on the display surface 131 to R zoom 2.

[0244] As a screen display switching signal, for example in the case of an automobile, it is preferable to have a signal that is silent when the user has the shift lever in a position other than P, and becomes active when the user puts the shift lever in P. As an example, the camera 100 may receive a signal when the user puts the shift lever in P and simultaneously display images from two cameras on the display surface 131 (specifically, it may change the display mode to F+R), or it may change the display mode to R zoom 2.

[0245] As a screen display switching signal, for example, it is preferable to have a signal that is silent when the doors of vehicle 400 are closed and becomes active when the doors are opened. For example, the camera 100 may receive a signal when the doors are opened and change the display mode on the display surface 131 to R zoom 2. This allows, for example, the driver to look at the display surface 131 to check for safety behind the vehicle before exiting vehicle 400. Another example is that the camera 100 may receive a signal when the doors are opened (for example, when the doors are ajar) and change the display mode on the display surface 131 to F zoom. This makes it easier for, for example, the driver to look at the display surface 131 and confirm that the doors are open.

[0246] As a screen display switching signal, for example, in an example where a sensor (e.g., an acceleration sensor) is provided to detect an impact when the vehicle 400 is subjected to some kind of impact, the signal should be no signal when the sensor does not detect an impact, and a signal should be provided when the sensor detects an impact. As an example, the camera 100 receives a signal when it detects an impact and changes the display mode on the display surface 131 to R zoom 2. This allows the camera 100 to display or record an image of the rear of the vehicle on the display surface 131 when the vehicle 400 is subjected to an impact.

[0247] For example, in the case of a car equipped with an accident recording device that records the operation status of the car's accelerator and brakes in response to the ECU controlling the airbags detecting a sudden change in speed, the screen display switching signal should be a signal that is no signal when the ECU does not detect a sudden change in speed, and becomes a signal when the ECU detects a sudden change in speed. As an example, the camera 100 receives a signal in response to the ECU detecting a sudden change in speed and changes the display mode on the display surface 131 to R zoom 2. This allows the camera 100 to display or record an image of the rear of the vehicle on the display surface 131 when, for example, vehicle 400 is involved in an accident.

[0248] For example, in a vehicle 400 equipped with a brake-by-wire (BBW) that converts the amount the driver presses the brake into an electrical signal and transmits it via the brake line to an ECU that controls the vehicle 400, the screen display switching signal should be a signal that becomes active when the brake line reaches a predetermined voltage (e.g., 12V). BBW is a technology that eliminates the mechanical connection previously operated by the driver using hydraulics and links, by replacing the driver's operation with electrical signals, and controls the brakes using a computer. For example, the camera 100 receives a signal when the brake line reaches a predetermined voltage (e.g., 12V or 24V) and changes the display mode on the display surface 131 to R zoom 2. This allows the camera 100 to display or record an image of the rear of the vehicle on the display surface 131 when the brakes are applied. In particular, if the brakes used to obtain braking force in a BBW are disc brakes, the brake command is transmitted as an electrical signal from the ECU to the hydraulic pressure generator connected to the disc brake via a wire (electrical wire, optical cable, etc.). This wire can be used as the brake line. In particular, in the case of a BBW where the method of transmitting the operation of the brake pedal to the brake is an air brake (specifically, the method of transmitting the force of the brake pedal to the brake by high-pressure air), the amount of depression of the brake pedal is transmitted as an electrical signal from the stroke sensor (or pressure sensor) to the ECU via a wire. This wire may be used as a brake wire.

[0249] The screen display switching signal may be a signal related to the state of the vehicle 400 based on information flowing through an in-vehicle LAN such as CAN or a K-line output from the ECU.

[0250] Thus, the screen display switching signal from the vehicle 400 is preferably a signal that occurs, for example, in a rear wire signal, when the parking light is on, when the door of the vehicle 400 is opened, when the car security is on, when there is an event (accident), etc. Note that a signal that becomes a signal in response to the blinker being on may also be used as the screen display switching signal, or a signal that becomes a signal in response to a switch provided in the vehicle 400 being turned on (or off) may also be used as the screen display switching signal.

[0251] <Screen display switching signal from devices other than the vehicle 400> For example, as signals from devices other than the vehicle 400, the signals exemplified below can be considered for use as the screen display switching signal.

[0252] For example, in an example where the car security that alarms when the vehicle 400 is stolen is activated by locking the door of the vehicle 400 when the ACC power supply of the vehicle 400 is off and the engine is stopped, the screen display switching signal may be a signal that is no signal when the car security is not alarming and becomes a signal in response to the alarm being issued. The ACC power supply is the power supply that enters the devices wired to the vehicle 400 when the key of the vehicle 400 is turned one step, or when the push start button is pressed once without stepping on the brake pedal. The engine of the vehicle 400 does not operate just by turning on the ACC power supply. Here, car security is a theft prevention measure for the vehicle 400. The car security system will emit a loud noise or send a notification to the user's remote control if it detects an impact (for example, being shaken from the outside, having a window broken, being lifted with a jack, or having a sudden force applied). Some vehicle 400s come with car security pre-installed, while others are retrofitted devices purchased separately by the user. For example, it would be good if the car security system could be activated by the remote control, or if it could be activated when the car engine is turned off, the doors are closed and locked.

[0253] Furthermore, parking surveillance and car security systems differ in the following ways, for example. Specifically, parking surveillance continuously monitors the vehicle, while car security systems only detect when something happens and issue an alarm. Also, parking surveillance systems record video footage, while car security systems notify the user. Event recording may also be performed in conjunction with car security systems. Additionally, parking surveillance is a function built into the camera unit 100, while car security systems require a separate device (specifically, equipment for car security) from which they receive a signal (hereinafter also referred to as the "security signal").

[0254] As an example of using a security signal as a screen display switching signal, the camera 100 may display only the area around the vehicle 400 for a predetermined time (for example, within 1 hour (or 8 hours) until the engine of the vehicle 400 is started) from the time the security signal is received. For example, upon receiving the security signal, the camera 100 changes the display mode on the display surface 131 to R zoom 2. This allows the camera 100 to display or record an image of the area behind the vehicle on the display surface 131 when the vehicle 400 is impacted. As another example, upon receiving the security signal, the camera 100 may change the display mode on the display surface 131 to F zoom. This allows the camera 100 to display the interior of the vehicle 400 on the display surface 131, thus acting as a deterrent against car break-ins.

[0255] The screen display switching signal should be based on the vital signs of the driver or passenger (for example, information indicating at least one of pulse, respiration, blood pressure, or body temperature). For example, the camera 100 receives a signal when the passenger's blood pressure becomes dangerously high and changes the display mode on the display surface 131 to F+R (or F zoom). This allows the user to see the passenger's condition.

[0256] As described above, System 1 can switch screens when it receives a screen display switching signal. Therefore, System 1 can switch to a specific part of the camera when the vehicle 400 is in a specific position at the time of the switching line, so the effect of the shooting device 100 changes depending on the type of screen display switching signal.

[0257] An external switch unrelated to the vehicle (for example, a manual switch, a wireless switch, etc.) may be placed inside the vehicle as part of the camera 100 (or as a separate device from the camera 100), and the signal from this switch may be used as a screen display switching signal.

[0258] While the screen display switching signal may be a single signal, it is preferable for System 1 to have multiple (e.g., two) screen display switching signals. For example, in an example where multiple screen display switching signals are provided, if the image is displayed in a display mode corresponding to the type of screen display switching signal, the user can view the image in a display mode corresponding to the type of screen display switching signal when they receive it.

[0259] The screen display switching signal may be a signal containing some kind of information, such as one composed of packets.

[0260] The number of cameras in System 1 can be one or three, and System 1 may also have a third imaging device, an imaging device 300 (not shown). The imaging device 300 may be, for example, a camera that captures the rear seats inside the vehicle, or a camera positioned on the side of the vehicle 400. The imaging device 300 may be, for example, mounted at predetermined positions on the left and right sides outside the vehicle 400, and capture images with the side of the vehicle as the shooting direction. The imaging device 300 has the function of capturing images and the function of outputting image data showing the captured images to the imaging device 100. The imaging device 300 is connected to the imaging device 100 by a wired or wireless communication path, similar to the imaging device 200. When System 1 receives a screen display switching signal, it may switch to a display mode that displays the image acquired from the imaging device 300 in accordance with that signal.

[0261] The imaging devices 100 and 200 may be imaging devices that capture celestial images such as a full sphere or a hemisphere, or they may be two cameras that capture the entire area around the vehicle 400, one camera that captures the front and another camera that captures the rear and the interior of the vehicle.

[0262] As a switching wire, one possible method is to use an electrical tap to branch off from, for example, the brake wire, the wire connected to the reverse light, or the parking light wire (or cut the wire, strip the insulation, and attach a crimp terminal to branch it off) and to prepare something like a relay (not shown) to receive the signal in several stages as an analog value (so-called voltage value). The switching wire can also be connected to another terminal that receives a voltage similar to 12V or 24V.

[0263] The system 1 may have a single switching line, but it is more preferable for the system 1 to have multiple (e.g., two types) switching lines. The system 1 may also have a function to indicate whether the first switching line (e.g., brake line), the second switching line (e.g., line connected to the reverse lamp), and the third switching line (e.g., parking line) are in the ON state or not. In particular, in a configuration with only one switching line, it is not necessary to have a function to indicate whether the switching line is ON or not, but even in a configuration with only one switching line, the above function may be provided and characters indicating the ON state may be displayed on the display surface 131.

[0264] [Regarding the shape of the imaging device 100] The housing of the imaging device 100 is not limited to a box shape; it can take any shape, for example, like a car's rearview mirror (see Figures 16 and 17). In the example where the housing (and display surface 131) of the imaging device 100 is like a car's rearview mirror, the imaging device 100 may be an add-on device attached to the rearview mirror of the vehicle 400, or the imaging device 100 may be a rearview mirror pre-installed in the vehicle 400. In the example where the housing (and display surface 131) of the imaging device 100 is like a car's rearview mirror, the display unit 13 may be a mirror LCD, and more preferably a half-mirror. For example, the mirror LCD may consist of a liquid crystal, a reflective polarizing plate, and a polarizing plate arranged in that order from the front, and the mirror state and the transmittance state may be switched by controlling the liquid crystal. If it is to be used as a normal rearview mirror while driving, the display surface 131 may be turned off to display the part that would be reflected by a normal mirror.

[0265] In the example where the housing (and display surface 131) of the imaging device 100 is the type of a car's rearview mirror, the camera in the imaging device 100 is preferably located at one end of the display surface 131. Specifically, when the display surface 131 is fixed so as to overlap with the car's rearview mirror, the camera should be positioned so as to protrude from the rearview mirror. More preferably, the camera is located at the left end of the display surface 131, but it may also be located at the right end. The camera being at the left end of the display surface 131 is less of an obstruction to the driver than being at the right end. The camera of the imaging device 100 may also be separated from the imaging device 100 (see Figures 16 to 18). In such a configuration, there is a wire connecting the imaging device 100 to the camera, and the front camera can be placed anywhere freely. In the example of a car rearview mirror-type camera device 100 (and display surface 131), it is also preferable to include a rear camera (specifically, a camera device 200). In such a configuration, there is a cable 300 connecting the camera device 100 to the rear camera.

[0266] In the case where the housing (and display surface 131) of the camera 100 is the type of a car's rearview mirror, the user may want to see it as a normal mirror under normal circumstances, and only want to see the moving object (or the direction the vehicle 400 is moving) when the vehicle 400 is backing up. According to System 1, it can be used as a normal rearview mirror while driving, and when the vehicle 400's shift lever is in R and it is used as a rearview mirror, the user can display their preferred position (for example, the area directly behind and below the vehicle 400) when the switch line is connected to, for example, the reverse line.

[0267] Here, for example, if the image from the camera 200 is projected directly onto the display surface 131, the image from the camera 200 is quite wide-angle, so it will project a much wider area than what is actually reflected in the rearview mirror. Therefore, in order to display the area that is actually reflected in the rearview mirror, a portion of the image from the camera 200 (specifically, the area that is visible through reflection) must be cropped and displayed on the display surface 131.

[0268] In the example where the housing (and display surface 131) of the camera 100 is the type of a car's rearview mirror, the display unit 13 is, for example, a half-mirror, and since it is a regular mirror, it is made of glass and reflects light (hereinafter referred to as the "reflected image"). The reflected image is an image that changes depending on the adjustment, and the appearance of the reflected image changes depending on the area of ​​the mirror and whether it is a flat mirror or a curved mirror. Furthermore, since the display surface 131 is semi-transparent, it also displays the images from the camera 100 and camera 200 (hereinafter referred to as the "displayed image"). The reflected image and the displayed image are slightly misaligned and appear doubled. This misalignment between the reflected image and the displayed image causes a problem in that it is difficult to see. The degree to which the reflected image and the displayed image are misaligned is related to the camera's installation position, field of view, and the range of adjustment for zooming in and out.

[0269] To avoid the misalignment between the reflected image and the displayed image, one possible solution is to allow the user to manually adjust the angle of the display surface 131 to reflect the ceiling (for example, by pulling a lever (not shown) located at the bottom of the camera 100 towards the user to change the angle of the display surface 131 to reflect the ceiling). This would turn on the power to the display surface 131, resulting in a clear image. Then, by tilting the display surface 131 downwards (or by pushing the lever inwards), the power to the display surface 131 would be turned off, allowing it to be used as a rearview mirror.

[0270] However, simply orienting the display surface 131 towards the ceiling may result in a double image of the reflected image and the displayed image. For example, if an expensive material such as a prism is not added to the mirror of the display unit 13 to adjust the reflectivity, the image displayed on the display surface 131 may be difficult to see.

[0271] Therefore, it is conceivable to attach the camera 100 to the rearview mirror so that its angle can be changed, and then attach a privacy screen to the display unit 13 from above. In the example where the display unit is behind the mirror, the privacy screen must be placed between the mirror and the display unit. The privacy screen has fine slits that allow it to be seen when viewed directly, but prevent light from being seen when viewed from the left or right (specifically, at the angle where the rear reflects). With the privacy screen, it is visible directly in front, but not when viewed at an angle. When the camera 100 is pointed towards the user, the screen is within the viewing angle range of the privacy screen, but it is best to set the viewing angle of the privacy screen so that it is not within the viewing angle range when the camera 100 is angled to be seen behind.

[0272] Regarding the discrepancy between the reflected image and the displayed image, there is a challenge in shrinking the displayed image to match the reflected image (i.e., the real image). Here, a person's height changes by several centimeters between when they wake up and after they have been active. With a rearview mirror, the view changes depending on one's height, so the same view cannot be seen in the morning and evening unless the position of the rearview mirror or the driver's seat is changed. In contrast, with the shooting device 100, the image from the camera does not change, so the same image can be seen regardless of height. For example, if a user were to manually adjust the reflected image and the displayed image, in the morning their height is increased, and the displayed image and the reflected image would be adjusted in this increased state. Then, in the evening their height has decreased, so the reflected image is shifted upwards, and it is necessary to adjust the displayed image to the reflected image again, which is troublesome.

[0273] Therefore, if the control unit 11 does not detect a screen display switching signal, it is advisable to further change the field of view screen during the startup time of the shooting device 100. Even if the camera's installation position, field of view, and range of adjustment for zooming in and out are set so that the reflected image and the displayed image can be aligned, the above problem still exists, so it can be solved by adjusting the displayed image according to the time. For example, assuming that the displayed image is aligned with the reflected image by adjusting the position of the displayed image or zooming in (or out), it is advisable to slightly shift the display position of the image displayed on the display surface 131 between morning and evening.

[0274] Furthermore, if a screen display switching signal is detected (specifically, if it is displayed in R zoom 2), the display position should be fixed regardless of the startup time of the shooting device 100. On the other hand, if a screen display switching signal is not detected (for example, if it is displayed in R zoom 1 or if the vehicle is in the forward position), the display position of the displayed image should be changed according to the startup time.

[0275] The camera 100 is powered on when the ACC power of the vehicle 400 is turned on, and switches to parking surveillance mode and then powers off when the ACC power of the vehicle 400 is turned off. Therefore, the display position of the displayed image is changed according to the time when the camera 100 is powered on. In the case of long-term driving, the display position of the displayed image may be changed in steps according to the time.

[0276] The control unit 11 may determine the display position of the display image based on the position of the driver's eyes, identified by the in-camera and the DMS (Driver Monitoring System) that monitors the driver, and the position of the camera 100. By detecting the driver's eye level in this way, the reflected image and the displayed image can be aligned regardless of who is driving.

[0277] For example, there could be a function to identify the driver (for instance, in a car-sharing system where multiple people drive the same car, a function where biometric information stored online is linked to an ID card), and the settings of the camera 100 could be automatically configured according to the above identification. With automatic settings, it would be good to allow users to individually recall settings such as how the screen switches and which position to display. If settings can be configured automatically in this way, the reflected image and the displayed image can be matched for any vehicle 400.

[0278] The driver identification function may be one in which the driver can be identified by holding an NFC (Near Field Communication) equipped driver's license over the camera 100, and the settings of the camera 100 may be automatically configured according to the above identification. Alternatively, the driver identification function may be one in which the driver can be identified by holding a business-use NFC equipped ID card over the camera 100, and the settings of the camera 100 may be automatically configured according to the above identification.

[0279] The function to change the display position of the displayed image may have three (or four) pre-set display positions depending on the driver's seat position. Preset 1 may be the first display position with this setting, Preset 2 may be the second display position with this setting, and so on, with the settings being uniquely determined.

[0280] Basically, since the vehicle 400 stores seat position information, it is best to obtain a signal from the vehicle 400's ECU (or vehicle network) to identify the state of the driver's seat and switch to a setting that matches that state. As for the function to identify the position of the driver's seat, if the seat is visible in the camera's view, or if the infotainment display showing the seat status is visible in the camera's view, the seat status can be identified using that image.

[0281] Here, the vehicle 400 may be equipped with other mirrors (e.g., side mirrors). For example, in a vehicle 400 equipped with external side mirrors, the imaging device 100 is not attached to the side mirrors but to the rearview mirror. That is, the imaging device 100 is a mirror (and a luminous object inside the vehicle) located inside the vehicle 400. For example, during the daytime, the inside of the vehicle 400 is dark and the outside is bright, so there is a difference in brightness, and therefore it is preferable to process the images acquired from the imaging device 100 and the imaging device 200.

[0282] The camera 200 may be attached to the side mirror (or the side of the vehicle 400), and the image from the side mirror may be displayed inside the vehicle 400 on the display surface 131 of the camera 100.

[0283] There are two methods for fixing the rearview mirror-type camera device 100 to the vehicle 400: one is to fix it to the rearview mirror pre-installed on the vehicle 400 with a band; the other is to clamp the rearview mirror of the vehicle 400 from above and below using mounting members that attach the camera device 100 to the vehicle 400.

[0284] [Regarding operating instructions] If R zoom 1 and R zoom 2 are displaying the same area (i.e., cropped image position 132), the user will not know which display mode is being used. Therefore, the control unit 11 may display an operation instruction (for example, an arrow indicating that the screen can be switched or the word "adjustable") only if the display has not been changed from R zoom 1 to R zoom 2.

[0285] The control unit 11 may, for example, display operation instructions (e.g., an arrow indicating that the screen can be switched or the word "adjustable") brightly as guidance, while displaying other displays (e.g., the clock display) dimmer than usual, but only in the following cases. • When you have never changed from R zoom 1 to R zoom 2. Until any image processing adjustments are made based on user input. • Up to several days after the installation of the imaging device 100 (for example, up to two days).

[0286] The control unit 11 may not display operation instructions (for example, an arrow indicating that the screen can be switched or the word "adjustable") in R zoom 1, but may display the above operation instructions in R zoom 2. The control unit 11 may not display the above operation instructions in F+R, F zoom, R zoom 1, and the off state when the screen is displayed in two halves (left and right), but may display the above operation instructions in R zoom 2.

[0287] The control unit 11 may continue to display the operation instruction until, for example, the following conditions are met. The condition is that the R zoom will change from R zoom 1 to R zoom 2. • The condition is that some kind of image processing adjustment is made based on user actions. The condition is that several days have passed since the installation of the imaging device 100 (for example, two days have passed). However, in the configuration described above, the operating instructions may interfere with the user's operation. Therefore, it is preferable that the control unit 11 hides the operation instructions (for example, an arrow indicating that the screen can be switched or the word "adjustable") after a short period of time, about 2 seconds, has elapsed since the display started, so as not to interfere with the operation.

[0288] The operation instructions are set to be displayed (on) by default, but the user may set them to be hidden (off). The control unit 11 should have a function to accept user input regardless of whether the operation instructions are displayed or not, and to make some adjustments to image processing based on the input.

[0289] The audio output unit 14 may output the on-screen explanation as audio. Specifically, the audio output unit 14 may provide guidance by outputting the following audio, for example, in the initial setup mode for initializing the shooting device 100 and the shooting device 200. For example, the audio output unit 14 may output the audio, "Tap the arrow to change the image display position," to suggest that the cropped image position 132 will change when the user touches the move icon with their finger. The audio output unit 14 may also output the audio, "You can zoom in," to suggest that the user can zoom in when they touch the zoom icon with their finger. The audio output unit 14 may also output the audio, "You can zoom out," to suggest that the user can zoom out when they touch the zoom out icon with their finger.

[0290] The control unit 11 may display the following string or status icon on the display screen to indicate what is being displayed on the screen. Specifically, for example, the control unit 11 may display the following in the upper right corner of the display surface 131. • When Display mode 1 is selected, it will be indicated as "F|R". • When in Display mode 2, it will be displayed as "F zoom". When Display mode is 3, it will be displayed as "R zoom 1". • When Display mode is 4, it will be displayed as "R zoom 2". When Display mode 5 is selected, the power to the display surface 131 is off, so it is preferable to hide the above text or status icon that indicates what is currently being displayed. The control unit 11 may highlight the string or status icon indicating what screen is currently being displayed for a predetermined time (for example, 1 second) when the display mode changes. For example, if the display is automatically switched to R zoom 2 in response to the reception of a screen display switching signal, the control unit 11 may highlight the string or status icon, which is normally displayed in white (specifically, when the display is switched to R zoom 2 in response to the operation of the DISP button), by displaying it in red, or display "Screen switching mode in progress".

[0291] When the screen display switching signal is ON, the screen display itself is fixed to, for example, R zoom 2, so it is preferable to highlight that it has become R zoom 2 using the above string or status icon. The above string or status icon is more intended to indicate to the user that the display mode has switched than to indicate whether the screen display switching signal is ON or OFF.

[0292] The control unit 11 may output an audio message indicating the screen being switched to, depending on the screen switching. For example, the control unit 11 may output an audio message saying "Front and rear display" when switching to Display mode 1. The control unit 11 may also output an audio message saying "Front display" when switching to Display mode 2. The control unit 11 may also output an audio message saying "Rear zoom 1" when switching to Display mode 3. The control unit 11 may also output an audio message saying "Rear zoom 2" when switching to Display mode 4. The control unit 11 may also output an audio message saying "Display surface 131 will be turned off" when switching to Display mode 5.

[0293] The control unit 11 does not output sound indicating the screen to be switched to when switching to Display mode 1, 2, and 5, but may output sound indicating the screen to be switched to when switching to Display mode 3 or 4.

[0294] Figure 11 is an explanatory diagram illustrating a modified example of how images switch on the display surface 131. In the following explanation of Figure 11, configurations similar to those described with reference to Figure 10 will be omitted, and configurations different from those in Figure 10 will be described.

[0295] Here, since the area in front of vehicle 400 is actually visible to the user, it is likely that few users will drive with F zoom displayed continuously. Therefore, F zoom is more often used to check whether the view is properly visible when the camera 100 is installed. If we consider usability, in the initial setup mode for initializing camera 100 and camera 200, the screen is split into left and right halves and the display switches repeatedly in the sequence F+R → F zoom → R zoom 1 → R zoom 2 → off state → F+R → F zoom →... However, when the user actually uses it, it is more usable to switch repeatedly in the sequence R zoom 1 → R zoom 2 → off state → R zoom 1 → R zoom 2 →... Since the display is switched by button operation in camera 100, it is more usable if the display mode used only for settings is not switchable by button operation.

[0296] Therefore, as illustrated in Figures 11(A) and (B), the F+R display and the F zoom display, which split the screen into left and right halves, may be displayed only once for setting purposes. For example, when the F+R display and the F zoom display are active, the words "Setting Mode" or "Checking Settings" may be displayed on the display surface 131 at the initial stage after the power is turned on (not shown). Then, if the user presses a button image (not shown) that shows the word "OK" displayed on the display surface 131 along with the above words, the above words may not be displayed again until the camera device 100 is initialized.

[0297] The F+R display, which splits the screen into two halves, and the F zoom display may be configured so that they are not displayed unless the user enters settings mode.

[0298] Furthermore, the F+R display and F zoom display, which split the screen into left and right halves, may be configured by the user to be displayed or not via a menu that appears when the user presses the third button 1233. This way, if F+R and F zoom are hidden, the display will cycle through R zoom 1 → R zoom 2 → off → R zoom 1 → R zoom 2 → off → ... depending on the operation of the first button 1231. Thus, the user may configure whether or not to include the F+R display and F zoom display, which split the screen into left and right halves, in the toggle display. This allows the user to view, for example, dogs or cats in the car, passengers (especially children or the elderly who need supervision, or suspicious passengers in a taxi) by displaying F+R or F zoom depending on the situation. Such a configuration is preferable, for example, when considering the use of the camera 100 as a rearview mirror.

[0299] How the display switches (specifically, whether it cycles through R zoom 1 → R zoom 2 → off, or whether F+R and F zoom are also included in the cycle) can be determined by the user in the settings. For example, the default could be R zoom 1 → R zoom 2 → off, and the user could add or remove the switches as they wish. This would allow settings to be customized for each user.

[0300] Figures 10 and 11 describe the system assuming that imaging devices 100 and 200 are connected to system 1. When there are imaging devices not connected to system 1, a display mode corresponding to the unconnected imaging device may be included in the toggle display, but it is more preferable to skip the display mode for the unconnected imaging device. For example, when both imaging devices 100 and 200 are not connected to system 1, it is preferable that only the off state is displayed.

[0301] When the power to the imaging device 100 is turned off, the control unit 11 does not need to store the display mode that was displayed at the time it was turned off, but it is more preferable to store the display mode that was displayed at the time it was turned off. Then, when the power to the imaging device 100 is turned on again, it is preferable for the control unit 11 to display the display mode that was stored at the time of the previous shutdown.

[0302] In Figures 10 and 11, System 1 is described as displaying R zoom 2 on the screen when the screen display switching signal is turned ON, and displaying the originally displayed display mode on the screen when the screen display switching signal is turned OFF. The control unit 11 may execute the above transitions when the "automatic screen display switching" setting is ON, but may restrict the above transitions when the "automatic screen display switching" setting is OFF. That is, when the "automatic screen display switching" setting is OFF, even if the screen display switching signal is turned ON, for example, R zoom 2 may not be displayed on the screen, and the originally displayed display mode may be continued.

[0303] In Figures 10 and 11, System 1 is described as transitioning to R zoom 2 from any screen when the screen display switching signal is turned ON. The control unit 11 may also be configured to transition to R zoom 1 from any screen when the screen display switching signal is turned ON. Furthermore, the control unit 11 may have different transition destinations depending on the display mode when the screen display switching signal is turned ON. For example, the user may be able to pre-set the transition destination for each display mode when the screen display switching signal is turned ON.

[0304] Even if recording or formatting of storage medium 500 is being performed at the time the screen display switching signal is turned on, it is preferable that the process is not interrupted and continues to run in the background. In situations where audio playback from the audio output unit 14 is required during the background processing described above (for example, situations that notify that an event recording has occurred, or situations that notify that the folder on the storage medium 500 is full with overwrite protection), it is preferable to play the audio while maintaining the display of R zoom 2 in accordance with the situation. In contrast, in situations where a pop-up display is required for the background processing described above, it is preferable to display the pop-up display in response to the screen display switching signal being turned off and the screen returning to the original state. If multiple pop-up displays are required, it is preferable to display them by automatically switching them sequentially in chronological order (for example, switching every 5 seconds). The control unit 11 may also prioritize displaying a pop-up on the R zoom 2 side when a situation arises where a pop-up display is required. The control unit 11 may have a function to accept user input regardless of whether a pop-up display is active or not, and to adjust some image processing based on the input. When the screen display switching signal is turned on while a pop-up display is active, the control unit 11 may hide the pop-up display and, for example, switch the R zoom 2 screen, and then resume displaying the pop-up display in response to the screen display switching signal being turned off and the screen returning to the original state. When the screen display switching signal is turned on while a pop-up display is active, the control unit 11 may continue displaying the currently displayed pop-up display until a predetermined display time (for example, 5 seconds from the start of display) has elapsed, and then start the next pop-up display in response to the screen display switching signal being turned off and the screen returning to the original state.

[0305] [Regarding the OFF state of display surface 131] In Figure 10, the screen is split into left and right halves, and the sequence F+R → F zoom → R zoom 1 → R zoom 2 → Off state includes the Off state. Similarly, in Figure 11, the sequence R zoom 1 → R zoom 2 → Off state also includes the Off state. However, there is a question of whether it is appropriate to lump the Off state together with other switching states.

[0306] As a prerequisite, the display surface 131 is fine as long as it is easy to see when displaying the camera image, but it becomes difficult to see depending on the amount of sunlight. For example, if the shooting device 100 is about the same size as a car's rearview mirror (for example, about 9 to 10 inches) and has a display surface 131 that mimics the shape of a rearview mirror, and has a mirror behind the display surface 131 (hereinafter referred to as the "rearview mirror type"), the display surface 131 is superimposed on the mirror, making it even more difficult to see. For this reason, the need to turn off the power to the display surface 131 arises in various situations. If the display surface 131 cannot be switched off without pressing many buttons, it may become frustrating.

[0307] Therefore, it is preferable to provide a separate power button for the display surface 131 and a toggle button for switching the display mode of the display surface 131. For example, it is preferable to provide a relatively large power button on the bottom surface of the shooting device 100 (for example, the bottom of the screen), so that the user can switch the power of the display surface 131 between the ON state and the OFF state by briefly pressing the power button. It is also preferable to have a toggle button (for example, a first button 1231) for switching the display mode of the display surface 131 at a location separate from the power button. The size of the power button may be the same as or smaller than the toggle button, but it is more preferable that it be larger than the toggle button.

[0308] [About physical buttons] In the above description, the operation unit 123 was described as having a first button 1231, a second button 1232, a third button 1233, and a fourth button 1234. The operation unit 123 may instead have physical buttons such as a DISP button, a one-touch button, and a reset button used for screen switching, while the other buttons may be software buttons displayed on the display surface 131 instead of physical buttons. It is preferable to make the DISP button and one-touch button physical buttons because it would be difficult for the user to understand if they were software buttons that are touched, but they may also be software buttons.

[0309] The DISP button may function as a button that switches the display mode of the display surface 131 when pressed briefly. Specifically, for example, it may function as a button that switches the display mode of the display surface 131 when pressed briefly during recording, when recording is stopped, or during playback of a recording. Alternatively, for example, when playing back image data stored on the storage medium 500, or in the setting mode for configuring the shooting device 100 and shooting device 200 (the setting mode is a concept that includes the initial setting mode), it may function as a button that temporarily turns off the power to the display surface 131 when pressed briefly. "Temporarily off" more preferably means that the display surface 131 remains off until the user turns it on, but it may also remain off for a predetermined time (for example, 3 seconds) before switching it on.

[0310] Furthermore, for example, when the power to the display surface 131 is on, pressing and holding the DISP button would temporarily turn off the power to the display surface 131 (i.e., the display mode would instantly switch to the off state). However, long-pressing is surprisingly inconvenient, so it would be more practical if pressing the DISP button once briefly temporarily turned off the power to the display screen 131, and pressing the DISP button twice in quick succession switched one screen on the display screen 131. When driving, you might be in a hurry and want to look behind you, but the display screen 131 is showing something and you can't see it. In such cases, a quick press of the DISP button once can temporarily turn off the power to the display screen 131, which is very convenient.

[0311] Furthermore, for example, when the power to the display surface 131 is off, the DISP button may function as a button that turns on the power to the display surface 131 when pressed briefly (or held down).

[0312] The DISP button should be designed to do nothing if operated at any time other than those mentioned above.

[0313] The DISP button should be located in an easily accessible position for the driver (for example, on the second side 1013) or on the top of the camera 100. The DISP button should be relatively large; for example, it should be a large button that occupies one-third of the width of the camera 100. This makes it easier for the user to press the DISP button while driving, allowing for easy screen switching during driving.

[0314] The one-touch button should function as a button that allows the user to manually trigger an event by short-pressing it. For example, if the acceleration sensor of the sensor unit 17 does not detect an event, but the vehicle 400 is scraped, pressing the one-touch button should protect the image data before and after the one-touch button press as an event. When protected as an event, the image data should be moved to a different folder from the normal continuously recording folder that is overwritten, and saved without being overwritten. The one-touch button should function as a button that allows the user to manually trigger an event by short-pressing it during recording, but should not do anything if the one-touch button is operated at times other than during recording. Also, the one-touch button should not do anything if it is long-pressed.

[0315] The one-touch button should be placed in a location that is easy for the user to press (for example, in the middle of the bottom of the imaging device 100). The one-touch button should be smaller than the DISP button. The DISP button and the one-touch button should be placed as far apart as possible. Preferably, the DISP button and the one-touch button should be on different sides of the imaging device 100. Specifically, the DISP button and the one-touch button may be placed symmetrically on the left and right sides of the imaging device 100, for example.

[0316] The user may change the assignment of the DISP button and the one-touch button. The DISP button may be a relatively larger button, the same size as the one-touch button.

[0317] The reset button is a hidden button that can be pressed by the user with the tip of a needle, and it is preferable that it functions as a button that instructs the power of the imaging device 100 to be reset when it is pressed briefly (more preferably long). The reset button is preferably located in a position that is relatively difficult for the user to press, and it is preferable that it be a relatively small button. Furthermore, it is even more preferable that the reset button is configured to be pressed by the user with their hand, in which case, even if the imaging device 100 freezes due to a malfunction or the like, a reset operation can be performed without the need for a thin rod such as a needle.

[0318] [Regarding the software buttons displayed on display surface 131] Figure 12 is an explanatory diagram illustrating an example of an image displayed on the display surface 131. Figure 12(A) illustrates the state of the display surface 131 before the user taps it with their finger. Figure 12(B) illustrates the state of the display surface 131 immediately after the user taps it with their finger, showing the software buttons displayed on the display surface 131. The software buttons, such as R zoom 1, appear when the screen is tapped. There is a great demand for users to be able to quickly and easily check the display surface 131 as soon as they start driving the vehicle 400, so the software buttons are hidden when the power of the camera 100 is turned on and the screen starts displaying. Alternatively, the software buttons may be displayed when the power of the camera 100 is turned on and the screen starts displaying. As illustrated in Figure 12(B), tapping the screen displays various software buttons (for example, a brightness adjustment gauge T9 for adjusting brightness), allowing the user to perform various operations such as switching to setting mode or stopping recording. Software buttons are displayed by overlapping them onto the actual screen, but in Figure 12, images acquired from the camera devices 100 and 200 are omitted for the sake of simplicity in the diagram. If the user does not touch the display surface 131 for a predetermined time (for example, 10 seconds) after tapping the display surface 131 with their finger, the display surface 131 will transition from the state illustrated in Figure 12(B) to the state illustrated in Figure 12(A). In this way, for example, if there is no operation for 10 seconds, the software buttons should be hidden.

[0319] The control unit 11 may display the software buttons when the user taps the screen while the software buttons are hidden, and may hide the software buttons again when the user taps the screen while the software buttons are displayed. When the user taps the screen while the software buttons are hidden, the control unit 11 may display the software buttons and also display a hide button (not shown) that hides the software buttons. The hide button is, for example, labeled "×" and is a software button that has the function of hiding the software buttons when tapped by the user. The hide button may be displayed below the clock display S8 or towards the upper right of the screen.

[0320] The recording image S1 is an image indicating that the recording device 100 is recording. The recording time image S2 is an image indicating the duration of the image data currently being recorded. The audio recording image S3 is an image indicating that the recording device 100 is recording. The parking surveillance mode image S4 is an image indicating that the device is in parking surveillance mode. The rear camera connection image S5 is an image indicating that the recording device 200 is connected to the recording device 100. The storage medium image S6 is an image indicating that the storage medium 500 is inserted inside the recording device 100. The GPS image S7 is an image indicating that the recording device 100 is acquiring a signal from GPS. The clock display S8 is an image indicating the current time. The date display S9 is an image indicating the current date. The number of records image S10 is an image indicating the number of image data recorded on the storage medium 500. The number of events recorded image S11 is an image indicating the number of image data protected as events on the storage medium 500. The clock display S8, date display S9, and recording count image S10 are always displayed, and the status images for the recording image S1, shooting time image S2, recording image S3, parking surveillance mode image S4, rear camera connection image S5, storage medium image S6, and GPS image S7 are always displayed when the indicated status applies, and are hidden when the status does not apply. The clock display S8 and date display S9 may be set by the user to be displayed or not.

[0321] Move icon T1 is a software button that, when tapped by the user, moves the cropped image position 132 to the left. Move icon T2 is a software button that, when tapped by the user, moves the cropped image position 132 upwards. Move icon T3 is a software button that, when tapped by the user, moves the cropped image position 132 to the right. Move icon T4 is a software button that, when tapped by the user, moves the cropped image position 132 downwards.

[0322] In the case where the housing (and display surface 131) of the camera device 100 is shaped like a car's rearview mirror, the user may continue pressing the button if they want to see further down because it is a mirror. Therefore, it is good to indicate that the user has reached the edge of the image by operating the movement icons T1-4. For example, if a movement icon indicating the direction in which further movement is not possible is pressed when the user is at the edge of the image, the image on the display surface 131 may bounce or shake. Also, when the user has reached the limit in which further movement is not possible, it is good to display a red line at the edge of the image to indicate that further movement is not possible.

[0323] The zoom icon T5 is a software button that, when tapped by the user, enlarges the image displayed on the display surface 131. The default size of the image data is, for example, FullHD (specifically 1920 x 1080), and the width of the display surface 131 is the same size as the width of FullHD (specifically 1920). Depending on the aspect ratio of the display, by default, the display surface 131 displays the middle part of the vertical dimension of FullHD, divided into thirds. By operating the zoom icon T5, the user can enlarge the image to approximately 400% of the default size. When the image is enlarged to its maximum, it would be good to indicate that it has been enlarged to its maximum extent, for example, by having the image on the display surface 131 bounce.

[0324] The T6 minimize icon is a software button that, when tapped by the user, reduces the size of the image displayed on the display surface 131. Tapping the T6 minimize icon reduces the image to approximately 20% of its default size. Once the image has been reduced to its minimum size, it would be helpful to indicate, for example, that the image on the display surface 131 has been reduced to its minimum size by bouncing.

[0325] The move icons T1-4, zoom icon T5, and zoom out icon T6 may be designed so that when they reach their limits, their corresponding software buttons are grayed out and the user cannot press them.

[0326] The "×Number" image T7 has a function that affects all of the movement distance when operating the move icons T1-4, the zoom level when operating the zoom icon T5, and the zoom level when operating the zoom out icon T6. Basically, it is an image that indicates how many pixels to move. The default is "×1", and when the user taps the "×Number" image T7, it will toggle between "×1", "×5" (meaning 5x), "×10" (meaning 10x), and "×100" (meaning 100x) in a predetermined order. "×1" means 1 pixel at a time. Note that "×1" may also mean 2 pixels at a time, 3 pixels at a time, or 10 pixels at a time. "×1" can mean 10 pixels at a time, but 10 pixels may be too many. If it means 10 pixels at a time, the vertical size of FullHD (specifically 1080) will be reached by moving the move icon T4 100 times to reach the display range from the top to the bottom. In such cases, for example, with "×5", it takes about 10 moves, and with "×10", it takes about 2 moves to reach the top to bottom display range. It is preferable for the control unit 11 to retain the setting of which of "×1", "×5", "×10", or "×100" is displayed as the "×number" image T7, but it is not necessary to retain the setting. When the move button or zoom button is pressed once, it moves (or zooms in or out in the case of zooming in or out) by a predetermined amount according to the number displayed as the "×number" image T7. For example, the key point is that you can initially set it to "×100" to make a large change, and then fine-tune it with "×1", etc. If you want to fine-tune it every day, you can save it in the "×10" state, so for example, you can press the up button 3 times in the morning and the down button 3 times at night to return to the original state. For example, in situations where you want to zoom in, such as when checking the license plate of a vehicle driving behind you, you can set it to "×100" and zoom in all at once. When an image is enlarged or reduced, it can be displayed anywhere on the display surface 131, either above, below, left, or right, regardless of whether it touches the edge of the display surface 131. By controlling both the movement distance and the enlargement / reduction with the same "x number" image T7, the effort required for user operation can be reduced.For example, a user can roughly adjust the zoom level and movement distance by setting the "x number" image T7 to "x100," and then gradually adjust the position and zoom level by setting the "x number" image T7 to, for example, "x5," to find the desired result. Adjusting using the "x number" image T7 is easier than adjusting the position and zoom level by, for example, swiping the display surface 131. Specifically, with swiping, it is possible to make confusing operations and end up with an image that is too large to see what is being displayed, but with adjustment using the "x number" image T7, if you want to return to the original state (for example, the default), you can do so by pressing, for example, "x100."

[0327] While a dedicated software button that instantly restores the device to its original state (e.g., default) may be provided, it is preferable not to include one. Such a software button would not function significantly differently from the "x number" image T7 that indicates "x 100," and since the display surface 131 shows the location the user is actually seeing, the user can generally tell where it is being displayed by comparing the location with the display surface 131.

[0328] The toggle display order when tapping the "× number" image T7 should preferably be the same as in the initial settings and in normal use after the initial settings: "×1", "×5", "×10", and "×100". However, the user may change the toggle display order when tapping the "× number" image T7 in the settings. For example, it may be possible to set it so that "×1" and "×5" are toggled in the order of normal use, while "×10" and "×100" are hidden.

[0329] Note that there may be separate "× number" images T7 for position and scaling.

[0330] Furthermore, the method for specifying the cropped image position 132 may include a function to change the direction of movement of the cropped image position 132 relative to the swipe direction. For example, instead of changing the display area of ​​R zoom 2 with a software button on the screen, it may be changed with a swipe. The user may be able to choose between a mode in which the cropping range of the image moves downwards when swiping from top to bottom, and a mode in which the cropping range of the image moves upwards.

[0331] The pop-up area T8 illustrated in Figure 12(B) is an area where pop-up displays are shown. Examples of pop-up displays include messages indicating an error or an event. The brightness adjustment gauge T9 is a software button that indicates the brightness of the display surface 131 adjusted by the user moving their finger left or right on the display surface 131. The current brightness value is displayed on the brightness adjustment gauge T9. For example, the user can brighten the screen by swiping right and dim the screen by swiping left, not only on the brightness adjustment gauge T9 but in any area of ​​the display surface 131. The shooting device 100 has an auto-dimmer function that automatically adjusts the brightness of the display surface 131, but the user can manually control the brightness by turning off the auto-dimmer function.

[0332] The volume control gauge T10 is a software button that indicates the adjusted volume by the user moving their finger up and down on the display surface 131. The current volume value is displayed on the volume control gauge T10. For example, the user can increase the volume by swiping up and decrease the volume by swiping down, not only on the volume control gauge T10 but also in any area of ​​the display surface 131. The fact that the brightness control gauge T9 and the volume control gauge T10 are orthogonal to each other is important for ease of operation.

[0333] While swiping, pinching out, and pinching in to zoom in, and move images is intuitive, the response can be unreliable, making fine adjustments difficult. Therefore, brightness and volume adjustments were made using swipe gestures, creating a one-to-one correspondence between the gesture and the function. Image zooming, panning, and movement were handled using software buttons. This makes the operation easy to understand, as the same action is performed regardless of location on the display surface 131, and is easier to remember compared to configurations where, for example, the swipe gesture function differs depending on the scene.

[0334] Swipe gestures should be valid regardless of where they are performed on the screen. For example, a swipe should be accepted even when nothing is displayed, regardless of whether software buttons are visible. In contrast, tap gestures should only be accepted when performed on a software button.

[0335] SD Image T11 is a software button that, when tapped by the user, instructs the user to format the storage medium 500. Time-lapse Image T12 is a software button that, when tapped by the user, acquires still images from the image data at regular intervals and stitches them together to display a time-lapse video (hereinafter referred to as "time-lapse"). Audio Image T13 is a software button that, when tapped by the user, switches between recording and not recording. Recording Image T14 is a software button that, when tapped by the user, starts recording. Playback Image T15 is a software button that, when tapped by the user, plays back the recorded image data. Settings Image T16 is a software button that, when tapped by the user, switches to settings mode.

[0336] [About Guide Display] Figure 13 is an explanatory diagram illustrating an example of a guide display G1 that indicates which position (or range) of the original image the cropped image position 132 corresponds to. It is preferable for the control unit 11 to provide a guide display that indicates which position (or range) of the original image the range of the displayed video corresponds to. For example, the control unit 11 displays a guide display that indicates which area of ​​the original image is being displayed, as a small picture-in-picture (PinP) at the edge of the screen, in front of the image.

[0337] In the guide display G1 illustrated in Figure 13, the guide display is an image with a red frame around it, relative to a still image obtained from the original image data. Figure 13(A) shows the guide display G1 indicating that the entire position of the original image is displayed on the display surface 131. Figure 13(B) shows the guide display G1 indicating that the central part of the original image is displayed. In this case, the display surface 131 displays an enlarged view of the middle part of the original image. Figure 13(C) shows the guide display G1 indicating that the top position of the original image is displayed. Figure 13(D) shows the guide display G1 indicating that the middle position of the original image is displayed. Figure 13(E) shows the guide display G1 indicating that the bottom position of the original image is displayed. Figure 13(F) shows the guide display G1 indicating that the upper middle part of the original image is displayed.

[0338] The guide display may be displayed iconically without using the original image data. Figure 14 is an explanatory diagram illustrating an example of a guide display G2 that shows where (or within what range) the cropped image position 132 is located in the original image. In the guide display G2 exemplified in Figure 14, a rectangular outer frame of the same size is displayed regardless of the original image data, and a guide (e.g., diagonal lines) is displayed within it to indicate where the cropped image position 132 is located. Figure 14(A) is a guide display G2 that shows the entire original image position displayed on the display surface 131. Figure 14(B) is a guide display G2 that shows the central part of the original image being displayed. In this case, the display surface 131 displays an enlarged view of the middle of the original image. Figure 14(C) is a guide display G2 that shows the top of the original image being displayed. Figure 14(D) is a guide display G2 that shows the middle of the original image being displayed. Figure 14(E) is a guide display G2 that shows the bottom of the original image being displayed. Figure 14(F) is a guide display G2 that shows the upper middle part of the original image being displayed.

[0339] The guide display is best displayed when the original image is enlarged. The area displayed on the display surface 131 shifts up, down, left, and right as the original image is enlarged, making it difficult to determine the cropped image position 132. Displaying the guide in such cases makes it easier to see where the cropped image position 132 is.

[0340] For example, the user may decide in the settings whether or not to display the guide display. The guide display may be displayed in place of the clock display S8 and the date display S9. The user may decide in the settings whether or not to display the guide display in place of the clock display S8 and the date display S9. Whether or not to display the guide display may be predetermined depending on the type of display mode, or it may be decided in the settings by the user. The guide display may be displayed when the image is enlarged by the zoom function, and hidden when the image is not enlarged by the zoom function.

[0341] [Regarding the information to be recorded on storage medium 500] All images recorded by the recording device 100 on the storage medium 500 are the original images. For example, even when a user manually triggers an event by briefly pressing a one-touch button, the entire video field is recorded. Also, when using Picture-in-Picture (PinP) on the display surface 131, the device stores the image of the camera itself, not the PinP image. Therefore, it stores the entire image, not just a part of it, recording three images if there are three cameras, and four images if there are four cameras. The recording device 100 does not store information about the image actually displayed on the display surface 131, and does not record which position is being displayed on the SD card. For this reason, it is not possible to later check what kind of image processing was performed on the original image.

[0342] Here, anything outside the user's field of view is simply footage captured by the camera and can be considered unrelated to the user. If the user were to cause an accident with vehicle 400, for example, if it could be proven through the information on the storage medium 500 that "it was not displayed in the display area," the user's negligence might be denied. For this reason, information relating to the image actually displayed on the display surface 131 may have evidentiary value.

[0343] Therefore, the shooting device 100 displays a display range different from the recording range (for example, a cropped image position 132, which is a range that can be changed by the user), and records information (for example, range coordinate information related to the cropped image position 132, magnification, etc.) so that the display range within the recording range can be viewed (i.e., analyzed) later by the viewer. Even without recording the displayed video itself, the shooting device 100 stores information about the original video and the display range (i.e., information that the setting to display on the display surface 131 was this cropped image position 132), and when played back, the viewer can analyze and prove that the displayed image was that cropped image position 132. The shooting device 100 records information indicating what kind of image processing was performed on the original image in association with the original image data, so that it is possible to later confirm what kind of image processing was performed on the original image.

[0344] The recording device 100 may also record video from a display range different from the recording range (i.e., the video that was displayed on the display surface 131) in association with the original image (for example, so that it can be played back in sync). By recording the processed image data in association with the original image data, the recording device 100 allows the user to later review the image they were viewing.

[0345] The camera 100 does not need to store information on how the picture-in-picture (PinP) display is shown, but it is preferable to store the above information. The camera 100 may, for example, store an image of the entire screen with the area that was displayed in PinP enclosed in a frame. By storing in the camera 100 that the image was displayed in PinP, it is possible to prove, for example, that a passenger committed a crime even though the display surface 131 of the camera 100 installed in a taxi was showing the passenger.

[0346] [About the viewer] While general video viewing software can be used to view the footage, adding acceleration sensor graphs or maps to the image data recorded by the camera 100 may require specialized software to view.

[0347] Therefore, it is desirable that the camera 100 be equipped with a web browser or viewer that has the function of synchronizing and playing back the video of the recording range and the video of the display range based on the recorded information of the display range. It would be good if the user could download the web browser or viewer from the internet, for example. This would make it easier for the user to understand where they are (or where the camera 100 is shooting) when playing back the image data recorded by the camera 100, for example, by displaying the video, the current acceleration, and the map in sync.

[0348] [About anti-glare measures] In a rearview mirror-type camera 100, where the camera 100 is about the same size as a car's rearview mirror (for example, about 9-10 inches) and has a display surface 131 shaped like a rearview mirror, with a mirror behind the display surface 131, the display surface 131 may suddenly appear dazzling. However, it may be difficult to adjust the glare by operating the camera 100 while driving.

[0349] Therefore, it is preferable to have a structure that allows a light-reducing filter to be attached to the front of the rearview mirror-type shooting device 100 in a flip-up manner. This allows the light-reducing filter to act as a sun visor, effectively suppressing the risk of the display surface 131 becoming dazzling.

[0350] The imaging device 100 may electronically or mechanically switch between a display state, a normal mirror state, and an anti-glare mirror state. The display state is when the power to the display surface 131 is turned on. The normal mirror state is when the power to the display surface 131 is turned off. For example, the normal mirror state may be a state in which there is liquid crystal on the front side of the mirror (specifically, on the opposite side of the display surface 131 with respect to the mirror), and the liquid crystal is not controlled to make it difficult to reflect light from the outside. In the case of a mirror LCD, for example, the normal mirror state may be a state in which the liquid crystal constituting the mirror LCD is not controlled to make it difficult to reflect light from the outside. Also, for example, in an example where the display surface 131 includes a touch panel and a liquid crystal display, the normal mirror state may be a state in which an anti-glare liquid crystal sheet is attached between the touch panel and the liquid crystal display, and the liquid crystal sheet is not controlled to make it difficult to reflect light from the outside.

[0351] For example, in the anti-glare mirror state, there may be a liquid crystal on the front side of the mirror, and this liquid crystal may control the reflection of external light to a state that is less likely to reflect than in the normal mirror state. For example, in the anti-glare mirror state, in an example where the display surface 131 has a touch panel and a liquid crystal display, an anti-glare liquid crystal sheet may be attached between the touch panel and the liquid crystal display, and the liquid crystal sheet may control the reflection of external light to a state that is less likely to reflect than in the normal mirror state. By attaching an anti-glare liquid crystal sheet between the touch panel and the liquid crystal display, the direction of reflected light can be controlled. By making the external light a scattering state or a reflective state with the liquid crystal sheet, it is possible to prevent light from directly coming from behind. The anti-glare mirror state can be described as a mode to prevent light from directly coming from behind when light shines in from behind in the evening, for example. In the anti-glare mirror state, for example, the level of anti-glare may be switched analogously by detecting strong light entering the camera. Here, "analog" means that a certain quantity or data is expressed as a physical quantity (voltage, current, etc.) that can change continuously. For an anti-glare mirror, for example, an illuminance sensor (also called a brightness sensor) can be installed behind the mirror LCD. If the light entering the illuminance sensor is strong, the screen brightness can be switched (specifically, made brighter) to enhance the anti-glare function. In such an anti-glare mirror state, for example, if the headlights of a vehicle behind are strong, the image may become difficult to see, so it is advisable to increase the brightness of the display surface 131. However, because the image may become difficult to see when the headlights of a vehicle behind are strong, it may not be possible to place the mirror LCD in front of the illuminance sensor.

[0352] Furthermore, if the brightness of the images from the cameras 100 and 200 is strong, the anti-glare mirrors may be activated. In such cases, the cameras of the cameras 100 and 200 should detect the brightness and activate the anti-glare mirrors accordingly. For example, even when the image from camera 100 is displayed on the display surface 131, if the brightness received by the camera of camera 200 is strong, the image from camera 100 displayed on the display surface 131 should be brightened. Methods for brightening the image displayed on the display surface 131 include increasing the brightness of the backlight of the display surface 131, and making the LCD screen in front of the display surface 131 a darker screen (for example, displaying it in gray to reduce the difference). An auto-dimmer function may also be used to brighten the image displayed on the display surface 131. Since camera 100 has an illuminance sensor, the brightness of the display surface 131 should be controlled according to whether the surroundings of the vehicle 400 are bright or dark. Furthermore, if the power to the display surface 131 is turned off and it is detected that the area behind the vehicle 400 is bright (specifically, an intensely bright area exceeding a predetermined threshold), the anti-glare mirror state may be turned on.

[0353] For switching between the display state, normal mirror state, and anti-glare mirror state, for example, when the vehicle 400 is moving forward and the anti-glare mirror state is active, if the vehicle 400's shift lever is moved to the R position, it is preferable to switch from the anti-glare mirror state to the display state. Subsequently, when the vehicle 400 moves forward again, if the time between switching to the display state and moving forward is shorter than a predetermined time (e.g., 5 minutes), it is preferable to switch back to the anti-glare mirror state. If the time is longer than the predetermined time, it is preferable to switch back to the normal mirror state.

[0354] When switching screens, the imaging device 100 should switch to the anti-glare mirror state after the power to the display surface 131 has been turned off by a toggle.

[0355] The imaging device 100 may also have a gel inside the mirror LCD, and by applying voltage to the gel to switch its reflectivity, it may perform automatic control of the anti-glare function (i.e., automatic control of the mirror's reflectivity). This gel is called an "electronic shutter." The imaging device 100 is configured with the mirror, gel, and LCD arranged in that order from the front. The gel is normally transparent, and the mirror is visible, so it reflects completely. However, if the gel is slightly cloudy, the light is scattered and does not come directly. By lowering the reflectivity in this way, it becomes less likely to reflect light, so even if strong light comes in from a vehicle behind, it is gentle on the user's eyes. The gel may also be used to suppress the mirror function when the LCD display is desired. In the example of the imaging device 100 without a display surface 131, the imaging device 100 may be configured with the glass, gel, and mirror arranged in that order from the front. It is also possible to place the display surface 131 separately at the back to create a half-mirror. Alternatively, liquid crystal can be used instead of the gel, and the reflectivity may be changed depending on whether the liquid crystals are aligned or misaligned. In this case, if the liquid crystals are aligned, all light will pass through, but if the liquid crystals are misaligned, the light will scatter and not reach directly.

[0356] [Regarding the use of a portion of the display surface 131 as a mirror] Figure 15 is an explanatory diagram illustrating an example of a configuration in which an image is displayed on a portion of the display surface 131 and the rest is used as a mirror. Unlike a configuration in which the image capture device 100 can only reduce the image until the edge of the image reaches the edge of the display surface 131, the image capture device 100 can reduce the image even when the edge of the image is smaller than the edge of the display surface 131. The extent to which it can be reduced does not need to be predetermined, but it is preferable that it cannot be reduced to a size that makes it difficult to see if it is reduced too much, as this would be confusing. As illustrated in Figure 15, the image capture device 100 can reduce the image to a size even smaller than the actual image (e.g., 1920), and employs a configuration that displays black in the blank area where the image is not displayed. By displaying black in the blank area where the image is not displayed, the black display portion functions as a mirror. There is a trend to display the image acquired from the image capture device 100 (or image capture device 200) across the entire surface, but there is a great demand to use a portion of it as a mirror. The imaging device 100 allows for both displaying the image across the entire surface and using a portion of it as a mirror, thus greatly expanding the range of uses for the user. Alternatively, the image may be displayed on a portion of the display surface 131, while the remaining portion is not used as a mirror and can be used for other purposes (for example, displaying favorite images).

[0357] For example, in a configuration where only half of the image is not displayable, and the non-displayable portion functions as a mirror, the area outside the displayable portion of the screen is a regular mirror rather than a half-mirror, resulting in a small display area. In contrast, the shooting device 100 has a half-mirror across the entire screen, and the user can adjust the image size as they wish, so the problem of a small display area does not occur.

[0358] Here, even if part of the display surface 131 is a completely dark screen, if something is displayed somewhere, the backlight of the display surface 131 is turned on. Currently, there are 6 (or 8) backlights arranged in series within the display surface 131. As a result, the black areas become a dimly lit mirror rather than a perfect mirror. Since the display surface 131 displays an image in part and the entire surface is a display, the backlight is on, so the black areas cannot be used as a perfectly black mirror.

[0359] Therefore, it is best to turn off the backlight for the black areas. However, even if the backlight is turned off, light will still leak through, so the black areas will still glow faintly. The above can be solved by inserting a separator to isolate the backlight, but when a separator is inserted, a line will appear at the separator when the image is displayed across the entire screen. If the separator is made of transparent liquid crystal, the line will be less likely to appear. Also, when the image is made smaller, it is preferable to reduce the brightness compared to when it is displayed in full screen. This reduces the brightness of the black areas as well, making it easier to function as a mirror. Figure 15(A) is an example of a configuration in which an image is displayed on the left and black is displayed on the right to use it as a mirror. The shooting device 100 can change the display position of the image, so it is also possible to display the image left-aligned. For example, by connecting the backlights on the left and right sides in series separately, and turning off the backlight on the right side, it is possible to display the image only on the left half of the screen and hide the image on the right half, using it as a mirror.

[0360] Figure 15(B) shows an example of a configuration in which an even smaller image than that in Figure 15(A) is displayed in the lower left corner, and the remaining portion is displayed in black to be used as a mirror. For example, by connecting the backlights in series and turning off the backlights except for the leftmost one, it is possible to display an image only in the lower left corner of the screen, and hide the image in the remaining portion to use it as a mirror.

[0361] Figure 15(C) shows an example of a configuration where an image is displayed in the lower half and black is displayed in the upper half to use it as a mirror. For example, by connecting the upper and lower backlights separately in series and turning off the upper backlight, the upper half of the screen can be used as a mirror while the lower half of the screen displays an image.

[0362] In this way, the user can choose which position is best for displaying the image on the imaging device 100, or which display position is best for a given situation. For example, there are two display modes, R zoom 1 and R zoom 2. R zoom 1 displays the entire image, while R zoom 2 allows the user to view a small portion of the image acquired from the imaging device 100 (or imaging device 200) using a mirror, displaying only a small portion of the image (for example, the lower half).

[0363] [Regarding parking surveillance mode] The camera 100 is connected to the ACC power plug and enters parking surveillance mode when the ACC power is turned off. More specifically, the camera 100 enters parking surveillance mode when the automatic parking mode switch is turned on and the ACC power is turned off. The camera 100 continues recording for a set time (for example, 1 hour or 8 hours) after the ACC power is turned off. Recording methods in parking surveillance mode include keeping the camera always on and recording at a reduced bitrate per frame, or recording when objects around the vehicle 400 move. Alternatively, a Doppler sensor can be connected to the camera 100, and when the camera is off, the camera will turn on and an event will be triggered when the Doppler sensor detects movement.

[0364] In parking surveillance mode, the control unit 11 of the recording device 100 and the power to the cameras are kept off. When the control microcontroller for parking surveillance mode is turned on, the power to the recording device 100 is turned on and recording begins in response to a G-sensor reaction. In parking surveillance mode, video from all cameras connected to the recording device 100 is recorded.

[0365] When parking surveillance mode is started, the power to the display surface 131 is turned on and a character indicating that parking surveillance mode is in effect is displayed on the display surface 131. During parking surveillance mode, the power to the display surface 131 is basically turned off, but in modes where the frame rate is reduced for recording (specifically, modes in which the control unit 11 of the recording device 100 remains awake), it is preferable to allow the video to be viewed by tapping the display surface 131.

[0366] In parking surveillance mode, if the external sensor is turned on and normal recording is in progress, the system switches to parking monitoring mode. In parking monitoring mode, if no events occur for a predetermined period of time (e.g., 5 minutes), power-saving operation is performed. Specifically, the power to the display screen 131 is turned off, and the main power to the camera 100 is also turned off (or operated in standby mode). When an event occurs in parking monitoring mode, recording is started first, followed by the display of the alarm function screen. The alarm function screen display is a function that displays the image of a person on the display screen 131, for example, when a person is captured by the camera 200. In the alarm function screen display, even if the location of the person is different from the set display range, it is preferable to change the display range to include the person's location. For example, the display range may be moved to include the person, but it is more preferable to move the display range to center on the person. For example, if someone looks at the vehicle 400 from behind, their image will suddenly appear on the display screen 131, which acts as a deterrent to crime. The camera 100 has internal information about a display position that captures the entire rear of the vehicle 400, and may display the image of that position if a person approaches looking over the rear of the vehicle. However, even if a person is captured by the camera 100, the display surface 131 is not visible from the front of the vehicle 400, so it is best to ignore the person captured by the camera 100 and not display their image. However, if a person is captured by the camera 100, the display surface 131 may display the image of that person.

[0367] Furthermore, in parking surveillance mode, if the external sensor is off and motion is detected, the system may switch to motion detection mode. In motion detection mode, if the recording device 100 is not operated and no events occur for a predetermined time (e.g., 1 minute), the power to the display panel 131 is turned off and the system switches to motion detection standby mode. When an event occurs in motion detection mode, recording is started first, and then the display panel 131 flashes. The flash display is a function that switches between white and black on the display panel 131 at predetermined time intervals (e.g., every 0.1 seconds) when an event occurs in parking surveillance mode. It is recommended to display text such as "Security Monitoring Mode" while the flash display is running.

[0368] The system configuration described above may also be configured as illustrated in Figures 16 to 19 (an example of a rearview mirror type). Other embodiments for carrying out the present invention will be described below with reference to Figures 16 to 19. In the following description of Figures 16 to 19, configurations similar to those described above will be omitted, and different configurations will be described.

[0369] Figure 16 is a six-view drawing showing an example of the external configuration of the imaging device 100. Note that the imaging device 100 illustrated in Figure 16 differs from the imaging device 100 illustrated in Figure 2 in that the imaging device 100 itself does not have an imaging unit 15, but is connected to the imaging unit 15 illustrated in Figure 18 via a cable. This cable digitally transmits signals between the imaging device 100 and the imaging unit 15. Because the imaging unit 15 is separate from the imaging device 100, the user can freely tilt the imaging device 100 itself without affecting the angle of the lens of the imaging unit 15. Furthermore, since an acceleration sensor is built into the imaging unit 15, the angle of the imaging device 100 itself does not affect the acceleration sensor.

[0370] Figure 16(A) is a front view of the imaging device 100. The fourth side section 015 illustrated in Figure 16(A) is provided with a display surface 131 and a light-emitting section 21. The imaging device 100 has, for example, a width of 277 mm, a depth of 21 mm, and a height of 72 mm. Thus, it is a well-balanced size that is neither too long nor too short.

[0371] Figure 16(B) is a plan view of the imaging device 100. The top surface 1011 shown in Figure 16(B) is provided with a joint rail 102, a camera jack 191 (also called the "rear camera connector"), a terminal 192 (also called the "power cable terminal"), a front camera jack 193 (also called the "front camera connector"), a switching wire terminal 194 (also called the "reverse gear cable terminal"), and a sensor terminal 195 (also called the "sensor connector").

[0372] The joint rail 102 illustrated in Figure 16(B) may have a detachable band for attaching the camera device 100 to a predetermined mounting position on the vehicle 400 (e.g., the rearview mirror), or the joint rail 102 may clamp the rearview mirror of the vehicle 400 from above and below.

[0373] The front camera jack 193 illustrated in Figure 16(B) is a terminal to which one end of a communication cable connecting the imaging device 100 and the imaging unit 15 illustrated in Figure 18 is connected. The front camera jack 193 may, for example, be compatible with the USB Type-C standard and serve as a terminal for the imaging device 100 to communicate with the imaging unit 15 using the Ethernet standard.

[0374] The switching wire terminal 194 is the terminal to which the switching wire is connected to the imaging device 100. The sensor terminal 195 is the terminal to which the sensors provided by the system are connected to the imaging device 100.

[0375] Figure 16(C) is a bottom view of the imaging device 100. The bottom surface is provided with a first button 1231 (which may function as the DISP button described above), a microphone hole 104, an event recording button 122 (which may function as the one-touch button described above), and a joint rail 102.

[0376] Figure 16(D) is a rear view of the imaging device 100. As illustrated by the "cable cover" shown in Figure 16(D), the imaging device 100 is equipped with a cable cover that conceals the wiring connectors (for example, the rear camera connector and the front camera connector), thus neatly hiding the wiring connectors.

[0377] Figure 16(E) is a left side view of the imaging device 100. Figure 16(F) is a right side view of the imaging device 100. The second side 1013 illustrated in Figure 16(F) is provided with a reset button and a storage medium insertion slot 181.

[0378] Figure 17 is a perspective view showing an example of the external configuration of the imaging device 100 illustrated in Figure 16. Figure 17(A) is a view of the imaging device 100 from the rear, diagonally downward to the right. Figure 17(B) is a view of the imaging device 100 from the front, diagonally downward to the right.

[0379] Figure 18 is a six-view and perspective view showing an example of the external configuration of the imaging unit 15 in the embodiment illustrated in Figure 16. Figure 18(A) is a front view of the imaging unit 15. Figures 18(B) and (C) are top views of the imaging unit 15. Figure 18(D) is a left side view of the imaging unit 15. Figure 18(E) is a right side view of the imaging unit 15. Figure 18(F) is a rear view of the imaging unit 15. Figure 18(G) is a bottom view of the imaging unit 15. Figure 18(H) is a view of the imaging unit 15 from the front, diagonally downward to the right. Figure 18(I) is a view of the imaging unit 15 from the rear, diagonally downward to the right.

[0380] The imaging unit 15 has an imaging housing 150. The imaging housing 150 is a rectangular parallelepiped with approximately equal length in the vertical and horizontal directions and a relatively small thickness. The imaging device 100 is larger than the imaging unit 15. For example, the imaging unit 15 has a width of 44.9 mm, a depth of 43.5 mm, and a height of 39.4 mm. The imaging device 100 illustrated in Figure 18 is a stylish night vision front camera. In a configuration where the imaging device 100 itself does not have an imaging unit 15 and is connected to the imaging unit 15 illustrated in Figure 18 via a cable, the imaging unit 15 incorporates GPS, which reduces the influence of obstacles and improves sensitivity. In contrast, if the imaging device 100 has a built-in GPS, vibrations from the vehicle 400 are transmitted to the front mounting part 152 (described later) and the imaging device 100, leading to malfunction of the acceleration sensor.

[0381] The camera housing 150 has an upward-facing camera top surface 1501 when mounted on the vehicle 400, a first camera side surface 1502, a second camera side surface 1503, a third camera side surface 1504 located opposite the second camera side surface 1503, and a fourth camera side surface 1505 located opposite the first camera side surface 1502.

[0382] The other end of a communication cable connecting to the imaging device 100 is connected to the top imaging surface 1501. Above the top imaging surface 1501, a front mounting part 152 is provided that rotates in the front-rear direction of the vehicle 400 with a rotation axis 153 as the axis of rotation. Figure 18(B) illustrates a configuration in which the front mounting part 152 is located further rearward on the vehicle 400 than in Figure 18(C). The front mounting part 152 is attached to the vehicle 400 (for example, the windshield) using fixing members such as double-sided tape or suction cups, with its upper surface as the mounting surface. An imaging lens 151 is provided on the first side imaging surface 1502.

[0383] Figure 19 is a six-view and perspective view showing an example of the external configuration of the imaging device 200 in the embodiment illustrated in Figure 16. Figure 19(A) is a front view of the imaging device 200. Figure 19(B) is a top view of the imaging device 200. Figure 19(C) is a left side view of the imaging device 200. Figure 19(D) is a right side view of the imaging device 200. Figure 19(E) is a rear view of the imaging device 200. Figure 19(F) is a bottom view of the imaging device 200. Figure 19(G) is a view of the imaging device 200 from the front, diagonally downward to the right. Figure 19(H) is a view of the imaging device 200 from the rear, diagonally downward to the right. As illustrated in Figure 19, the imaging device 200 is a small cylindrical rear camera that does not obstruct the user's view.

[0384] The imaging device 200 has a cylindrical housing 201 and is equipped with a rear imaging lens 202. The cylindrical housing 201 is a three-dimensional shape that is longer in the left-right direction than in the up-down direction and has a relatively small thickness. For example, the imaging device 200 has a width of 67.2 mm, a depth of 36.3 mm, and a height of 30 mm. The imaging device 200 may also have a rectangular prism-shaped housing.

[0385] The cylindrical housing 201 has an upward-facing top surface 1501 when mounted on the vehicle 400, a first shooting side surface 1502, a second shooting side surface 1503, a third shooting side surface 1504 located opposite the second shooting side surface 1503, and a fourth shooting side surface 1505 located opposite the first shooting side surface 1502.

[0386] The other end of a communication cable connecting to the imaging device 100 is connected to the right side of the imaging device 200. The imaging device 200 is provided with a rear mounting section 203 that rotates in the front-rear direction of the vehicle 400 with the center of its right side as the axis of rotation. The rear mounting section 203 is attached to the vehicle 400 (for example, the back door glass) using fixing members such as double-sided tape or suction cups, with its upper surface as the mounting surface.

[0387] The system configuration described above may also be configured as illustrated in Figure 20 (an example of a rearview mirror type). Other embodiments for carrying out the present invention will now be described with reference to Figure 20. In the following description of Figure 20, configurations similar to those described above will be omitted, and different configurations will be described.

[0388] Figure 20 is an explanatory diagram showing an example of the external configuration of the imaging device 100. Note that the imaging device 100 illustrated in Figure 20 differs from the imaging device 100 illustrated in Figure 2 mainly in that, like the imaging device 100 illustrated in Figure 16, the imaging device 100 itself does not have an imaging unit 15, but is connected to the imaging unit 15 illustrated in Figure 18 via a cable. Since the imaging unit 15 is separate from the imaging device 100, the user can freely tilt the imaging device 100 itself without affecting the angle of the lens of the imaging unit 15. In addition, since the acceleration sensor is built into the imaging unit 15, the angle of the imaging device 100 itself does not affect the acceleration sensor.

[0389] Figure 20(A) is a front view of the imaging device 100, and Figure 20(B) is a bottom view of the imaging device 100. The imaging device 100 has a well-balanced size, neither too long nor too short, with a width of 277 mm, a depth of 21 mm, and a height of 72 mm. The display surface 131 is 10.88 inches, and the LCD active area has a width of 251 mm and a height of 58 mm. The mirror surface of the display surface 131 has a width of 269 mm and a height of 68 mm. The image sensor is a CMOS with a resolution of 1920 × 1080 pixels. For the imaging unit 15 connected to the imaging device 100 as illustrated in Figure 20, the field of view is 110 degrees horizontally, 60 degrees vertically, and 131 degrees diagonally. The lens has an F-number of 1.0 and a pixel size of 4.0 μm, so the imaging device 100 has excellent night vision capabilities. The larger the pixel size, the greater the light-gathering power and the brighter the image obtained. For example, when the pixel size is 4.0 μm, the light-gathering power is 1.9 times that of 2.9 μm. The smaller the F-number, the greater the light-gathering power. The light-gathering power of F-number 1.0 is four times that of F-number 2.0 and 3.2 times that of F-number 1.8. The higher the light-gathering power, the less need there is to significantly increase the sensitivity of the CMOS sensor, resulting in less noise.

[0390] Figure 21 is an explanatory diagram showing an example of the external configuration of the imaging device 100. Note that the imaging device 100 illustrated in Figure 21 differs from the imaging device 100 illustrated in Figure 2 mainly in that, like the imaging device 100 illustrated in Figure 16, the imaging device 100 itself does not have an imaging unit 15, but is connected to the imaging unit 15 illustrated in Figure 18 via a cable. Since the imaging unit 15 is separate from the imaging device 100, the user can freely tilt the imaging device 100 itself without affecting the angle of the lens of the imaging unit 15. In addition, since the acceleration sensor is built into the imaging unit 15, the angle of the imaging device 100 itself does not affect the acceleration sensor.

[0391] The imaging device 100 illustrated in Figure 21 differs from the imaging device 100 illustrated in Figure 2 in that it does not have a joint rail 102 and is attached to a predetermined mounting position on the vehicle 400 (for example, the position of the rearview mirror) with a ball joint.

[0392] In the photographic device 100 illustrated in Figure 21, the part that attaches to the vehicle 400 and the part with the ball joint are a single integrated structure, and there is a hole in the ball joint through which the cable can be passed. The photographic device 100 illustrated in Figure 21 is configured in such a way that it cannot be attached to the vehicle 400 without performing the difficult task of connecting and storing various cables. For this reason, the photographic device 100 is installed on the vehicle 400 with the ball joint attached when the vehicle 400 is sold by the manufacturer, but it may also be configured to be attached to the vehicle 400 after it has been delivered to the user.

[0393] Figure 21(A) is a front view of the imaging device 100, and Figure 21(B) is a bottom view of the imaging device 100. The imaging device 100 has a width of 277 mm, a depth of 35 mm, and a height of 72 mm, which is a well-balanced size that is neither too long nor too short. The imaging device 100 shown in Figure 21 is thicker than the imaging device 100 shown in Figure 20 by the thickness of the part that attaches the ball joint to the imaging device 100. Note that the thickness of the imaging device 100 may be the same regardless of whether or not the part attached with a ball joint is attached.

[0394] Further information regarding the imaging device 100 illustrated in Figure 21 is as follows: The display surface 131 is 10.88 inches, and the LCD active area is, for example, 251 mm wide and 58 mm high. The mirror surface of the display surface 131 is, for example, 269 mm wide and 68 mm high. The image sensor is a CMOS with a resolution of 2688 × 1520 pixels. For the imaging unit 15 connected to the imaging device 100 illustrated in Figure 21, the field of view is 130 to 140 degrees horizontally, 80 to 90 degrees vertically, and 160 to 170 degrees diagonally. The lens has an F-number of 2.0 and a pixel size of 4.0 μm.

[0395] It is preferable that the image sensor, field of view, and lens F-number be the same for both the imaging device 100 and the imaging device 200, but they may be different. Here, the smaller the F-number and the larger the pixel size, the less need there is to increase the ISO sensitivity of the image sensor (e.g., CMOS), and the less impact noise per pixel has. This reduces the graininess of images in dark places and improves image quality.

[0396] In the examples shown in Figures 20 and 21, the housing (and display surface 131) of the recording device 100 is a car rearview mirror type, and the recording device 100 is a mirror drive recorder. The device is configured to have a touch panel on the display surface 131 and a first button 1231 (which may function as the DISP button described above) and an event recording button 122 (which may function as the one-touch button described above) on the bottom surface as means for the user to operate it.

[0397] <Free Button> In the system configuration examples described above, basically only one predetermined fixed function is assigned to each physical button (or software button), or two predetermined fixed functions are assigned to each physical button, one for short presses and one for long presses.

[0398] Here, if the number of physical buttons (and software buttons) on the imaging device 100 is large, the convenience for the user at a glance decreases. For this reason, it is preferable that the number of physical buttons (and software buttons) on the imaging device 100 be as small as possible. Furthermore, it is preferable that the physical buttons on the imaging device 100 be mainly those that should be operated in urgent situations or those that should be operated immediately with simple operations. An example of a button that should be operated in urgent situations is the event recording button 122. An example of a button that should be operated immediately with simple operations is a button for electronically or mechanically switching between the display state, normal mirror state, and anti-glare mirror state (for example, the first button 1231, or the DISP button).

[0399] However, the minimum number of buttons needed may differ from person to person. Therefore, it is preferable to have several functions that can be assigned to each button within the minimum physical button configuration (or software button configuration).

[0400] Therefore, it is preferable that the imaging device 100 be configured to include a free button (also called an "arbitrary setting button") that allows the user to freely switch functions to enable multi-functional use, and to configure what function the button should have. It is more preferable that the free button be provided as a physical button, but it may also be provided as a software button. The reason why a physical button is preferable is that if the free button is provided as a software button, it is necessary to perform an operation to display the free button, which is normally hidden, before operating the free button, which effectively results in two operations, making it time-consuming and troublesome.

[0401] Furthermore, if the free button is a software button, it cannot be operated when the power to the display panel 131 is off. In contrast, if the free button is a physical button, it can be operated regardless of whether the power to the display panel 131 is off or not. For this reason, it is more convenient for the user to have the free button as a physical button.

[0402] The free button may also be configured as a touch sensor. For example, a touch sensor may be provided on the edge of the display surface 131 (preferably an area extending from the side to a part of the front), and the button may be operated by touching or swiping this edge.

[0403] Figure 22 is an explanatory diagram illustrating examples of functions that can be assigned to the free buttons. Each free button can be assigned at least one function. Examples of functions that are preferable to assign to the free buttons include (1) to (12) below. Other functions that are preferable to assign to the free buttons will be discussed later. (1) A function to start recording (i.e., start event recording) or stop recording an image captured by the camera 100 or camera 200. (2) A screen display switching function that allows you to select which camera's image to display on the display surface 131 of the camera when multiple cameras (for example, two or three) are connected to the camera 100. (3) A setting mode transition function for moving to the setting mode. (4) A playback screen transition function for moving to a screen that plays back images recorded by the recording device 100. (5) A function to start parking surveillance mode. (6) A function to switch the recording state while monitoring the vehicle 400 in parking surveillance mode. Specifically, a function to switch to a mode that saves power or storage space, such as time-lapse mode or motion detection mode. (7) A function to instruct the formatting of the storage medium 500. (8) A function to switch voice recording on and off. (9) A function to electronically or mechanically switch between display state, normal mirror state, and anti-glare mirror state. (10) A function to switch the microphone 121 of the recording device 100 between muted and unmuted, regardless of whether recording is in progress or not. (11) A function to change the lighting color of the light-emitting elements (e.g., full-color LEDs) in a configuration in which the buttons of the imaging device 100 are made of a resin that transmits and diffuses light, and each button has a light-emitting element inside. Specifically, for example, a function to change the lighting color of the light-emitting elements provided in each button to a different color (e.g., blue) when the entire button is emitting light of the same color by lighting the light-emitting elements provided in each button with the same color (e.g., red). (12) A function that switches the power of the display surface 131 between on and off states.

[0404] A8 The free buttons assigned to functions (1), (3)-(5), (7), and (12) above can be considered buttons for performing functions. On the other hand, the free buttons assigned to functions (2), (6), and (8)-(11) above can be considered buttons for changing settings.

[0405] When the function assigned to the free button does not involve any processing that is performed with the display panel 131 powered on, it is preferable to configure the system so that the display panel 131 is not powered on when the free button is operated while the display panel 131 is powered off. This prevents the display panel 131 from being powered on unintentionally.

[0406] For example, if the imaging device 100 can be equipped with a relatively large number of physical buttons (e.g., five or six), it may be sufficient to simply assign the above functions to them. Therefore, to make better use of the advantages of free buttons, it is preferable to provide a relatively small number of physical buttons (e.g., one free button or two free buttons), assign the above functions to those buttons in a setting mode, and then activate the desired function when the button is pressed. Note that the imaging device 100 equipped with free buttons may also be equipped with a relatively large number of physical buttons (e.g., five or six).

[0407] Thus, free buttons can be more effectively utilized in imaging devices 100, for example, where the number of physical buttons is reduced for design or configuration reasons. Specifically, an example is imaging device 100 whose display surface 131 includes both a touch panel and a liquid crystal display. In such cases, the touch panel is an added value, and necessary operations can be completed using physical buttons without operating the touch panel, or they may not be possible. However, basic operations are performed using the touch panel, which may reduce the number of physical buttons.

[0408] However, in a configuration where the display surface 131 is equipped with both a touch panel and a liquid crystal display, and basic operations are performed via the touch panel, there are at least the following problems. • One issue is that the screen of display surface 131 gets dirty with operation, so users want to avoid touching the touch panel as much as possible. • There is a problem where the recognition accuracy of the touch panel decreases due to fingerprints, etc. One issue is that when someone unfamiliar with the operation gets into vehicle 400, they might randomly touch the touch panel and mess up the settings. • A challenge exists when a user rents a car equipped with a camera 100 and does not want to touch the touch panel of that camera 100. Even if software buttons (see Figure 12) are present, it is desirable to keep the display surface 131 as full as possible with video display, so it is preferable to hide the software buttons when not being operated, such as while driving. However, in order to operate and activate a hidden software button, one must first tap the display surface 131 to display various software buttons, and then tap the desired software button to finally activate it. This presents a challenge as it requires two steps to activate the desired function.

[0409] Having physical buttons as "free buttons" offers advantages, such as allowing users who prefer not to touch the touchscreen due to fingerprints to utilize the aforementioned functions without touching the touchscreen. Furthermore, if a function is assigned to a physical button as a free button, that function can be used with just one press, making it more convenient than configurations that require two or more steps to activate the desired function.

[0410] In an example of a shooting device 100 in which the display surface 131 is equipped with a touch panel and a liquid crystal display, and software buttons and free buttons as physical buttons, the following configuration is preferable. - There is a touch panel with software buttons that allow for some kind of setting operation, but if the above setting operation is assigned to a free button, nothing will happen when the display surface 131 is tapped (for example, if the above setting operation is assigned to a free button, the touch panel is disabled, and even if the display surface 131 is tapped, the hidden software button remains hidden and the above setting operation cannot be accessed). In addition to the above configuration, for example, pressing two predetermined combinations of physical buttons (including free buttons) simultaneously enables the previously disabled touch panel, allowing the above setting operations to be performed using software buttons. Note that the operation to enable the touch panel may also involve operating a predetermined physical button (for example, a short press, a long press, or repeated presses), in which case the user can easily operate it with one hand.

[0411] Regardless of whether they are free buttons or not, it is preferable that physical buttons perform a predetermined function in response to their operation during normal operation outside of setting mode, and do not respond to any operation in setting mode. However, physical buttons may also be configured to perform the above function in response to their operation regardless of whether they are in setting mode or not.

[0412] While it is possible to configure the system to execute a single function regardless of the operation performed on the free button, it is more preferable to configure it so that different functions can be assigned to each type of operation performed on a single free button (for example, a short press, a long press, and repeated presses). This makes it possible to assign multiple functions to a single free button.

[0413] The imaging device 100 may have one free button, but it is more preferable to have multiple (for example, two or three). For example, all the physical buttons on the imaging device 100 may be configured as free buttons. It is preferable to configure the device so that each of the multiple free buttons can be independently assigned some function.

[0414] Other functions that can be assigned to the free button include, for example, the following:

[0415] (Function to switch shooting modes) The function for switching shooting modes may be configured to switch to a shooting mode specialized for shooting in bright places, but more preferably, it is configured to switch to a shooting mode specialized for shooting in dark places, for example.

[0416] Here, when shooting in dark places, unlike in bright scenes, it is necessary to switch settings by slowing down the shutter speed or increasing the gain to increase brightness. However, for example, slowing down the shutter speed makes the camera image brighter, but there is a risk of increased afterimages. For example, if the shutter speed is slowed down while the vehicle 400 equipped with the camera device 100 is moving, there is a risk that afterimages will be so prevalent that the license plates of surrounding cars will become invisible. For this reason, there is a challenge in keeping the shutter speed as fast as possible while the vehicle is moving. Therefore, when it is necessary to brighten the image acquired from the camera device 100 (and camera device 200) in a dark area around the vehicle 400 while it is moving, it is preferable to set the shutter speed (or gain) so that the license plates included in the image are just barely readable.

[0417] In contrast, when vehicle 400 is parked, the risk of afterimages is less than when it is in motion, so the shutter speed does not need to be as fast. Therefore, when vehicle 400 is parked in a dark place, there is a need to make the image acquired from the camera 100 (and camera 200) brighter than when it is in motion.

[0418] Therefore, it is preferable to assign a function to a free button that switches to a parking-specific mode, which is specialized for shooting when parked in a dark place. When the camera is parked, the user can press the free button to which the above function is assigned, thereby switching to the brightness for the parking-specific mode (i.e., a configuration that slows down the shutter speed or increases the gain).

[0419] The function to switch to a shooting mode specialized for shooting in low light conditions could also be a function to switch to an infrared camera. Specifically, for example, it would be good to configure the system so that a function to turn on an infrared LED and take a black and white image using infrared light can be assigned to a free button. When the user presses the free button to which the above function is assigned, it would be good to activate a mechanism that removes, for example, the IR light cut filter on the camera lens.

[0420] In surveillance cameras, switching to an infrared camera is done automatically. However, surveillance cameras are generally not operated by the user and lack the unique features of a dashcam, such as the ability for the user to quickly record an accident when it occurs. A dashcam has a significant advantage in that it can switch to a shooting mode specialized for shooting in low light with a single operation, in terms of quickly securing evidence.

[0421] When the auto-dimmer function is turned on, the camera automatically adjusts the gain (i.e., brightness) and shutter speed for daytime and dark conditions. This automatic adjustment is intended to ensure that various scenes are captured as reliably as possible, and it may be a somewhat weak, general-purpose adjustment. Such general adjustments do not allow for fine-tuning, such as using a specific shooting mode when the vehicle is stopped or a different mode in complete darkness. Therefore, in addition to the automatic adjustments mentioned above, it is preferable to further manually optimize the settings for shooting in low light conditions. This allows users to reap the benefits of both automatic and manual adjustments, and meet the demand for a shooting mode that is suitable for shooting while stopped or in complete darkness.

[0422] The function to switch to the infrared camera is similar to the function to switch to the parking-specific mode described above. Therefore, a configuration that includes either the function to switch to the parking-specific mode described above or the function to switch to the infrared camera may be used as a function to switch to a shooting mode specialized for shooting in dark places, but it is more preferable to have a configuration that includes both.

[0423] (Function to switch the lens used for recording) The function to switch the recording lens is interesting and preferable to configure as a function to physically switch the recording lens, for example. The function to switch the recording lens could be configured to switch between a wide-angle lens and a narrow-angle lens, but more preferably as a function to switch between a wide-angle lens and a macro lens. Here, for example, a dashcam has a fixed focus setting for objects 5-10 meters away, and there is a problem in that dashcams do not have a function to adjust the focus. In order to focus on a QR code (registered trademark) with a dashcam configured in this way, the QR code (registered trademark) must be placed, for example, 5 meters away. However, a QR code (registered trademark) at 5 meters away may be too small to be read due to its pixel-level limitations. Therefore, it is preferable to configure the system so that the user can insert the macro lens and read the QR code (registered trademark) by pressing a free button assigned to the function of switching between the wide-angle lens and the macro lens. In this way, instead of using the telephoto or wide-angle characteristics of the drive recorder, inserting the macro lens into the shooting device 100 (or shooting device 200) can completely change the characteristics of the shooting device 100 (or shooting device 200).

[0424] The function to switch the recording lens should ideally be configured to switch between lenses with different f-numbers. Here, a lower f-number lens allows for brighter images, but the depth of field is narrower, making it harder to focus. Conversely, a higher f-number lens has a wider depth of field, making it easier to focus. Therefore, it is preferable to configure the system so that, by pressing a free button to which the above function is assigned, the system can, for example, switch to a low f-number lens in dark scenes around the vehicle, and to use a high f-number lens to capture highly detailed, in-focus footage in bright scenes, such as while driving. A challenge specific to dashcams is that license plates are difficult to read when the focus is off, and this is particularly true for license plates of cars that are too close to the vehicle, rather than those of cars far away. Switching to lenses with different f-numbers offers advantages in such cases.

[0425] In the example where the imaging device 100 is equipped with two cameras (or where the imaging device 200 is equipped with two cameras), the function to switch the lens to record may be configured as a function to switch the camera that records.

[0426] Here, switching lenses is something that is done with SLR cameras. However, SLR cameras are photographic devices that allow you to photograph your subject to your liking. In contrast, dashcams are photographic devices that are primarily for evidentiary purposes, and SLR cameras and dashcams have different purposes. For this reason, the ability to switch lenses is a distinctive feature of dashcams.

[0427] While it is not necessary to record information such as switching shooting modes or changing the recording lens, it is preferable to record this information, as this is a key characteristic of dashcams in terms of their evidentiary value. Specifically, for example, it is preferable to record the current shooting mode (or lens status) as metadata associated with the recorded video on the storage medium 500. Then, it is good to configure the system to read this metadata when analyzing the footage later with a viewer.

[0428] (Brightness switching function) In the example where the housing (and display surface 131) of the imaging device 100 is shaped like a car's rearview mirror, the shape of the display surface 131 is narrow like a rearview mirror. As a result, although the imaging range is the entire area, there are times when bright areas exist only in parts that are not displayed on the display surface 131. For example, if the sun is reflected in the sky, the image may be controlled to be somewhat darker. Also, if the sun is clearly reflected in the background, the image may be controlled to be darker. In such cases, the display surface 131 may be controlled to be darker to match the bright areas that are not displayed on the display surface 131. However, since the display surface 131 itself is displaying a different, darker cropped image position 132, the user wants the brightness to be matched to that of the cropped image position 132. To meet the above request, it would be preferable to have a parameter for adjusting the brightness of only the cropped image position 132, but this may be difficult from a cost perspective.

[0429] Therefore, it would be good to have a function that switches the brightness, which can be assigned to a free button, that brightens the screen when it is dark. For example, when the free button assigned the above function is pressed, the backlight and the displayed image should both brighten. The reason for brightening both the backlight and the displayed image is that in sunlight, the human eye is too focused on bright surroundings, making it difficult to see dark things, so the brightness of the backlight is more important in bright places. Also, at night or in dark places, the human eye adjusts to the darkness and the pupils dilate, so the backlight can be dazzling. Therefore, the backlight should not be brighter at night than it is during the day. Furthermore, if the image itself is brightened at night, there is a risk of overexposure due to the headlights of following cars, so it is better not to brighten it. For this reason, there is no need for special adjustments to brighten only the backlight or the displayed image and dim the other for the above function; it is preferable to brighten both to a suitable degree.

[0430] The system could be configured so that each time you press the free button, which is assigned the function of brightening the screen when it's dark, it toggles between the original brightness and the changed brightness. This allows the screen to instantly brighten when you press the free button, and instantly dim when you press it again.

[0431] A useful feature for assigning brightness to a free button is to include a function that dims the screen when it is bright. For example, when the free button assigned to the above function is pressed, the backlight dims and the displayed image darkens. Alternatively, each time the free button assigned to the above function is pressed, the system may toggle between the brightness before the change and the brightness after the change.

[0432] Even when the brightness adjustment function described above (specifically, the auto-dimmer function, in which the camera 100 automatically adjusts the brightness of the display surface 131, and the function, in which the user sets the upper and lower limits for brightness adjustment) is functioning, the ideal brightness level varies from user to user, depending on whether it is bright or dark. For this reason, even in configurations equipped with a brightness adjustment function, a free button to brighten the screen when it is dark is useful.

[0433] The free button should ideally have a function to switch brightness levels, which can be assigned to a button that evens out the brightness of areas that are too bright and areas that are too dark, making both areas easier to see. More preferably, it should have a function that improves visibility when the headlights of a following vehicle are too bright. For example, when the headlights of a following vehicle are too bright, pressing the free button assigned to the above function should even out the brightness of areas that are too bright and areas that are too dark, making both areas easier to see.

[0434] The function of leveling out overly bright and overly dark areas to make both bright and dark areas easier to see can be achieved by enhancing the HDR effect or by using WDR (Wide Dynamic Range). The HDR effect is a software-based technique that expands the dynamic range (specifically, the logarithm of the illuminance ratio between bright and dark areas) by changing the shutter speed, leveling out overly bright and overly dark areas to make both bright and dark areas easier to see. WDR is a hardware-based technique that provides a wide dynamic range. The HDR effect (or WDR) can suppress the brightness of the headlights of following vehicles, making the surrounding dark areas (for example, roads and side streets) easier to see.

[0435] For example, if the recording device 100 is a dashcam, then from the perspective of recording evidence footage, it is desirable to have as strong an HDR effect as possible. However, the HDR effect flattens brightness and darkness, so there is a risk that the degree of emphasis on brightness and darkness will be lost.

[0436] The principle of the HDR effect is to suppress overexposure (or underexposure) by taking and combining two photos almost simultaneously. One photo is taken with the camera's aperture wide open (more precisely, with a longer electronic shutter time and a longer time to accumulate charge), and the other is taken with the camera's aperture closed (more precisely, with a shorter electronic shutter time and a shorter time to accumulate charge). By combining the two photos, a bright scene and a dark scene are combined into a single image. The stronger the HDR effect, the longer the difference in the shooting times of the two photos becomes, resulting in a greater sense of afterimage, such as a telephone pole appearing to double. Therefore, if the HDR effect is too strong, it may not be desirable as a display image in the case of a dashcam. Thus, it is preferable to make the HDR effect strong enough so that no afterimage remains.

[0437] While it is not necessary to record information that the brightness of the displayed image was switched by pressing the free button, it is preferable to record this information, as this is a key characteristic of a dashcam in terms of its evidentiary value. Specifically, for example, it is preferable to record the current brightness state of the displayed image as metadata associated with the recorded video on the storage medium 500. Then, it is preferable to configure the system to read this metadata whe...

Claims

1. The mobile body includes a display control unit that displays images acquired from a shooting unit installed on the mobile body on a display means within the mobile body. The display control unit, The image can be displayed in a first display mode and a second display mode based on user operation. A system that displays the image in a second display mode in response to receiving a specific signal while the image is being displayed in the first display mode.

2. The first display mode is a display mode in which a first display range, which is a part of the image, can be displayed on the display means. The system according to claim 1, wherein the second display mode is a display mode that allows the display means to display a second display range which is a part of the image and different from the first display range.

3. The display control unit, The image in the first display mode can be switched to the image in the second display mode in response to a user switching operation while the image in the first display mode is being displayed. The system according to claim 1, wherein the system can switch to displaying the image in the first display mode in response to the switching operation being performed while the image in the second display mode is being displayed.

4. The aforementioned imaging unit includes a first imaging unit that photographs the rear of the moving object and a second imaging unit that photographs the front of the moving object. The display control unit, The first image acquired from the first imaging unit can be displayed in the first display mode and the second display mode. The second image acquired from the second imaging unit can be displayed in a third display mode. The first display mode, the second display mode, and the third display mode can be switched according to the user's switching operation. When the first image in the first display mode is being displayed, the system switches to displaying the first image in the second display mode in response to the reception of the specific signal. The system according to claim 1, wherein, in response to receiving the specific signal while the second image of the third display mode is being displayed, the system switches to displaying the first image of the second display mode.

5. The display control unit, While the image in the second display mode is being displayed, the second display mode can be changed based on the user's operation. The system according to claim 1, wherein the system displays the image in the first display mode in response to the fulfillment of a predetermined termination condition while the image in the second display mode is being displayed, and displays the image in the second display mode as it appeared most recently when the predetermined termination condition was fulfilled, in response to the reception of the specific signal while the image in the first display mode is being displayed.

6. The system according to claim 1, wherein the display control unit can display a change operation image indicating that it is possible to change the second display mode while the image of the second display mode is being displayed.

7. The second display mode is a mode in which a portion of the image can be displayed on the display means, The display control unit, The system according to claim 1, wherein, while the image in the second display mode is being displayed, a range-indicating image indicating the range of the image displayed on the display means is displayed.

8. The display control unit, While the image in the first display mode is being displayed, the first display mode can be changed based on user operation. The system according to claim 1, wherein the system displays the image in a second display mode in response to the reception of a specific signal while the image in the first display mode is being displayed, and displays the image in the first display mode as it was when the most recent specific signal was received, in response to the fulfillment of a predetermined termination condition while the image in the second display mode is being displayed.

9. The display control unit, While the image of the first display mode is being displayed, a first suggestion image indicating that the first display mode is being displayed can be displayed. While the image of the second display mode is being displayed, a second suggestion image indicating that the second display mode is being displayed can be displayed. The system according to claim 1, wherein when displaying the image in the second display mode, the second suggestive image is emphasized and displayed in response to the reception of the specific signal.

10. The system includes a detection unit that detects a predetermined object, The display control unit, The system according to claim 1, wherein, based on the detection unit detecting a predetermined object while the image in the second display mode is being displayed, an object suggestion image is displayed superimposed on at least a portion of the image in the second display mode on the foreground side to indicate that the predetermined object has been detected.

11. The system includes a brightness acquisition unit that acquires the brightness of the image. The display control unit, The system according to claim 1, wherein the second display mode can be changed based on the brightness acquired by the brightness acquisition unit while the image in the second display mode is being displayed.

12. The second display mode is a display mode in which a predetermined display range, which is a part of the image, can be displayed on the display means. The system according to claim 1, wherein the system is capable of storing the images acquired from the imaging unit in the storage unit.

13. The second display mode is a display mode in which, from the image acquired from the imaging unit installed on the mobile body, a range based on user operation is displayed on the display means within the mobile body. The system according to claim 1, wherein the system associates the image acquired from the imaging unit with information indicating a range based on the user's operation and stores them in a storage unit so that they can be retrieved from the outside.

14. The display control unit, The reflectivity of the mirror covering the front of the display means, which transmits and reflects a portion of the light, can be changed. The display state in which the aforementioned image is displayed, In a non-glare state where the aforementioned image is hidden and the reflectance of the mirror is the first reflectance, The aforementioned image is hidden, and the mirror's reflectivity is controlled to a second reflectivity which is lower than the first reflectivity, thus preventing glare. The system according to claim 1, wherein the system transitions to the display state and displays the image in the second display mode in response to receiving the specific signal during control in the non-glare state or the anti-glare state.

15. The display means is covered on its front with a mirror that transmits and reflects a portion of the light. The display control unit, The system according to claim 1, wherein at least a portion of the image can be displayed in a predetermined display area of ​​the display means set based on user operation, while the image is hidden in areas other than the predetermined display area.

16. The system according to claim 1, wherein the display control unit can change the first display mode based on time information when displaying the image in the first display mode.

17. The system includes a detection unit that detects a predetermined object, The display control unit, The display state in which the aforementioned image is displayed, The aforementioned image can be controlled to a hidden state, and The system according to claim 1, wherein, based on the detection unit detecting the predetermined object during control in the aforementioned non-display state, the display means displays an image including the predetermined object as the image.

18. The aforementioned system, It is equipped with a control panel operated by the user, The system according to claim 1, wherein, as a function corresponding to the operation of the operation unit of 1, the user can assign a function selected from among a first function that sets matters relating to the display of the image by the display control unit and a second function different from the first function.

19. The aforementioned system, The user operates the control panel, It comprises a current location information acquisition unit that obtains the current location information of the moving object, The system according to claim 1, wherein, in response to the user operating the control unit, the display means displays a map of the area around the current location of the moving object based on the current location information.

20. The system includes a detection information acquisition unit that acquires predetermined detection information. The display control unit, The display state in which the aforementioned image is displayed, The aforementioned image can be controlled to a hidden state, and Based on the fact that the detection information acquisition unit has acquired the detection information during control in the aforementioned hidden state, the display means does not display a suggestion image that suggests the detection information. The system according to claim 1, wherein the suggestion image is displayed on the display means based on the fact that the detection information acquisition unit has acquired the detection information during control in the display state.

21. The system according to claim 1, wherein the display control unit, in response to the fact that the image is not acquired from the imaging unit, hides the image without displaying on the display means that the image is not acquired from the imaging unit.

22. A program for a computer to implement the functions of the system described in any one of claims 1 to 21.

Images