Apparatus, program, and the like
Patent Information
- Application Number
- JP2024220588
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-12-17
- Publication Date
- 2025-03-26
- Estimated Expiration
- 2038-11-29
AI Technical Summary
【0075】 本発明によれば、従来よりも優れた装置、及びプログラムを提供できる。
Smart Images

Figure 2025041711000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to, for example, an apparatus and a program. [Background technology]
[0002] 2. Description of the Related Art In recent years, various in-vehicle devices that enhance the convenience of drivers have been sold. For example, such devices include a drive recorder that is capable of capturing images using a camera. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2016-57822 A Summary of the Invention [Problem to be solved by the invention]
[0004] In recent years, dangerous driving, such as road rage, has come to be seen as a problem. In preparation for the case of being a victim of such dangerous driving, etc., there is a demand to install devices such as the above-mentioned drive recorders and cameras not only in the front but also in the rear of the vehicle in order to obtain video evidence.
[0005] However, for example, when attempting to install a drive recorder at the rear or side of a vehicle, various problems arise, such as the need for work to route wiring for the installation of such a device. Furthermore, when attempting to install a separate camera at the rear or side of a vehicle, not only the routing of wiring but also more complicated processing such as forming a hole in the vehicle body for installing the camera is required.
[0006] Therefore, an object of the present invention is to provide a device and program that are superior to conventional devices, for example, that can be easily installed and that can acquire images captured at positions such as the front, rear, left and right of the vehicle.
[0007] The purpose of the invention of this application is not limited to this, and the applicant intends to obtain rights for configurations that aim to obtain effects from parts of the configurations disclosed in this specification and drawings, etc., by filing a divisional application, amendment, etc. For example, this specification discloses a problem in which the phrase "can be" is read as "the problem is," and the applicant intends to obtain rights for configurations that solve this problem by filing a divisional application, amendment, etc. The applicant intends to include part of the configurations described in this specification in the scope of the patent claims by amendment or divisional application. [Means for solving the problem]
[0008] (1) For example, a device that is added to a vehicle that is equipped with an on-board camera and a vehicle-side device that uses images acquired from the on-board camera when shipped from the vehicle manufacturer, after the vehicle is shipped from the vehicle manufacturer, may include an acquisition unit that directly or indirectly acquires a video signal flowing between the on-board camera and the vehicle-side device, a processing unit that performs predetermined processing on the video signal acquired by the acquisition unit, and an output unit that directly or indirectly outputs the video signal acquired by the acquisition unit to the vehicle-side device that is equipped in the vehicle when shipped from the vehicle manufacturer.
[0009] In this way, the images captured by the on-board camera can be utilized not only in the vehicle device, but also in this device that is added after the vehicle is shipped from the vehicle manufacturer. In addition, the on-board camera can be used after the vehicle is shipped from the vehicle manufacturer without drilling holes or installing wires to the on-board camera. The cost of the parts for the on-board camera, the labor cost for installing the on-board camera, etc. can be minimized.
[0010] The image signal output from the on-board camera equipped in the vehicle at the time of shipment from the vehicle manufacturer and acquired by the acquisition unit is processed in a predetermined manner in the processing unit, and the image signal is output to the vehicle-side device via the output unit. In this way, the image captured by the on-board camera can be utilized not only in the vehicle-side device, but also in the device of the present invention that is added at the time of shipment from the vehicle manufacturer.
[0011] In addition, it is preferable to use the on-board camera that is equipped on the vehicle when it is shipped from the vehicle manufacturer, and to use it without having to install a new on-board camera on the vehicle after it is shipped from the vehicle manufacturer. In this way, the vehicle can be used after it is shipped from the vehicle manufacturer without having to perform processing such as drilling holes in the vehicle body to install the on-board camera, or without performing wiring work to connect to the on-board camera. It is possible to minimize the costs required for installation, such as the cost of parts for the on-board camera, the labor cost for installing the on-board camera, etc.
[0012] It is preferable to use the on-board camera that is installed in the vehicle when it is shipped from the vehicle manufacturer. In this way, the processing unit can perform a predetermined process on the video signal acquired from the on-board camera that is placed in the optimal position or environment for shooting.
[0013] It is preferable to use the on-board camera that is installed in the vehicle when it is shipped from the vehicle manufacturer. In this way, the image signal can be acquired in a substantially constant position and environment regardless of the vehicle model, and the predetermined processing can be performed in the processing unit.
[0014] The "vehicle-mounted camera" may be any camera that is equipped in the vehicle when it is shipped from the vehicle manufacturer, and may be, for example, a camera that is equipped in the vehicle as a so-called genuine product or standard equipment. Specifically, the camera in the device of the present invention may be appropriately selected from a front camera equipped in front of the vehicle, a front side view camera, a side view camera equipped on the side of the vehicle, a back camera equipped in the rear of the vehicle, a camera for an electronic rearview mirror, etc. The number of the above-mentioned "vehicle-mounted cameras" may be any number, but it is preferable to use a plurality of the various cameras described above.
[0015] Furthermore, the "vehicle-side device that is installed in the vehicle from the time of shipment from the vehicle manufacturer" may be any device that inputs a video signal, and may be, for example, equipment that is installed in the vehicle as a so-called genuine product or standard equipment, etc. Specifically, in the device of the present invention, the vehicle-side device that is installed in the vehicle from the time of shipment from the vehicle manufacturer may be, for example, an image processing device that is installed as a genuine product for processing images input from various cameras, an image synthesizing device that synthesizes multiple images, a car navigation device, a radar device, a drive recorder, an image display device such as a liquid crystal monitor, or any other suitable device.
[0016] In addition, "equipped from the time of shipment from the vehicle manufacturer" may refer to, for example, a standard genuine part provided on the vehicle, or a so-called manufacturer option that is installed by the vehicle manufacturer at the time of manufacturing the vehicle in response to the user's request, etc. Meanwhile, "equipment added after shipment from the vehicle manufacturer" may refer to, for example, equipment provided for retrofitting to the vehicle after shipment from the vehicle manufacturer at a car shop or the like, or a part that is installed at a car dealer or the like in response to the user's request after shipment from the vehicle manufacturer, etc.
[0017] In addition, the "video signal flowing between the vehicle-mounted camera and the vehicle-side device" refers to an electrical signal related to the image captured by the vehicle-mounted camera, and refers to all video signals flowing between the vehicle-mounted camera and the vehicle-side device via a communication line, such as a CAN or LAN, whether wired or wireless. There are no limitations on the type of line through which the video signal flows or the type of the video signal.
[0018] The "acquisition unit" may directly acquire the video signal flowing between the vehicle-mounted camera and the vehicle-side device, or may indirectly acquire the video signal. For example, the acquisition unit may be directly connected to a communication line connecting the vehicle-mounted camera and the vehicle-side device by wire or wirelessly, and acquire the video signal. Also, the acquisition unit may be indirectly connected to the communication line connecting the vehicle-mounted camera and the vehicle-side device via, for example, another device.
[0019] The "processing unit" may be any unit that performs a predetermined process on the video signal acquired by the acquiring unit. The predetermined process performed by the processing unit may be any unit, but may be, in particular, a recording process for recording the video signal, a communication process for communicating the video signal with other devices, a process for displaying the video signal on a display device such as a monitor, or the like.
[0020] The "output unit" may be any unit that directly or indirectly outputs the video signal acquired by the acquisition unit to a vehicle-side device that is installed in the vehicle when it is shipped from the vehicle manufacturer. For example, the output unit may be directly connected to a communication line that connects the vehicle-side device with the video signal output, either via a wired or wireless communication line or indirectly connected to the communication line that connects the vehicle-side device with the video signal output, for example, via another device.
[0021] (2) For example, the vehicle-side device may be equipped with a device capable of outputting a processed video signal obtained by processing a video signal, and by inputting the processed video signal to the acquisition unit, a predetermined processing may be performed on the processed video signal in the processing unit.
[0022] In this way, the processing unit can perform predetermined processing not only on the video signal acquired from the vehicle-mounted camera in the acquisition unit, but also on the processed video signal obtained by processing in the vehicle-side device. This makes it possible to utilize not only the video signal acquired from the vehicle-mounted camera, but also the processed video signal obtained by processing in the vehicle-side device.
[0023] The "predetermined processing" performed on the processed video signal in the processing unit may be any type of processing, but may in particular be a recording process for recording the processed video signal, a communication process for communicating the processed video signal with other devices, or a process for displaying the processed video signal on a display device such as a monitor.
[0024] (3) For example, a video signal output from an on-board camera mounted on a vehicle may be acquired by the acquisition unit without being processed, and may be made processable by the processing unit.
[0025] In this way, the video signal output from the on-board camera equipped in the vehicle at the time of shipment from the vehicle manufacturer can be acquired without processing and utilized for processing in the processing unit. In particular, the video signal output from one or more cameras, such as a front camera, a front side view camera, a side view camera, a back camera, a camera for an electronic rearview mirror, etc., can be directly processed in the processing unit for, for example, recording, communication with other devices, or display on a display device such as a monitor.
[0026] "The video signal output from the vehicle-mounted camera is acquired by the acquisition unit in its unprocessed form" preferably means acquiring the video signal obtained by the vehicle-mounted camera itself without performing any processing, such as synthesis of the video signal or cutting out part of the video signal.
[0027] (4) For example, a part or all of the processing in the processing section may be either or both of recording the video signal and outputting it to the outside via communication.
[0028] In this way, the video signal output from the on-board camera equipped in the vehicle at the time of shipment from the vehicle manufacturer can be recorded and output to the outside via communication. The video signal output from the on-board camera can be used not only in the vehicle side device equipped in the vehicle at the time of shipment from the vehicle manufacturer, but also for other purposes such as recording and utilizing in a recording unit or outputting and utilizing to the outside via communication.
[0029] "Part or all of the processing in the processing unit is recording the video signal or outputting it to the outside by communication" may include, in addition to recording the video signal or outputting it to the outside, processing in the processing unit such as display processing for displaying the video signal on a display device, etc.
[0030] (5) For example, it may be provided with a communication unit that can be connected to a communication line, and may perform at least one of the following processes: a process of outputting part or all of the video signal acquired by the acquisition unit directly via the communication unit, a process of processing part or all of the video signal acquired by the acquisition unit in a processing unit and outputting the processed part or all of the video signal acquired by the acquisition unit in real time via the communication unit, or a process of temporarily storing the processed part or all of the video signal acquired by the acquisition unit in a processing unit and then outputting the processed part or all of the video signal via the communication unit.
[0031] In this way, for example, a process of outputting the video signal acquired in the acquisition unit as it is through the communication unit, a process of processing the video signal acquired in the acquisition unit in the processing unit and outputting it in real time through the communication unit, a process of storing the processed signal through the processing unit and then outputting it through the communication unit, etc. can be performed. For example, by making it possible to perform a process of outputting the video signal acquired in the acquisition unit as it is through the communication unit, the video signal acquired by the vehicle-mounted camera can be used as it is in other devices, etc., which are the output destinations of the video signal. In addition, for example, by making it possible to process the video signal acquired in the acquisition unit in the processing unit and output it in real time through the communication unit, the video signal processed by the processing unit can be used in real time in other devices, etc., which are the output destinations of the video signal. In addition, for example, by making it possible to perform a process of storing the processed signal in the processing unit and then outputting it through the communication unit, the video signal processed in the processing unit can be stored, and the stored video signal can be used in other devices, etc., which are the output destinations of the video signal.
[0032] "A portion of the video signal acquired by the acquisition unit" may refer to, for example, a video signal acquired from a portion of a plurality of vehicle-mounted cameras among the video signals acquired by the acquisition unit.
[0033] "Processing of all or part of the video signal acquired by the acquisition unit in a processing unit and outputting it in real time via the communication unit" may mean, for example, performing a recording process for recording the video signal, a process for cutting out the video signal, a process for adjusting the brightness, color tone, hue, etc. of the video signal in the processing unit, and outputting the video signal obtained by the processing in real time via the communication unit.
[0034] (6) For example, it is preferable that a media connection unit capable of connecting to an external medium is provided, and that a part or all of the video signal processed in the processing unit can be output via the media connection unit.
[0035] In this way, a part or all of the video signal processed in the processing unit can be output to an external medium via the media connection unit, which makes it possible to record, for example, a part or all of the video signal processed in the processing unit on the external medium.
[0036] The "external media" may be any suitable medium, such as an SD card, a microSD card, a USB flash memory, a hard disk, a recordable CD, or a recordable DVD.
[0037] (7) For example, the vehicle-mounted camera may be disposed outside the vehicle cabin.
[0038] In this way, it is possible to obtain video signals captured at angles and positions that are difficult to obtain using a camera installed inside the vehicle.
[0039] (8) For example, the video signal may be processed in the processing unit using output information from a specific sensor that is equipped on the vehicle from the time of shipment from the vehicle manufacturer to sense the surroundings of the vehicle as a trigger.
[0040] In this way, the output signal of the sensor, which is equipment installed in the vehicle from the time of shipment from the vehicle manufacturer to sense the surroundings of the vehicle, can be utilized as a trigger for processing the video signal in the processing unit. Therefore, it is not necessary to provide a detection device such as a sensor in the vehicle after shipment from the vehicle manufacturer in order to obtain a trigger for processing the video signal in the processing unit. Therefore, it is possible to use the vehicle without performing processing such as drilling holes in the vehicle body to install the sensor, or without performing wiring work connected to the sensor. Therefore, it is possible to minimize the cost required for installation, such as the cost of parts for the sensor, the labor cost for installing the sensor, etc.
[0041] It is preferable to use the sensor that is equipped on the vehicle when it is shipped from the vehicle manufacturer. In this way, the video signal can be processed in the processing unit based on the output signal output from the sensor that is placed in a position or environment that is optimal for shooting.
[0042] It is preferable to use the sensors that are equipped in the vehicle when it is shipped from the vehicle manufacturer. In this way, video signals can be obtained at approximately the same position and environment regardless of the vehicle model, and the specified processing can be performed in the processing unit.
[0043] The "sensor" may be any sensor that is equipped in the vehicle when it is shipped from the vehicle manufacturer, but it is particularly preferable to use a sensor that is equipped in the vehicle as a so-called genuine product or standard equipment. The sensor may be selected appropriately from, for example, a front side sensor, a front sensor, a back side sensor, a back sensor, etc., used in clearance sonar, back sonar, intelligent clearance sonar, etc. The number of the above-mentioned "sensors" may be any number, but it is preferable to use a plurality of the various sensors described above.
[0044] (9) For example, the vehicle may execute a danger avoidance operation to avoid danger on condition that a predetermined condition is satisfied, and the video signal may be processed in the processing unit based on a signal that triggers the execution of the danger avoidance operation.
[0045] In this way, when the vehicle performs a danger avoidance operation, the video signal can be subjected to predetermined processing, such as a recording process for recording the video signal, a communication process for communicating the video signal with other devices, and a process for displaying the video signal on a display device such as a monitor. It is preferable to use a signal that serves as an execution trigger for the vehicle to perform a danger avoidance operation as a trigger for executing processing in the processing unit. For example, without providing a device for determining whether or not the situation requires danger avoidance, the processing unit can perform predetermined processing on the video signal in the situation requires danger avoidance, which can simplify the device configuration and operation accordingly.
[0046] It should be noted that "danger avoidance actions to avoid danger" may be any appropriate action, such as tightening a seat belt in preparation for a collision with another vehicle, deploying an airbag, automatically activating the brakes to avoid a collision, or activating the anti-lock braking system (ABS).
[0047] (10) For example, the video signal output from the output unit may be disposed adjacent to the vehicle-side device to which the video signal is input.
[0048] In this way, the distance between the present device and the vehicle-side device can be minimized. As a result, for example, when the output unit and the vehicle-side device are connected by wire, the wiring for connection can be minimized. As a result, for example, the decrease in communication speed and deterioration in quality of the video signal transmitted from the present device to the vehicle-side device can be minimized. Also, for example, when the output unit and the vehicle-side device are connected wirelessly, the possibility of communication failure, decrease in communication speed, deterioration in video quality, etc. can be minimized.
[0049] (11) For example, the vehicle-side device may be an image synthesizing device that synthesizes image signals output from a plurality of vehicle-mounted cameras to form a composite image.
[0050] In this way, the image output from the vehicle-mounted camera to form a composite image in the vehicle-side device can be acquired by the acquisition unit before being input to the vehicle-side device, and processed by the processing unit. As described above, the device includes an output unit, and the image signal acquired by the acquisition unit can be output directly or indirectly to the vehicle-side device that is installed in the vehicle when shipped from the vehicle manufacturer. In this way, the image signal output from the vehicle-mounted camera can also be output to the vehicle-side device to form a composite image.
[0051] The "image synthesis device that synthesizes image signals output from multiple vehicle-mounted cameras to form a composite image" may be, for example, a device that forms a composite image to convey the situation around the vehicle to assist in parking the vehicle, etc.
[0052] (12) For example, a vehicle model setting section may be provided that can change settings according to the vehicle model, and by changing the settings of the vehicle model setting section, processing according to the settings may be performed.
[0053] In this way, the device of the present invention can be used in various vehicle models according to the settings in the vehicle model setting section, so there is no need to prepare a different device for each vehicle model.
[0054] The "vehicle type setting section" may be, for example, a mechanically changeable switch such as a so-called DIP switch, or an electrically or electronically changeable switch.
[0055] (13) For example, some or all of the vehicle-side device may be an image display device capable of receiving the video signal and displaying an image, may have a driving state discrimination means for discriminating the driving state of the vehicle, may be capable of switching the display form of an image on the image display device according to the driving state, and may be capable of recording the display form selected when the image was displayed on the image display device.
[0056] Depending on the driving state determined by the driving state determination means, the display form of the image on the image display device constituting the vehicle side device can be switched and the display form in which the image was displayed can be recorded. For example, it is advisable to record in association with the driving state and the situation in which the vehicle was in. The recorded data obtained in this manner can be effectively used, for example, for identifying and analyzing the cause of an accident. For example, it is advisable to record in association with the situation around the vehicle when the driving state of the vehicle is set in reverse gear.
[0057] (14) For example, a part or all of the vehicle-side device may be an image display device capable of receiving the video signal and displaying an image, have a driving state discrimination means for discriminating the driving state of the vehicle, be capable of switching the display form of an image on the image display device according to the driving state, and record the display form selected when the image was displayed on the image display device and time information.
[0058] Depending on the driving state determined by the driving state determination means, the display form of the image on the image display device constituting the vehicle side device can be switched, and the display form in which the image was displayed and time information can be recorded. In addition, by recording the display form in which the image was displayed together with the time information, it is possible to record when and in what situation the vehicle was in in association with each other. The recorded data obtained in this manner can be effectively used, for example, for identifying and analyzing the cause of an accident. For example, when the driving state of the vehicle is set in reverse gear, it is preferable to record the surrounding situation of the vehicle and the time information in association with each other.
[0059] (15) For example, in addition to the video signal output from the on-board camera, a video signal output from an additional camera that is added to the vehicle after shipping from the vehicle manufacturer, separate from the on-board camera, can be acquired by the acquisition unit and processed by the processing unit, and predetermined processing can be performed by distinguishing between the video acquired by the additional camera and the video acquired by the on-board camera.
[0060] Not only the video signal output from the on-board camera, but also the video signal output from the additional camera added to the vehicle after shipping from the vehicle manufacturer can be acquired and processed in the processing unit. For example, when it is desired to acquire more video signals than can be acquired by the on-board camera installed in the vehicle at the time of shipping from the vehicle manufacturer, an additional camera can be added to the vehicle after shipping from the vehicle manufacturer, and the video signal acquired by the additional camera can be used. The video acquired by the additional camera can be distinguished from the video acquired by the on-board camera and a predetermined process can be performed. Therefore, for example, the video acquired by the additional camera can be used in various forms, such as using it for a purpose other than the video acquired by the on-board camera, or using it by adding another image processing.
[0061] It should be noted that "an additional camera added to the vehicle after it has been shipped from the vehicle manufacturer" may refer to, for example, a camera that is added to a vehicle shipped from the vehicle manufacturer in response to a user's request, such as a so-called dealer option, or a camera that is purchased and added at a so-called car shop, etc.
[0062] Furthermore, the "predetermined processing" performed in the processing unit may be anything, but may be, for example, a recording process for recording a video signal, a communication process for communicating the video signal with other devices, or a process for displaying the video signal on a display device such as a monitor.
[0063] (16) For example, it is preferable to include a safety evaluation unit that evaluates the safety of driving based on the video signal processed by the processing unit.
[0064] In this way, the evaluation of driving safety can be performed in the device of the present invention, which can reduce the load on other devices for evaluating driving safety, and can be useful for contributing to the realization of edge computing, for example.
[0065] (17) For example, the device may include a calculation unit that performs a predetermined calculation process based on the video signal processed in the processing unit, and a communication unit that can be connected to a communication line, and the calculation result by the calculation unit may be output via the communication unit.
[0066] In this way, the calculation unit can perform a predetermined calculation process based on the video signal in the device, and the calculation result can be output via the communication unit. This can reduce the load on other devices, etc., for performing a predetermined calculation process based on the video signal, and can be useful for contributing to the realization of edge computing, for example.
[0067] (18) The vehicle may be equipped with a safety evaluation unit that evaluates the safety of driving based on the video signal processed in the processing unit, and a communication unit that can be connected to a communication line, and it is preferable that the evaluation results by the safety evaluation unit can be output via the communication unit at predetermined intervals.
[0068] In this way, the evaluation of the driving safety based on the video signal can be performed in the present device, and the processing for the safety evaluation can be performed without imposing a burden on other devices, etc. Also, by outputting the evaluation result by the safety evaluation unit via the communication unit at predetermined intervals as described above, the communication load can be reduced compared to the case where the evaluation result is constantly output.
[0069] (19) For example, it is preferable to have a safety evaluation unit that evaluates the safety of driving based on the video signal processed in the processing unit, and an insurance premium derivation unit that derives an insurance premium for insurance that covers damage occurring in conjunction with driving of the vehicle based on the evaluation result by the safety evaluation unit.
[0070] In this way, in addition to evaluating the driving safety based on the video signal, the device can also derive the insurance premium based on the evaluation result. This allows the processes for safety evaluation and insurance premium derivation to be performed without placing a burden on other devices.
[0071] (20) The vehicle-side device may be, for example, one of the devices described in (1) to (19) above.
[0072] This eliminates the need to provide the above-mentioned device separately from the vehicle-side device, which contributes to making the device configuration more compact and simple.
[0073] (21) The program may be for causing a control means to execute the functions of the device described in any one of (1) to (20) above.
[0074] The above-mentioned configurations are examples, and may be partially expanded or partially limited. Also, the configurations may be combined within a range in which there is no contradiction. For example, the above-mentioned inventions (1) to (21) may be arbitrarily combined. Also, for example, the invention may not have all or a part of the configuration (1), but may have at least one of the other configurations (2) to (21). However, in particular, it is preferable to have all or a part of the configuration (1) and combine it with at least one of the configurations (2) to (21). Also, any component may be extracted from at least one of the configurations (1) to (21) and combined. The applicant of the present application intends to obtain patent rights for such configurations as well. Effect of the Invention
[0075] According to the present invention, it is possible to provide an apparatus and a program that are superior to conventional ones. [Brief description of the drawings]
[0076] [Figure 1] 1 is a schematic diagram showing the configuration of a vehicle equipped with a drive recorder according to an embodiment of the present invention; [Diagram 2] FIG. 1 is a schematic diagram showing a system configuration that is provided in a vehicle at the time of shipment from a vehicle manufacturer, before a drive recorder according to an embodiment of the present invention is installed. [Diagram 3]1 is a system schematic diagram showing a state in which a drive recorder according to an embodiment of the present invention is mounted on a vehicle. [Figure 4] FIG. 11 is a system schematic diagram showing a state in which a drive recorder according to a first modified example is mounted on a vehicle. [Diagram 5] FIG. 11 is a system schematic diagram showing a state in which a drive recorder according to a second modified example is mounted on a vehicle. [Figure 6] FIG. 13 is a system schematic diagram showing a state in which a drive recorder according to a third modified example is mounted on a vehicle. [Figure 7] FIG. 13 is a system schematic diagram showing a state in which a drive recorder according to a fourth modified example is mounted on a vehicle. [Figure 8] FIG. 13 is a system schematic diagram showing a state in which a drive recorder according to a fifth modified example is mounted on a vehicle. [Figure 9] FIG. 13 is a system schematic diagram showing a state in which a drive recorder according to a sixth modified example is mounted on a vehicle. [Figure 10] FIG. 13 is a system schematic diagram showing a state in which a drive recorder according to a seventh modified example is mounted on a vehicle. [Figure 11] 10 is an image diagram showing an example of a display form of an image obtained by an in-vehicle camera or the like on a vehicle-side image display device. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0077] Next, a drive recorder 10 as an embodiment of the device of the present invention, a program used in the drive recorder 10, and a vehicle 100 equipped with the drive recorder 10 will be described in detail with reference to the drawings. In the following description, prior to describing the drive recorder 10, characteristic parts of the vehicle 100 will be described.
[0078] 1 and 2, the vehicle 100 is equipped with an on-board camera 110, a vehicle-side image synthesizer 130, a sensor 150, etc. The on-board camera 110, the vehicle-side image synthesizer 130, the vehicle-side image display 140, the sensor 150, etc. are mounted on the vehicle 100 at the time of shipment from the vehicle manufacturer, and are, for example, genuine standard equipment, or so-called manufacturer options, which are installed by the vehicle manufacturer at the time of manufacturing the vehicle in response to a user's request.
[0079] The on-board camera 110 is a camera disposed outside the cabin of the vehicle 100. The on-board camera 110 can capture images at various parts of the vehicle 100 and output the images as video signals. The on-board camera 110 is mounted, for example, as a camera for acquiring images to be shown to the driver of the vehicle 100, or as a sensing camera used for automatic driving, collision prevention operation, and the like. As cameras for acquiring images to be shown to the driver of the vehicle 100, the vehicle 100 is equipped with, for example, a front camera 112, a front side view camera 114, side view cameras 116L and 116R, a back camera 118, and an electronic rearview mirror camera 120.
[0080] The front camera 112 is a camera mounted in front of the vehicle 100 and captures an image in front of the vehicle 100. The front side view camera 114 is a camera mounted in front of the vehicle 100 and captures an image in front of the vehicle 100. The side view cameras 116L and 116R are cameras mounted on the left and right sides of the vehicle 100, respectively. The back camera 118 is a camera mounted in the rear of the vehicle 100 and captures an image in the rear of the vehicle 100. The electronic rearview mirror camera 120 is a camera that captures an image to be displayed on an electronic rearview mirror arranged in the vehicle cabin. The vehicle 100 also includes a sensing camera 122 as an in-vehicle camera used for automatic driving, collision prevention operation, and the like.
[0081] The vehicle-side image synthesizer 130 is a device that uses images acquired from the vehicle-mounted camera 110. Like the vehicle-mounted camera 110, the vehicle-side image synthesizer 130 is installed in the vehicle at the time of shipment from the vehicle manufacturer. The vehicle-side image synthesizer 130 is connected to the vehicle-mounted camera 110 via a communication line 132, which may be a wired line such as a CAN or a wireless line. The vehicle-side image synthesizer 130 can acquire a video signal output from the vehicle-mounted camera 110 and flowing through the communication line 132.
[0082] The vehicle-side image synthesizer 130 is a device that synthesizes image signals output from multiple vehicle-mounted cameras to form a composite image. The vehicle-side image synthesizer 130 is, for example, a device that forms a composite image to convey the situation around the vehicle in order to assist in parking the vehicle, etc. The vehicle-side image synthesizer 130 can output the image signal that forms the composite image.
[0083] The vehicle-side image display 140 is composed of, for example, a dedicated device for displaying images such as a liquid crystal monitor, or a display device such as a liquid crystal monitor provided in association with a device such as a car navigation device, a radar device, or a drive recorder. The vehicle-side image display 140 can acquire and display the image signal output from the vehicle-mounted camera 110 and the image signal forming the composite image output from the vehicle-side image synthesizer 130. The image to be displayed on the vehicle-side image display 140 can be switched by an image changeover switch 142 provided in the vehicle 100. The image changeover switch 142 can be a dedicated switch, a switch displayed on the panel of the car navigation system, or the like.
[0084] The sensor 150 is equipped to sense the surroundings of the vehicle 100. The sensor 150 may be, for example, a front side sensor, a front sensor, a back side sensor, a back sensor, etc. used in a clearance sonar, a back sonar, an intelligent clearance sonar, etc. The sensor 150 can output a detection signal when it detects the presence of another vehicle, a person, a building, etc. in the vicinity of the vehicle 100. Any number of sensors 150 may be attached to the vehicle 100, but it is preferable that a plurality of various types of sensors are provided.
[0085] The vehicle 100 is capable of performing a danger avoidance operation to avoid danger, provided that certain conditions are satisfied. As the danger avoidance operation, the vehicle 100 is capable of performing, for example, an operation to tighten a seat belt in preparation for a collision with another vehicle or the like, an operation to activate an airbag, an operation to automatically activate the brakes to avoid a collision, an operation to activate an antilock brake system (ABS), and the like.
[0086] Furthermore, the vehicle 100 can be equipped with an additional camera 160 in addition to the above-described vehicle-mounted camera 110. The additional camera 160 is a camera that is added to the vehicle 100 after the vehicle 100 is shipped from the vehicle manufacturer. The additional camera 160 can be, for example, a camera provided for retrofitting to a vehicle shipped from the vehicle manufacturer at a car shop or the like, or a camera that is attached at a car dealer or the like according to a user's request after the vehicle is shipped from the vehicle manufacturer.
[0087] 2 and 3, the drive recorder 10 is a device that is added to the vehicle 100 after it is shipped from the vehicle manufacturer. The drive recorder 10 can be installed in any position within the vehicle 100, and may be placed, for example, adjacent to the vehicle-side image synthesizer 130. As shown in Fig. 3, the drive recorder 10 includes an acquisition unit 20, a processing unit 30, and an output unit 40. In addition to these components, the drive recorder 10 includes a communication unit 50 and a media connection unit 60.
[0088] The acquisition unit 20 acquires the video signal flowing between the vehicle-mounted camera 110 and the vehicle-side image synthesizer 130. The acquisition unit 20 acquires the video signal obtained by the vehicle-mounted camera 110 as it is without processing the video signal such as synthesis processing or processing such as cutting out a part of the video signal. The acquisition unit 20 has a plurality of input terminals 22 for acquiring the video signal. In the example shown in FIG. 2, five terminals consisting of input terminals 22a to 22e are provided. The input terminal 22a is a terminal for connecting an input cable 72a connected to the front camera 112 or the front side-view camera 114. Similarly, the input terminal 22b is a terminal for connecting an input cable 72b connected to the side-view camera 116L, the input terminal 22c is a terminal for connecting an input cable 72c connected to the side-view camera 116R, and the input terminal 22d is a terminal for connecting an input cable 72d connected to the rearview camera 118 or the electronic rearview mirror camera 120. The input terminal 22e is a terminal for connecting an input cable 72e that is connected to the vehicle side image synthesizer 130.
[0089] The processing unit 30 performs a predetermined process on the video signal acquired by the acquisition unit 20. The processing unit 30 includes a recording processing device 30a for realizing a function of recording the video signal acquired by the acquisition unit 20 (video recording function), a communication processing device 30b for performing communication processing for outputting the video signal to other devices, and an image synthesizing device 30c for synthesizing images for displaying the video signal on a display device such as the vehicle-side image display 140 or a separately provided monitor.
[0090] The output unit 40 can output the video signal acquired by the acquisition unit 20 directly to the vehicle-side image synthesizer 130, which is a vehicle-side device equipped in the vehicle 100 when shipped from the vehicle manufacturer, or indirectly via other devices. The output unit 40 has a plurality of output terminals 42 for outputting video signals. In the example shown in FIG. 11, five terminals consisting of output terminals 42a to 42e are provided. The output terminal 42a is a terminal for connecting an output cable 74a for outputting a video signal acquired from the front camera 112 or the front side-view camera 114. Similarly, the output terminal 42b is a terminal for connecting an output cable 74b for outputting a video signal acquired from the side-view camera 116L, the output terminal 42c is a terminal for connecting an output cable 74c for outputting a video signal acquired from the side-view camera 116R, and the output terminal 42d is a terminal for connecting an output cable 74d for outputting a video signal acquired from the rearview camera 118 or the electronic rearview mirror camera 120. The output terminal 42e is a terminal for connecting an output cable 74e which is connected to the vehicle-side image display 140. The image displayed on the vehicle-side image display 140 by outputting an image signal from the output terminal 42e can be switched by the image changeover switch 44.
[0091] The communication unit 50 is connectable to a communication line. The communication unit 50 can perform processing to directly output a part or all of the video signal acquired by the acquisition unit 20. The communication unit 50 includes a communication circuit that can connect to and communicate with a communication line consisting of various mobile communication standards such as LTE (Long Term Evolution), 3G, 4G, and 5G. The drive recorder 10 can transmit and receive data via the communication unit 50 to and from a cloud computer, a server, or the like that is accessible from a client terminal such as a user's smartphone or personal computer.
[0092] The media connection unit 60 is connectable to an external medium. The external medium connectable to the media connection unit 60 may be, for example, an SD card, a microSD card, a USB flash memory, a hard disk, a recordable CD, a recordable DVD, or the like. The media connection unit 60 has a function of outputting a part or all of the video signal processed by the processing unit 30 to the external medium and writing information to the external medium.
[0093] The drive recorder 10 is installed in the vehicle 100 by connecting the front camera 112, the front side view camera 114, the side view cameras 116L and 116R, the rear camera 118, the electronic rearview mirror camera 120, and the vehicle-side image synthesizer 130 so that video signals can be communicated using the cables and the cable harness 70 that have been used in the vehicle 100 since the shipping stage of the vehicle manufacturer. Specifically, the input cables 72a to 72e are those that have been used in the vehicle 100 since the shipping stage of the vehicle manufacturer to connect the in-vehicle cameras 110, such as the front camera 112, the front side view camera 114, the side view cameras 116L and 116R, the rear camera 118, and the electronic rearview mirror camera 120, to the vehicle-side image synthesizer 130. The cable harness 70 is a bundle of the output cables 74a to 74e, and is used to connect the drive recorder 10 and the vehicle-side image synthesizer 130. In order to ensure the quality of the video signal, the cable harness 70 is made capable of communicating a video signal with substantially the same quality or higher than that used in the vehicle 100 from the time of shipment from the vehicle manufacturer.
[0094] The drive recorder 10 uses video signals transmitted from the on-board cameras 110, such as the front camera 112, the front side view camera 114, the side view cameras 116L and 116R, the rearview camera 118, and the electronic rearview mirror camera 120, which are mounted on the vehicle 100 from the time of shipment from the vehicle manufacturer, and the vehicle-side image synthesizer 130, to enable recording and automatic transmission of video of approximately the entire circumference (approximately 360 degrees) of the vehicle 100. Specifically, the drive recorder 10 can acquire, in the acquisition unit 20, video signals transmitted from the various on-board cameras 110 and the vehicle-side image synthesizer 130, which are mounted on the vehicle 100 from the time of shipment from the vehicle manufacturer. The drive recorder 10 also performs a process of recording the video signals acquired by the acquisition unit 20 through processing by the processing unit 30. In addition, the drive recorder 10 can perform communication processing to communicate with other devices other than the drive recorder 10, such as outputting video signals acquired from various vehicle-mounted cameras 110 to the vehicle-side image synthesizer 130 by the processing unit 30, and outputting video signals acquired from various vehicle-mounted cameras 110 and the vehicle-side image synthesizer 130 to the vehicle-side image display 140. In addition, the drive recorder 10 can transmit information such as video signals acquired from various vehicle-mounted cameras 110 and the vehicle-side image synthesizer 130 by connecting to a communication line via the communication unit 50. In addition, the drive recorder 10 can transmit information such as video signals acquired from various vehicle-mounted cameras 110 and the vehicle-side image synthesizer 130 to the external media by connecting to an external media via the media connection unit 60.
[0095] In addition, the drive recorder 10 can display the images obtained by each vehicle-mounted camera 110 on the vehicle-side image display 140 via the output terminal 42e in various forms. For example, as shown in FIG. 11, a plurality of display frames can be provided on the vehicle-side image display 140, and images obtained from the vehicle-mounted camera 110 and the additional camera 160 can be displayed in each display frame. For example, as shown in FIG. 11, images can be displayed in such a form that an image obtained by the additional camera 160 is displayed in the first frame, an image on the left side of the vehicle 100 is displayed in the second frame, an image on the right side of the vehicle 100 is displayed in the third frame, an image in front of the vehicle 100 is displayed in the fourth frame, an image on the rear of the vehicle 100 is displayed in the fifth frame, and an image of the entire circumference of the vehicle 100 obtained by a composition process by the vehicle-side image composition device 130 is displayed in the sixth frame.
[0096] As described above, the drive recorder 10 of this embodiment performs predetermined processing in the processing unit 30 on the video signal output from the on-board camera 110 equipped on the vehicle 100 at the time of shipment from the vehicle manufacturer and acquired in the acquisition unit 20, and can output the video signal to the vehicle-side image synthesizer 130 via the output unit 40. This allows the video captured by the on-board camera 110 to be utilized not only in the vehicle-side image synthesizer 130, but also in the drive recorder 10 of this embodiment that is added at the time of shipment from the vehicle manufacturer.
[0097] In addition, the drive recorder 10 of this embodiment uses the on-board camera 110 that is equipped on the vehicle 100 when it is shipped from the vehicle manufacturer, and can be used without installing a new on-board camera 110 on the vehicle 100 after it is shipped from the vehicle manufacturer. Therefore, the drive recorder 10 of this embodiment can be used on the vehicle 100 after it is shipped from the vehicle manufacturer without performing processing such as drilling holes in the body of the vehicle 100 for installing the on-board camera 110, or without performing wiring work connected to the on-board camera 110. Therefore, the drive recorder 10 of this embodiment can minimize the costs required for installation, such as the cost of parts for the on-board camera 110, the labor cost for installing the on-board camera 110, etc.
[0098] Furthermore, since the drive recorder 10 of this embodiment uses the on-board camera 110 that is equipped on the vehicle 100 when shipped from the vehicle manufacturer, the processing unit 30 can perform predetermined processing on the video signal obtained from the on-board camera 110 that is placed in a position or environment that is optimal for shooting.
[0099] In addition, since the drive recorder 10 of this embodiment uses the onboard camera 110 that is equipped on the vehicle 100 when shipped from the vehicle manufacturer, as long as the vehicle is of the same model, it can acquire video signals at approximately the same position and environment, etc., regardless of the vehicle 100, and perform the specified processing in the processing unit 30.
[0100] In the drive recorder 10 of this embodiment, the "vehicle-mounted camera 110" may be, for example, a camera that is equipped on the vehicle 100 as a so-called genuine product or standard equipment. Specifically, an appropriate camera may be selected from the front camera 112 exemplified in this embodiment, the front side-view camera 114, the side-view cameras 116L and 116R, the rearview camera 118, the electronic rearview mirror camera 120, etc. The number of the above-mentioned "vehicle-mounted cameras 110" may be any number, but it is preferable to use a plurality of the various cameras described above.
[0101] In addition, in this embodiment, the vehicle-side image synthesis device 130 is given as an example of "vehicle-side equipment that is equipped in the vehicle 100 from the time of shipment from the vehicle manufacturer," but any other appropriate device can be used, such as an image processing device that is equipped as an original product for processing images input from various cameras, such as applying effects to the images, a car navigation device, a radar device, a drive recorder, an image display device such as an LCD monitor, etc.
[0102] In addition, "equipped from the time of shipment from the vehicle manufacturer" includes, for example, a standard genuine part provided on the vehicle 100, or a so-called manufacturer option that is installed by the vehicle manufacturer at the time of manufacturing the vehicle 100 in response to a user's request. On the other hand, "devices added after shipment from the vehicle manufacturer" includes, for example, a drive recorder 10 provided for retrofitting to the vehicle 100 after shipment from the vehicle manufacturer at a car shop or the like, and parts that are installed at a car dealer or the like in response to a user's request after shipment from the vehicle manufacturer.
[0103] In this embodiment, the "video signal flowing between the vehicle-mounted camera 110 and the vehicle-side image synthesizer 130" refers to an electrical signal related to the video captured by the vehicle-mounted camera 110. In this embodiment, an example is shown in which the video signal flows between the vehicle-mounted camera 110 and the vehicle-side image synthesizer 130 via a communication system established by wire between the vehicle-mounted camera 110 and the vehicle-side image synthesizer 130, but the present invention is not limited to this, and the video signal may flow between the vehicle-mounted camera 110 and the vehicle-side image synthesizer 130 via a communication system established by wireless.
[0104] In addition, in this embodiment, the acquisition unit 20 directly acquires the video signal flowing between the vehicle-mounted camera 110 and the vehicle-side image synthesizer 130, but the present invention is not limited to this, and the acquisition unit 20 may indirectly acquire the video signal flowing between the vehicle-mounted camera 110 and the vehicle-side image synthesizer 130. For example, the acquisition unit 20 may be indirectly connected to a communication line that connects the vehicle-mounted camera 110 and the vehicle-side image synthesizer 130 by wire or wirelessly, for example, via another device.
[0105] In this embodiment, the processing unit 30 performs a recording process for recording a video signal, but the processing unit 30 may perform a predetermined process on the video signal acquired by the acquisition unit 20, and is not limited to the example shown in this embodiment. In addition to or instead of the recording process for recording the video signal, the processing unit 30 may perform a communication process for communicating the video signal with other devices, a process for displaying the video signal on a display device such as a monitor, and the like.
[0106] In addition, in this embodiment, the output unit 40 outputs the video signal acquired by the acquisition unit 20 directly to the vehicle-side image synthesizer 130 that is equipped in the vehicle 100 at the time of shipment from the vehicle manufacturer, but may indirectly output the video signal to the vehicle-side image synthesizer 130 via other equipment, etc. In addition, in the present embodiment, an example in which the output unit 40 and the vehicle-side image synthesizer 130 are connected by wire has been shown, but the present invention is not limited to this, and they may be connected wirelessly.
[0107] The drive recorder 10 of this embodiment is equipped with, for example, a vehicle-side image synthesizer 130 capable of outputting a processed image signal obtained by processing an image signal, and by inputting the processed image signal to the acquisition unit 20, the processed image can be recorded in the processing unit 30. With this configuration, not only the image signal acquired by the acquisition unit 20 from the vehicle-mounted camera 110, but also the processed image signal obtained by processing in the vehicle-side image synthesizer 130 can be recorded and processed in the processing unit 30.
[0108] In this embodiment, a recording process for recording the processed video signal has been exemplified as the process performed in the processing unit 30 by inputting the processed video signal to the acquisition unit 20, but the present invention is not limited to this. In addition to or instead of the above-mentioned recording process, the process performed in the processing unit 30 can be a communication process for communicating the processed video signal with other devices, a process for displaying the processed video signal on a display device such as a monitor, etc.
[0109] The drive recorder 10 of this embodiment can acquire the video signal output from the onboard camera 110 equipped on the vehicle 100 without processing it in the acquisition unit 20, and perform recording processing in which the signal is recorded in the processing unit 30, and processing in which the signal is displayed on the vehicle-side video display unit 140, etc.
[0110] The drive recorder 10 of this embodiment acquires the video signal output from the vehicle-mounted camera 110 in an unprocessed form at the acquisition unit 20, and acquires the video signal itself obtained by the vehicle-mounted camera 110 without performing processing such as synthesis of the video signal or processing such as cutting out a part of the video signal, but the present invention is not limited to this. For example, the drive recorder 10 may acquire in the acquisition unit 20 a video signal output from the vehicle-mounted camera 110 that has been processed by cutting out only a necessary part or applying an effect.
[0111] The drive recorder 10 of this embodiment includes a communication unit 50 that can be connected to a communication line. Therefore, the drive recorder 10 can perform, for example, a process of outputting a video signal acquired by the acquisition unit 20 as is via the communication unit 50, a process of processing a part or all of the video signal acquired by the acquisition unit 20 in the processing unit 30 and outputting the processed part or all of the video signal acquired by the acquisition unit 20 via the communication unit 50 in real time, or a process of temporarily storing a part or all of the video signal acquired by the acquisition unit 20 processed by the processing unit 30 and then outputting the processed part or all of the video signal via the communication unit 50.
[0112] For example, by making it possible to perform processing to output the video signal acquired by the acquisition unit 20 as it is via the communication unit 50, the video signal acquired by the vehicle-mounted camera 110 can be used as it is in other devices to which the video signal is output. Also, by making it possible to process the video signal acquired by the acquisition unit 20 in the processing unit 30 and output it in real time via the communication unit 50, the video signal processed by the processing unit 30 can be used in real time in other devices to which the video signal is output. Also, by making it possible to perform processing to temporarily store what has been processed in the processing unit 30 and then output it via the communication unit 50, the video signal processed by the processing unit 30 can be stored, and the stored video signal can be used in other devices to which the video signal is output.
[0113] In addition, "a portion of the video signals acquired by the acquisition unit 20" refers to, for example, video signals acquired from a portion of the vehicle-mounted cameras 110 among the video signals acquired by the acquisition unit 20 from a plurality of vehicle-mounted cameras 110.
[0114] In addition, "processing of a part or all of the video signal acquired by the acquisition unit 20 in the processing unit 30 and outputting it in real time via the communication unit" refers to performing processing such as recording processing for recording the video signal, processing for cutting out the video signal, processing for adjusting the brightness, color tone, hue, etc. of the video signal in the processing unit 30, and outputting the video signal obtained by the processing in real time via the communication unit.
[0115] The drive recorder 10 of this embodiment includes a media connection unit 60 that can be connected to an appropriate external medium, such as an SD card, a microSD card, a USB flash memory, a hard disk, a recordable CD, or a recordable DVD. The drive recorder 10 can also output a part or all of the video signal processed in the processing unit 30 via the media connection unit 60. Therefore, the drive recorder 10 can record, for example, a part or all of the video signal processed in the processing unit 30 in an external medium.
[0116] Although the drive recorder 10 illustrated in this embodiment includes the media connection unit 60, the present invention is not limited to this, and the drive recorder may not include the media connection unit 60.
[0117] Moreover, the drive recorder 10 of this embodiment uses a video signal captured by an on-board camera 110 arranged outside the vehicle cabin. Therefore, the drive recorder 10 can obtain a video signal captured at an angle or position that is difficult to obtain with a camera installed inside the vehicle cabin.
[0118] In this embodiment, an example in which only the vehicle-mounted camera 110 is installed outside the vehicle cabin has been shown, but the present invention is not limited to this. For example, a part or all of the vehicle-mounted camera 110 may be installed inside the vehicle cabin.
[0119] In addition, the drive recorder 10 of the present embodiment may be disposed anywhere in the vehicle 100, but may be disposed adjacent to the vehicle-side image synthesizer 130 to which the image signal output from the output unit 40 is input. With this configuration, the distance between the drive recorder 10 and the vehicle-side image synthesizer 130 can be minimized. As a result, when the output unit 40 and the vehicle-side image synthesizer 130 are connected by wire, the wiring for connection can be minimized. As a result, for example, the decrease in communication speed and deterioration in quality of the image signal transmitted from the drive recorder 10 to the vehicle-side image synthesizer 130 can be minimized. Also, when the output unit 40 and the vehicle-side image synthesizer 130 are connected wirelessly, for example, the drive recorder 10 can be disposed adjacent to the vehicle-side image synthesizer 130 to minimize the possibility of communication failure, decrease in communication speed, deterioration in image quality, etc.
[0120] The drive recorder 10 of this embodiment is configured to be disposed in the middle of a wiring system connecting the vehicle-mounted camera 110 and the vehicle-side image synthesizer 130. Therefore, the drive recorder 10 can acquire the image signal output from the vehicle-mounted camera 110 in the acquisition unit 20 before input to the vehicle-side image synthesizer 130 to form a composite image in the vehicle-side image synthesizer 130, and process it in the processing unit 30. As described above, the drive recorder 10 includes the output unit 40, and can directly or indirectly output the image signal acquired by the acquisition unit 20 to the vehicle-side image synthesizer 130 that is equipped in the vehicle 100 when shipped from the vehicle manufacturer. Therefore, the drive recorder 10 can also output the image signal output from the vehicle-mounted camera 110 to the vehicle-side image synthesizer 130 to form a composite image.
[0121] In this embodiment, the "vehicle-side image synthesizing device 130 that synthesizes image signals output from multiple vehicle-mounted cameras 110 to form a composite image" may be, for example, a device for forming a composite image to convey the situation around the vehicle 100 to assist in parking the vehicle 100, etc.
[0122] First Variation Hereinafter, the first modified example of the above-mentioned drive recorder 10 will be described in detail with reference to the drawings. In the description of the first modified example, the same reference numerals will be used to designate configurations common to the above-mentioned embodiment, and detailed description thereof will be omitted.
[0123] 4, in the drive recorder 10, the acquisition unit 20 includes a sensor input terminal 24. The sensor input terminal 24 is a terminal for connecting via wiring to a sensor 150 equipped in the vehicle 100. Specifically, the sensor input terminal 24 can connect sensors 150 such as a front side sensor, a front sensor, a back side sensor, and a back sensor used in clearance sonar, back sonar, intelligent clearance sonar, and the like.
[0124] The drive recorder 10 can process the video signal in the processing unit 30, triggered by the detection signal output from the sensor 150. Specifically, the drive recorder 10 performs a recording process of recording the video signal input from the in-vehicle camera 110 to the input terminals 22b to 22f, on the condition that the detection signal output from the sensor 150 is input via the sensor input terminal 24.
[0125] The drive recorder 10 of the first modified example described above does not need to provide a detection device such as a sensor for acquiring a trigger for processing a video signal in the processing unit 30 to the vehicle 100 after it is shipped from the vehicle manufacturer. Therefore, the drive recorder 10 of the first modified example can be used without performing processing such as drilling holes in the body of the vehicle 100 for installing the sensor 150, or performing installation work for wiring connected to the sensor 150. Therefore, the drive recorder 10 of the first modified example can minimize installation costs such as the cost of parts for the sensor 150 and the labor cost for installing the sensor 150.
[0126] Furthermore, since the drive recorder 10 of this modified example uses the sensor 150 that is equipped on the vehicle 100 when it is shipped from the vehicle manufacturer, the video signal can be processed in the processing unit 30 based on the output signal output from the sensor 150 that is placed in a position or environment that is optimal for shooting.
[0127] In addition, since the drive recorder 10 of this modified example uses the sensor 150 that is equipped on the vehicle 100 when it is shipped from the vehicle manufacturer, it can acquire video signals at approximately the same position and environment, etc., regardless of the vehicle 100 of the same model, and perform the specified processing in the processing unit 30.
[0128] The sensor 150 connected to the drive recorder 10 of this modification may be any sensor equipped in the vehicle 100 at the time of shipment from the vehicle manufacturer, and may be, for example, a sensor 150 equipped in the vehicle 100 as a so-called genuine product or standard equipment. Specifically, the sensor 150 connected to the drive recorder 10 of this modification may be appropriately selected from, for example, a front side sensor, a front sensor, a back side sensor, a back sensor, etc. used in a clearance sonar, a back sonar, an intelligent clearance sonar, etc. In addition, the drive recorder 10 may be connectable to all of the sensors 150 equipped in the vehicle 100 at the time of shipment from the vehicle manufacturer, or may be connectable to only a part of the sensors 150 equipped in the vehicle 100 at the time of shipment from the vehicle manufacturer.
[0129] <<Second Variation>> Hereinafter, the second modified example of the above-mentioned drive recorder 10 will be described in detail with reference to the drawings. In the description of the second modified example, the same reference numerals will be used to designate configurations common to the above-mentioned embodiment and the modified example, and detailed description thereof will be omitted.
[0130] The drive recorder 10 of this modification is suitable for use in cases where the vehicle 100 executes a danger avoidance operation to avoid danger on condition that a predetermined condition is satisfied. As shown in Fig. 5, in the drive recorder 10 of this modification, the acquisition unit 20 includes a trigger acquisition unit 26. The trigger acquisition unit 26 is connected to a vehicle-side communication line 170 such as a CAN provided in the vehicle 100, for example, and acquires a signal that serves as a trigger for executing the danger avoidance operation and that flows through the vehicle-side communication line 170. In the drive recorder 10 of this modification, the processing unit 30 performs a predetermined process on the video signal on condition that the trigger acquisition unit 26 acquires a signal that serves as a trigger for executing the danger avoidance operation.
[0131] When the vehicle 100 performs a danger avoidance operation, the drive recorder 10 of this modified example can perform predetermined processing on the video signal, such as a recording process for recording the video signal, a communication process for communicating the video signal with other devices, and a process for displaying the video signal on a display device such as a monitor. The drive recorder 10 of this modified example uses a signal that is an execution trigger for the vehicle 100 to perform a danger avoidance operation as a trigger for executing processing in the processing unit 30. Therefore, the drive recorder 10 of this embodiment can perform predetermined processing on the video signal in the processing unit 30 in a situation where danger should be avoided without providing a device for determining whether or not the situation requires danger avoidance, and the device configuration and operation can be simplified accordingly.
[0132] In this modified example, the "danger avoidance action to avoid danger" may be any appropriate action, such as tightening a seat belt in preparation for a collision of vehicle 100 with another vehicle 100, deploying an airbag, automatically activating the brakes to avoid a collision, or activating an anti-lock braking system (ABS).
[0133] In addition, the drive recorder 10 of this modified example only needs to perform a predetermined processing of the video signal in the processing unit 30 on the condition that the trigger acquisition unit 26 acquires a signal that triggers the execution of a danger avoidance operation, and other judgment conditions may be added as conditions for performing a predetermined processing of the video signal in the processing unit 30.
[0134] <Third Variation> Hereinafter, the third modified example of the above-mentioned drive recorder 10 will be described in detail with reference to the drawings. In describing the second modified example, the same reference numerals will be used to designate configurations common to the above-mentioned embodiment and modified example, and detailed descriptions thereof will be omitted.
[0135] 6, the drive recorder 10 of this modified example has a vehicle type setting unit 80 whose setting can be changed according to the vehicle type of the vehicle 100. The drive recorder 10 performs processing according to the setting by changing the setting of the vehicle type setting unit 80. The vehicle type setting unit 80 is, for example, a mechanically changeable switch such as a so-called DIP switch, or an electrically or electronically changeable switch.
[0136] The drive recorder 10 of this modified example can be used in various vehicle models according to the setting of the vehicle model setting unit 80. Therefore, it is not necessary to prepare a different drive recorder 10 of this modified example for each vehicle model.
[0137] <Fourth Variation> Hereinafter, the fourth modified example of the above-mentioned drive recorder 10 will be described in detail with reference to the drawings. In describing the second modified example, the same reference numerals will be used to designate configurations common to the above-mentioned embodiment and modified example, and detailed descriptions thereof will be omitted.
[0138] The drive recorder 10 of this modification can be suitably used in a vehicle 100 equipped with a vehicle-side image display device 140 (image display device) capable of receiving a video signal and displaying an image as part or all of the vehicle-side device that is equipped from the time of shipment from the vehicle manufacturer. As shown in Fig. 7, the drive recorder 10 of this modification includes a driving state determination device 82 (driving state determination means).
[0139] The driving state discrimination device 82 is a device for discriminating the driving state of the vehicle 100. The driving state discrimination device 82 has a driving state signal acquisition unit 28 constituting the acquisition unit 20, and a driving state discrimination unit 32 constituting the processing unit 30. The driving state signal acquisition unit 28 is connected to a communication line such as a CAN or LAN provided in the vehicle 100, and acquires a signal (driving state signal) indicating the driving state flowing through the communication line. In addition, the driving state discrimination unit 32 discriminates the driving state of the vehicle 100, for example, whether the vehicle is in a reverse gear state or in a traveling state, based on the driving state signal acquired by the driving state signal acquisition unit 28.
[0140] The drive recorder 10 of this modification can perform a process of switching the display mode of the image on the vehicle-side image display 140 by the processing unit 30 according to the driving state determined by the driving state determination device 82, and can record the display mode selected when the image was displayed on the vehicle-side image display 140 and time information. For example, in a driving state in which the gear is in reverse gear, the drive recorder 10 can switch the display mode of the image on the vehicle-side image display 140 to an image showing the rear of the vehicle, and can record that the display mode selected when the image was displayed on the vehicle-side image display 140 was an image showing the rear of the vehicle, and the time information. Therefore, the drive recorder 10 of this modification can record when and in what situation the vehicle 100 was in, in association with each other. For example, in a state in which the driving state of the vehicle 100 is set to reverse gear, the surrounding situation of the vehicle 100 and time information can be recorded in association with each other. The recorded data obtained in this manner can be effectively used, for example, for identifying and analyzing the cause of an accident.
[0141] In this modified example, an example of the driving state discrimination device 82 is shown as being configured by a combination of the driving state signal acquisition unit 28 and the driving state discrimination unit 32, but the present invention is not limited to this, and other configurations may be added in addition to or instead of these configurations.
[0142] <Fifth Variation> Hereinafter, the fifth modified example of the above-mentioned drive recorder 10 will be described in detail with reference to the drawings. In describing the second modified example, the same reference numerals will be used to designate configurations common to the above-mentioned embodiment and modified example, and detailed descriptions thereof will be omitted.
[0143] The drive recorder 10 of this modified example can be suitably used in a vehicle 100 equipped with an additional camera 160 that is added to the vehicle 100 after shipment from the vehicle manufacturer, in addition to the on-board camera 110. As shown in Fig. 8, in the drive recorder 10 of this modified example, the acquisition unit 20 includes an input terminal 23 for the additional camera.
[0144] The additional camera input terminal 23 is a terminal that is connected by wiring to the additional camera 160. The drive recorder 10 of this modified example can obtain a video signal obtained by shooting with the additional camera 160 via the additional camera input terminal 23.
[0145] In the drive recorder 10 of this modified example, in addition to the video signal output from the in-vehicle camera 110, the acquisition unit 20 can acquire a video signal output from an additional camera 160 that has been added to the vehicle 100 after shipment from the vehicle manufacturer, separate from the in-vehicle camera 110, and process the acquired video signal in the processing unit 30. The drive recorder 10 can distinguish between the video captured by the additional camera 160 and the video captured by the in-vehicle camera 110 and perform the specified processing.
[0146] The drive recorder 10 of this modification can acquire not only the video signal output from the in-vehicle camera 110 but also the video signal output from the additional camera 160 added to the vehicle 100 after shipping from the vehicle manufacturer, and process the video signal in the processing unit 30. Therefore, the drive recorder 10 of this embodiment can add the additional camera 160 to the vehicle 100 after shipping from the vehicle manufacturer, for example, when it is desired to acquire more video signals than the video signals that can be acquired by the in-vehicle camera 110 installed in the vehicle 100 at the time of shipping from the vehicle manufacturer, and can use the video signal acquired by the additional camera 160. Furthermore, the drive recorder 10 of this modification can perform a predetermined process by distinguishing between the video acquired by the additional camera 160 and the video acquired by the in-vehicle camera 110. Therefore, for example, the video acquired by the additional camera 160 can be used in various forms, such as using the video acquired by the in-vehicle camera 110 for a purpose other than that of the video acquired by the in-vehicle camera 110, or adding another image processing to the video.
[0147] It should be noted that "additional camera 160 added to vehicle 100 after shipment from the vehicle manufacturer" includes, for example, cameras added to vehicle 100 shipped from the vehicle manufacturer at the user's request, such as so-called dealer options, and cameras purchased and added at a so-called car shop, etc.
[0148] Furthermore, in the drive recorder 10 of this modified example, the "predetermined processing" performed by the processing unit 30 may be any type, such as a recording process for recording a video signal, a communication process for communicating the video signal with other devices, or a process for displaying the video signal on a display device such as a monitor.
[0149] <Sixth Variation> Hereinafter, the sixth modified example of the above-mentioned drive recorder 10 will be described in detail with reference to the drawings. In describing the second modified example, the same reference numerals will be used to designate configurations common to the above-mentioned embodiment and modified example, and detailed descriptions thereof will be omitted.
[0150] As shown in FIG. 9, the drive recorder 10 of this modification includes a safety evaluation unit 84. The safety evaluation unit 84 evaluates the safety of driving based on the video signal processed by the processing unit 30. For example, the safety evaluation unit 84 may recognize the legal speed based on the image of a sign reflected in the video, calculate the actual vehicle speed, and compare the legal speed with the vehicle speed to evaluate whether the driver is driving safely. The evaluation by the safety evaluation unit 84 can be performed in an appropriate manner, such as a five-level evaluation method of A, B, C, D, and E, or a score evaluation method with a maximum score of 100 points.
[0151] Moreover, the safety evaluation unit 84 evaluates the safety level at each predetermined period. Specifically, the safety evaluation unit 84 may determine the evaluation at each predetermined evaluation determination period, such as weekly, daily, monthly, or hourly. The safety evaluation unit 84 may derive an evaluation (hereinafter also referred to as a "provisional evaluation") at each period shorter than the evaluation determination period described above, and at the expiration of the evaluation determination period or thereafter, may comprehensively determine the safety evaluation by synthesizing the provisional evaluations derived within the evaluation determination period. Specifically, when the evaluation determination period is one week, a provisional evaluation may be derived for each day within the evaluation determination period, and at the expiration of the evaluation determination period, a comprehensive judgment may be made based on the provisional evaluations for each day, thereby formally determining the safety evaluation for the evaluation determination period.
[0152] As described above, the drive recorder 10 of this modified example includes a safety evaluation unit 84 that evaluates the driving safety level based on the video signal processed by the processing unit 30. Therefore, with a configuration like this modified example, the driving safety level can be evaluated in the drive recorder 10 without relying on other devices, etc. This makes it possible to reduce the load on other devices, etc., for evaluating the driving safety level, and can be useful for contributing to the realization of edge computing, for example.
[0153] The drive recorder 10 of this modified example is equipped with a safety evaluation unit 84 that evaluates the safety of driving based on the video signal processed in the processing unit 30, and a communication unit 50 that can be connected to a communication line, and it is preferable that the evaluation results by the safety evaluation unit 84 can be output via the communication unit 50 at predetermined intervals.
[0154] According to this configuration, the driving safety evaluation based on the video signal can be performed in the drive recorder 10 of this modified example, and the processing for the safety evaluation can be performed without imposing a burden on other devices, etc. Also, as described above, by outputting the evaluation result by the safety evaluation unit 84 via the communication unit 50 at predetermined intervals, the communication load can be reduced compared to the case where the evaluation result is constantly output.
[0155] In addition, the drive recorder 10 of this modified example may have a safety evaluation unit 84 that evaluates the safety of driving based on the video signal processed in the processing unit 30, and an insurance premium derivation unit 86 that derives an insurance premium for insurance that covers damages occurring in conjunction with driving the vehicle 100 based on the evaluation results by the safety evaluation unit 84.
[0156] According to this configuration, in addition to evaluating the driving safety based on the video signal, the drive recorder 10 of this modified example can also derive the insurance premium based on the evaluation result. This allows the processes for safety evaluation and insurance premium deriving to be performed without imposing a burden on other devices, etc. The safety evaluation unit 84 may, for example, derive an estimated insurance premium so that the insurance premium for a good driver who is always rated A in safety is lower than that for a driver who is always rated C, or derive an estimated insurance premium that is significantly higher than normal for a driver who is rated E, the lowest level, taking into account the risk of causing an accident.
[0157] Furthermore, by being able to perform the above-mentioned processing, the derivation of insurance premiums can be performed without manual labor or with a significant reduction in manual labor. Therefore, the drive recorder 10 of this modified example can make a significant contribution to the full automation of automobile insurance-related operations. Furthermore, the drive recorder 10 of this modified example can free up or reduce the labor required for insurance premium derivation operations, thereby increasing the number of workers allocated to customer support operations and accident care, which require labor. Therefore, the drive recorder 10 of this modified example can be suitably used in the automobile insurance industry.
[0158] Here, it is assumed that automobile insurance has a huge number of policyholders, ranging from millions to tens of millions. Therefore, if the driving safety of the driver is evaluated and appropriate insurance premiums can be calculated individually, as in the case of the drive recorder 10 of this embodiment, the effort required for insurance companies to set and calculate insurance premiums and the load on devices such as servers can be significantly reduced.
[0159] The drive recorder 10 of this modification utilizes the on-board camera 110 that is installed from the time of shipment from the vehicle manufacturer, and unlike conventional commonly used drive recorders, it can evaluate the overall safety of driving by using images in other directions, not just images in one direction such as the front. In addition, since the on-board camera 110 is installed from the time of shipment from the vehicle manufacturer, no additional costs are required for installation, and the configuration can be simplified.
[0160] <Seventh Variation> Hereinafter, the seventh modified example of the above-mentioned drive recorder 10 will be described in detail with reference to the drawings. In addition, in describing the second modified example, the same reference numerals will be used to designate the same components as those in the above-mentioned embodiment and modified example, and detailed description thereof will be omitted.
[0161] As shown in Fig. 10, the drive recorder 10 of this modified example includes a calculation unit 88. The calculation unit 80 performs a predetermined calculation process based on the video signal processed by the processing unit 30. The calculation performed by the calculation unit 80 may be, for example, a calculation process for processing an image signal, or a calculation process for deriving an evaluation by the safety evaluation unit 84 of the sixth embodiment. The drive recorder 10 of this modified example is effective for realizing edge computing because the calculation process can be performed by the calculation unit 88.
[0162] Furthermore, after the drive recorder 10 of this modified example performs arithmetic processing by the calculation unit 88, the drive recorder 10 can output the arithmetic processing result via the communication unit 50. Therefore, the drive recorder 10 of this modified example does not communicate the video signal to be subjected to the arithmetic processing or the large amount of data with a large amount of information itself via the communication unit 50, but rather the arithmetic processing result obtained from the video signal or the large amount of data is the communication target of the communication unit 50, thereby minimizing the communication load.
[0163] The vehicle-mounted camera in each of the above-mentioned embodiments may be a normal camera such as a color visible light camera (for example, a camera that captures RGB), but at least one of the cameras should be a special camera. The special camera should be at least one of an infrared camera, a ToF camera, a multispectral camera, a hyperspectral camera, and a thermal camera. Although a special camera is more expensive than a normal camera, the device can realize desired processing using images from the special camera without incurring costs because the special camera is used.
[0164] In the above-described embodiments, it is preferable to provide both a normal camera and a special camera as the vehicle-mounted camera. In particular, it is preferable to provide both a normal camera and a special camera that capture images including the same area. It is preferable to obtain images from both the normal camera and the special camera that capture images including the same area from the vehicle side and perform processing using both images.
[0165] The present invention is not limited to the configurations described in the above-mentioned embodiments. The components of each of the above-mentioned embodiments and variations may be arbitrarily selected and combined. Any component of each of the embodiments and variations may be arbitrarily combined with any component described in the Summary of the Invention or any component that embodies any component described in the Summary of the Invention. We intend to obtain rights to these as well through amendments to this application or divisional applications, etc. [Industrial Applicability]
[0166] The device of the present invention can be suitably used in any device, such as a drive recorder. [Explanation of symbols]
[0167] 10. Drive Recorder 20 Acquisition Department 30 Processing section 40 Output section 50 Communications Department 60 Media Connection 80 Vehicle Setting Section 82 Driving condition determination device 86 Insurance Premium Derivation Department 100 vehicles 110 Car Camera 130 Vehicle side image synthesizer 150 Sensors 160 additional cameras
Claims
1. A device that is added to a vehicle after the vehicle manufacturer is shipped from the vehicle manufacturer, the device being configured to include an on-board camera and a vehicle-side device that uses an image acquired from the on-board camera, the device comprising: An acquisition unit that directly or indirectly acquires a video signal flowing between the vehicle-mounted camera and the vehicle-side device; a processing unit that performs a predetermined process on the video signal acquired by the acquisition unit; an output unit that directly or indirectly outputs the video signal acquired by the acquisition unit to the vehicle-side device that is installed in the vehicle at the time of shipment from a vehicle manufacturer; Equipped with a part or all of the vehicle-side device is a video display device capable of receiving the video signal and displaying a video, A driving state determination means for determining a driving state of a vehicle is provided, An apparatus capable of switching the display format of an image on the image display device in accordance with the driving state, and capable of recording the display format selected when the image was displayed on the image display device.
2. 2. The apparatus according to claim 1, further comprising a display unit for displaying an image on said video display device, said display unit being operable to record time information when said image is displayed on said video display device.
3. A program for causing a control means to execute the functions of the device according to claim 1 or 2.
Citation Information
Patent Citations
Image recorder for vehicle, reproducing apparatus, and program
JP2013102494A
Display system, display control device, and display control method
JP2013167862A
On-vehicle monitoring system and on-vehicle camera adapter
JP2014204361A
Intermediate connector
JP2015022315A
Vehicular image processing system
JP2016053942A