On-vehicle unit
The in-vehicle device addresses misalignment issues in camera systems by detecting and warning of angle deviations through wiper trajectory comparison, maintaining accurate image processing and driving assistance without positioning constraints.
Patent Information
- Application Number
- JP2024062100
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-04-08
- Publication Date
- 2025-10-21
AI Technical Summary
Existing in-vehicle camera systems face misalignment issues due to loose screws or driver interference, leading to inaccurate image processing and impaired driving assistance, while current solutions restrict the mounting position of the camera.
An in-vehicle device that detects angle of view deviations by comparing the initial and inspection images of the wiper trajectory, issuing warnings when misalignment occurs, without limiting the camera's mounting position.
Enables accurate image processing and driving assistance by detecting and alerting misalignments in the camera's angle of view, ensuring high precision without restricting the camera's installation location.
Smart Images

Figure 2025159498000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an in-vehicle device. [Background technology]
[0002] In-vehicle devices have been proposed that process images captured by an on-board camera installed in a vehicle and perform image recording, driving assistance, etc. In order to properly perform this image processing, the on-board camera must be fixed in the correct mounting position.
[0003] However, in the market, misalignment of the angle of view of in-vehicle cameras occurs due to loosening of fixing screws, touching of the hands of drivers during cleaning, etc. When misalignment of the angle of view occurs, image processing cannot be performed correctly, which poses the problem of not being able to record images accurately or provide driving assistance.
[0004] To solve this problem, an on-board camera inspection device has been proposed as described in Patent Document 1. This on-board camera inspection device compares a reference image showing the bumper with an image captured by the on-board camera, and issues a warning if it detects a discrepancy between the captured image and the reference image.
[0005] However, the vehicle-mounted camera inspection device of Patent Document 1 described above has a problem in that the vehicle-mounted camera needs to be mounted in a position where it can capture an image of the bumper, which limits the mounting position. [Prior art documents] [Patent documents]
[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-38773 Summary of the Invention [Problem to be solved by the invention]
[0007] The present invention has been made in consideration of the above-mentioned circumstances, and its purpose is to provide an in-vehicle device that can detect and warn of misalignment in the angle of view without restricting the mounting position of the in-vehicle camera. [Means for solving the problem]
[0008] In order to achieve the above-mentioned object, the vehicle-mounted device according to the present invention has the following features. An in-vehicle device that detects a deviation in the angle of view of an in-vehicle camera mounted on a vehicle, a detection unit that compares an initial position of the wiper in a reference image captured when the on-board camera is in a correct mounting position with a position of the wiper in an inspection image captured by the on-board camera, and detects the misalignment of the angle of view based on the comparison result; a warning unit that warns the user when the angle of view deviation is detected by the detection unit, It must be an in-vehicle device. [Effects of the Invention]
[0009] The vehicle-mounted device according to the present invention has the advantage that it can detect and warn of deviations in the angle of view without restricting the mounting position of the vehicle-mounted camera.
[0010] The present invention has been briefly described above. The details of the present invention will become clearer by reading the following detailed description of the invention (hereinafter referred to as "embodiments") with reference to the accompanying drawings. [Brief explanation of the drawings]
[0011] [Figure 1] FIG. 1 is a block diagram showing an embodiment of a digital tachograph as an in-vehicle device of the present invention. [Figure 2] FIG. 2 is a diagram showing the mounting position of the vehicle-mounted camera shown in FIG. 1 on the vehicle. [Figure 3] FIG. 3 is a flowchart illustrating a processing procedure of the CPU shown in FIG. [Figure 4]FIG. 4 is a flowchart showing the processing procedure of the CPU shown in FIG. [Figure 5] FIG. 5 is an explanatory diagram for explaining the detection of the angle of view deviation executed by the CPU shown in FIG. DETAILED DESCRIPTION OF THE INVENTION
[0012] Specific embodiments of the present invention will be described below with reference to the accompanying drawings.
[0013] 1 is a block diagram showing an embodiment of a digital tachograph 1 as an on-board device of the present invention. The digital tachograph 1 is mounted on, for example, a truck vehicle (hereinafter simply referred to as "vehicle") managed by a transportation company.
[0014] The digital tachograph 1 of this embodiment records driving data such as the time of entry and exit, travel distance, travel time, travel speed, accelerator opening, excessive speed, excessive engine RPM, sudden start, sudden acceleration, sudden deceleration, etc. The digital tachograph 1 also processes images taken by the in-vehicle camera 25 to detect dangerous driving such as snaking and ignoring traffic lights, and provides driving assistance by outputting a warning, and records images when dangerous driving is detected.
[0015] The digital tachograph 1 includes a CPU (Central Processing Unit) 2, a nonvolatile memory 3, and a card I / F 4.
[0016] The CPU 2 comprehensively controls each part of the digital tachograph 1. The CPU 2 is a computer that operates according to an operating program stored in a memory (not shown). The non-volatile memory 3 stores data such as operation data and images in a predetermined storage area. A memory card 20 owned by the driver is removably connected to the card I / F 4. The CPU 2 writes the operation data stored in the non-volatile memory 3 to the memory card 20 connected to the card I / F 4.
[0017] The digital tachograph 1 also includes I / Fs 5 to 9 and a communication unit 10.
[0018] A vehicle speed sensor 21 that detects the speed of the vehicle is connected to I / F5. An engine rotation sensor 22 is connected to I / F6. An accelerator opening sensor 23 is connected to I / F7. A G sensor 24 that detects acceleration is connected to I / F8.
[0019] An on-board camera 25 is connected to the I / F 9. In this embodiment, the on-board camera 25 is installed inside the vehicle 100 as shown in Fig. 2, and acquires images of the area ahead of the vehicle 100. The communication unit 10 performs wide-area communication, and when connected to a wireless base station (not shown) via a portable communication network (mobile communication network), transmits operation data to a management server or an office PC via a network such as the Internet connected to the wireless base station.
[0020] The above-mentioned CPU 2 compares the initial position of the movement trajectory of the wiper tip in the reference image taken when the vehicle-mounted camera 25 is in the correct mounting position with the position of the movement trajectory of the wiper tip in the inspection image taken by the vehicle-mounted camera 25, and detects a deviation in the angle of view of the vehicle-mounted camera 25 (= a deviation in the mounting position) based on the comparison result.
[0021] The digital tachograph 1 also has a display unit 11 and a speaker 12. The display unit 11 and the speaker 12 are connected to the CPU 2 and controlled by the CPU 2.
[0022] Next, the operation of the digital tachograph 1 outlined above will be described in detail with reference to Figures 3 and 4. The digital tachograph 1 is switchable between a driving mode and a land transport mode. In the driving mode, the CPU 2 of the digital tachograph 1 functions as a recording unit and can record driving data. In the land transport mode, the digital tachograph 1 does not record driving data.
[0023] When the digital tachograph 1 and the in-vehicle camera 25 are installed in the vehicle 100, the digital tachograph 1 is switched to the land transport mode. After installation, the digital tachograph 1 is switched from the land transport mode to the driving mode.
[0024] In the operation mode, the CPU 2 executes an inspection process when power supply to the digital tachograph 1 is started. In the inspection process, when a leaving operation indicating the start of operation is performed (S1), the CPU 2 determines whether or not this is the first operation since the land transport mode was released (S2). If it is the first operation (Y in S2), the CPU 2 determines that the on-board camera 25 has just been installed and is in the correct mounting position, and functions as an instruction unit, causing the speaker 12 to sound a message saying "Please turn on the wipers" (S3).
[0025] 5(A), CPU 2 captures, for example, 30 seconds of images captured by in-vehicle camera 25 as reference image 102. CPU 2 records the initial position P1 of the movement trajectory of the tip of wiper 101 in the captured reference image 102 (S4). If CPU 2 cannot successfully record the initial position P1 of the movement trajectory (N in S5), it returns to S3.
[0026] If the CPU 2 can successfully record the initial position P1 of the movement trajectory (Y in S5), it stores the recorded initial position P1 of the movement trajectory in the non-volatile memory 3 (S6) and ends the process.
[0027] If it is not the first operation (N in S2), CPU 2 proceeds to S7 in FIG. 4. In S7, CPU 2 functions as an instruction unit and causes speaker 12 to sound, "Please operate wipers." Then, as shown in FIG. 5(B), CPU 2 captures, as inspection image 103, images taken by in-vehicle camera 25 for, for example, 30 seconds. CPU 2 records position P2 of the movement trajectory of the tip of wiper 101 in the captured inspection image 103 (S8). Next, CPU 2 functions as a detection unit and compares the initial position P1 of the movement trajectory of the tip of wiper 101 with position P2 of the movement trajectory of the tip of wiper 101 (S9).
[0028] If the comparison result shows that the deviation between the initial position P1 and the position P2 is not within the allowable range (N in S10), the CPU 2 detects a deviation in the angle of view of the in-vehicle camera 25, functions as an alarm unit, and causes the speaker 12 to output a voice message saying, "The angle of view is deviated. Please contact your dealer" (S11). Thereafter, if wide-area communication is enabled (Y in S12), the CPU 2 controls the communication unit 10 to notify the management server or the office PC that a deviation in the angle of view has been detected (S13), and then proceeds to S15.
[0029] If wide area communication is not enabled (N in S12), the CPU 2 does not notify the management server or the office PC of the detection of the angle of view deviation (S14), and proceeds to S15.
[0030] On the other hand, if the deviation between the initial position P1 and the position P2 is within the allowable range (Y in S10), the CPU 2 determines that the vehicle-mounted camera 25 is in the correct mounting position, and immediately proceeds to S15.
[0031] In S15, when a warehousing operation indicating the end of operation is performed (S15), CPU 2 determines whether or not a misalignment of the angle of view was detected in S10 (S16). If a misalignment of the angle of view is detected (Y in S16), CPU 2 again outputs a voice message from speaker 12 saying, "The angle of view has shifted. Please contact your dealer." (S17), and then ends the process. On the other hand, if a misalignment of the angle of view is not detected (N in S16), CPU 2 immediately ends the process.
[0032] According to the above-described embodiment, the CPU 2 compares the initial position P1 of the movement trajectory of the tip of the wiper 101 in the reference image 102 with the position P2 of the movement trajectory of the tip of the wiper 101 in the inspection image 103, and detects a deviation in the angle of view of the on-board camera 25 based on the comparison result. This makes it possible to reduce the possibility of driving with the angle of view of the on-board camera 25 being deviated, and to perform image processing on the image captured by the on-board camera 25 to perform image recording, driving assistance, etc. with high accuracy.
[0033] Furthermore, when the on-board camera 25 is installed inside the vehicle 100, the wiper 101 is always captured by the on-board camera 25. Therefore, the mounting position of the on-board camera 25 is not limited, and deviation in the angle of view of the on-board camera 25 can be detected.
[0034] According to the above-described embodiment, the misalignment of the angle of view of the in-vehicle camera 25 is detected based on the positions P1 and P2 of the movement locus of the tip of the movable wiper 101. Therefore, it is easier to detect the wiper 101 by image processing than when the wiper 101 is in the retracted state.
[0035] According to the embodiment described above, every time a leaving operation indicating the start of operation is performed, CPU 2 acquires an image taken by on-board camera 25 as inspection image 103, and detects a deviation in the angle of view of on-board camera 25 from the acquired inspection image 103. As a result, since a deviation in the angle of view of on-board camera 25 is detected every time the vehicle leaves the garage, a warning can be issued to the driver or manager of vehicle 100 as soon as possible if a deviation in the angle of view occurs.
[0036] According to the above-described embodiment, when the land transport mode is released and the first leaving operation is performed, the CPU 2 acquires an image captured by the on-board camera 25 as the reference image 102. This makes it possible to accurately set the image captured when the on-board camera 25 is in the correct position as the reference image 102.
[0037] According to the above-described embodiment, every time a leaving operation is performed, the CPU 2 instructs the occupant of the vehicle 100 to drive the wiper 101. This allows the wiper 101 to rotate, and the positions P1 and P2 of the movement locus of the tip of the wiper 101 to be acquired.
[0038] The present invention is not limited to the above-described embodiments, and can be appropriately modified, improved, etc. The material, shape, size, number, location, etc. of each component in the above-described embodiments are arbitrary and not limited as long as they can achieve the present invention.
[0039] According to the embodiment described above, the CPU 2 detects the deviation of the angle of view of the in-vehicle camera 25 based on the positions P1 and P2 of the movement trajectory of the tip of the wiper 101, but this is not limited to this. The deviation of the angle of view may be detected based on the position of the movable area of the wiper 101, or based on the position of the wiper 101 in the retracted state.
[0040] Here, the features of the above-described embodiments of the vehicle-mounted device according to the present invention will be briefly summarized and listed below in [1] to [5].
[0041] [1] An in-vehicle device (1) for detecting a deviation in the angle of view of an in-vehicle camera (25) mounted on a vehicle (100), a detection unit (2) that compares an initial position (P1) of the wiper (101) in a reference image (102) captured when the on-board camera (25) is in a correct mounting position with a position (P2) of the wiper (101) in an inspection image (103) captured by the on-board camera (25), and detects the misalignment of the angle of view based on the comparison result; and a warning unit (2) that warns the user when the angle of view deviation is detected by the detection unit (2). Onboard equipment (1).
[0042] According to the vehicle-mounted device (1) having the configuration [1] above, the wiper (101) is always captured by the vehicle-mounted camera (25) when the vehicle-mounted camera (25) is installed inside the vehicle (100). Therefore, deviation in the angle of view of the vehicle-mounted camera (25) can be detected without any restriction on the installation position of the vehicle-mounted camera (25).
[0043] [2] In the vehicle-mounted device (1) described in [1], The reference image (102) and the inspection image (103) are images taken when the wiper (101) is driven, the detection unit (2) compares the initial position (P1) of the movement trajectory of the tip of the wiper (101) in the reference image (102) with a position (P2) of the movement trajectory of the tip of the wiper (101) in the inspection image (103), or compares the initial position (P1) of the movable area of the wiper (101) in the reference image (102) with a position (P2) of the movable area of the wiper (101) in the inspection image (103), and detects the angle of view deviation based on the comparison result; Onboard equipment (1).
[0044] According to the vehicle-mounted device (1) having the configuration [2] above, the wiper (101) can be more easily detected by image processing than when the wiper (101) is in the housed state.
[0045] [3] In the vehicle-mounted device (1) described in [1], A recording unit (2) is provided for recording operation data for each operation, The detection unit (2) acquires an image taken by the on-board camera (25) as the inspection image (103) every time a leaving operation indicating the start of operation is performed, and detects the angle of view deviation from the acquired inspection image (103). Onboard equipment (1).
[0046] According to the in-vehicle device (1) having the configuration [3] above, since the in-vehicle device (1) detects a deviation in the angle of view of the in-vehicle camera (25) every time the vehicle leaves the garage, it is possible to quickly warn the driver or manager of the vehicle (100) when a deviation in the angle of view occurs.
[0047] [4] In the vehicle-mounted device (1) described in [3], The vehicle is provided so as to be switchable between a driving mode, which is different in whether or not the driving data is recorded, and a land transport mode, When the land transport mode is released and the first leaving operation is performed, the detection unit (2) acquires an image captured by the vehicle-mounted camera (25) as the reference image (102). Onboard equipment (1).
[0048] According to the vehicle-mounted device (1) having the configuration [4] above, the image captured when the vehicle-mounted camera (25) is in the correct position can be used as the reference image (102) with high accuracy.
[0049] [5] In the vehicle-mounted device (1) according to [3] or [4], and an instruction unit (2) that instructs an occupant of the vehicle (100) to drive the wiper (101) every time the leaving operation is performed. Onboard equipment (1).
[0050] According to the vehicle-mounted device (1) configured as described above in [5], the wiper (101) can be rotated to acquire the movement locus of the tip of the wiper 101 or the positions (P1, P2) of the movable area of the wiper 101. [Explanation of symbols]
[0051] 1 Digital tachograph (on-board unit) 2 CPUs (detection, warning, recording, instruction) 25 In-car camera 100 vehicles 101 Wiper 102 Reference Image 103 Inspection Image P1 initial position P2 position
Claims
1. An in-vehicle device that detects a deviation in the angle of view of an in-vehicle camera mounted on a vehicle, a detection unit that compares an initial position of the wiper in a reference image captured when the on-board camera is in a correct mounting position with a position of the wiper in an inspection image captured by the on-board camera, and detects the misalignment of the angle of view based on the comparison result; a warning unit that warns the user when the angle of view deviation is detected by the detection unit, Onboard equipment.
2. The vehicle-mounted device according to claim 1, the reference image and the inspection image are images taken when the wiper is driven, the detection unit compares the initial position of the movement trajectory of the wiper tip in the reference image with the position of the movement trajectory of the wiper tip in the inspection image, or compares the initial position of the wiper movement area in the reference image with the position of the wiper movement area in the inspection image, and detects the angle of view deviation based on the comparison result; Onboard equipment.
3. The vehicle-mounted device according to claim 1, A recording unit is provided to record operation data for each operation, The detection unit acquires an image captured by the on-board camera as the inspection image each time a leaving operation indicating the start of operation is performed, and detects the angle of view deviation from the acquired inspection image. Onboard equipment.
4. The vehicle-mounted device according to claim 3, The vehicle is provided so as to be switchable between a driving mode, which is different in whether or not the driving data is recorded, and a land transport mode, When the land transportation mode is released and the first leaving operation is performed, the detection unit acquires an image captured by the in-vehicle camera as the reference image. Onboard equipment.
5. 5. The vehicle-mounted device according to claim 3, and an instruction unit that instructs an occupant of the vehicle to drive the wiper every time the leaving operation is performed. Onboard equipment.
Citation Information
Patent Citations
On-vehicle camera inspection device
JP2007038773A