Vehicle driving visual field self-adaptive adjusting device and method

Abstract

The invention provides a vehicle driving visual field self-adaptive adjusting device and method. The device is composed of two wide-angle cameras installed on left and right external ear mechanical arm structures of a vehicle, an electronic outside rear-view mirror controller and two display screens embedded in the inner sides of left and right vehicle doors. Wherein the wide-angle camera is used for collecting the outer rear view of a vehicle, the electronic outside rear-view mirror controller is used for analyzing the outer rear view image data collected by the wide-angle camera and carrying out ISP image processing and outer rear view image zooming and translation processing, and the display screen is used for carrying out video display on the finally processed outer rear view image. The problem that when a driver drives a vehicle at present, the lateral rear view cannot be adaptively adjusted according to the driving working condition, and a more suitable and visual vehicle lateral rear view is provided for the driver is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of automobile electronics, and in particular to a device and method for adaptively adjusting a vehicle driving field of view. Background Art

[0002] When driving a vehicle, the driver usually only obtains the side and rear view of the vehicle through the imaging method of the physical lens plane mirror installed on the outer ear of the vehicle. During the driving process of the vehicle, since the physical lens is not automatically adjusted, during the driving process, if the driver does not actively adjust the position of the physical lens, the driver's side and rear view area of ​​​​the vehicle will be fixed and cannot adapt to the driving scene to provide the driver with a suitable observation field of view (such as the reversing field of view is tilted downward, the turning field of view is expanded outward, etc.).

[0003] In addition, the existing streaming media electronic exterior rearview mirror uses a camera to capture the rear view of the vehicle, and after processing the image through an image processing unit, it outputs it to a display screen for field of view display. Although the camera can usually capture a better field of view of the rear side of the vehicle than a physical mirror (usually the physical mirror only accounts for about 2 / 3 of the electronic exterior rearview mirror's field of view), it is also impossible to adaptively adjust the field of view in real time according to the driving scenario. Summary of the invention

[0004] To solve the above problems, the present invention discloses a vehicle driving field of view adaptive adjustment device and method, which solves the problem that the side rear field of view of the current driver cannot be adaptively adjusted according to the driving conditions when driving the vehicle, and provides the driver with a more suitable and intuitive vehicle side rear field of view.

[0005] The specific plan is as follows: A vehicle driving field of view adaptive adjustment device, comprising two wide-angle cameras installed on the left and right outer ear mechanical arm structures of the vehicle, an electronic exterior rearview mirror controller, and two display screens embedded in the inner sides of the left and right doors; wherein the wide-angle camera is used to collect the vehicle's exterior rear field of view, the electronic exterior rearview mirror controller is responsible for parsing the exterior rear field of view image data collected by the wide-angle camera, and performing ISP image processing and exterior rear field of view image scaling and translation processing, and the display screen is used to display the final processed exterior rear field of view picture video.

[0006] Furthermore, the parameters of the wide-angle camera are: 63° horizontally and 53° vertically; the electronic exterior rearview mirror controller is installed in the vehicle, and it outputs the processed image data to the display screens installed on the inside of the left and right doors to display the real-time field of view of the rear side of the vehicle.

[0007] During driving, the system establishes CAN communication with the vehicle to obtain driving-related information, including gear position signal, steering switch signal, and vehicle speed signal, to judge the driving scene and working condition. Then, the original image captured by the camera is cropped, scaled, or translated according to different driving scenes and working conditions to obtain a suitable side and rear view of the vehicle under different driving conditions.

[0008] When the vehicle is reversing, the electronic exterior mirror controller recognizes that the current gear is reverse through the gear information, that is, controls the display field of view to shift downward, so that the driver can directly see the rear of the vehicle and the area between the rear wheels and the ground, and receives the obstacle distance detection information of the whole vehicle ADAS ultrasonic radar, and zooms in on the area behind the vehicle where there is a risk of collision, that is, the picture-in-picture effect, to instruct the driver to keep a distance from obstacles and avoid collision between the vehicle and the near-end obstacles. (Only when the gear is judged to be R gear, the user can manually turn on / off this function); the picture-in-picture effect is: superimpose a partial enlarged picture on the right / upper left corner of a complete picture, where the left display screen superimposes a partial enlarged picture in the upper right corner, and the right display screen superimposes a partial enlarged picture in the upper left corner.

[0009] When the vehicle is turning, the electronic exterior mirror controller obtains the turn signal status information and recognizes that the current driving is turning, that is, it controls the display field of view to move away from the vehicle body end and expand the field of view, so that the driver can directly observe the wide field of view of the surrounding environment on the turning side of the vehicle. (Steering wheel angle information, when the angle > 100° (TBD, subject to the actual vehicle).

[0010] When the vehicle is driving at high speed, the vehicle speed information is obtained and it is determined whether it is currently driving at high speed. If the vehicle speed reaches the high-speed driving scene, the camera capture image is compressed by the controller unit and output to the display screen to achieve an expanded field of view. (Only confirm the vehicle speed, if the vehicle speed is >80km / h, the high-speed field of view is triggered, the user can manually turn it on / off, and the high-speed vehicle speed can be determined, and the user can set it, such as: 60km / h trigger, 70km / h trigger, 80km / h trigger).

[0011] When the vehicle is driving normally (driving straight ahead on a regular urban road), the field of view is automatically switched to the normal field of view without compression, enlargement or stretching, making the sense of distance in the field of view more intuitive.

[0012] A method for adaptively adjusting a vehicle driving field of view comprises the following steps: S1, collecting the rear view image of the vehicle through the wide-angle camera, and transmitting it to the electronic rearview mirror controller for camera data analysis operation; S2. The vehicle data unit synchronously analyzes the vehicle data, including vehicle steering, gear position, and speed information; during normal driving with few vehicles on the road, the preset default rear view range is displayed; S3, sending the acquired wide-angle camera video stream data to the ISP module for image processing to improve the clarity and color reproduction of the rear view image; S4. Compress or crop the processed image input by the ISP module according to the field of view adjustment instruction, and output the image to the display screen for display.

[0013] Furthermore, the vehicle data processing unit outputs a visual field adjustment instruction according to the current driving gear, steering, speed and obstacle information of the vehicle, including: a. When the vehicle is in reverse gear, the output instruction of the downward translation of the picture is output, and the rear end and rear wheels of the vehicle are in the ground area to avoid collision between the vehicle and the near-end obstacle; b. When the vehicle is in D gear and the speed is >80km / h, the output instruction of picture compression is output, that is, the picture is reduced but the visual field is expanded, so that the driver can see a wider visual field, and the driver can easily make driving predictions with the assistance of a wide visual field; The beneficial effects of the present invention are: 1. Establish communication between the electronic exterior rearview mirror controller and the vehicle to obtain vehicle driving information and identify different vehicle driving scenarios and working conditions 2. By identifying different driving conditions, the field of view can be adaptively adjusted to pan, shrink, and enlarge, providing the driver with a suitable and intuitive side and rear driving view of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is a system diagram of the device of the present invention.

[0015] Figure 2 It is a flow chart of the method of the present invention. DETAILED DESCRIPTION

[0016] The present invention will be further explained below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the following specific embodiments are only used to illustrate the present invention and are not used to limit the scope of the present invention.

[0017] like Figure 1 As shown, the present invention provides a vehicle driving field of view adaptive adjustment device, which consists of two wide-angle cameras installed on the left and right outer ear mechanical arm structures of the vehicle, an electronic exterior rearview mirror controller, and two display screens embedded in the inner sides of the left and right doors; wherein the wide-angle camera is used to collect the vehicle's exterior rear field of view, the electronic exterior rearview mirror controller is responsible for parsing the exterior rear field of view image data collected by the wide-angle camera, and performing ISP image processing and exterior rear field of view image scaling and translation processing, and the display screen is used to display the final processed exterior rear field of view picture video.

[0018] In this embodiment, the parameters of the wide-angle camera are: 63° horizontally and 53° vertically; the electronic exterior rearview mirror controller is installed in the vehicle, and it outputs the processed image data to the display screens installed on the inside of the left and right doors to display the real-time field of view of the rear side of the vehicle.

[0019] During driving, the system establishes CAN communication with the vehicle to obtain driving-related information, including gear position signal, steering switch signal, and vehicle speed signal, to judge the driving scene and working condition. Then, the original image captured by the camera is cropped, scaled, or translated according to different driving scenes and working conditions to obtain a suitable side and rear view of the vehicle under different driving conditions.

[0020] When the vehicle is reversing, the electronic exterior mirror controller identifies that the current gear is reverse gear through the gear information, that is, it controls the display field of view to shift downward so that the driver can intuitively see the rear of the vehicle and the area between the rear wheels and the ground. By receiving the obstacle distance detection information of the whole vehicle ADAS ultrasonic radar, the partial picture is captured and enlarged for the collision risk area behind the vehicle, that is, the picture-in-picture effect, to instruct the driver to keep a distance from obstacles and avoid collision between the vehicle and near-end obstacles (only the gear is judged to be R gear, and the user can manually turn on / off this function); the picture-in-picture effect is: superimposing a partial enlarged picture in the right / upper left corner area of ​​a complete picture, among which the left display screen superimposes a partial enlarged picture in the upper right corner, and the right display screen superimposes a partial enlarged picture in the upper left corner.

[0021] When the vehicle is turning, the electronic exterior mirror controller obtains the turn signal status information and recognizes that the current driving is turning, that is, it controls the display field of view to move away from the vehicle body end and expand the field of view, so that the driver can directly observe the wide field of view of the surrounding environment on the turning side of the vehicle. (Steering wheel angle information, when the angle > 100° (TBD, subject to the actual vehicle).

[0022] When the vehicle is driving at high speed, the vehicle speed information is obtained and it is determined whether it is currently driving at high speed. If the vehicle speed reaches the high-speed driving scene, the camera capture image is compressed by the controller unit and output to the display screen to achieve an expanded field of view. (Only confirm the vehicle speed, if the vehicle speed is >80km / h, the high-speed field of view is triggered, the user can manually turn it on / off, and the high-speed vehicle speed can be determined, and the user can set it, such as: 60km / h trigger, 70km / h trigger, 80km / h trigger).

[0023] When the vehicle is driving normally (driving straight ahead on a regular urban road), the field of view is automatically switched to the normal field of view without compression, enlargement or stretching, making the sense of distance in the field of view more intuitive.

[0024] like Figure 2As shown, the present invention also provides a method for adaptively adjusting a vehicle driving field of view, comprising the following steps: S1, collecting the rear view image of the vehicle through the wide-angle camera, and transmitting it to the electronic rearview mirror controller for camera data analysis operation; S2. The vehicle data unit synchronously analyzes the vehicle data, including vehicle steering, gear position, and speed information; during normal driving with few vehicles on the road, the preset default rear view range is displayed; S3, sending the acquired wide-angle camera video stream data to the ISP module for image processing to improve the clarity and color reproduction of the rear view image; S4. Compress or crop the processed image input by the ISP module according to the field of view adjustment instruction, and output the image to the display screen for display.

[0025] In this embodiment, the vehicle data processing unit outputs a field of view adjustment instruction according to the vehicle's current driving gear, steering, speed and obstacle information, including: a. When the vehicle is in reverse gear, it outputs a downward translation instruction for the image, and the rear end and rear wheels of the vehicle are in the ground area to avoid collision between the vehicle and near-end obstacles; b. When the vehicle is in D gear and the speed is >80km / h, it outputs a picture compression instruction, that is, the picture is reduced but the field of view is expanded, so that the driver can see a wider field of view, and the driver can easily make driving predictions with the assistance of a wide field of view.

[0026] The technical means disclosed in the scheme of the present invention are not limited to the technical means disclosed in the above-mentioned implementation mode, but also include technical schemes composed of any combination of the above-mentioned technical features. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications are also regarded as the protection scope of the present invention.

Claims

1. A vehicle driving vision adaptive adjustment device, characterized in that: It consists of two wide-angle cameras installed on the left and right outer ear mechanical arm structures of the vehicle, an electronic exterior rearview mirror controller, and two display screens embedded on the inside of the left and right doors; among them, the wide-angle camera is used to collect the vehicle's exterior rear view, the electronic exterior rearview mirror controller is responsible for parsing the exterior rear view image data collected by the wide-angle camera, and performing ISP image processing and exterior rear view image scaling and translation processing, and the display screen is used to display the final processed exterior rear view picture video.

2. The vehicle driving vision adaptive adjustment device according to claim 1, characterized in that: The parameters of the wide-angle camera are: 63° horizontally and 53° vertically; the electronic exterior rearview mirror controller is installed in the vehicle, and it outputs the processed image data to the display screens installed on the inside of the left and right doors to display the real-time field of view of the rear side of the vehicle.

3. The vehicle driving vision adaptive adjustment device according to claim 2, characterized in that: During driving, the system establishes CAN communication with the vehicle to obtain driving-related information, including gear position signal, steering switch signal, and vehicle speed signal, to judge the driving scene and working condition. Then, the original image captured by the camera is cropped, scaled, or translated according to different driving scenes and working conditions to obtain a suitable side and rear view of the vehicle under different driving conditions.

4. The vehicle driving vision adaptive adjustment device according to claim 3, characterized in that: When the vehicle is reversing, the electronic exterior mirror controller identifies that the current gear is reverse gear through the gear information, that is, it controls the display field of view to shift downward so that the driver can intuitively see the rear of the vehicle and the area between the rear wheels and the ground. By receiving the obstacle distance detection information of the whole vehicle ADAS ultrasonic radar, the partial picture is captured and enlarged for the collision risk area behind the vehicle, that is, the picture-in-picture effect, to instruct the driver to keep a distance from obstacles and avoid collision between the vehicle and near-end obstacles; the picture-in-picture effect is: superimposing a partial enlarged picture in the right / upper left corner area of ​​a complete picture, wherein the left display screen superimposes a partial enlarged picture in the upper right corner, and the right display screen superimposes a partial enlarged picture in the upper left corner.

5. The vehicle driving vision adaptive adjustment device according to claim 4, characterized in that: When the vehicle turns, the electronic exterior mirror controller obtains the turn signal status information and recognizes that it is currently turning. It controls the display field of view to move away from the vehicle body end and expand the field of view, so that the driver can intuitively observe the wide field of view of the surrounding environment on the turning side of the vehicle.

6. The vehicle driving vision adaptive adjustment device according to claim 5, characterized in that: When the vehicle is driving at high speed, the vehicle speed information is obtained and it is determined whether it is currently driving at high speed. If the vehicle speed reaches the high-speed driving scenario, the camera capture image is full-frame compressed through the controller unit and output to the display screen to achieve an expanded field of view.

7. The vehicle driving vision adaptive adjustment device according to claim 6, characterized in that: When the vehicle is driving normally (driving straight ahead on a regular urban road), the field of view is automatically switched to the normal field of view without compression, enlargement or stretching, making the sense of distance in the field of view more intuitive.

8. A method for adaptively adjusting a vehicle's driving vision, characterized in that: The steps include: S1, collecting the rear view image of the vehicle through the wide-angle camera, and transmitting it to the electronic rearview mirror controller for camera data analysis operation; S2. The vehicle data unit synchronously analyzes the vehicle data, including vehicle steering, gear position, and speed information; during normal driving with few vehicles on the road, the preset default rear view range is displayed; S3, sending the acquired wide-angle camera video stream data to the ISP module for image processing to improve the clarity and color reproduction of the external rear view image; S4. Compress or crop the processed image input by the ISP module according to the field of view adjustment instruction, and output the image to the display screen for display.

9. The method for adaptively adjusting vehicle driving vision according to claim 8, characterized in that: The vehicle data processing unit outputs a field of view picture adjustment instruction according to the vehicle's current driving gear, steering, speed and obstacle information, including: a. When the vehicle is in reverse gear, a downward translation instruction is output, and the rear end and rear wheels of the vehicle are in the ground area to avoid collision between the vehicle and near-end obstacles; b. When the vehicle is in D gear and the speed is >80km / h, a picture compression instruction is output, that is, the picture is reduced but the field of view is expanded, so that the driver can see a wider field of view, and the driver can easily make driving predictions with the assistance of a wide field of view.

Images