Electronic rearview mirror based on optical fiber transmission

Abstract

The invention provides an electronic rearview mirror based on optical fiber transmission, the electronic rearview mirror comprises an input end, an image transmission optical fiber bundle and an output end, the input end comprises an optical fiber camera, an active optical chip and a lens; the output end comprises a lens, an image processing module, an image conversion module, an electronic rearview mirror process module and a display screen. Image information is transmitted through the optical fiber, the image processing and image conversion processes are removed, image processing is directly carried out at the output end of the optical fiber, the image definition transmitted by the optical fiber is not affected while time delay is reduced in the image transmission process of the electronic rearview mirror, more accurate and real-time image data are provided for a driver, and the driver experience is improved. And the safety and the applicability of the electronic rearview mirror are improved.

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to an electronic rearview mirror based on optical fiber transmission. Background Art

[0002] As cars become more and more intelligent, the functions of traditional rearview mirrors can no longer meet the safety needs of vehicles with smart cockpits. Electronic rearview mirrors have become standard equipment for many high-end cars. Electronic rearview mirrors greatly reduce the safety risks brought by traditional rearview mirrors when driving in rainy days. The rearview mirror image data can also be connected to the smart cockpit to analyze the risks brought by the vehicle environment in real time and improve the active safety of the vehicle.

[0003] Most existing electronic rearview mirrors use traditional cameras, and the transmission medium is coaxial cable, which has a low transmission bandwidth. The video signal can only be encoded first, compressed and transmitted, and then decoded to form a frame of image, resulting in low clarity of signal transmission and very large delay, which cannot meet the safety standards of high precision and low delay. Another solution uses optical fiber as the transmission medium. Although the transmission bandwidth is greatly improved and uncompressed lossless video signals can basically be transmitted, traditional optical fiber cannot directly transmit images, so it is necessary to use a CMOS chip at the camera to encode the image, and then decode and display it after optical fiber transmission. There is also a delay caused by encoding and decoding. Therefore, how to reduce the delay in the process of transmitting images in electronic rearview mirrors has become a technical problem that needs to be solved at present. Summary of the invention

[0004] The present invention provides an electronic rearview mirror based on optical fiber transmission, which is used to solve the technical problems of long delay and low image quality in the process of image transmission of the electronic rearview mirror in the prior art.

[0005] The invention provides an electronic rearview mirror based on optical fiber transmission, comprising: an input end, an image transmission optical fiber bundle and an output end, wherein the input end comprises an optical fiber camera, an active optical chip and a lens; the output end comprises a lens, an image processing module, an image conversion module, an electronic rearview mirror process module and a display screen.

[0006] Optionally, a fiber optic camera is used to capture images from the rear of the vehicle, and when the vehicle enters a reverse mode, the fiber optic camera is automatically activated.

[0007] Optionally, an active optical chip is used to enhance the image, adjust the brightness, contrast, saturation and hue of the image, improve the clarity of the image, and reduce the noise of the image.

[0008] Optionally, the lens is coupled to the image transmission fiber bundle in a proportional position, the lens is used to change the size of the image, and the light source pixels of the image correspond one-to-one with the pixel elements of the image transmission fiber bundle.

[0009] Optionally, the lens includes a single lens and a multiple lens.

[0010] Optionally, the image processing module includes a CMOS image sensor and an ISP image controller.

[0011] Optionally, the image conversion module includes an FPGA data conversion module,

[0012] The FPGA data conversion module is used to receive the image data processed by the CMOS image processor and the ISP image controller; convert the processed image data into video data in a preset format; and transmit the converted video data to the display output interface.

[0013] Optionally, the electronic rearview mirror process is used to collect video data of the display output interface based on the V4L2 protocol; and use the Linux DRM image management system to render the video data to the display screen.

[0014] Optionally, an electronic rearview mirror process is used to send video data to the smart cockpit.

[0015] Optionally, a display screen is set at a preset position according to needs and displays warning information.

[0016] It can be seen from the above technical solution that the present invention provides an electronic rearview mirror based on optical fiber transmission, which includes: an input end, an image transmission optical fiber bundle and an output end, wherein the input end includes an optical fiber camera, an active optical chip and a lens; and the output end includes a lens, an image processing module, an image conversion module, an electronic rearview mirror process module and a display screen. By using optical fiber to transmit the image information of the electronic rearview mirror, the image processing and image conversion processes are eliminated, and the image processing is performed directly at the output end of the optical fiber, which reduces the delay while the image clarity is not affected, provides the driver with more accurate and real-time image data, and improves the safety and applicability of the electronic rearview mirror. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 A schematic structural diagram of an electronic rearview mirror based on optical fiber transmission provided by one embodiment of the present invention;

[0018] Figure 2 A schematic diagram of the structure of an input terminal of an electronic rearview mirror provided by an embodiment of the present invention;

[0019] Figure 3 A schematic structural diagram of an output end of an electronic rearview mirror provided in one embodiment of the present invention. DETAILED DESCRIPTION

[0020] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0021] Figure 1 FIG. 1 shows a schematic diagram of the structure of an electronic rearview mirror based on optical fiber transmission provided by an embodiment of the present invention. Figure 1 As shown, the electronic rearview mirror based on optical fiber transmission of this embodiment includes: an input end 11, an image transmission optical fiber bundle 12 and an output end 13. The input end 11 collects image data behind the vehicle, enhances the image, and maps the processed image to the front end of the image transmission optical fiber bundle 12 through a lens. The image transmission optical fiber bundle 12 directly transmits image elements, and the output end of the image transmission optical fiber bundle 12 directly outputs real-time image data. The image data at the output end of the image transmission optical fiber bundle 12 is magnified by a lens, image processed and converted, and then converted into a data format that meets the video playback and transmitted to the signal output port. Finally, the electronic rearview mirror process collects the video data of the signal output port through the V4L2 protocol, and displays it on the electronic display screen through the Linux DRM image management system. Among them, the image transmission light bundle is composed of a large number of fine optical fibers, and each optical fiber that constitutes the image transmission light bundle represents an imaging point. When the optical fibers of the image transmission light bundle are arranged regularly, that is, the optical fibers at the input end and the output end correspond one by one, the image at the input end is sampled by the optical fiber and transmitted to the output end. Therefore, the image transmission light bundle can transmit the image without loss.

[0022] Figure 2 FIG. 4 shows a schematic diagram of the structure of the input end of the electronic rearview mirror provided by an embodiment of the present invention. Figure 2 As shown, the input end of the electronic rearview mirror of this embodiment includes a fiber optic camera 21, an active optical chip 22, an input lens 23 and an image transmission fiber bundle 24.

[0023] The fiber optic camera 21 collects the image behind the vehicle. It relies on a high-performance laser light source and a megapixel lens, with high image clarity, long service life, and uniform and clear night vision. When the vehicle enters the reverse mode, the fiber optic camera 21 automatically activates to collect the image behind the vehicle, and automatically stops collecting when the reverse ends, ensuring that the image behind the vehicle is collected while reducing energy consumption.

[0024] The active optical chip 22 enhances the image captured by the optical fiber camera 21, adjusts the brightness, contrast, saturation and hue of the image, improves the clarity of the image, and reduces the noise of the image. Image enhancement is to improve the quality of the image, remove the noise in the image, make the edges clear and highlight certain properties in the image, and improve the readability of the image according to the characteristics of the human eye's observation of light brightness. Through image enhancement processing, such as contrast adjustment, sharpening, denoising and color adjustment, the contrast of the image is improved, the details and sharpness of the image are improved, the noise in the image is reduced, and the saturation and color effect of the image are improved, thereby adjusting the brightness, contrast, saturation and hue of the image, improving the resolution of the image, reducing the noise of the image, and improving the clarity of the image.

[0025] The image enhanced by the active optical chip 22 is output to the input lens 23. The input lens 23 is coupled with the image transmission fiber bundle 24 in a proportional position. The focusing effect of the input lens 23 can focus the image within a smaller size range, thereby achieving accurate focusing and control of the image. The placement ratio of the two is adjusted according to the radius of the front and rear surfaces of the input lens 23 and the size of the image transmission fiber bundle 24. By adjusting the positions of the input lens 23 and the image transmission fiber bundle 24, the input lens 23 reduces the overall image and makes the light source pixels of the image correspond to the pixel elements of the image transmission fiber bundle 24 one by one. Each light source pixel passing through the input lens 23 enters the corresponding optical fiber in the image transmission fiber bundle 24 at a total reflection angle.

[0026] Lens coupling is divided into single-lens coupling and multi-lens coupling. In single-lens coupling, the light beam is focused by the lens. In multi-lens coupling, the light beam becomes parallel light through the first lens and then is focused by the second lens. After lens coupling, the image is reduced as a whole so that the pixels in the image correspond one-to-one to the optical fiber pixels. The light source pixels in the image enter the corresponding optical fiber at the total reflection angle.

[0027] Figure 3 FIG. 4 shows a schematic diagram of the structure of the output end of the electronic rearview mirror provided by an embodiment of the present invention. Figure 3 As shown, the output end of the electronic rearview mirror of this embodiment includes an image transmission fiber bundle 31, an output lens 32, an image processing module 33, an image conversion module 34, an electronic rearview mirror process module 35 and a display screen 36.

[0028] The optical fiber in the image transmission fiber bundle 31 transmits images. The optical fiber is a fiber made of glass or plastic. It is a light transmission tool achieved by the principle of total reflection of light in the fiber made of glass or plastic. Based on the transmission principle of total reflection of light, the image transmission fiber bundle 31 directly transmits image pixels. The output end of the image transmission fiber bundle 31 is directly the real-time image data of the input end. The output end of the image transmission fiber bundle 31 is coupled to the output lens 32. By adjusting the position of the output lens 32 and the image transmission fiber bundle 31, the output lens 32 amplifies the output image as a whole. The amplified image is input to the image processing module 33 for processing. The image processing module 33 includes a complementary metal oxide semiconductor (CMOS) image sensor and an image signal processor (ISP). Among them, the CMOS image sensor is a typical solid imaging sensor, which is usually composed of a pixel array, a row driver, a column driver, a timing control logic, an AD converter, a data bus output interface, a control interface, etc. The CMOS image sensor is based on the photoelectric effect, converts the optical signal into an electrical signal, and then converts it into a digital signal through a digital-to-analog conversion module, and finally pre-processes and transmits the image information through a transmission interface, outputting low power consumption, high integration and good image quality. The ISP image controller is used to process the output data of the CMOS image sensor, process and optimize the original image signal collected from the CMOS image sensor, and generate the final high-quality image or video output. The ISP image controller works closely with the CMOS image sensor to process and enhance the image output by the output lens 32 in real time.

[0029] The image conversion module 34 includes a field programmable gate array (FPGA) data conversion module. The FPGA data conversion module is a highly configurable integrated circuit with powerful logic resources and low latency characteristics. It can provide real-time and high-speed image processing capabilities and achieve efficient image analysis and processing. After the CMOS image processor and the ISP image controller process the image, they are transmitted to the image conversion module 34 through the MIPI (Mobile Industry Processor Interface) protocol. The FPGA data conversion module converts the processed image data into video data in a preset format that meets the requirements of video playback, and transmits the converted video data to the display output interface.

[0030] The electronic rearview mirror process module 35 collects video data of the display output interface based on the V4L2 (Video for Linux 2) protocol. V4L2 is the video device driver interface standard in the Linux operating system and is a set of general API interfaces for collecting pictures, videos and audio data under the Linux operating system. The Linux operating system can safely and efficiently collect video data of the display output interface based on the V4L2 protocol, specifically including: opening the image conversion module 34, setting initialization parameters, setting the video image acquisition window, acquisition dot size and format through the V4L2 interface; applying for image frame buffers, and performing memory mapping, mapping these frame buffers from the kernel space to the user space, so that the application can read and process image data; enqueueing the frame buffer to start video acquisition; the driver starts the acquisition of video data, and the application takes out the frame buffer from the video acquisition output queue. After processing, the frame buffer is put back into the video acquisition input queue, and continuous video data is collected repeatedly; releasing resources and stopping the acquisition work.

[0031] After the electronic rearview mirror process 35 collects the video data, it uses the Direct Rendering Manager (DRM) image management system in Linux to render the image data to the display screen 36. DRM is a graphics subsystem in the Linux kernel and is a kernel subsystem responsible for interacting with modern GPU video cards. User space programs can use the DRM API to send data and commands to the GPU and can perform operations similar to setting the display mode. The Linux system renders the video data to the display screen 36 through the DRM image management system. The display screen 36 plays the video. The display screen can use LED backlight technology to prevent the display screen from being affected by light changes. Whether at night or in direct sunlight, the display screen 36 can provide clear images.

[0032] The electronic rearview mirror process 35 synchronously sends the processed video data to the smart cockpit. The smart cockpit refers to the integration of IT and artificial intelligence technologies in the car cockpit to build the car computer into a digital platform. After the smart cockpit receives the synchronized video from the rear of the car, it analyzes the vehicle environment in real time. After the video data is intelligently processed, it warns of dangerous vehicle events, such as lane departure, blind spot monitoring, and collision risks, and synchronizes the warning information to the display screen 36 and the terminal. The display screen 36 displays the warning information in real time to improve the active safety of the vehicle.

[0033] The display screen 36 of the electronic rearview mirror can be set at a preset position according to user needs, for example, at any position on the side of the vehicle, on the roof, or inside the vehicle that is convenient for users to observe. During driving, the driver can set it at a position that is convenient for users to observe and has a wide viewing angle according to user needs. Users can see the video behind the vehicle displayed on the display screen 36 without deliberately turning their heads, thereby improving driving safety.

[0034] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc., does not indicate any order. These words may be interpreted as names.

[0035] Those skilled in the art will appreciate that the foregoing embodiments are merely intended to illustrate the technical solutions of the present invention rather than to limit the present invention. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will appreciate that the technical solutions described in the foregoing embodiments may be modified or some or all of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope defined by the claims of the present invention.

Claims

1. An electronic rearview mirror based on optical fiber transmission, characterized in that: include: Input end, image fiber bundle and output end, The input end includes a fiber optic camera, an active optical chip and a lens; The output end includes a lens, an image processing module, an image conversion module, an electronic rearview mirror process module and a display screen.

2. The electronic rearview mirror according to claim 1, characterized in that: The optical fiber camera is used to collect images of the rear of the vehicle. When the vehicle enters the reverse mode, the optical fiber camera is automatically activated.

3. The electronic rearview mirror according to claim 1, characterized in that: The active optical chip is used to enhance the image, adjust the brightness, contrast, saturation and hue of the image, improve the clarity of the image, and reduce the noise of the image.

4. The electronic rearview mirror according to claim 1, characterized in that: The lens is coupled to the image transmission fiber bundle in a proportional position. The lens is used to change the size of the image, and the light source pixels of the image correspond one to one with the pixel elements of the image transmission fiber bundle.

5. The electronic rearview mirror according to claim 4, characterized in that: The lens includes a single lens and a multiple lens.

6. The electronic rearview mirror according to claim 1, characterized in that: The image processing module includes a CMOS image sensor and an ISP image controller.

7. The electronic rearview mirror according to claim 6, characterized in that: The image conversion module includes an FPGA data conversion module, The FPGA data conversion module is used to receive the image data processed by the CMOS image processor and the ISP image controller; Converting the processed image data into video data in a preset format; The converted video data is transmitted to the display output interface.

8. The electronic rearview mirror according to claim 7, characterized in that: The electronic rearview mirror process is used to collect video data of the display output interface based on the V4L2 protocol; The Linux DRM image management system is used to render the video data to the display screen.

9. The electronic rearview mirror according to claim 8, characterized in that: The electronic rearview mirror process is used to send the video data to the smart cockpit.

10. The electronic rearview mirror according to claim 1, characterized in that: The display screen is used to be set at a preset position according to needs and display warning information.

Images