A multi-scene multispectral camera system

Abstract

The utility model relates to optical imaging technical field provides a kind of for multi-scene multispectral camera system, including visible light camera component, shortwave infrared camera component, longwave infrared camera component, display device, power supply system and cable, shortwave infrared camera component uses InGaAs uncooled infrared focal plane detector, longwave infrared camera component uses vanadium oxide uncooled infrared focal plane detector, display device is equipped with gigabit network interface and HDMI interface.The utility model's detector product has the advantages such as low power consumption, small size, no TEC, is suitable for low-power, size-sensitive vehicle-mounted low-cost, low-power application occasion, through the innovation technology of domestic integration and polaroid adjustment, ensure whole process self-controlling and stable supply, realize the efficient, stable application of multispectral camera in vehicle equipment, significantly improve image quality and environmental adaptability.

Description

Technical Field

[0001] This utility model relates to the field of optical imaging technology, and in particular to a multi-scene multispectral camera system. Background Technology

[0002] Multispectral cameras are primarily used in existing general-purpose vehicles, enabling real-time detection and display of video images of the road conditions ahead, thus assisting drivers. Applicable vehicle types include command vehicles, tractor units, transport vehicles (including off-road and non-off-road vehicles), and general-purpose special-purpose vehicles.

[0003] However, existing multispectral cameras typically rely on imported components, leading to issues such as unstable supply, high power consumption, and large size. Furthermore, they often require external illumination, limiting their application in low-power, compact environments. Therefore, to address these problems, a multispectral imaging system that combines module design and polarizer adjustment mechanisms to achieve full-field-of-view, low-power, and highly consistent multispectral imaging is needed. Utility Model Content

[0004] In view of this, in order to overcome the shortcomings of the prior art, the purpose of this utility model is to propose a multi-scene multispectral camera system. Through domestic integration and innovative polarizer adjustment, it ensures independent controllability and stable supply throughout the entire process, realizing the efficient and stable application of multispectral cameras in vehicle equipment, and significantly improving image quality and environmental adaptability.

[0005] To achieve the above objectives, this utility model provides the following technical solution: To achieve the above objectives, in a first aspect, this utility model provides a multi-scene multispectral camera system, comprising: Visible light camera assembly, used to acquire visible light images; A short-wave infrared camera assembly employs an InGaAs uncooled infrared focal plane detector and includes a polarizer adjustment mechanism configured to achieve a polarizer-free, fixed polarizer, or rotating polarizer state. The long-wave infrared camera assembly employs a vanadium oxide uncooled infrared focal plane detector and includes a long-wave driven gear mirror chamber configured to rotate at any angle to adjust the pressed-in polarizer. The display device is equipped with a gigabit Ethernet port and an HDMI interface for image data output and external screen expansion; The power supply system supplies power to the visible light camera assembly, the short-wave infrared camera assembly, the long-wave infrared camera assembly, and the display device via cables.

[0006] As a further embodiment of this utility model, the polarizer adjustment mechanism of the shortwave infrared camera assembly includes a slide rail, a slide table, a drive motor, a polarizer mounting bracket, a limiting bracket, and a polarizer mounting base; the slide table is slidably arranged along the slide rail, the polarizer mounting bracket, the limiting bracket, and the polarizer mounting base are all mounted on the slide table, the drive motor is mounted on the polarizer mounting bracket, the polarizer mounting bracket is used to mount a rotating polarizer, the limiting bracket is used to mount a shortwave camera, and the polarizer mounting base is used to mount a fixed polarizer.

[0007] As a further embodiment of this utility model, the polarizer mounting bracket is provided with a rotating shortwave driven gear mirror chamber, and a polarizer for rotation is installed in the shortwave driven gear mirror chamber. The drive motor engages the shortwave driven gear mirror chamber with a drive gear to drive the polarizer in the shortwave driven gear mirror chamber to rotate and adjust at any angle.

[0008] As a further embodiment of this utility model, a polarizer for fixing is pressed into the polarizer mounting base and fastened with screws. When the polarizer mounting base is configured to fix the polarizer, it is fastened with screws. When the polarizer mounting bracket is configured to rotate the polarizer, a short-wave driven gear mirror chamber is pressed into it.

[0009] As a further embodiment of this utility model, the long-wave infrared camera assembly also includes a polarizer bracket, a servo motor, and a long-wave camera; the long-wave driven gear mirror chamber is rotatably installed in the polarizer bracket, the polarizer is pressed into the rotating long-wave driven gear mirror chamber, and the servo motor drives the long-wave driven gear mirror chamber through the drive gear, so that the polarizer pressed into the long-wave driven gear mirror chamber can be rotated and adjusted at any angle.

[0010] As a further embodiment of this invention, the gigabit Ethernet port of the display device supports the IEEE 802.3 protocol, with an interface rate that adapts to 10 / 100 / 1000Mbps, and uses the PDXP / UDP / IP protocol for real-time data transmission; the HDMI interface supports 1080p resolution and multi-channel audio output.

[0011] Compared with existing technologies, the multi-scene multispectral camera system proposed in this utility model has the following beneficial effects: This utility model discloses a multispectral camera system for multiple scenarios. Through domestically produced module integration and innovative polarizer adjustment, it solves the problems of existing technologies, such as reliance on imported components, high power consumption, large size, and the need for external supplementary lighting. The visible light imaging detector, short-wave infrared imaging detector, long-wave infrared imaging detector, and main control chip all use domestically produced components, achieving fully independent and controllable production and avoiding the risk of import dependence. Both the short-wave and long-wave infrared detectors employ an uncooled solution, offering advantages such as low power consumption, small size, and no TEC (Transmission Electron Device). Compared to traditional cooled detectors, this reduces power consumption and size, making it suitable for low-power, size-sensitive, low-cost automotive applications. The system integrates visible light, short-wave infrared, and long-wave infrared imaging into one unit. Through multispectral complementarity, it can still achieve clear imaging in low-light, foggy, or nighttime environments, improving the all-weather adaptability of vehicle assisted driving and significantly enhancing the multispectral camera's self-control, power consumption, imaging quality, reliability, and maintainability.

[0012] These or other aspects of this application will become more apparent from the following description of embodiments. It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only, and are not intended to limit the application. Attached Figure Description

[0013] To more clearly illustrate the technical solutions in the embodiments of this utility model or related technologies, the accompanying drawings used in the description of the exemplary embodiments or related technologies will be briefly introduced below. The drawings are used to provide a further understanding of this utility model and constitute a part of the specification. They are used together with the embodiments of this utility model to explain this utility model and do not constitute a limitation on this utility model. In the drawings: Figure 1 This is a schematic diagram of the structure of a multi-scene multispectral camera system according to an embodiment of the present invention.

[0014] Figure 2 This is a schematic diagram of the structure of a shortwave camera component in a multi-scene multispectral camera system according to an embodiment of the present invention.

[0015] Figure 3 This is a schematic diagram of the structure of a long-wavelength camera component in a multi-scene multispectral camera system according to an embodiment of the present invention.

[0016] Figure 4 This is a flowchart illustrating the operation of a display device in a multi-scene multispectral camera system according to an embodiment of the present invention.

[0017] Figure reference numerals: 100-Visible light camera assembly, 200-Shortwave infrared camera assembly, 300-Longwave infrared camera assembly, 1-Slide rail, 2-Slide table, 3-Drive motor, 4-Polarizer mounting bracket, 5-Shortwave camera, 6-Limit bracket, 7-Polarizer mounting base, 8-Drive gear, 9-Shortwave driven gear lens chamber, 10-Polarizer bracket, 11-Servo motor, 12-Longwave camera, 13-Drive gear, 14-Longwave driven gear lens chamber. Detailed Implementation

[0018] The present application will now be further described in conjunction with the accompanying drawings and specific embodiments. It should be noted that, without conflict, the various embodiments or technical features described below can be arbitrarily combined to form new embodiments.

[0019] To make the objectives, technical solutions, and advantages of this utility model clearer, the embodiments of this utility model are further described in detail below with reference to specific examples and the accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative and are not intended to limit this application.

[0020] It should be noted that all uses of the terms "first" and "second" in the embodiments of this utility model are for the purpose of distinguishing two different entities or different parameters with the same name. Therefore, "first" and "second" are merely for convenience of expression and should not be construed as limiting the embodiments of this utility model. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, such as other steps or units inherent in a process, method, system, product, or device that includes a series of steps or units.

[0021] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0022] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0023] The following detailed description of some embodiments of this application is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0024] See Figure 1As shown, an embodiment of this utility model provides a multi-scene multispectral camera system, including: a visible light camera assembly 100; a short-wave infrared camera assembly 200, employing an InGaAs uncooled infrared focal plane detector and including a polarizer adjustment mechanism configured to achieve a state of no polarizer, fixed polarizer, or rotating polarizer; a long-wave infrared camera assembly 300, employing a vanadium oxide uncooled infrared focal plane detector and including a long-wave driven gear mirror chamber 14, configured to rotate at any angle to adjust the pressed-in polarizer; a display device equipped with a gigabit Ethernet port and an HDMI interface for image data output and external screen expansion; and a power supply system that supplies power to the visible light camera assembly 100, the short-wave infrared camera assembly 200, the long-wave infrared camera assembly 300, and the display device via cables.

[0025] In this embodiment, the multi-scene multispectral camera system adopts a domestically produced module design. The main control chips of the visible light camera component 100, short-wave infrared camera component 200, and long-wave infrared camera component 300 are all domestically produced chips, with independent and controllable production throughout the entire process and stable supply. The short-wave imaging detector of the short-wave infrared camera component 200 adopts an InGaAs uncooled infrared focal plane detector; the long-wave infrared imaging detector of the long-wave infrared camera component 300 adopts a vanadium oxide uncooled infrared focal plane detector, which has the advantages of low power consumption, small size, and no TEC, and is suitable for low-power, size-sensitive vehicle-mounted low-cost, low-power applications. The multispectral camera integrates visible light, short-wave infrared, and long-wave infrared into one unit, eliminating the need for illumination supplementation measures across the entire field of view.

[0026] In some embodiments, see Figure 2 As shown, the polarizer adjustment mechanism of the shortwave infrared camera assembly 200 includes a slide rail 1, a slide table 2, a drive motor 3, a polarizer mounting bracket 4, a limiting bracket 6, and a polarizer mounting base 7. The slide table 2 is slidably arranged along the slide rail 1. The polarizer mounting bracket 4, the limiting bracket 6, and the polarizer mounting base 7 are all mounted on the slide table 2. The drive motor 3 is mounted on the polarizer mounting bracket 4. The polarizer mounting bracket 4 is used to mount a rotating polarizer. The limiting bracket 6 is used to mount a shortwave camera 5. The polarizer mounting base 7 is used to mount a fixed polarizer.

[0027] The polarizer mounting bracket 4 is equipped with a rotating shortwave driven gear mirror chamber 9, in which a polarizer for rotation is installed. The drive motor 3 engages with the shortwave driven gear mirror chamber 9 via a drive gear 8, thereby driving the polarizer in the shortwave driven gear mirror chamber 9 to rotate and adjust at any angle.

[0028] The polarizer mounting base 7 has a polarizer pressed into it for fixing and is fastened with screws. When the polarizer mounting base 7 is configured to fix the polarizer, it is fastened with screws. When the polarizer mounting bracket 4 is configured to rotate the polarizer, a shortwave driven gear mirror chamber 9 is pressed into it.

[0029] In this embodiment, the shortwave camera 5 operates in three states: without polarizer, with polarizer (fixed), and with polarizer (rotating). The state without polarizer requires no special design. The shortwave infrared camera assembly 200 of this invention is suitable for the state with polarizer. This includes the polarizer mounting base 7 being fastened with screws when the polarizer is fixed, and the polarizer mounting bracket 4 being pressed into the shortwave driven gear lens chamber 9 when the polarizer is rotating. Both states are mounted on a straight slide rail 1, reducing the overall space and making the overall structure more reliable and easier to operate.

[0030] In some embodiments, see Figure 3 As shown, the long-wave infrared camera assembly 300 also includes a polarizer bracket 10, a servo motor 11, and a long-wave camera 12; the long-wave driven gear mirror chamber 14 is rotatably mounted in the polarizer bracket 10, the polarizer is pressed into the rotating long-wave driven gear mirror chamber 14, and the servo motor 11 drives the long-wave driven gear mirror chamber 14 through the drive gear 13, so that the polarizer pressed into the long-wave driven gear mirror chamber 14 can be rotated and adjusted at any angle.

[0031] A polarizer needs to be installed in front of the long-wave camera 12 for adjustment. The polarizer is pressed into the rotating long-wave driven gear lens chamber 14, which allows the polarizer to be adjusted at any angle without affecting the lens's shooting. The drive gear 13 is driven by the servo motor 11. The drive gear 13 meshes with the long-wave driven gear lens chamber 14, resulting in smooth transmission, high transmission efficiency, long service life, and improved overall structural reliability.

[0032] In some embodiments, the gigabit Ethernet port of the display device supports the IEEE 802.3 protocol, with an interface rate that adapts to 10 / 100 / 1000Mbps, and uses the PDXP / UDP / IP protocol for real-time data transmission; the HDMI interface supports 1080p resolution and multi-channel audio output.

[0033] Among them, see Figure 4As shown, the display device for data interaction has one gigabit Ethernet port for communication with the camera module (switch) and one HDMI driver interface for expanding external screens and testing. The gigabit Ethernet port's data link interface is IEEE 802.3, with an interface speed of 10 Mbps / 100 Mbps / 1000 Mbps adaptive. The high-level protocol used for real-time data transmission is PDXP / UDP / IP; file transfer uses FEP / TCP / IP or FEP+RECP / UDP / IP; and operational information transmission uses SNMP (V2) / UDP / IP. See Table 1 for gigabit Ethernet port types and transmission distances. Table 1. Gigabit Ethernet Port Types and Transmission Distances speed Common Names Informal IEEE standard names Official IEEE standard name Cable type Maximum transmission distance 10Mbps Ethernet 10BASE-T 802.3 Twisted pair 100m 100Mbps Fast Ethernet 100BASE-T 802.3u Twisted pair 100m 1Gbps Gigabit Ethernet 1000BASE-LX 802.3z optical fiber 5000m 1Gbps Gigabit Ethernet 1000BASE-T 802.3ab Twisted pair 100m 10Gbps 10 Gigabit Ethernet 10GBASE-T 802.3an Twisted pair 100m The HDMI interface for data interaction displays replaces older analog signal audio / video transmission interfaces such as SCART or RCA terminals. It supports various TV and computer video formats, including SDTV and HDTV video, as well as multi-channel digital audio. This ensures that congestion does not occur during high video throughput. Each pixel has 24 bits of data, and the image is transmitted line by line, with a specific pause added after each line and frame is transmitted. Each frame is completely retransmitted during this update. The maximum pixel transfer rate is 165 Mpx / sec, supporting 1080p resolution at 60 frames per second, or UXGA resolution (1600x1200). In the HDMI 1.3 specification, this has been expanded to 340 Mpx / sec to meet usage requirements. The HDMI interface also supports uncompressed 8-channel digital audio transmission (192kHz sampling rate, 24 bits / sample), as well as any compressed audio streams such as Dolby Digital or DTS, and also supports the 8-channel 1-bit DSD signal used by SACD. The HDMI 1.3 specification supports lossless compressed audio streams with ultra-high data volume, such as Dolby TrueHD and DTS-HD.

[0034] The standard Type A HDMI connector has 19 pins, while the Type B connector supports higher resolutions. The Type B connector has 29 pins and sends extended video channels to meet high-definition requirements, such as WQSXGA (3200x2048). Type A HDMI is also backward compatible with most current monitors and graphics cards using Single-link DVI-D or DVI-I interfaces (but not DVI-A). Signal sources using DVI-D interfaces can drive HDMI screens via an adapter cable. Type B HDMI connectors are also backward compatible with Dual-link DVI interfaces.

[0035] This utility model discloses a multispectral camera system for multiple scenarios. Through domestic module integration and innovative polarizer adjustment, it solves the problems of existing technologies, such as reliance on imported components, high power consumption, large size, and the need for external supplementary lighting. The visible light imaging detector, short-wave infrared imaging detector, long-wave infrared imaging detector, and main control chip all use domestically produced components, achieving fully independent and controllable production and avoiding the risk of import dependence. Both the short-wave and long-wave infrared detectors adopt an uncooled solution, which has advantages such as low power consumption, small size, and no TEC (Transmission Electron Device). Compared with traditional cooled detectors, power consumption is reduced and size is smaller, making it suitable for low-power, size-sensitive, low-cost, low-power automotive applications. The system integrates visible light, short-wave infrared, and long-wave infrared imaging into one unit. Through multispectral complementarity, it can still achieve clear imaging in low-light, foggy, or nighttime environments, improving the all-weather adaptability of vehicle assisted driving. This significantly improves the multispectral camera in terms of independent controllability, power consumption, imaging quality, reliability, and maintainability.

[0036] The above are exemplary embodiments disclosed in this utility model. However, it should be noted that various changes and modifications can be made without departing from the scope of the embodiments of this utility model as defined by the claims. The functions, steps, and / or actions of the methods according to the disclosed embodiments described herein do not need to be performed in any particular order. Furthermore, although the elements disclosed in the embodiments of this utility model may be described or claimed individually, they may be understood as multiple unless explicitly limited to a singular number.

[0037] It should be understood that, as used herein, the singular form "a" is intended to include the plural form as well, unless the context clearly supports an exception. It should also be understood that, as used herein, "and / or" refers to any and all possible combinations of one or more of the associatedly listed items. The embodiment numbers disclosed above are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0038] Those skilled in the art should understand that the discussion of any of the above embodiments is merely exemplary and is not intended to imply that the scope of the present invention (including the claims) is limited to these examples. Within the framework of the present invention, technical features of the above embodiments or different embodiments can also be combined, and many other variations of different aspects of the present invention exist, which are not provided in the details for the sake of brevity. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A multi-scene multispectral camera system, characterized in that, include: Visible light camera components; A short-wave infrared camera assembly employs an InGaAs uncooled infrared focal plane detector and includes a polarizer adjustment mechanism configured to achieve a polarizer-free, fixed polarizer, or rotating polarizer state. The long-wave infrared camera assembly employs a vanadium oxide uncooled infrared focal plane detector and includes a long-wave driven gear mirror chamber configured to rotate at any angle to adjust the pressed-in polarizer. Display device, equipped with Gigabit Ethernet port and HDMI interface; The power supply system supplies power to the visible light camera assembly, the short-wave infrared camera assembly, the long-wave infrared camera assembly, and the display device via cables.

2. The multi-scene multispectral camera system as described in claim 1, characterized in that, In step 1), the polarizer adjustment mechanism of the shortwave infrared camera assembly includes a slide rail, a slide table, a drive motor, a polarizer mounting bracket, a limiting bracket, and a polarizer mounting base; the slide table is slidably arranged along the slide rail, the polarizer mounting bracket, the limiting bracket, and the polarizer mounting base are all mounted on the slide table, the drive motor is mounted on the polarizer mounting bracket, the polarizer mounting bracket is used to mount a rotating polarizer, the limiting bracket is used to mount a shortwave camera, and the polarizer mounting base is used to mount a fixed polarizer.

3. The multi-scene multispectral camera system as described in claim 2, characterized in that, The polarizer mounting bracket is equipped with a rotating shortwave driven gear mirror chamber, in which a polarizer for rotation is installed. The drive motor engages the shortwave driven gear mirror chamber with a drive gear to drive the polarizer inside the shortwave driven gear mirror chamber to rotate and adjust at any angle.

4. The multi-scene multispectral camera system as described in claim 3, characterized in that, A polarizer is pressed into the polarizer mounting base for fixing and is secured with screws. When the polarizer mounting base is configured to fix the polarizer, it is secured with screws. When the polarizer mounting bracket is configured to rotate the polarizer, it is pressed into the short-wave driven gear mirror chamber.

5. The multi-scene multispectral camera system as described in claim 1, characterized in that, The long-wave infrared camera assembly also includes a polarizer bracket, a servo motor, and a long-wave camera; the long-wave driven gear mirror chamber is rotatably installed in the polarizer bracket, the polarizer is pressed into the rotating long-wave driven gear mirror chamber, and the servo motor drives the long-wave driven gear mirror chamber through the drive gear, so that the polarizer pressed into the long-wave driven gear mirror chamber can be rotated and adjusted at any angle.

6. The multi-scene multispectral camera system as described in claim 1, characterized in that, The display device's gigabit Ethernet port supports the IEEE 802.3 protocol, with an interface speed adaptive of 10 / 100 / 1000Mbps, and uses PDXP / UDP / IP protocols for real-time data transmission; the HDMI interface supports 1080p resolution and multi-channel audio output.

Images