Device, system and method for assisting gluing of optical prism and image sensor

Abstract

The invention relates to the technical field of optics, and particularly provides a device, system and method for assisting gluing of an optical prism and an image sensor, and the device can comprise a built-in circuit board which is used for connecting a plurality of image sensors, and the plurality of image sensors are glued with the prism; the control module is used for connecting terminal equipment, and the terminal equipment is used for controlling the plurality of image sensors to output images under different sensor parameters; the digital image interface is used for connecting a monitor and a video oscilloscope, the monitor is used for displaying the images output by the plurality of image sensors, and the video oscilloscope is used for displaying video oscillogram corresponding to the images. And determining the gluing effect of the plurality of image sensors and the prisms through the images and the video oscillogram. Some embodiments of the invention can improve the precision of gluing alignment of the image sensor and the prism.

Description

Technical Field

[0001] The present application relates to the field of optical technology, and in particular to a device, system and method for gluing an auxiliary optical prism and an image sensor. Background Art

[0002] Color camera systems generally include single sensors and multi-chip sensors. The imaging system of a multi-chip image sensor is a combination of a three-color separation prism and at least three image sensors. The prism decomposes the incident complex light into three colors of R, G, and B, and each color light signal is received by its corresponding image sensor. In order to make a combined imaging system of a multi-chip image sensor and a prism, the prism and the multi-chip image sensor need to be aligned and glued. At present, the production process relies on human eyes to observe and judge whether the prism and the multi-chip image sensor are aligned and glued, which has low accuracy.

[0003] Therefore, how to provide a technical solution for gluing auxiliary optical prisms and image sensors with higher precision has become a technical problem that needs to be solved urgently. Summary of the invention

[0004] The purpose of some embodiments of the present application is to provide a device, system and method for assisting the gluing of an optical prism and an image sensor. Through the technical solutions of the embodiments of the present application, the gluing effect of the prism and the image sensor can be observed more intuitively, thereby improving the precision and accuracy of the gluing alignment of the prism and the image sensor.

[0005] In a first aspect, some embodiments of the present application provide a device for assisting the gluing of an optical prism and an image sensor, comprising: a built-in circuit board for connecting multiple image sensors, wherein the multiple image sensors and the prism are glued; a control module for connecting a terminal device, wherein the terminal device is used to control the multiple image sensors to output images under different sensor parameters; a digital image interface for connecting a monitor and a video oscilloscope, wherein the monitor is used to display the images output by the multiple image sensors, and the video oscilloscope is used to display a video waveform graph corresponding to the image, so as to determine the gluing effect of the multiple image sensors and the prism through the image and the video waveform graph.

[0006] Some embodiments of the present application are connected through a built-in circuit board and multiple image sensors, and then a terminal device connected through a control module controls the multiple image sensors to output images under different sensor parameters, and displays the images and video waveforms on a monitor and a video oscilloscope, so as to more intuitively observe the bonding effect of the prism and the image sensor, thereby improving the precision and accuracy of the bonding alignment of the prism and the image sensor.

[0007] In some embodiments, the built-in circuit board is used to: connect the multiple image sensors via multiple connecting cables; wherein one connecting cable connects one image sensor; receive control instructions sent by the control module, and digitally process image data output by the multiple image sensors to obtain the image.

[0008] Some embodiments of the present application connect multiple image sensors via multiple connection cables to facilitate analysis of the bonding effect of the multiple image sensors and prisms.

[0009] In some embodiments, the terminal device is used to: in response to a first operation instruction from a user, control the sensor parameters of each image sensor in the multiple image sensors, the sensor parameters including gain, black level and shutter time; in response to a second operation instruction from the user, select image parameters, the image parameters including image output format and image center mark; the control module is used to control the sensor parameters and the image parameters of each image sensor, and transmit them to each image sensor through the multiple connection cables, so as to output the image matching the sensor parameters and the image parameters.

[0010] In some embodiments of the present application, by adjusting sensor parameters on a terminal device, a control module can transmit the sensor parameters to each image sensor so that the image sensor can output an image under corresponding parameters, and the accuracy of gluing and aligning the image sensor and the prism can be improved by observing the image.

[0011] In some embodiments, the digital image interface includes two serial digital interfaces, and the digital image interface is used to respectively connect the monitor and the video oscilloscope through the two serial digital interfaces.

[0012] Some embodiments of the present application can intuitively view the effect of gluing the image sensor and the prism together by connecting a monitor and a video oscilloscope to display images and video waveforms.

[0013] In some embodiments, the plurality of connection cables include three cables, and the plurality of image sensors include three image sensors.

[0014] In some embodiments, each image sensor in the plurality of image sensors is fixed on a mechanical fixture; and the device is connected to each image sensor and the camera circuit substrate through an IC socket.

[0015] Some embodiments of the present application connect the image sensor and the preamplifier substrate via an IC socket, which facilitates installation and removal.

[0016] In some embodiments, the terminal device is a PC or a hardware controller.

[0017] In some embodiments, the device further comprises a power source.

[0018] In a second aspect, some embodiments of the present application provide a system of gluing an auxiliary optical prism and an image sensor, including: an imaging system composed of multiple image sensors and prisms, a monitor, a video oscilloscope, a terminal device, and an apparatus as described in any embodiment of the first aspect.

[0019] In a third aspect, some embodiments of the present application provide a method for gluing an auxiliary optical prism and an image sensor, comprising: a terminal device obtains sensor parameters of each image sensor in a plurality of image sensors in response to an operation instruction of a user; a device for gluing the auxiliary optical prism and the image sensor transmits the sensor parameters of each image sensor to each image sensor; the plurality of image sensors output images matching the sensor parameters; a monitor displays the image, and a video oscilloscope displays a video waveform graph corresponding to the image. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of some embodiments of the present application, the drawings required for use in some embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1 A system diagram of an auxiliary optical prism and an image sensor glued together provided for some embodiments of the present application; Figure 2 A structural diagram of a device for bonding an auxiliary optical prism and an image sensor provided in some embodiments of the present application; Figure 3 A schematic diagram of a software interface provided for some embodiments of the present application; Figure 4 A schematic diagram of a hardware controller panel provided for some embodiments of the present application; Figure 5 A flow chart of a method for gluing an auxiliary optical prism and an image sensor provided in some embodiments of the present application. DETAILED DESCRIPTION

[0022] The technical solutions in some embodiments of the present application will be described below in conjunction with the drawings in some embodiments of the present application.

[0023] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0024] In the related art, color camera systems generally include single sensors and three sensors. In a single sensor camera system, a Bayer filter containing only the three primary colors of R, G, and B is covered on the surface of the image sensor. The three-color signal filtered by the filter is received by the image sensor, and then the signal collected by the image sensor is processed by an image algorithm (such as color interpolation), and finally a color digital signal is obtained for display. In practical applications, even the best color space interpolation method will produce a low-pass effect. At the same time, the light utilization rate of the Bayer filter cannot reach a very high level due to design limitations. In high-end image applications (such as broadcasting, medical treatment, and high-end video conferencing), the image clarity, color reproduction, and image sensitivity of the output are difficult to meet the image quality requirements of the system application. Therefore, in this application scenario, an imaging system with at least three image sensors is required. The imaging system of multiple image sensors is a combination of a three-color separation prism and at least three image sensors. The prism decomposes the incident complex light into three colors of R, G, and B, and each color light signal is received by its corresponding sensor. Its advantage is that compared with a single-sensor system, this camera method can obtain high-definition images with high color reproduction.

[0025] The prism is a non-standard structure, and the relative angles between the three output ports R, G, and B are non-standard. The general assembly is performed by using three robotic arms controlled by a computer, and the relative positions of the three image sensors to the prism are controlled by a program. However, due to the extremely high alignment accuracy requirements (error tolerance of a few tenths of a micron), it is impossible to accurately position the image by only subjectively judging the bonding accuracy through human eyes during the control process.

[0026] In view of this, some embodiments of the present application provide a device for assisting the bonding of an optical prism and an image sensor. During operation, the device can synchronously monitor the image and video waveform output after the prism and the image sensor are bonded to determine the bonding effect. Moreover, the device can adjust some parameters of the sensor online in real time and assist in outputting some image effects after bonding. In this way, the bonding effect of the prism and the image sensor can be more intuitively viewed through the device to assist the monitor and oscilloscope, thereby improving the precision and accuracy of the bonding alignment of the image sensor and the prism.

[0027] The following is combined with Figure 1The overall composition structure of a system in which an auxiliary optical prism and an image sensor are glued together, provided in some embodiments of the present application, is exemplified.

[0028] like Figure 1 As shown, some embodiments of the present application provide a system for gluing an auxiliary optical prism and an image sensor, the system comprising: an auxiliary optical prism and an image sensor gluing device 100 (referred to as device 100), an imaging system 110, a monitor 120, a video oscilloscope 130, a terminal device 140 and a power supply 150. The imaging system 110 comprises an Rch image sensor 111, a Gch image sensor 112, a Bch image sensor 113 (as a specific example of a multi-chip image sensor) and a prism (not shown in the figure).

[0029] It should be noted that although Figure 1 The example in the figure connects three image sensors. In practical applications, the number of image sensors can be set according to actual needs, and the embodiments of the present application are not limited to this.

[0030] The following is an example of Figure 1 The functions of each structure in it.

[0031] like Figure 2 As shown, in some embodiments of the present application, the device 100 for bonding the auxiliary optical prism and the image sensor may include: a mechanical housing, a built-in circuit board, a control module, a digital image interface and a power supply. Figure 2 The power interface 7 in the apparatus 100 is connected, which can supply power to the entire apparatus 100, and the supply voltage can be 12V-17V.

[0032] In some embodiments of the present application, the built-in circuit board is used to: connect multiple image sensors, wherein the multiple image sensors are glued to the prisms, wherein the multiple image sensors are connected via multiple connecting cables, wherein one connecting cable connects one image sensor.

[0033] For example, in some embodiments of the present application, an interface is provided on the built-in circuit board. Figure 2 Interfaces 1, 2, and 3 on the built-in circuit board in the apparatus 100 are connected to three image sensors (i.e., Rch image sensor 111, Gch image sensor 112, and Bch image sensor 113) through cables (as a specific example of multiple connection cables). One end of the cable is fixed to the built-in circuit board inside the apparatus 100, and the other end is fixed to the image sensor board.

[0034] In some embodiments of the present application, the built-in circuit board is further used to: receive a control instruction sent by the control module, and digitally process the image data output by the multiple image sensors to obtain the image.

[0035] For example, in some embodiments of the present application, the built-in circuit board can also perform digital image processing operations on the image data output by the Rch image sensor 111, the Gch image sensor 112, and the Bch image sensor 113 after receiving the control instruction of the control module to obtain the corresponding image, so as to facilitate the subsequent monitor 120 and the video oscilloscope 130 to output the auxiliary images and video waveforms required for gluing.

[0036] In some embodiments of the present application, each image sensor in the plurality of image sensors is fixed on a mechanical fixture; the device is connected to each image sensor and the camera circuit substrate by an IC socket.

[0037] For example, in some embodiments of the present application, the other side of the image sensor board is fixed on a mechanical fixture to facilitate the pasting operation of the robot. The image sensor device and the preamplifier substrate of the circuit fixture (that is, the part directly connected to the camera element) are connected to the entire device using an IC socket, which can be easily installed and disassembled. The length of the connecting cable (that is, the cable) from the circuit fixture to the tooling chassis interface of the device 100 can be set according to actual conditions (for example, the cable length is about 300 to 500 mm), and the cable should use soft wire as much as possible. In addition, the influence of external noise should be reduced.

[0038] In some embodiments of the present application, the control module is used to: connect to a terminal device, wherein the terminal device is used to control the multiple image sensors to output images under different sensor parameters, wherein the terminal device is a PC or a hardware controller.

[0039] For example, in some embodiments of the present application, the control module includes: Figure 2 The control interface 6 shown. A terminal device can be connected via the control interface 6. For example, it can be connected to a computer (as a specific example of a PC terminal) or a hardware controller. The computer can be a desktop or mobile type, and the present application embodiment is not specifically limited here.

[0040] In some embodiments of the present application, the terminal device 140 is used to: in response to a first operation instruction of the user, obtain the sensor parameters of each image sensor in the multiple image sensors, the sensor parameters including gain, black level and shutter time; in response to a second operation instruction of the user, select image parameters, the image parameters including image output format and image center mark.

[0041] For example, in some embodiments of the present application, when the terminal device 140 is a computer, the tooling parameters (as a specific example of sensor parameters) are set and operated through the host computer control software on the computer or connected to the control panel. Figure 3As shown in the software interface diagram, users can adjust the gain size (Gain), black level size (Pedestal) and shutter time of each image sensor through the buttons on the software interface diagram. In addition, users can also select different image output formats (MONITOR OUT SELECTOR) and whether to turn on the image center cross mark switch (CenterMarker, as a specific example of the image center mark) and other image parameters (or digital image output parameters), so as to obtain the sensor parameters of each image sensor.

[0042] For example, in some other embodiments, the terminal device 140 may be Figure 4 The front panel (FRONT PANEL) of the hardware controller is provided with buttons (or knobs) for adjusting tooling parameters corresponding to the above software interface. Users can adjust the sensor parameters of each image sensor by operating the buttons. The rear panel (REAR PANEL) is provided with output control buttons and a power access module.

[0043] In some embodiments of the present application, the control module is used to: control the sensor parameters and the image parameters of each image sensor, and transmit them to each image sensor through the multiple connecting cables, so as to output the image that matches the sensor parameters and the image parameters.

[0044] For example, in some embodiments of the present application, after receiving the sensor parameters and image parameters through the control interface, the sensor parameters are transmitted to the corresponding image sensor through the built-in circuit board and the connecting cable of each sensor, and the image sensor can output the image under the corresponding sensor parameters. The image output format and center mark of the image output by the monitor 120 can be controlled through the image parameters.

[0045] In some embodiments of the present application, the digital image interface is used to connect a monitor and a video oscilloscope, wherein the monitor is used to display the image output by the multi-chip image sensor, and the video oscilloscope is used to display a video waveform corresponding to the image, so as to determine the gluing effect of the multi-chip image sensor and the prism through the image and the video waveform. The digital image interface includes two serial digital interfaces, and the digital image interface is used to connect the monitor and the video oscilloscope respectively through the two serial digital interfaces.

[0046] For example, in some embodiments of the present application, the digital image interface includes a serial digital interface (SDI for short). Figure 2The first SDI interface 4 and the second SDI interface 5 are shown. The first SDI interface 4 and the second SDI interface 5 are connected to the monitor 120 and the video oscilloscope 130 respectively. Specifically, the RGB4:4:4 image in the G / B / RG / BG / RGB format output by the multiple image sensors is connected to the monitor 120 and the video oscilloscope 130 and other devices through the SDI cable, and the monitor 120 and the video oscilloscope 130 display the image to facilitate real-time monitoring of the image and the corresponding video waveform. Among them, the G / B / RG / BG / RGB format can be selected according to the actual application scenario, and the embodiments of the present application are not limited to this.

[0047] Through the above-mentioned device 100 of the present application, the images and waveforms output by the auxiliary monitor 120 and the video oscilloscope 130 can more intuitively view the effect after gluing, thereby improving the precision and accuracy of the gluing alignment between the image sensor and the prism.

[0048] The following is combined with Figure 5 Exemplary description of some embodiments of the present application provided by Figure 1 The system shown implements the process of gluing the auxiliary optical prism and the image sensor.

[0049] Please see attached Figure 5 , Figure 5 A flow chart of a method for gluing an auxiliary optical prism and an image sensor is provided for some embodiments of the present application. The method for gluing an auxiliary optical prism and an image sensor may include: S510, the terminal device obtains the sensor parameters of each image sensor in a plurality of image sensors in response to an operation instruction of a user; S520, the device for gluing the auxiliary optical prism and the image sensor transmits the sensor parameters of each image sensor to each image sensor; S530, the plurality of image sensors output images matching the sensor parameters; S540, the monitor displays the image, and the video oscilloscope displays a video waveform corresponding to the image.

[0050] Understandably, Figure 5 The specific implementation process of the method embodiment shown can refer to the device and system embodiments provided above. To avoid repetition, the description is omitted here.

[0051] The above description is only an embodiment of the present application and is not intended to limit the scope of protection of the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application. It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings.

[0052] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0053] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

Claims

1. A device for gluing an auxiliary optical prism and an image sensor, characterized in that: include: A built-in circuit board is used to connect multiple image sensors, wherein the multiple image sensors and prisms are glued together; A control module, used for connecting to a terminal device, wherein the terminal device is used for controlling the multiple image sensors to output images under different sensor parameters; A digital image interface is used to connect a monitor and a video oscilloscope, wherein the monitor is used to display the image output by the multi-chip image sensor, and the video oscilloscope is used to display a video waveform corresponding to the image, so as to determine the gluing effect of the multi-chip image sensor and the prism through the image and the video waveform.

2. The device according to claim 1, characterized in that The built-in circuit board is used for: The plurality of image sensors are connected via a plurality of connection cables; wherein one connection cable is connected to one image sensor; A control instruction sent by the control module is received, and image data output by the multiple image sensors are digitally processed to obtain the image.

3. The device according to claim 2, characterized in that The terminal device is used for: In response to a first operation instruction of a user, controlling the sensor parameters of each image sensor in the plurality of image sensors, the sensor parameters including: gain, black level and shutter time; In response to the second operation instruction of the user, selecting image parameters, the image parameters including: image output format and image center mark; The control module is used to control the sensor parameters and the image parameters of each image sensor, and transmit them to each image sensor through the multiple connection cables, so as to output the image matching the sensor parameters and the image parameters.

4. The device according to claim 1 or 2, characterized in that The digital image interface comprises two serial digital interfaces, and the digital image interface is used to respectively connect the monitor and the video oscilloscope through the two serial digital interfaces.

5. The device according to claim 2, characterized in that The plurality of connection cables include three cables, and the plurality of image sensors include three image sensors.

6. The device according to claim 1 or 2, characterized in that: Each image sensor in the plurality of image sensors is fixed on a mechanical fixture; the device is connected to each image sensor and a camera circuit substrate by using an IC socket.

7. The device according to claim 1 or 2, characterized in that The terminal device is a PC or a hardware controller.

8. The device according to claim 1 or 2, characterized in that The device also includes a power source.

9. A system for gluing an auxiliary optical prism and an image sensor, characterized in that: include: An imaging system composed of multiple image sensors and prisms, a monitor, a video oscilloscope, a terminal device, and a device as described in any one of claims 1 to 7.

10. A method for gluing an auxiliary optical prism to an image sensor, characterized in that: include: The terminal device obtains the sensor parameter of each image sensor among the plurality of image sensors in response to the operation instruction of the user; The device for gluing the auxiliary optical prism and the image sensor transmits the sensor parameters of each image sensor to each image sensor; The multiple image sensors output images that match the sensor parameters; The monitor displays the image, and the video oscilloscope displays a video waveform graph corresponding to the image.

Images