Image acquisition method
By using parallel output signals in the endoscopic image sensor, the problem of frame rate drop under multi-frame exposure HDR technology is solved, and the image is achieved higher real-time and smoothness, improving image quality and user experience.
Patent Information
- Application Number
- CN202411694153.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-25
- Publication Date
- 2025-03-07
- Estimated Expiration
- 2044-11-25
AI Technical Summary
When existing endoscopic image sensors realize multi-frame exposure HDR technology, the frame rate decreases, affecting the real-time and smoothness of the image, resulting in poor quality of the target acquisition.
By introducing parallel output signals into the image sensor, signal transmission is performed using multiplexed pins of the control circuit and the readout circuit, thereby increasing the frame rate of the photosensitive analog signal without changing the clock.
It effectively improves the real-time and smoothness of the images collected by the image sensor, improves the quality of image acquisition results, and improves the user experience of image sensors that support multi-frame exposure HDR technology.
Smart Images

Figure CN119172622B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to but is not limited to the technical field of image acquisition devices, and in particular to an image acquisition method. Background Art
[0002] In recent years, with the continuous advancement of medical technology, image acquisition systems have been used more and more widely in the medical field. For example, endoscopes have become an important auxiliary means for doctors to perform diagnosis and surgery in many fields, from traditional gastrointestinal examinations to urology, obstetrics and gynecology.
[0003] As the application of medical endoscopes becomes more and more in-depth, people have more and more requirements for multi-image sensor endoscopes. For example, multi-image sensor endoscopes can support high dynamic range (HDR) technology. Multi-frame exposure HDR technology in HDR technology is widely used in image sensors of endoscopes due to its low cost and rich image details. A HDR technology that synthesizes multiple frames into one frame can achieve a larger dynamic range. However, when the image sensor of the current endoscope implements multi-frame exposure HDR technology, it is often accompanied by a decrease in frame rate, which means that the frame rate of the real-time surgical image is doubled, thereby affecting the real-time and smoothness of the image collected by the image sensor, resulting in poor quality of the target collected image. Summary of the invention
[0004] The embodiment of the present application provides an image acquisition method, which can improve the image frame rate of an endoscope system in acquiring a target acquired image, thereby effectively improving the quality of the target acquired image.
[0005] In a first aspect, an embodiment of the present application provides an image acquisition method, which is applied to an endoscope system, wherein the endoscope system includes an image sensor having a control circuit, a pixel matrix and a readout circuit, and a controller having a control unit and an image processing unit, wherein the control circuit is provided with a first control pin, the pixel matrix includes M rows×N columns of pixel units, M first column lines connected to the pixel units of odd rows, and N second column lines connected to the pixel units of even rows, the readout circuit is provided with a data pin and includes a first data output line and a second data output line, the first data output line is electrically connected to the data pin or the first control pin, and the second data output line is electrically connected to the first control pin or the data pin, and the method includes:
[0006] The control unit sends an image acquisition control signal to each pixel unit through the first control pin;
[0007] The pixel units of the odd-numbered rows generate a first analog signal in response to a pixel control signal and send the first analog signal to the first data output line through the corresponding first column line, wherein the pixel control signal is converted from the image acquisition control signal;
[0008] The pixel units of the even-numbered rows generate a second analog signal in response to the pixel control signal and send the second analog signal to the second data output line through the corresponding second column line;
[0009] The readout circuit sends the first analog signal, the second analog signal and the status signal to the image processing unit through the data pin and / or the first control pin;
[0010] The image processing unit obtains a target acquisition image according to the first analog signal and the second analog signal.
[0011] In some embodiments, the control circuit is further provided with a clock pin, and the image sensor further comprises:
[0012] A first power management circuit, wherein the first power management circuit is provided with a first power pin;
[0013] Ground pin;
[0014] The first power pin, the first control pin, the clock pin and the data pin are electrically connected to the controller, and the ground pin is connected to a common ground with the controller.
[0015] In some embodiments, the pixel matrix further comprises:
[0016] A pixel control signal receiving line, all the pixel units are electrically connected to the pixel control signal receiving line, and the pixel control signal receiving line is electrically connected to the control circuit;
[0017] The readout circuit further comprises:
[0018] Sample and hold circuit;
[0019] A first time-division multiplexing circuit;
[0020] a second time-division multiplexing circuit;
[0021] Among them, the first column line is electrically connected to the input end of the first data output line through the sampling and holding circuit and the first time-division multiplexing circuit in sequence, and the output end of the first data output line is electrically connected to the first control pin, and the second column line is electrically connected to the input end of the second data output line through the sampling and holding circuit and the second time-division multiplexing circuit in sequence, and the output end of the second data output line is electrically connected to the data pin.
[0022] In some embodiments, the control unit is electrically connected to the first control pin, the image processing unit is electrically connected to the control unit and the data pin respectively, and the controller further includes:
[0023] a second power management circuit, the second power management circuit being electrically connected to the first power pin;
[0024] a clock unit, the clock unit being electrically connected to the clock pin;
[0025] A grounding module, the grounding module is electrically connected to the grounding pin;
[0026] System communication interface.
[0027] In some embodiments, the control unit includes: a flash control unit and an image acquisition control unit, wherein the flash control unit is used to send a flash control signal, and the image acquisition control unit is used to send an image acquisition control signal and / or a clock synchronization signal.
[0028] In some embodiments, the control unit includes a control processing module and a multi-level generating circuit, and the control processing module is electrically connected to the multi-level generating circuit.
[0029] In some embodiments, the endoscope system further comprises:
[0030] A flash module, comprising a second control pin, a second power pin, a driving circuit and a plurality of flashes, wherein the second control pin is electrically connected to the control unit, and the second power pin is electrically connected to the second power management circuit.
[0031] In some embodiments, there are multiple image sensors, each of which is provided with a first control pin, and the method further includes:
[0032] The control processing module generates a composite signal including a clock synchronization signal and an image acquisition control signal in combination with a multi-level generating circuit;
[0033] The clock synchronization signal in the composite signal is located in a first level range interval, and the image acquisition control signal is located in a second level range interval. The two level range intervals do not overlap, but the bottom level of the higher level range interval is equal to the top level of the lower range interval.
[0034] The control processing module determines a first sending time of the clock synchronization signal and a second sending time of the image acquisition control signal based on logic settings, sends the clock synchronization signal to the first control pin of each of the image sensors based on the first sending time, and sends the image acquisition control signal to the first control pin of each of the image sensors based on the second sending time.
[0035] Then the first control pin of the image sensor transmits the composite signal to the control circuit of the image sensor. The level recognition function contained in the control circuit distinguishes the clock synchronization signal instruction and the image acquisition control signal instruction according to the different level ranges of the composite signal, and performs corresponding operations.
[0036] In some embodiments, there are multiple image sensors, each of which is provided with the first control pin, and the method further includes:
[0037] The multi-level generating circuit generates a fifth multi-level signal in combination with the control processing module;
[0038] The control processing module determines a rising edge or a falling edge preset in a first preset time period in the fifth multi-level signal as a clock synchronization signal;
[0039] The control processing module determines the signal in the second preset time period of the fifth multi-level signal as the image acquisition control signal;
[0040] The control processing module sends the clock synchronization signal and the image acquisition control signal to the first control pin of each image sensor in a time-division multiplexing manner.
[0041] In some embodiments, the endoscope system further includes a flash module, the flash module includes a second control pin, a second power pin, a drive circuit and a plurality of flashes, wherein the second control pin is electrically connected to the control unit, and the second power pin is electrically connected to the second power management circuit; the control unit is provided with a control processing module and a multi-level generating circuit, and the control processing module is electrically connected to the multi-level generating circuit; the method further includes:
[0042] The second power management circuit sends a second power supply signal to the second power pin to power on the flash module;
[0043] The control processing module combines with the multi-level generating circuit to generate a composite signal including an independent control signal of each flash lamp and an image acquisition signal, wherein the independent control signal of each flash lamp is located in a third level range interval, and the image acquisition control signal is located in a fourth level range interval, and the two level range intervals do not overlap, but the bottom level of the higher level range interval is equal to the top level of the lower range interval;
[0044] The control module determines the third sending time of the independent control signal of each flash and the fourth sending time of the image acquisition control signal in the composite signal based on the logic setting, sends the independent control signal of each flash to the flash module based on the third sending time, and sends the image acquisition control signal to the first control pin of each image sensor based on the fourth sending time.
[0045] In some embodiments, the level recognition circuit of the flash module recognizes the independent control signal of each flash according to the different levels, and independently controls each flash with different wavelengths to realize the multimodal shooting function of the endoscope, facilitating the doctor's in-depth observation of tissue lesions.
[0046] An embodiment of the present application provides an image acquisition method, including: the control unit sends an image acquisition control signal to each pixel unit through the first control pin; the pixel units in the odd rows generate a first analog signal in response to the pixel control signal and send the first analog signal to the first data output line through the corresponding first column line, and the pixel control signal is converted from the image acquisition control signal sent by the control unit; the pixel units in the even rows generate a second analog signal in response to the pixel control signal and send the second analog signal to the second data output line through the corresponding second column line; the readout circuit sends the first analog signal, the second analog signal and the status signal to the image processing unit through the data pin and / or the first control pin; the image processing unit obtains a target acquisition image according to the first analog signal and the second analog signal. According to the solution provided in the embodiment of the present application, the photosensitive analog signal from the pixel matrix can be output in parallel to two different multiplexed pins (a first control pin and a data pin) through the two data output lines of the readout circuit to realize signal transmission, thereby improving the frame rate of the transmitted photosensitive analog signal while keeping the clock unchanged, thereby effectively ensuring the real-time and smoothness of the image captured by the image sensor, improving the quality of the image acquisition results, and improving the user experience of the image sensor that supports multi-frame exposure HDR technology. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Figure 1 is a module schematic diagram of an image sensor provided by an embodiment of the present application;
[0048] Figure 2 is a module schematic diagram of a controller provided by another embodiment of the present application;
[0049] Figure 3 is a schematic diagram of connecting a pixel matrix and a readout circuit provided by another embodiment of the present application;
[0050] Figure 4 is a schematic diagram of interconnection between a single image sensor and a controller in an endoscope system provided by another embodiment of the present application;
[0051] Figure 5 is a schematic diagram of interconnection between a single image sensor and a controller in an endoscope system provided by another embodiment of the present application;
[0052] Figure 6 is a schematic diagram of interconnection between a single image sensor and a controller in an endoscope system provided by another embodiment of the present application;
[0053] Figure 7 is a schematic diagram of interconnection between a single image sensor and a controller in an endoscope system provided by another embodiment of the present application;
[0054] Figure 8 is a schematic diagram of interconnection between multiple image sensors and a controller in an endoscope system provided by another embodiment of the present application;
[0055] Fig. 9 is a schematic diagram of interconnection between multiple image sensors and a controller in an endoscope system provided by another embodiment of the present application;
[0056] Fig.10 is a timing diagram of a first control pin, a data pin, and a clock pin transmitting a signal provided by another embodiment of the present application;
[0057] Fig.11 is a timing diagram of a first control pin, a data pin, and a clock pin transmitting a signal provided by another embodiment of the present application;
[0058] Fig.12 is a timing diagram of a first control pin, a data pin, and a clock pin transmitting a signal provided by another embodiment of the present application;
[0059] Fig.13 It is a schematic diagram of an endoscope system with multiple image sensors provided by another embodiment of the present application that multiplexes the first control pin to transmit a clock synchronization signal and an image acquisition control signal;
[0060] Fig.14It is a schematic diagram of an endoscope system with multiple image sensors provided by another embodiment of the present application that multiplexes the first control pin to transmit a clock synchronization signal and an image acquisition control signal;
[0061] Fig.15 It is a schematic diagram of an endoscope system with multiple image sensors provided by another embodiment of the present application that multiplexes the first control pin to transmit a clock synchronization signal and an image acquisition control signal;
[0062] Fig.16 It is a flowchart of the steps of an image acquisition method applied to an endoscope system provided by one embodiment of the present application.
[0063] Description of reference numerals:
[0064] Image sensor 100; pixel matrix 110; pixel control signal receiving line 112; pixel unit 111; readout circuit 120; data pin 121; sample and hold circuit 122; first power management circuit 130; first power pin 131; control circuit 140; clock pin 141; first control pin 142; ground pin 151; controller 200; second power management circuit 210; control unit 220; flash control unit 221; image acquisition control unit 222; image processing unit 230; clock unit 240; system communication interface 250; flash module 300; multiple flashes 310; drive circuit 320; second control pin 330; second power pin 340. DETAILED DESCRIPTION
[0065] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0066] It is understood that although the functional modules are divided in the device schematic diagram and the logical order is shown in the flow chart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flow chart. The terms "first", "second", etc. in the specification, claims or the above drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.
[0067] In recent years, with the continuous advancement of medical technology, image acquisition systems have been used more and more widely in the medical field. For example, endoscopes have become an important auxiliary means for doctors to perform diagnosis and surgery in many fields, from traditional gastrointestinal examinations to urology, obstetrics and gynecology.
[0068] As the application of medical endoscopes becomes more and more in-depth, people have more and more requirements for multi-image sensor endoscopes. For example, multi-image sensor endoscopes can support high dynamic range (HDR) technology. Multi-frame exposure HDR technology in HDR technology is widely used in image sensors of endoscopes due to its low cost and rich image details. A HDR technology that synthesizes multiple frames into one frame can achieve a larger dynamic range. However, when the image sensor of the current endoscope implements multi-frame exposure HDR technology, it is often accompanied by a decrease in frame rate, which means that the frame rate of the real-time surgical image is doubled, thereby affecting the real-time and smoothness of the image collected by the image sensor, resulting in poor quality of the target collected image.
[0069] To solve the above-mentioned problems, an embodiment of the present application provides an image acquisition method and an endoscope system thereof, the method comprising: the control unit sends an image acquisition control signal to each pixel unit through the first control pin; the pixel units in odd rows generate a first analog signal in response to the pixel control signal and send the first analog signal to the first data output line through the corresponding first column line, and the pixel control signal is obtained by converting the image acquisition control signal; the pixel units in even rows generate a second analog signal in response to the pixel control signal and send the second analog signal to the second data output line through the corresponding second column line; the readout circuit sends the first analog signal and the status signal to the image processing unit through the first control pin, and sends the second analog signal to the image processing unit through the data pin, or sends the first analog signal to the image processing unit through the first control pin, and sends the second analog signal and the status signal to the image processing unit through the data pin; the image processing unit obtains the target acquisition image according to the photosensitive analog signal. According to the solution provided in the embodiment of the present application, the photosensitive analog signal from the pixel matrix is output in parallel to two different multiplexed pins (a first control pin and a data pin) through two data output lines of the readout circuit to realize signal transmission, thereby improving the frame rate of the transmitted photosensitive analog signal while keeping the clock unchanged, thereby effectively ensuring the real-time and smoothness of the image captured by the image sensor, improving the quality of the image acquisition results, and improving the user experience of the image sensor that supports multi-frame exposure HDR technology.
[0070] The embodiments of the present application are further described below in conjunction with the accompanying drawings.
[0071] refer to Figure 1 , the embodiment of the present application provides an image sensor 100, including:
[0072] A pixel matrix 110;
[0073] A first power management circuit 130, wherein the first power management circuit 130 is provided with a first power pin 131;
[0074] A control circuit 140 , the control circuit 140 is electrically connected to the pixel matrix 110 , and the control circuit 140 is provided with a first control pin 142 and a clock pin 141 ;
[0075] A readout circuit 120, the readout circuit 120 is electrically connected to the pixel matrix 110 and the control circuit 140 respectively, and the readout circuit 120 is provided with a data pin 121;
[0076] Ground pin 151;
[0077] The first power pin 131 , the first control pin 142 , the clock pin 141 and the data pin 121 are electrically connected to the controller 200 , and the ground pin 151 is commonly connected to the controller 200 .
[0078] Specifically, the first control pin 142 and the data pin 121 of the embodiment of the present application are signal multiplexing pins, that is, the first control pin 142 can receive or send multiple signals. For example, the first control pin 142 can receive a clock synchronization signal, an image acquisition control signal, and can send a status signal and an image photosensitivity analog signal; the data pin 121 can send a status signal and a photosensitivity analog signal, wherein the status signal is data related to image acquisition stored in the image sensor 100.
[0079] Specifically, the pixel matrix 110 is used to respond to control instructions such as the image acquisition control signal sent by the first control pin 142 through the control circuit 140, perform photoelectric conversion to generate a photosensitive analog signal, and transmit the photosensitive analog signal to the controller 200 through the data pin 121 of the readout circuit 120 and / or the first control pin 142 of the control circuit 140, thereby providing effective hardware support for capturing the target image.
[0080] It can be understood that the image sensor 100 of this embodiment is used in an endoscope system, and the traditional image acquisition sensor is physically separated into an analog front-end processing part (i.e., the image sensor 100) and a digital control part (i.e., the controller 200). That is to say, the image sensor 100 of this embodiment omits the AD conversion and system communication interface 250 and some control circuits such as processing, and only includes the analog front-end processing part for acquiring image signals. The control circuits of the AD conversion and system communication interface 250 and processing parts are arranged in the controller 200 that does not need to enter the human body. By applying the above-mentioned technical solution, the image sensor 100 and the accompanying cable that enter the human body can be made very slim, and can more easily enter relatively narrow spaces such as the urethra. The operation is more flexible and the application scenarios are more extensive. It can effectively reduce the risk of trauma of patients using endoscopes and improve the comfort of patients, reduce the pain of the diagnosis and treatment process, reduce the volume of the endoscope system, and reduce the use cost of the image sensor 100 as a disposable diagnosis and treatment product.
[0081] In a specific embodiment, reference Figure 3 , the pixel matrix 110 includes:
[0082] M×N pixel units 111, where M is the number of rows, N is the number of columns, and both M and N are positive integers greater than or equal to 2;
[0083] A pixel control signal receiving line 112, all pixel units 111 are electrically connected to the pixel control signal receiving line 112, and the pixel control signal receiving line 112 is electrically connected to the control circuit 140;
[0084] First column lines, the first column lines are electrically connected to the pixel units 111 of odd-numbered rows, and the number of the first column lines is N;
[0085] Second column lines, the second column lines are electrically connected to the pixel units 111 of even-numbered rows, and the number of the second column lines is N;
[0086] In a specific embodiment, reference Figure 3 , the readout circuit 120 includes:
[0087] Sample and hold circuit 122;
[0088] A first time-division multiplexing circuit;
[0089] a second time-division multiplexing circuit;
[0090] The first data output line (corresponding to Figure 3 The output end of the first data output line is electrically connected to the first control pin 142;
[0091] The second data output line (corresponding to Figure 3The output end of the second data output line is electrically connected to the data pin 121;
[0092] The first column line is electrically connected to the input end of the first data output line through the sampling and holding circuit 122 and the first time-division multiplexing circuit in sequence, and the second column line is electrically connected to the input end of the second data output line through the sampling and holding circuit 122 and the second time-division multiplexing circuit in sequence.
[0093] Therefore, in this embodiment, reference Figure 3 The first control pin 142 and the data pin 121 of the image sensor 100 can output image data in parallel. Compared with a traditional image sensor with only one analog data output pin, under the same clock frequency, the frame rate of the image sensor 100 in this embodiment can reach twice that of the traditional image sensor 100 with only one analog data output pin.
[0094] The following is an application in which the image sensor 100 of this embodiment is more advantageous than ordinary image sensors in endoscopes: As the application of medical endoscopes becomes more and more in-depth, people have higher and higher requirements on the performance of the images they capture, such as requiring image sensors to support a higher dynamic range, so that the images seen by doctors during diagnosis and treatment can contain brighter and darker details at the same time without overexposure. A multi-frame exposure HDR technology currently widely used in endoscopes can continuously capture multiple images with different exposure times, and then fuse these images to obtain an image with a larger dynamic range. This technology reduces the frame rate while achieving a high dynamic range of the image.
[0095] If the image sensor 100 supporting two-way parallel output of image data in this embodiment is used in the endoscope supporting the multi-frame exposure HDR technology, the disadvantage of reducing the frame frequency can be avoided or alleviated. Because as mentioned above, under the same clock frequency, the frame rate of the image sensor 100 in this embodiment is twice that of the traditional image sensor 100 with only one image data output pin. In this way, when doctors take advantage of the multi-frame exposure HDR technology, they will not be troubled by the low frame rate.
[0096] It should be noted that the embodiment of the present application does not limit the specific number of rows and columns of the pixel units 111 in the pixel matrix 110, and those skilled in the art can adjust it according to actual needs. Figure 3As shown, it includes 4×4 (4 rows and 4 columns) pixel units 111, corresponding to 8 column lines: COL_1, COL_2, COL_3, COL_4, Col_1', Col_2', Col_3', Col_4', wherein COL_1, COL_2, COL_3 and COL_4 are first column lines, and Col_1', Col_2', Col_3' and Col_4' are second column lines.
[0097] refer to Figure 2 ,The embodiment of the present application provides a controller 200, including:
[0098] A second power management circuit 210, the second power management circuit 210 is electrically connected to the first power pin 131;
[0099] A clock unit 240, the clock unit 240 is electrically connected to the clock pin 141;
[0100] A control unit 220, the control unit 220 is electrically connected to the first control pin 142;
[0101] An image processing unit 230 , the image processing unit 230 is electrically connected to the control unit 220 , and the image processing unit 230 is electrically connected to the data pin 121 ;
[0102] A grounding module, the grounding module is electrically connected to the grounding pin 151;
[0103] System communication interface 250;
[0104] Among them, the first power pin 131 , the clock pin 141 , the first control pin 142 , the data pin 121 and the ground pin 151 belong to the image sensor 100 .
[0105] It can be understood that, referring to the description of the above embodiment, the controller 200 of this embodiment is applied in an endoscope system and is used to be electrically connected to the first power pin 131, the clock pin 141, the first control pin 142, the data pin 121 and the ground pin 151 of the image sensor 100. When a plurality of image sensors 100 are provided in the endoscope system (see Figure 8 , Fig. 9 ), and only one controller 200 is used. Multiple image sensors 100 are connected to one controller 200, and each image sensor 100 is electrically connected to the controller 200 using only five pins. The controller 200 transmits the clock synchronization signal and the image acquisition signal by multiplexing the first control pin 142 of each image sensor 100, thereby reducing the number of pin settings, thereby reducing the size of the endoscope system while reducing the cost, thereby reducing the risk of trauma to patients using the endoscope and improving the patient's comfort.
[0106] In some embodiments, reference Figure 7 The control unit 220 includes: a flash control unit 221 and an image acquisition control unit 222, wherein the flash control unit 221 is used to send a flash control signal, and the image acquisition control unit 222 is used to send an image acquisition control signal and / or a clock synchronization signal.
[0107] It can be understood that the flash control unit 221 of the present embodiment is used to be electrically connected to the flash module 300 of the endoscope system to send a flash control signal to the flash module 300 to trigger the flash module 300 to start.
[0108] In some embodiments, the control unit 220 is provided with a control processing module and a multi-level generating circuit, and the control processing module is electrically connected to the multi-level generating circuit.
[0109] It can be understood that when the control unit 220 needs to send at least two different signals to the same pin, a multi-level generating circuit is arranged inside the control unit 220, which can set the level characteristics corresponding to different signals (such as level value, continuous high level / low level of preset length, etc.) and the sending timing of different signals based on logic.
[0110] refer to Figures 4 to 7 , an embodiment of the present application provides an endoscope system, comprising:
[0111] At least one image sensor 100 according to any one of the embodiments of the first aspect, the image sensor 100 comprising a first power pin 131, a first control pin 142, a clock pin 141, a data pin 121 and a ground pin 151;
[0112] The controller 200 of any embodiment of the second aspect, wherein the controller 200 includes a second power management circuit 210, a clock unit 240, a control unit 220, an image processing unit 230, a grounding module 151 and a system communication interface 250, the second power management circuit 210 is electrically connected to the first power pin 131, the clock unit 240 is electrically connected to the clock pin 141, the control unit 220 is electrically connected to the first control pin 142, the image processing unit 230 is electrically connected to the control unit 220, the image processing unit 230 is electrically connected to the data pin 121, and the grounding module 151 is electrically connected to the ground pin 151.
[0113] It should be noted that the embodiment of the present application does not limit the specific number of image sensors 100 of the endoscope system, which can be one, two or more than two. Regardless of the number of image sensors 100, there is only one controller 200 in the present embodiment, and each image sensor 100 is connected to one controller 200, and each image sensor 100 is electrically connected to the controller 200 with only 5 pins, thereby reducing the number of pins and the number of controllers 200, thereby reducing the size of the endoscope system while reducing costs, thereby reducing the risk of trauma to patients using endoscopes and improving patient comfort.
[0114] In some embodiments, reference Figure 7 , the endoscope system also includes:
[0115] The flash module 300 includes a second control pin 330 , a second power pin 340 , a driving circuit 320 and a plurality of flashes 310 , wherein the second control pin 330 is electrically connected to the control unit 220 , and the second power pin 340 is electrically connected to the second power management circuit 210 .
[0116] Specifically, the present embodiment does not limit the specific number of flashlights in the flashlight module 300, and those skilled in the art may adjust the number according to actual needs.
[0117] It can be understood that the second power pin 340 of the present embodiment is used to receive the second power supply signal sent by the first power management module, so as to power on the flash module 300. The second control pin 330 is a multiplexed pin, so as to receive different flash control signals sent from the flash control unit 221, so as to realize the control of the switching or brightness change of flashes of different wavelengths. Without adding transmission lines, multiple flashes 310 can be independently controlled, thereby solving the problem that different flashes cannot be independently controlled when the flash module 300 has only two pins.
[0118] refer to Fig.16 The present application embodiment provides an image acquisition method, which is applied to the endoscope system of the above embodiment, and the image acquisition method includes but is not limited to the following steps:
[0119] Step S10, the second power management circuit sends a first power supply signal to the first power pin to power on the image sensor;
[0120] Step S20, the clock unit sends a clock signal to the clock pin;
[0121] Step S30, the control unit sends an image acquisition control signal to the first control pin, so that the control circuit sends the received image acquisition control signal to the pixel matrix;
[0122] Step S40, the pixel matrix generates a photosensitive analog signal in response to the control signal, and sends the photosensitive analog signal to a readout circuit;
[0123] Step S50, the readout circuit sends the photosensitive analog signal and the state signal to the image processing unit through the data pin and / or the first control pin;
[0124] Step S60: the image processing unit obtains a target captured image according to the photosensitive analog signal.
[0125] It should be noted that the specific implementation of the image acquisition method is basically the same as the specific embodiment of the image sensor and the controller in the above-mentioned endoscope system, and will not be repeated here.
[0126] In some embodiments, reference Figure 3 , the pixel matrix 110 includes: M×N pixel units 111, wherein M is the number of rows, N is the number of columns, and both M and N are positive integers greater than or equal to 2; a pixel control signal receiving line 112, all the pixel units 111 are electrically connected to the pixel control signal receiving line 112, and the pixel control signal receiving line 112 is electrically connected to the control circuit 140; a first column line, the first column line is electrically connected to the pixel units 111 of the odd rows, and the number of the first column lines is N; a second column line, the second column line is electrically connected to the pixel units 111 of the even rows, and the number of the second column lines is N; the readout circuit 120 includes: a sampling and holding circuit 122; a first time-division multiplexing circuit; a second time-division multiplexing circuit; a first data output line, the first data output line The output end is electrically connected to the first control pin 142; the second data output line, the output end of the second data output line is electrically connected to the data pin 121; wherein the first column line is electrically connected to the input end of the first data output line through the sampling and holding circuit 122 and the first time-division multiplexing circuit in sequence, and the second column line is electrically connected to the input end of the second data output line through the sampling and holding circuit 122 and the second time-division multiplexing circuit in sequence; the photosensitive analog signal includes the first analog signal and the second analog signal, the pixel control signals received by the pixel units 111 of different rows are different in time, the pixel control signals are converted from the image acquisition control signal, and the pixel control signals include a reset signal and a selection signal, and step S40 includes but is not limited to the following steps:
[0127] Step S41, each pixel unit of the odd-numbered rows generates each first analog signal in response to the corresponding reset signal and the selection signal, and sends each first analog signal to the corresponding first column line;
[0128] Step S42, each pixel unit of the even-numbered row generates each second analog signal in response to the corresponding reset signal and the selection signal, and sends each second analog signal to the corresponding second column line;
[0129] Step S43, each first column line sends the received first analog signal to the first data output line through the sampling and holding circuit and the first time-division multiplexing circuit;
[0130] Step S44 , each second column line sends the received second analog signal to the second data output line through the sampling and holding circuit and the second time-division multiplexing circuit, wherein the first data output line and the second data output line output the first analog signal and the second analog signal in parallel.
[0131] It can be understood that, referring to the description of the above embodiment, the specific structure of the pixel matrix and the readout circuit is as follows: Figure 3 In the case shown, the pixel matrix 110 generates a photosensitive analog signal in response to the image acquisition control signal, and sends the photosensitive analog signal to the readout circuit 120 in the specific steps: each pixel unit 111 of the odd-numbered rows generates each first analog signal in response to the corresponding reset signal and the selection signal, and sends each first analog signal to the corresponding first column line; each pixel unit 111 of the even-numbered rows generates each second analog signal in response to the corresponding reset signal and the selection signal, and sends each second analog signal to the corresponding second column line; each first column line receives the first analog signal through the sampling and holding circuit 122 and the first time-division multiplexing circuit The first data output line is sent to the first data output line; each second column line sends the received second analog signal to the second data output line through the sampling and holding circuit 122 and the second time-division multiplexing circuit, wherein the first data output line and the second data output line output the first analog signal and the second analog signal in parallel; in this way, all the photosensitive analog signals transmitted by the first column lines (i.e., the first analog signal, the photosensitive values of the pixels in the odd rows) and all the photosensitive analog signals transmitted by the second column lines (i.e., the second analog signal, the photosensitive values of the pixels in the even rows) can be output in parallel through the first data output line Data1 and the second data output line Data2, and the corresponding timing diagram when outputting the signal is referred to in FIG. Fig.10, the analog data signal is transmitted in parallel through the first control pin 142 and the data pin 121. Because Data1 and Data2 output data in parallel, the frame rate can reach twice that of the traditional pixel matrix solution. That is to say, this embodiment not only reduces the volume and production cost of the endoscope, but also doubles the frame rate of the analog signal transmitted by only a single pin when the clock remains unchanged, thereby effectively ensuring the real-time and smoothness of the image collected by the image sensor 100, improving the quality of the image acquisition results, and improving the user experience of the image sensor 100 supporting multi-frame exposure HDR technology. In addition, it should be noted that when there are multiple image sensors 100, each image sensor 100 includes but is not limited to the solution of parallel output of photosensitive analog signals applicable to this embodiment. The above-mentioned odd and even rows are only for the convenience of explaining the technical solution of this patent, and are not limited to this patent. In fact, other equivalent methods can also be used, such as using row and column lines with unequal intervals or numbers.
[0132] It should be noted that the readout circuit of this embodiment sends the first analog signal, the second analog signal and the status signal to the image processing unit through the data pin and / or the first control pin, and specifically protects a switching control mechanism for signal transmission. Specifically, it supports parallel transmission of the photosensitive analog signal (first analog signal, second analog signal) generated by the pixel matrix to different multiplexed pins, and also supports switching to a single-pin transmission signal, that is, transmitting all photosensitive analog signals to the same multiplexed pin. In this case, the readout circuit can send the first analog signal and the status signal to the image processing unit through the first control pin, and send the second analog signal to the image processing unit through the data control pin, or the readout circuit sends the first analog signal to the image processing unit through the first control pin, and sends the second analog signal and the status signal to the image processing unit through the data control pin; or the readout circuit sends both the first analog signal and the second analog signal to the image processing unit through the data pin, and sends the status signal to the image processing unit through the first control pin; or the first analog signal, the second analog signal and the status signal are all sent to the image processing unit through the data pin, and the first control pin is only responsible for receiving the image acquisition control signal.
[0133] In some embodiments, step S50 includes but is not limited to the following steps:
[0134] Step S51, the readout circuit sends a state signal to the control unit through the first control pin, so that the control unit sends the state signal to the image processing unit, and sends the photosensitive analog signal to the image processing unit through the data pin;
[0135] or,
[0136] Step S52 : the readout circuit sends the state signal and the photosensitive analog signal to the image processing unit through the data pin in a time-division multiplexing manner.
[0137] Specifically, with respect to step S51, the connection relationship between the image sensor and the controller of the endoscope system and the signal transmission relationship are as follows: Figure 5 In the case shown in FIG. 1 , the readout circuit 120 sends the state signal to the control unit 220 through the first control pin 142, so that the control unit 220 sends the state signal to the image processing unit 230, and the readout circuit 120 sends the photosensitive analog signal to the image processing unit 230 through the data pin 121. In this case, the timing diagram of the transmission signal corresponding to the image sensor 100 is as shown in FIG. Fig.12 As shown, the first control pin 142 of the image sensor 100 not only receives the image acquisition control signal from the controller 200, but also transmits the status signal to the controller 200, so that the image sensor 100 adjusts and aligns the data acquisition timing of each frame internally according to the image acquisition control signal, and adjusts the value of the control register related to the internal image acquisition, such as performing software reset, adjusting the exposure time, adjusting the analog gain, etc.; the image sensor 100 will also transmit some image acquisition related status signals to the controller 200 through the first control pin 142 within the time predetermined by the controller 200. It should also be noted that, in the case where there are multiple image sensors 100, each image sensor 100 is applicable to the solution of multiplexing the first control pin 142 to receive the image acquisition control signal and send the status signal in this embodiment.
[0138] Specifically, with respect to step S52, the connection relationship between the image sensor and the controller of the endoscope system and the signal transmission relationship are as follows: Figure 4 In the case shown in FIG. 1 , the readout circuit 120 sends the state signal and the photosensitive analog signal to the image processing unit 230 through the data pin 121 in a time-division multiplexing manner. In this case, the timing diagram of the transmission signal corresponding to the image sensor 100 is as shown in FIG. Fig.11As shown, that is, the first control pin 142 of the image sensor 100 only receives the image acquisition control signal from the controller 200. The image sensor 100 adjusts and aligns the data acquisition timing of each frame internally according to the received control signal, and adjusts the value of the control register related to the internal image acquisition, such as performing software reset, adjusting the exposure time, adjusting the analog gain, etc. At the same time, the image sensor 100 will timely output the state signal of the image sensor 100 (mainly some register data related to image acquisition) and the photosensitive analog signal of the pixel matrix 110 to the data pin 121 according to the data acquisition timing, and then feed it back to the controller 200 through the data connection corresponding to the data pin 121. It should also be noted that, in the case where there are multiple image sensors 100, each image sensor 100 is applicable to the solution of multiplexing the data pin 121 to send the state signal and the photosensitive analog signal in this embodiment.
[0139] In addition, in some embodiments, the pixel matrix of the image sensor is as follows Figure 3 In the case of the structure shown, step S50 includes but is not limited to the following steps:
[0140] Step S53, the readout circuit sends the first analog signal to the control unit through the first control pin, so that the control unit sends the first analog signal to the image processing unit;
[0141] Step S54 : the readout circuit sends the state signal and the second analog signal to the image processing unit through the data pin in a time-division multiplexing manner.
[0142] Specifically, the connection relationship between the image sensor and the controller of the endoscope system of this embodiment and the signal transmission relationship are as follows: Figure 6 As shown, the first control pin 142 is multiplexed to receive the image acquisition control signal and send the first analog signal to the image processing unit 230 of the controller 200, and the data pin 121 is multiplexed to send the status signal and the second analog signal to the image processing unit 230 of the controller 200. In this case, the timing diagram of the transmission signal corresponding to the image sensor 100 is as shown in FIG. Fig.12As shown, the first control pin 142 and the data pin 121 are essentially used to transmit the photosensitive analog signal in parallel, so when the clock frequency does not increase, the frame rate of the image can be up to twice that of transmitting data using a single pin, effectively ensuring the real-time and smoothness of the image captured by the image sensor 100, improving the quality of the image acquisition results, and improving the user experience of the image sensor 100 that supports multi-frame exposure HDR technology. It should also be noted that when there are multiple image sensors 100, each image sensor 100 includes but is not limited to the solution of using the first control pin 142 and the data pin 121 to transmit the photosensitive analog signal in parallel in this embodiment.
[0143] In addition, in the endoscope system, there are multiple image sensors, each image sensor is provided with a first control pin, the control unit is provided with a control processing module and a multi-level generating circuit, and the control processing module is electrically connected to the multi-level generating circuit. The image acquisition method of the embodiment of the present application also includes but is not limited to the following steps:
[0144] Step S71, the control processing module generates a clock synchronization signal and an image acquisition control signal;
[0145] Step S72, the multi-level generating circuit combines with the control unit to generate a clock synchronization signal and an image acquisition control signal in different level intervals based on the logic setting. The clock synchronization signal is in the first level range interval, and the image acquisition control signal is in the second level range interval. The two level range intervals do not overlap, but the bottom level of the higher level range interval is equal to the top level of the lower range interval, see Fig.13 and Fig.14 ;
[0146] Step S73, the control processing module determines the first sending time of the clock synchronization signal and the second sending time of the image acquisition control signal based on the logic setting, sends the clock synchronization signal to the first control pin of each image sensor based on the first sending time, and sends the image acquisition control signal to the first control pin of each image sensor based on the second sending time.
[0147] Specifically, this embodiment does not limit the specific level range interval, and the rising edge or falling edge used for multi-sensor clock synchronization.
[0148] Specifically, when there are multiple image sensors 100 in the endoscope system, synchronization of all image sensors 100 is very important. Hardware triggering or clock synchronization of each sensor is required to ensure that multiple image sensors 100 collect data at the same time, so as to avoid data misalignment caused by time offset between each other, especially when the image sensor 100 is moved or the external light intensity changes, which causes serious distortion to image fusion. In traditional endoscope systems with multiple image sensors 100, the most common method is to use a dedicated synchronization signal. For example, the controller 200 can send a dedicated synchronization signal to all sensors at the same time to achieve phase alignment of the clock signals of each sensor, and then by sending synchronized acquisition instructions, data with relatively time alignment can be collected. However, one of the biggest disadvantages of using a dedicated synchronization signal is that the number of sensor pins needs to be increased, which in turn increases the size and cost of each sensor. Based on this, the embodiment of the present application proposes a solution of multiplexing the first control pin 142 to transmit the clock synchronization signal and the image acquisition control signal to achieve synchronization between multiple image sensors 100. The data signal transmission relationship between the multiple image sensors 100 and the controller 200 in this embodiment can be as follows: Figure 8 As shown, taking the case where the number of image sensors 100 is 2 as an example, the control unit 220 multiplexes the first control pin 142 to transmit the clock synchronization signal and the image acquisition control signal to each first control pin 142 corresponding to the image sensor 1 and the image sensor 2; or Fig. 9 As shown, the first control pin 142 is multiplexed to transmit the clock synchronization signal and the image acquisition control signal to each first control pin 142 corresponding to the image sensor 1 and the image sensor 2, and the first control pin 142 is multiplexed to send the status signal and the photosensitive analog signal to the control unit 220.
[0149] It can be understood that when the control processing module needs to generate a clock synchronization signal and an image acquisition control signal, the multi-level generating circuit combines with the control unit to generate a clock synchronization signal and an image acquisition control signal in different level ranges, and determines the first sending time of the clock synchronization signal and the second sending time of the image acquisition control signal based on logic, sends the clock synchronization signal to the first control pin of each image sensor based on the first sending time, and sends the image acquisition control signal to the first control pin of each image sensor based on the second sending time.
[0150] In the case where the control processing module needs to generate a clock synchronization signal and an image acquisition control signal, it is also possible to use the same voltage range to transmit the image acquisition control signal and the clock synchronization signal without using a multi-level generation circuit to increase the level range of signal transmission, that is, to use the rising edge / falling edge of a preset length of continuous high level / low level as the clock synchronization point of all image sensors. The specific length of the continuous high and low levels needs to be determined by fully considering multiple factors such as transmission efficiency and whether the signal is confused. Fig.15 .
[0151] In addition, in some embodiments, reference Figure 7 In the case where the endoscope system includes a flash module 300, the flash module 300 includes a second control pin 330, a second power pin 340, a drive circuit 320 and a plurality of flashes 310, wherein the second control pin 330 is electrically connected to the control unit 220, the second power pin 340 is electrically connected to the second power management circuit 210, and the control unit 220 is provided with a control processing module and a multi-level generating circuit, and the control processing module is electrically connected to the multi-level generating circuit, the image acquisition method of the embodiment of the present application also includes but is not limited to the following steps:
[0152] Step S74, the second power management circuit sends a second power supply signal to the second power pin to power on the flash module;
[0153] Step S75: the multi-level generation circuit generates a third multi-level signal in combination with the control processing module, wherein the third multi-level signal includes a third level signal in a third level range interval and a fourth level signal in a fourth level range interval, the third level range interval and the fourth level range interval are different from each other, the third level range interval is between the first preset level value and the second preset level value, or between the second preset level value and the third preset level value, the fourth level range interval is between the first preset level value and the second preset level value, or between the second preset level value and the third preset level value, the first preset level value is greater than the second preset level value, and the second preset level value is greater than the third preset level value;
[0154] Step S76, the control unit controls the processing module to determine the third level signal as a flash control signal, and to determine the fourth level signal as an image acquisition control signal;
[0155] or,
[0156] Step S77, the control unit controls the processing module to determine the fourth level signal as a flash control signal, and determines the third level signal as an image acquisition control signal;
[0157] Step S78: the control unit controls the processing module to send the flash control signal and the image acquisition control signal to the second control pin in a time-division multiplexing manner.
[0158] Specifically, the flash light control signal of this embodiment is used to control the switching or brightness change of the flash light of the corresponding wavelength.
[0159] It is understandable that if Figure 7 As shown, in the case where the endoscope system includes a flash module 300, the controller 200 starts the process of controlling each flash as follows: the second power management circuit 210 sends a second power supply signal to the second power pin 340 to power on the flash module 300; the control processing module generates a flash control signal (which may include multiple independent light control signals) and an image acquisition control signal, wherein each independent light control signal corresponds to each flash one by one; the control processing module determines the third sending time of the flash control signal and the fourth sending time of the image acquisition control signal based on the logic setting, and according to the third sending time and the fourth sending time, the second control pin 330 is time-division multiplexed to send the flash control signal and the image acquisition control signal. , thereby realizing the multiplexing of the second control pin 330 of the flash module 300 to send multiple different flash control signals, realizing the multiplexing of the switch or brightness change control of flashes of different wavelengths, and independently controlling multiple flashes 310 without adding transmission lines, solving the problem that when the flash module 300 has only two pins, different flashes cannot be independently controlled. At the same time, the control unit 220 of the controller 200 only needs to send the image acquisition control signal for controlling the image sensor 100 and the flash control signal for controlling the flash module 300 by multiplexing one line, reducing the number of line connections between the controller 200 and the image sensor 100 and the flash module 300, and reducing the volume and cost of the endoscope system.
[0160] It can be understood that by finely controlling the switching and brightness of flash lights of different wavelengths in the endoscope system in the manner of this embodiment, multi-spectral imaging can be achieved, interference can be reduced, and image quality can be improved; and because different body tissues have different absorption rates for light of different wavelengths, using light capture comparison and fusion of different wavelengths makes it easier to identify specific tissue features, including lesions.
[0161] It will be appreciated by those skilled in the art that all or some of the steps and systems in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or transient medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically include computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.
[0162] The above is a specific description of the preferred implementation of the present invention, but the present invention is not limited to the above-mentioned implementation mode. Technical personnel familiar with the field can also make various equivalent deformations or substitutions under the shared conditions without violating the spirit of the present invention. These equivalent deformations or substitutions are all included in the scope defined by the claims of the present invention.
Claims
1. An image acquisition method, characterized in that: The invention is applied to an endoscope system, characterized in that the endoscope system comprises an image sensor having a control circuit, a pixel matrix and a readout circuit, and a controller having a control unit and an image processing unit, the control circuit is provided with a first control pin, the pixel matrix comprises M rows×N columns of pixel units, M first column lines connected to the pixel units of odd rows, and N second column lines connected to the pixel units of even rows, the readout circuit is provided with a data pin and comprises a first data output line and a second data output line, the first data output line is electrically connected to the data pin or the first control pin, and the second data output line is electrically connected to the first control pin or the data pin, and the method comprises: The control unit sends an image acquisition control signal to each pixel unit through the first control pin; The pixel units of the odd-numbered rows generate a first analog signal in response to a pixel control signal and send the first analog signal to the first data output line through the corresponding first column line, wherein the pixel control signal is obtained by converting the image acquisition control signal; The pixel units of the even-numbered rows generate a second analog signal in response to the pixel control signal and send the second analog signal to the second data output line through the corresponding second column line; The readout circuit sends the first analog signal, the second analog signal and the status signal to the image processing unit through the data pin and / or the first control pin; The image processing unit obtains a target acquisition image according to the first analog signal and the second analog signal.
2. The image acquisition method according to claim 1, characterized in that: The control circuit is further provided with a clock pin, and the image sensor further comprises: A first power management circuit, wherein the first power management circuit is provided with a first power pin; Ground pin; The first power pin, the first control pin, the clock pin and the data pin are electrically connected to the controller, and the ground pin is connected to a common ground with the controller.
3. The image acquisition method according to claim 1, characterized in that: The pixel matrix also includes: A pixel control signal receiving line, all the pixel units are electrically connected to the pixel control signal receiving line, and the pixel control signal receiving line is electrically connected to the control circuit; The readout circuit further comprises: Sample and hold circuit; A first time-division multiplexing circuit; a second time-division multiplexing circuit; Among them, the first column line is electrically connected to the input end of the first data output line through the sampling and holding circuit and the first time-division multiplexing circuit in sequence, and the output end of the first data output line is electrically connected to the first control pin, and the second column line is electrically connected to the input end of the second data output line through the sampling and holding circuit and the second time-division multiplexing circuit in sequence, and the output end of the second data output line is electrically connected to the data pin.
4. The image acquisition method according to claim 2, characterized in that: The control unit is electrically connected to the first control pin, the image processing unit is electrically connected to the control unit and the data pin respectively, and the controller further includes: a second power management circuit, the second power management circuit being electrically connected to the first power pin; a clock unit, the clock unit being electrically connected to the clock pin; A grounding module, the grounding module is electrically connected to the grounding pin; System communication interface.
5. The image acquisition method according to claim 1, characterized in that: The control unit comprises: a flash control unit and an image acquisition control unit, wherein the flash control unit is used to send a flash control signal, and the image acquisition control unit is used to send an image acquisition control signal and / or a clock synchronization signal.
6. The image acquisition method according to claim 1, characterized in that: The control unit includes a control processing module and a multi-level generating circuit, and the control processing module is electrically connected to the multi-level generating circuit.
7. The image acquisition method according to claim 4, characterized in that: The endoscope system further comprises: A flash module, comprising a second control pin, a second power pin, a driving circuit and a plurality of flashes, wherein the second control pin is electrically connected to the control unit, and the second power pin is electrically connected to the second power management circuit.
8. The image acquisition method according to claim 6, characterized in that: There are multiple image sensors, each of which is provided with the first control pin, and the method further includes: The multi-level generating circuit generates a first multi-level signal in combination with the control processing module, wherein the first multi-level signal includes a first level signal in a first level range interval and a second level signal in a second level range interval, the first level range interval and the second level range interval are different from each other, the first level range interval is between a first preset level value and a second preset level value, or between the second preset level value and a third preset level value, the second level range interval is between the first preset level value and the second preset level value, or between the second preset level value and the third preset level value, the first preset level value is greater than the second preset level value, and the second preset level value is greater than the third preset level value; The multi-level generating circuit generates the first level signal and the second level signal in combination with the control processing module; The control processing module determines a preset rising edge or falling edge of the first level signal as a clock synchronization signal, and determines the second level signal as the image acquisition control signal; or, The control processing module determines the first level signal as the image acquisition control signal, and determines a preset rising edge or falling edge in the second level signal as the clock synchronization signal; The control processing module sends the clock synchronization signal and the image acquisition control signal to the first control pin of each image sensor in a time-division multiplexing manner.
9. The image acquisition method according to claim 6, characterized in that: There are multiple image sensors, each of which is provided with the first control pin, and the method further includes: The multi-level generating circuit generates a fifth multi-level signal in combination with the control processing module; The control processing module determines a rising edge or a falling edge preset in a first preset time period in the fifth multi-level signal as a clock synchronization signal; The control processing module determines the signal in the second preset time period of the fifth multi-level signal as the image acquisition control signal; The control processing module sends the clock synchronization signal and the image acquisition control signal to the first control pin of each image sensor in a time-division multiplexing manner.
10. The image acquisition method according to claim 7, characterized in that: The control unit includes a control processing module and a multi-level generating circuit, the control processing module is electrically connected to the multi-level generating circuit, and the method further includes: The second power management circuit sends a second power supply signal to the second power pin to power on the flash module; The multi-level generating circuit generates a third multi-level signal in combination with the control processing module, wherein the third multi-level signal includes a third level signal in a third level range interval and a fourth level signal in a fourth level range interval, the third level range interval and the fourth level range interval are different from each other, the third level range interval is between a first preset level value and a second preset level value, or between the second preset level value and a third preset level value, the fourth level range interval is between the first preset level value and the second preset level value, or between the second preset level value and the third preset level value, the first preset level value is greater than the second preset level value, and the second preset level value is greater than the third preset level value; The control processing module determines the third level signal as a flash control signal, and determines the fourth level signal as an image acquisition control signal; or, The control processing module determines the fourth level signal as a flash control signal, and determines the third level signal as an image acquisition control signal; The control processing module sends the flash control signal and the image acquisition control signal to the second control pin in a time-division multiplexing manner.
Citation Information
Patent Citations
Latch type ADC, analog-to-digital conversion method, image sensor and storage medium
CN117319823A
Controller, image acquisition system, noise reduction method and storage medium
CN117998213A