Skin in-vivo confocal imaging image brightness self-adaptive adjusting device and method

Abstract

The invention relates to a skin in-vivo confocal imaging image brightness adaptive adjusting device and method, and the method comprises the steps: employing a scanning imaging device to emit illumination light to a skin sample, and carrying out the point-by-point scanning imaging of the skin sample through a micro-electromechanical system in a point-by-point scanning mode; and the brightness of the illumination light is adaptively adjusted in an iterative mode through the brightness adjusting device. In the iteration process, the average signal intensity of the electric signals of the obtained imaging result in the sampling period and the number of the pixels with the signal intensity higher than the reference value are substituted into an empirical formula, an adjusting parameter value for adjusting the brightness of the illumination light in the next step is obtained, and then the brightness adjustment in the next step is carried out. Therefore, according to the self-adaptive adjusting device disclosed by the invention, the light emitting power of the light source does not need to be frequently and manually adjusted or the signal dynamic range in a software system does not need to be manually changed, special image processing is not needed, and the sample detection efficiency and the imaging effect can be improved.

Description

Technical Field

[0001] This invention relates to the field of in vivo skin reflection confocal imaging and image processing technology, and more specifically, to a device and method for adaptive brightness adjustment of in vivo skin confocal imaging images. Background Technology

[0002] In vivo reflective confocal imaging of the skin is a novel skin imaging method that uses confocal imaging technology to achieve layered scanning imaging of skin tissue from the surface to the inner layers. It boasts advantages such as high imaging resolution and high signal-to-noise ratio, while also being non-invasive, real-time, in-situ, and rapid. It has important applications in fields such as dermatological examination, pre- and post-laser cosmetic surgery skin condition assessment, and efficacy evaluation of cosmetics or dermatological drugs.

[0003] Because the location of skin lesions is random, different operating postures and degrees of freedom are required when examining areas such as the armpit, behind the ear, and finger joints. Therefore, the examination equipment needs to be small and portable, preferably handheld, so that the operator can hold it with one hand. The development of handheld skin confocal imaging instruments has important practical value in the field of clinical application.

[0004] During the acquisition of skin sample images, the light intensity of the light beam varies at different layers and locations of the skin tissue, resulting in different overall brightness levels in the images. This directly affects the accuracy of doctors' observation of patient skin tissue imaging, identification of microstructural features, boundary definition, and even diagnostic results. Frequent manual control of the light source and changes in the dynamic range of the signal are not only cumbersome to operate but also distract doctors. Therefore, it is necessary to achieve rapid adaptive image brightness adjustment while the system is imaging in real time, maintaining the overall image brightness within a certain threshold range.

[0005] However, existing skin confocal imaging detection devices or methods typically require frequent manual adjustment of the light source power or manual modification of the signal dynamic range in the software system, which is cumbersome and distracts doctors. At the same time, existing skin confocal imaging instruments rely too heavily on post-processing image algorithms, thereby reducing sample detection efficiency and imaging effect. Summary of the Invention

[0006] The technical problem to be solved by the present invention is: how to overcome the technical defects of existing skin confocal imaging detection, such as cumbersome operation and excessive reliance on post-processing image algorithms. In order to overcome the above defects of the prior art, the present invention provides a device and method for adaptive adjustment of brightness of in vivo skin confocal imaging image, specifically including a device for adaptive adjustment of brightness of in vivo skin confocal imaging image and a method for adaptive adjustment of brightness of in vivo skin confocal imaging image.

[0007] This invention provides a skin in vivo confocal imaging image brightness adaptive adjustment device, the evaluation device comprising: A scanning imaging device is used to emit illumination light to a skin sample and perform point-by-point scanning imaging of the skin sample through a microelectromechanical system to obtain the electrical signal of the imaging result. A brightness adjustment device, electrically connected to the scanning imaging device, is used to adaptively adjust the brightness of the illumination light in an iterative manner. During the iteration process, it first counts the average signal strength of the electrical signal of the currently obtained imaging result within the sampling period and the number of pixels with signal strength higher than the reference value. The average signal strength and the number of pixels are then substituted into an empirical formula to obtain the adjustment parameter value for adjusting the brightness of the illumination light in the next step.

[0008] The skin in vivo confocal imaging brightness adaptive adjustment device disclosed in this invention, by setting up a scanning imaging device and a brightness adjustment device, uses the scanning imaging device to emit illumination light to the skin sample and performs point-by-point scanning imaging of the skin sample through a microelectromechanical system (MEMS). The brightness of the illumination light is then adaptively adjusted iteratively by the brightness adjustment device. During the iteration process, the average signal strength of the electrical signal of the obtained imaging result within the sampling period and the number of pixels with signal strength higher than the reference value are substituted into an empirical formula to obtain the adjustment parameter value for the next step of adjusting the brightness of the illumination light, thereby performing the next brightness adjustment. It can be seen that this adaptive adjustment device disclosed in this invention is a novel automated brightness adjustment device, eliminating the need for frequent manual adjustment of the light source power or manual modification of the signal dynamic range in the software system. It is simple to operate, can be operated with a single button, and thus does not distract the doctor. At the same time, because the brightness adjustment device uses an iterative method for adaptive brightness adjustment and samples through a point-by-point scanning method of the MEMS, the iteration process is based on the average signal strength of the electrical signal within the sampling period and the number of pixels with signal strength higher than the reference value, resulting in high adjustment accuracy, low computational energy consumption, and no need for specialized image processing, thereby improving sample detection efficiency and imaging effect.

[0009] In one possible implementation, the scanning imaging device includes: The light source module is electrically connected to the brightness adjustment device and is used to emit the illumination light; A polarizing beam splitter is used to transmit the illumination light while reflecting the reflected signal light formed by the illumination light reflected by the skin sample; The microelectromechanical scanning galvanometer, electrically connected to the brightness adjustment device, is used to reflect the illumination light transmitted by the polarizing beam splitter point by point, and simultaneously reflect the reflected signal light point by point back to the polarizing beam splitter, so as to complete the point-by-point scanning sampling of the skin sample. The modulation module is used to sequentially relay and phase-modulate the illumination light reflected by the microelectromechanical scanning mirror, and guide the phase-modulated illumination light onto the skin sample; simultaneously, it sequentially phase-modulates and relays the reflected signal light, and relays the reflected signal light onto the microelectromechanical scanning mirror; An imaging conversion module, electrically connected to the brightness adjustment device, is used to image the reflected signal light reflected by the polarizing beam splitter and convert it into an electrical signal of the imaging result. The light source module, the polarizing beam splitter, the microelectromechanical scanning mirror, and the modulation module are arranged sequentially along the propagation direction of the illumination light, while the modulation module, the microelectromechanical scanning mirror, the polarizing beam splitter, and the imaging conversion module are arranged sequentially along the propagation direction of the reflected signal light.

[0010] When the light source module emits illumination light, it enters the polarization beam splitter. Under the action of the polarization beam splitter, the polarization component vibrating in the P direction is transmitted and enters the microelectromechanical scanning mirror (MEMS scanning mirror). It is reflected by the MEMS scanning mirror and enters the modulation module. The modulation module modulates the incident linearly polarized light vibrating in the P direction, and then directs it toward the skin sample. Under the block-by-block scanning motion of the MEMS scanning mirror, the focused light spot on the skin sample moves block by block (more precisely, point by point and line by line). The light beam reflected or scattered by the skin sample will return to the modulation module, be modulated by the same phase again, and then enter the MEMS scanning mirror and the polarization beam splitter in sequence and be reflected. It is then incident on the imaging conversion module, which converts the detected sample light signal into an electrical signal and outputs it.

[0011] In one possible implementation, the light source module includes a light source for emitting illumination light and a collimating lens for collimating the illumination light. The light source is electrically connected to the brightness adjustment device and is located at the object-side focal point of the collimating lens.

[0012] In one possible implementation, the light source is a laser or a light-emitting diode. This facilitates meeting the requirement for adjustable luminous power and provides good stability of the light source.

[0013] In one possible implementation, the modulation module includes a relay lens, a reflector, a phase plate, and a microscope objective arranged sequentially along the propagation direction of the illumination light, wherein the phase plate is a λ / 4 waveplate. This enables the conversion between S-polarized, circularly polarized, and P-polarized light, helping to improve imaging accuracy and efficiency. The microscope objective magnifies the light reflected from the sample, allowing fine objects to be examined.

[0014] In one possible implementation, the imaging conversion module includes a pinhole lens, a pinhole plate, and a photodetector arranged sequentially along the propagation direction of the reflected signal light. The pinhole plate is located at the image-side focal point of the pinhole lens. The photodetector is used to perform photoelectric conversion on the output signal of the pinhole plate to obtain an electrical signal of the imaging result. The photodetector is electrically connected to the brightness adjustment device.

[0015] In one possible implementation, the brightness adjustment device includes: The display has an editor for users to set reference values ​​and the sampling period of the data acquisition device; The data acquisition unit, electrically connected to the photodetector, is used to convert the electrical signal of the imaging result into a digital signal, and to count the average signal strength of the acquired digital signal and the number of pixels with a signal strength higher than the reference value within the sampling period. The control unit is electrically connected to the display, the data acquisition unit, the light source, and the microelectromechanical scanning galvanometer, and is used to adaptively adjust the brightness of the illumination emitted by the light source in an iterative manner.

[0016] The brightness adjustment device with the above structure and functions can meet the user's parameter adjustment needs by setting up a display to realize human-computer interaction, and can convert the electrical signal of the imaging result into a digital signal by setting up a data acquisition unit, thereby improving the information acquisition efficiency. The control unit can control the data acquisition unit, light source and microelectromechanical scanning galvanometer, further reducing the user's burden and improving the operating efficiency.

[0017] In one possible implementation, the adaptive adjustment process performed by the control unit includes the following steps: A1: Receives the reference value and sampling period set by the user. If the user does not set the reference value and sampling period, the reference value and sampling period are set automatically. At the same time, the current adjustment parameter value is generated and the microelectromechanical scanning galvanometer is started. A2: Make the light source emit illumination light with the brightness corresponding to the current adjustment parameter value; A3: Invoke the data acquisition device to count the average signal strength of the electrical signal of the currently acquired imaging result within the sampling period and the number of pixels with signal strength higher than the reference value; A4: Substitute the current adjustment parameters, the average signal strength obtained in step A3, and the number of pixels into the empirical formula to obtain the adjustment parameter values ​​for the next step of adjusting the illumination brightness; A5: Take the adjustment parameter value for adjusting the lighting brightness obtained in step A4 as the current adjustment parameter value, and then return to step A2.

[0018] While acquiring data, the system can statistically analyze the average value of the photoelectric signals acquired within a certain sampling period and the number of points with signals higher than the reference value. This enables adaptive and orderly adjustment of brightness while improving adjustment efficiency. It eliminates the need for cumbersome operations and complex image processing.

[0019] In one possible implementation, the empirical formula is calculated as follows: , , In the formula, The target value representing the average signal strength; This represents the current adjustment parameter value; The average signal strength of the electrical signal representing the current imaging result within the sampling period; The number of pixels whose electrical signal strength is higher than the reference value within the sampling period, representing the current imaging result; This represents the lower limit of the adjustment parameter value corresponding to the brightness of the illumination emitted by the light source; This represents the upper limit of the adjustment parameter value corresponding to the brightness of the illumination emitted by the light source; This represents the adjustment parameter value for the next step of adjusting the lighting brightness; A, B, C, and D represent constant values ​​summarized from statistical data.

[0020] The above formula is simple in form and has the advantages of low computational complexity and good computational accuracy. Using the above formula for iteration can reduce computational energy consumption while maintaining a slight adjustment.

[0021] Another technical solution of the present invention is to provide a method for adaptive brightness adjustment of in vivo confocal imaging images of skin, comprising the following steps: S1: Illumination light is emitted to the skin sample through a scanning imaging device, and the skin sample is scanned point by point through a microelectromechanical system to obtain the electrical signal of the imaging result; S2: The brightness adjustment device is used to count the average signal strength of the electrical signal of the currently acquired imaging result within the sampling period and the number of pixels with signal strength higher than the reference value; S3: Substitute the average signal strength and the number of pixels into an empirical formula using a brightness adjustment device to obtain the adjustment parameter values ​​for adjusting the illumination brightness in the next step; S4: The brightness adjustment device takes the adjustment parameter value of the next step of adjusting the brightness of the illumination light as the current adjustment parameter value, and adjusts the brightness of the illumination light emitted by the scanning imaging device to the brightness corresponding to the current adjustment parameter value, and then returns to step S2.

[0022] The skin in vivo confocal imaging brightness adaptive adjustment method disclosed in this invention first uses a scanning imaging device to emit illumination light onto the skin sample, and then performs point-by-point scanning imaging of the skin sample using a microelectromechanical system (MEMS). Subsequently, a brightness adjustment device iteratively and adaptively adjusts the brightness of the illumination light. During the iteration process, the average signal strength of the electrical signal of the obtained imaging result within the sampling period and the number of pixels with signal strength higher than a reference value are substituted into an empirical formula to obtain the adjustment parameter value for the next step of adjusting the brightness of the illumination light, thereby performing the next brightness adjustment. It is evident that the method disclosed in this invention does not require frequent manual adjustment of the light source's luminous power or manual modification of the signal dynamic range in the software system. It is simple to operate and can be performed with a single click, thus not distracting the doctor's attention. Simultaneously, because it uses an iterative method for brightness adaptive adjustment and samples through a point-by-point scanning method using a MEMS, the iteration process is based on the average signal strength of the electrical signal within the sampling period and the number of pixels with signal strength higher than a reference value, resulting in high adjustment accuracy, low computational energy consumption, and no need for specialized image processing, thereby improving sample detection efficiency and imaging effect. Attached Figure Description

[0023] Figure 1 This is a schematic diagram of a skin in vivo confocal imaging image brightness adaptive adjustment device disclosed in an embodiment of the present invention; Figure 2 This is a schematic diagram of the scanning imaging device structure disclosed in the embodiments of the present invention; Figure 3 This is a schematic diagram of the brightness adjustment device structure disclosed in the embodiments of the present invention; Figure 4 This is a flowchart of the control unit operation as disclosed in the embodiments of the present invention; Figure 5 This is a flowchart of the method disclosed in the embodiments of the present invention.

[0024] Explanation of reference numerals in the attached figures: 1. Scanning imaging device; 11. Light source module; 11.1. Light source; 11.2. Collimating lens; 12. Polarizing beam splitter; 13. MEMS scanning galvanometer; 14. Modulation module; 14.1. Relay lens; 14.2. Reflector; 14.3. Phase plate; 14.4. Microscope objective; 15. Imaging conversion module; 15.1. Pinhole lens; 15.2. Pinhole plate; 15.3. Photodetector; 2. Skin sample; 3. Brightness adjustment device; 31. Display; 32. Data acquisition unit; 33. Control unit. Detailed Implementation

[0025] First, those skilled in the art should understand that these embodiments are merely used to explain the technical principles of the embodiments of this application and are not intended to limit the scope of protection of the embodiments of this application. Those skilled in the art can make adjustments as needed to adapt to specific application scenarios.

[0026] In the description of the embodiments of this application, it should be noted that, unless otherwise explicitly specified and limited, the technical terms "electrical connection" and "establishing an electrical connection relationship" should be interpreted broadly, that is, it should be understood that both or more have an electrical relationship, which can be achieved through a wire, a radio connection, or a combination of both; it can be a direct connection or an indirect connection through an intermediate medium. Those skilled in the art can understand the specific meaning of the above terms in the embodiments of this application according to the specific circumstances.

[0027] In the embodiments of this application, unless otherwise expressly specified and limited, "above" or "below" the second feature can mean that the first feature is in direct contact with the second feature, or that the first feature is in indirect contact with the second feature through an intermediate medium. Furthermore, "above," "on top of," and "over" the second feature can mean that the first feature is directly above or diagonally above the second feature, or simply that the first feature is at a higher horizontal level than the second feature. "Below," "below," and "under" the second feature can mean that the first feature is directly below or diagonally below the second feature, or simply that the first feature is at a lower horizontal level than the second feature.

[0028] The present application will now be described in further detail with reference to the accompanying drawings and specific embodiments.

[0029] See Figures 1-5 This embodiment discloses a skin in vivo confocal imaging image brightness adaptive adjustment device, the overall structure of which is shown in the schematic diagram below. Figure 1 As shown, the adaptive adjustment device includes a scanning imaging device 1 and a brightness adjustment device 3, wherein the brightness adjustment device 3 is electrically connected to the scanning imaging device 1.

[0030] See Figure 2In this adaptive adjustment device, the scanning imaging device 1 emits illumination light to the skin sample 2 and performs point-by-point scanning imaging of the skin sample 2 using a microelectromechanical system (MEMS) to obtain the electrical signal of the imaging result. For example... Figure 2 As shown, in this embodiment, the scanning imaging device 1 includes a light source module 11, a polarizing beam splitter 12, a microelectromechanical scanning galvanometer 13, a modulation module 14, and an imaging conversion module 15. The light source module 11, polarizing beam splitter 12, microelectromechanical scanning galvanometer 13, and modulation module 14 are arranged sequentially along the direction of illumination light propagation, while the modulation module 14, microelectromechanical scanning galvanometer 13, polarizing beam splitter 12, and imaging conversion module 15 are arranged sequentially along the direction of reflected signal light propagation. The light source module 11 is electrically connected to the brightness adjustment device 3, the microelectromechanical scanning galvanometer 13 is electrically connected to the brightness adjustment device 3, and the imaging conversion module 15 is electrically connected to the brightness adjustment device 3.

[0031] like Figure 2 As shown, in the scanning imaging device 1, the light source module 11 is used to emit illumination light. The light source module 11 includes a light source 11.1 for emitting illumination light and a collimating lens 11.2 for collimating the illumination light. The light source 11.1 is electrically connected to the brightness adjustment device 3. The light source 11.1 is located at the object-side focal point of the collimating lens 11.2, that is, the light source 11.1 and the collimating lens 11.2 are arranged sequentially along the direction of illumination light propagation. The light source 11.1 can be a laser or a light-emitting diode; in this embodiment, a light-emitting diode is used.

[0032] like Figure 2 As shown, in the scanning imaging device 1, the polarizing beam splitter 12 is used to transmit illumination light and simultaneously reflect the reflected signal light formed by the illumination light reflected by the skin sample 2. The microelectromechanical scanning galvanometer 13 (i.e., MEMS scanning galvanometer) is used to reflect the illumination light transmitted by the polarizing beam splitter 12 point by point, and simultaneously reflect the reflected signal light point by point back to the polarizing beam splitter 12, so as to complete the point-by-point scanning sampling of the skin sample 2.

[0033] like Figure 2 As shown, in the scanning imaging device 1, the modulation module 14 is used to sequentially relay and phase-modulate the illumination light reflected by the microelectromechanical scanning galvanometer 13, and guide the phase-modulated illumination light onto the skin sample 2; simultaneously, it sequentially phase-modulates and relays the reflected signal light, and relays the reflected signal light onto the microelectromechanical scanning galvanometer 13. In this embodiment, the modulation module 14 includes a relay lens 14.1, a reflector 14.2, a phase plate 14.3, and a microscope objective 14.4 arranged sequentially along the illumination light propagation direction, wherein the phase plate 14.3 is a λ / 4 waveplate.

[0034] like Figure 2As shown, in the scanning imaging device 1, the imaging conversion module 15 is used to image the reflected signal light reflected by the polarizing beam splitter 12 and convert it into an electrical signal of the imaging result. In this embodiment, the imaging conversion module 15 includes a pinhole lens 15.1, a pinhole plate 15.2, and a photodetector 15.3 arranged sequentially along the propagation direction of the reflected signal light. The pinhole plate 15.2 is located at the image-side focal point of the pinhole lens 15.1. The photodetector is used to perform photoelectric conversion on the output signal of the pinhole plate 15.2 to obtain an electrical signal of the imaging result. The photodetector 15.3 is electrically connected to the brightness adjustment device 3. The signal input ends of the pinhole plate 15.2 and the photodetector 15.3 are transmitted through optical fibers.

[0035] During operation, the light beam emitted from light source 11.1 is collimated by collimating lens 11.2. The polarized component vibrating in the P direction (P-light) is transmitted by polarizing beam splitter 12 and enters microelectromechanical scanning galvanometer 13 (i.e., MEMS scanning galvanometer). It is reflected by the scanning galvanometer and enters relay lens 14.1. The light beam relayed from relay lens 14.1 is reflected by mirror 14.2 and enters phase plate 14.3, i.e., λ / 4 waveplate. The λ / 4 waveplate modulates the incident linearly polarized light vibrating in the P direction into circularly polarized light. After exiting the λ / 4 waveplate, the light beam enters microscope objective 14.4. The light beam is focused into a point-like spot on the skin sample 2 at the focal plane of microscope objective 14.4. Microscope objective 14.4 can magnify and focus the light reflected from skin sample 2, thus facilitating the examination of small objects. Under the scanning motion of microelectromechanical scanning galvanometer 13, the focused spot formed by the light beam on skin sample 2 moves point by point and line by line.

[0036] The light beam reflected or scattered by skin sample 2, i.e., the reflected signal light, enters the λ / 4 waveplate after passing through the microscope objective 14.4. It is then phase-modulated again by the λ / 4 waveplate, converting the polarization state of the light beam exiting the λ / 4 waveplate into S-polarized light (S-beam). This light then passes sequentially through mirror 14.2, relay lens 14.1, and microelectromechanical scanning mirror 13, before entering the polarizing beam splitter 12 and being reflected. It then passes sequentially through pinhole lens 15.1, pinhole plate 15.2, and photodetector 15.3. Photodetector 15.3 converts the detected imaging signal into an analog voltage and outputs it to brightness adjustment device 3. Brightness adjustment device 3 then converts the electrical signal into a digital signal or outputs it to other image conversion devices for image conversion and processing.

[0037] See Figure 2 , Figure 3 and Figure 4In this adaptive adjustment device, the brightness adjustment device 3 is used to adaptively adjust the illumination brightness in an iterative manner. During the iteration process, it first calculates the average signal strength of the electrical signal of the currently acquired imaging result within the sampling period and the number of pixels with signal strengths higher than the reference value. The average signal strength and the number of pixels are then substituted into an empirical formula to obtain the adjustment parameter values ​​for the next step of adjusting the illumination brightness. For example... Figure 2 , Figure 3 As shown, in this embodiment, the brightness adjustment device 3 includes a display 31, a data acquisition unit 32, and a control unit 33. The data acquisition unit 32 is electrically connected to the photodetector 15.3, and the control unit 33 is electrically connected to the display 31, the data acquisition unit 32, the light source 11.1, and the microelectromechanical scanning mirror 13.

[0038] See Figure 2 and Figure 3 In the brightness adjustment device 3, the display 31 serves as an information display tool and is equipped with an editor for users to set reference values ​​and the sampling period of the data acquisition unit 32. The data acquisition unit 32 is used to convert the electrical signal of the imaging result into a digital signal and to count the average signal strength of the acquired digital signal and the number of pixels with signal strength higher than the reference value within the sampling period.

[0039] See Figure 4 In the brightness adjustment device 3, the control unit 33 is used to adaptively adjust the brightness of the illumination emitted by the light source 11.1 in an iterative manner. Specifically, as... Figure 4 As shown, the adaptive adjustment process performed by the control unit 33 includes the following steps: A1: Receives the reference value and sampling period set by the user. If the user has not set the reference value and sampling period, the reference value and sampling period will be set by the user. At the same time, the current adjustment parameter value will be generated and the microelectromechanical scanning galvanometer 13 will be started.

[0040] A2: Make light source 11.1 emit illumination light with the brightness corresponding to the current adjustment parameter value.

[0041] A3: Call the data acquisition unit 32 to run, and count the average signal strength of the electrical signal of the currently acquired imaging results within the sampling period and the number of pixels with signal strength higher than the reference value.

[0042] A4: Substitute the current adjustment parameters, the average signal strength obtained in step A3, and the number of pixels into the empirical formula to obtain the adjustment parameter values ​​for the next step of adjusting the illumination brightness. The empirical formula is calculated as follows: , , In the formula, The target value representing the average signal strength; This represents the current adjustment parameter value; The average signal strength of the electrical signal representing the current imaging result within the sampling period; The number of pixels whose electrical signal strength is higher than the reference value within the sampling period, representing the current imaging result; This represents the lower limit of the adjustment parameter value corresponding to the illumination brightness emitted by light source 11.1; This represents the upper limit of the adjustable parameter value corresponding to the brightness of the illumination emitted by light source 11.1; This represents the adjustment parameter value for the next step of adjusting the lighting brightness; A, B, C, and D represent constant values ​​summarized from statistical data.

[0043] A5: Take the adjustment parameter value for adjusting the lighting brightness obtained in step A4 as the current adjustment parameter value, and then return to step A2.

[0044] See Figure 5 The following further discloses the method of using the skin in vivo confocal imaging image brightness adaptive adjustment device in this embodiment, namely, the image brightness adaptive adjustment method, which includes the following steps: S1: Illumination light is emitted to the skin sample 2 through the scanning imaging device 1, and the skin sample 2 is scanned point by point through the microelectromechanical system to obtain the electrical signal of the imaging result.

[0045] S2: The brightness adjustment device 3 counts the average signal strength of the electrical signal of the currently acquired imaging result within the sampling period and the number of pixels with signal strength higher than the reference value.

[0046] S3: The average signal strength and the number of pixels are substituted into the empirical formula by the brightness adjustment device 3 to obtain the adjustment parameter values ​​for adjusting the illumination brightness in the next step. The empirical formula is the one disclosed in this embodiment.

[0047] S4: The brightness adjustment device 3 takes the adjustment parameter value of the next step of adjusting the brightness of the illumination light as the current adjustment parameter value, and adjusts the brightness of the illumination light emitted by the scanning imaging device 1 to the brightness corresponding to the current adjustment parameter value, and then returns to step S2.

[0048] The skin in vivo confocal imaging brightness adaptive adjustment device disclosed in this embodiment uses a scanning imaging device 1 and a brightness adjustment device 3. The scanning imaging device 1 emits illumination light to the skin sample 2, and the skin sample 2 is scanned point-by-point using a microelectromechanical system (MEMS) scanning method (i.e., a MEMS scanning galvanometer 13). The brightness of the illumination light is adaptively adjusted iteratively by the control unit 33 of the brightness adjustment device 3. During the iteration process, the average signal strength of the electrical signal of the obtained imaging result within the sampling period and the number of pixels with signal strength higher than the reference value are substituted into an empirical formula to obtain the adjustment parameter value for the next step of adjusting the brightness of the illumination light, thereby performing the next brightness adjustment. Therefore, this adaptive adjustment device disclosed in this embodiment is a novel automated brightness adjustment device. It eliminates the need for frequent manual adjustment of the light source power or manual modification of the signal dynamic range in the software system. It is simple to operate, can be operated with a single button, and thus does not distract the doctor. Meanwhile, since the brightness adjustment device 3 adopts an iterative method for adaptive brightness adjustment and samples by scanning point by point through a microelectromechanical system, the iterative process is based on the average signal strength of the electrical signal within the sampling period and the number of pixels with signal strength higher than the reference value. This results in high adjustment accuracy, low computational energy consumption, and no need for special image processing, thereby improving sample detection efficiency and imaging effect.

[0049] In the description of the embodiments of this application, it should be noted that the terms "inner" and "outer" and other terms indicating direction or positional relationship are based on the direction or positional relationship shown in the drawings. This is only for the convenience of description and does not indicate or imply that the device or component must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, it should not be construed as a limitation of this application.

[0050] In the description of this application, the references to terms such as "an embodiment," "some embodiments," "in this embodiment," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0051] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A skin in vivo confocal imaging image brightness adaptive adjustment device, characterized in that, include: The scanning imaging device (1) is used to emit illumination light to the skin sample (2) and perform point-by-point scanning imaging of the skin sample (2) through a microelectromechanical system to obtain the electrical signal of the imaging result; The brightness adjustment device (3) is electrically connected to the scanning imaging device (1) and is used to adaptively adjust the brightness of the illumination light in an iterative manner. During the iteration process, the average signal strength of the electrical signal of the current imaging result within the sampling period and the number of pixels with signal strength higher than the reference value are first counted. The average signal strength and the number of pixels are substituted into the empirical formula to obtain the adjustment parameter value for adjusting the brightness of the illumination light in the next step.

2. The skin in vivo confocal imaging image brightness adaptive adjustment device according to claim 1, characterized in that, The scanning imaging device (1) includes: The light source module (11) is electrically connected to the brightness adjustment device (3) and is used to emit the illumination light; A polarizing beam splitter (12) is used to transmit the illumination light while reflecting the reflected signal light formed by the illumination light reflected by the skin sample (2); The microelectromechanical scanning galvanometer (13) is electrically connected to the brightness adjustment device (3) and is used to reflect the illumination light transmitted by the polarizing beam splitter (12) point by point, and at the same time reflect the reflected signal light point by point onto the polarizing beam splitter (12) to complete the point-by-point scanning sampling of the skin sample (2). The modulation module (14) is used to sequentially relay and phase modulate the illumination light reflected by the microelectromechanical scanning galvanometer (13), and guide the phase-modulated illumination light onto the skin sample (2); at the same time, it sequentially performs phase modulation and relay on the reflected signal light, and relays the reflected signal light onto the microelectromechanical scanning galvanometer (13); The imaging conversion module (15) is electrically connected to the brightness adjustment device (3) and is used to image the reflected signal light reflected by the polarizing beam splitter (12) and convert it into an electrical signal of the imaging result. The light source module (11), the polarizing beam splitter (12), the microelectromechanical scanning mirror (13), and the modulation module (14) are arranged sequentially along the direction of illumination light propagation, and the modulation module (14), the microelectromechanical scanning mirror (13), the polarizing beam splitter (12), and the imaging conversion module (15) are arranged sequentially along the direction of reflection signal light propagation.

3. The skin in vivo confocal imaging image brightness adaptive adjustment device according to claim 2, characterized in that, The light source module (11) includes a light source (11.1) for emitting illumination light and a collimating lens (11.2) for collimating the illumination light. The light source (11.1) is electrically connected to the brightness adjustment device (3), and the light source (11.1) is located at the object-side focal point of the collimating lens (11.2).

4. The skin in vivo confocal imaging image brightness adaptive adjustment device according to claim 3, characterized in that, The light source (11.1) is a laser or a light-emitting diode.

5. The skin in vivo confocal imaging image brightness adaptive adjustment device according to claim 3 or 4, characterized in that, The modulation module (14) includes a relay lens (14.1), a reflector (14.2), a phase plate (14.3) and a microscope objective (14.4) arranged sequentially along the direction of illumination light propagation. The phase plate (14.3) is a λ / 4 waveplate.

6. The skin in vivo confocal imaging image brightness adaptive adjustment device according to claim 5, characterized in that, The imaging conversion module (15) includes a pinhole lens (15.1), a pinhole plate (15.2), and a photodetector (15.3) arranged sequentially along the propagation direction of the reflected signal light. The pinhole plate (15.2) is located at the image-side focal point of the pinhole lens (15.1). The photodetector is used to perform photoelectric conversion on the output signal of the pinhole plate (15.2) to obtain an electrical signal of the imaging result. The photodetector (15.3) is electrically connected to the brightness adjustment device (3).

7. The skin in vivo confocal imaging image brightness adaptive adjustment device according to claim 6, characterized in that, The brightness adjustment device (3) includes: The display (31) is equipped with an editor for users to set reference values ​​and the sampling period of the data acquisition device (32); The data acquisition unit (32) is electrically connected to the photodetector (15.3) and is used to convert the electrical signal of the imaging result into a digital signal, and to count the average signal strength of the acquired digital signal and the number of pixels with a signal strength higher than the reference value within the sampling period. The control unit (33) is electrically connected to the display (31), the data acquisition unit (32), the light source (11.1) and the microelectromechanical scanning galvanometer (13) for iterative adaptive adjustment of the illumination brightness emitted by the light source (11.1).

8. The skin in vivo confocal imaging image brightness adaptive adjustment device according to claim 7, characterized in that, The adaptive adjustment process performed by the control unit (33) includes the following steps: A1: Receives the reference value and sampling period set by the user. If the user does not set the reference value and sampling period, the reference value and sampling period are set by the user. At the same time, the current adjustment parameter value is generated and the microelectromechanical scanning galvanometer (13) is started. A2: Make the light source (11.1) emit illumination light with the brightness corresponding to the current adjustment parameter value; A3: Call the data acquisition device (32) to run, and count the average signal strength of the electrical signal of the currently acquired imaging result within the sampling period and the number of pixels with signal strength higher than the reference value; A4: Substitute the current adjustment parameters, the average signal strength obtained in step A3, and the number of pixels into the empirical formula to obtain the adjustment parameter values ​​for the next step of adjusting the illumination brightness; A5: Take the adjustment parameter value for adjusting the lighting brightness obtained in step A4 as the current adjustment parameter value, and then return to step A2.

9. The skin in vivo confocal imaging image brightness adaptive adjustment device according to claim 8, characterized in that, The calculation formula for the empirical formula is as follows: ， ， In the formula, The target value representing the average signal strength; This represents the current adjustment parameter value; The average signal strength of the electrical signal representing the current imaging result within the sampling period; The number of pixels whose electrical signal strength is higher than the reference value within the sampling period, representing the current imaging result; This represents the lower limit of the adjustment parameter value corresponding to the illumination brightness emitted by the light source (11.1); This represents the upper limit of the adjustment parameter value corresponding to the illumination brightness emitted by the light source (11.1); This represents the adjustment parameter value for the next step of adjusting the lighting brightness; A, B, C, and D represent constant values ​​summarized from statistical data.

10. A method for adaptive brightness adjustment of in vivo confocal imaging images of skin, characterized in that, The skin in vivo confocal imaging image brightness adaptive adjustment device according to any one of claims 1-9 includes the following steps: S1: Illumination light is emitted to the skin sample (2) by the scanning imaging device (1), and the skin sample (2) is scanned point by point by the microelectromechanical system to obtain the electrical signal of the imaging result; S2: The brightness adjustment device (3) counts the average signal strength of the electrical signal of the currently obtained imaging result within the sampling period and the number of pixels with signal strength higher than the reference value; S3: Substitute the average signal strength and the number of pixels into the empirical formula using the brightness adjustment device (3) to obtain the adjustment parameter value for adjusting the illumination brightness in the next step; S4: The brightness adjustment device (3) takes the adjustment parameter value of the next step of adjusting the brightness of the illumination light as the current adjustment parameter value, and adjusts the brightness of the illumination light emitted by the scanning imaging device (1) to the brightness corresponding to the current adjustment parameter value, and then returns to step S2.

Images