8K-based ultra-large depth-of-field biprism wireless surgical field shooting and lighting system

Abstract

The invention discloses a wireless surgical field shooting and lighting system based on an 8K ultra-large depth-of-field biprism, which relates to the technical field of medical instruments and comprises an 8K ultra-large depth-of-field biprism lens, a wireless surgical field host and a display screen. The 8K ultra-large depth-of-field biprism lens comprises a front-end objective lens end, a middle machine body, a connecting joint, a rear-end focusing and amplifying assembly and a suspension arm connecting piece. An LED lamp bead set, a lens set and a reflecting prism are arranged in the front end objective lens end, meanwhile, the reflecting prism is arranged in an inner cavity of the connecting joint, the optical axis direction of the objective lens is parallel to the optical axis of the rear end focusing amplification set, and a power supply cable of the lens set and the LED lamp bead set is arranged in the middle of the machine body of the front end objective lens end. According to the invention, the 8K ultra-large depth-of-field biprism lens with a lighting function is adopted, so that the hidden danger that a video recording picture is not clear due to insufficient light intensity is completely eradicated; the self-adaption of wireless surgical field illumination is realized by adopting a special image adjustment enhancement algorithm, and the definition of image display is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of medical devices, and in particular to a wireless surgical field camera illumination system based on an 8K ultra-large depth of field double prism. Background Art

[0002] At present, many large comprehensive hospitals in China undertake a large number of clinical teaching tasks for medical staff in small and medium-sized hospitals and medical students in medical colleges. In the past traditional on-site teaching mode, restricted by on-site conditions and hygiene requirements, there are problems such as a small number of observers, easy secondary infection, and inability to centrally display and store medical images. At the same time, based on the experience characteristics of the medical industry itself, it is determined that it needs to continuously communicate internally and externally to promote development and improve itself. For the above reasons, various surgical field cameras have been developed to undertake the operating room teaching system.

[0003] In recent years, using a surgical field camera for surgical video recording has become the mainstream. However, the commonly used surgical field cameras on the market for video recording have the following disadvantages: generally, a single lens is used, resulting in unclear video recording images due to insufficient light intensity; in addition, after the image is recorded, the image is not adjusted, resulting in unclear image display. Therefore, there is room for improvement. Summary of the Invention

[0004] The purpose of the present invention is to solve the disadvantages existing in the prior art, and to propose a wireless surgical field camera illumination system based on an 8K ultra-large depth of field double prism. Its advantages are that it uses an 8K ultra-large depth of field double prism lens with an illumination function, eliminating the hidden danger of unclear video recording images due to insufficient light intensity; and it uses a dedicated image adjustment and enhancement algorithm to achieve the adaptability of wireless surgical field illumination, improving the clarity of image display.

[0005] In order to achieve the above purpose, the present invention adopts the following technical solutions:

[0006] A wireless surgical field camera illumination system based on an 8K ultra-large depth of field double prism, comprising an 8K ultra-large depth of field double prism lens, a wireless surgical field host, and a display screen;

[0007] The 8K ultra-large depth of field double prism lens includes a front objective lens end, a middle body, a connecting joint, a rear focusing and magnifying component, and a boom connecting piece; the front objective lens end contains an LED lamp bead group, a lens group, and a reflecting prism inside, and at the same time, a reflecting prism is arranged in the inner cavity of the connecting joint. The optical axis direction of the objective lens is parallel to the optical axis of the rear focusing and magnifying group. The middle body inside the front objective lens end is provided with a power supply cable for the lens group and the LED lamp bead group, and a TYPE-C power supply port is arranged at the front of the connection between the tail of the middle body and the connecting joint;

[0008] The rear focus magnification component includes a focus ring, an aperture ring, and a buckle structure. The focus ring is used to adjust the relative distance between the sensor and the lens. The aperture ring is used to adjust the amount of incident light. The buckle structure is connected to the wireless surgical field host. The boom connector is fixed to the body of the 8K ultra-large depth-of-field double prism lens. A mobile charging and discharging device fixing cavity is provided in the middle of the boom connector, and a boom connection port is provided at the end of the boom connector.

[0009] The wireless surgical field host includes a photoelectric conversion image acquisition module, a digital image processing module, a display control module, an image output module, a storage module, a communication module, and a power supply module.

[0010] The display screen is built-in with a wireless receiving module, which is used to receive the image transmission signal transmitted by the surgical field camera host through wireless RF, process the received signal, and directly present the processed signal on the display screen. The display screen uses an ultra-large depth-of-field imaging algorithm to process the image. By introducing a special phase mask in the optical system, light in different depth-of-field ranges generates specific blurred images on the detector, and then the clear image is restored through digital image processing algorithms. After that, multiple images are taken at different focus positions, and then these images are synthesized in the digital domain to obtain a clear image within the entire scene range. The measurement method uses the peak signal-to-noise ratio, which is defined by the mean square error.

[0011] The present invention is further configured such that the 8K ultra-large depth-of-field double prism lens is an optical lens. The total length of the lens is 500 mm, the diameter of the lens body is 28 mm, the lens bayonet end is connected to the wireless surgical field host, and the body of the wireless surgical field host is mounted on the boom of the operating room trolley through a mechanical structure.

[0012] The present invention is further configured such that the photoelectric conversion image acquisition module internally contains a PCB board embedded with a CMOS image sensor, and the CMOS image sensor and the peripheral circuit complete the conversion of optical signals to electrical signals.

[0013] The present invention is further configured such that the digital image processing module performs real-time image processing on the video stream collected by the front-end image sensor, and enhances the visualization of the image by using the white light imaging image enhancement algorithm obtained under white light conditions.

[0014] The present invention is further configured such that the white light imaging image enhancement algorithm is a complete set of dedicated image calibration and enhancement algorithms for realizing real-time processing of video; an adaptive noise reduction model is adopted to filter random noise in the image while maintaining image detail information.

[0015] The present invention is further configured such that the display control module consists of a small OLED display screen and a button panel with seven buttons. The display content of the OLED display screen mainly includes the current RF wireless transmission mode, light source status, power status, image status, and video recording status indicator functions. The button panel mainly completes the on / off function of the camera and the adjustment or switching of various camera functions, including the adjustment of the image zoom ratio, the start / end operation of video recording, and the white balance operation.

[0016] The present invention is further configured such that the communication module includes an RF transmitting unit and an RF receiving unit. The RF transmitting unit consists of a transmitting modulator, a transmitting phase discriminator, a transmitting voltage-controlled oscillator, a power amplifier, a power controller, and a transmitting mutual inductor inside the intermediate frequency.

[0017] The present invention is further configured such that the calculation formula for the variance is:

[0018]

[0019] Where x, y and I, K represent two x×y monochromatic images I and K. If the two noises are similar, the peak signal-to-noise ratio is defined as:

[0020]

[0021] Where MAX1 represents the maximum color value of the image point. Through this formula, the value of the signal-to-noise ratio at the color peak can be calculated, with the unit of dB. The larger the value, the less the distortion.

[0022] The present invention is further configured such that the display screen is denoised using a Gaussian low-pass filter to remove high-frequency noise in the image while retaining low-frequency information, including edges and contours. For each pixel point, taking it as the center, the weighted average of all pixel gray values within its 3×3 area is used as the gray value of the center point. When calculating each pixel point, the current center point is regarded as the coordinate origin, so that the mean value μ = 0.

[0023] The present invention is further configured such that the Gaussian low-pass filter includes a one-dimensional Gaussian distribution and a two-dimensional Gaussian distribution. The formula for the one-dimensional Gaussian distribution is:

[0024]

[0025] The formula for the two-dimensional Gaussian distribution is:

[0026]

[0027] The beneficial effects of the present invention are as follows: In the wireless RF mode of wireless surgical field imaging, the host uses an 8K ultra-large depth-of-field double prism lens and a CMOS image sensor chip to obtain image signals. After the image signals are processed, the wireless RF transmission protocol is used to wirelessly transmit the image signals to the built-in wireless receiving module. The wireless receiving module processes the received signals and directly presents them on the display screen. An 8K ultra-large depth-of-field double prism lens with a lighting function is adopted to eliminate the hidden danger of unclear video recording images caused by insufficient light intensity; a dedicated image calibration and enhancement algorithm is used to achieve the self-adaptation of wireless surgical field lighting, improving the clarity of image display. Description of the Drawings

[0028] Figure 1 It is a schematic diagram of the overall structure of the wireless surgical field imaging lighting system based on an 8K ultra-large depth-of-field double prism proposed by the present invention;

[0029] Figure 2 It is a schematic diagram of the lens structure of the wireless surgical field imaging lighting system based on an 8K ultra-large depth-of-field double prism proposed by the present invention;

[0030] Figure 3 It is a schematic diagram of the connection relationship of the wireless surgical field imaging lighting system based on an 8K ultra-large depth-of-field double prism proposed by the present invention;

[0031] Figure 4 It is an electrical schematic diagram of the wireless surgical field host of the wireless surgical field imaging lighting system based on an 8K ultra-large depth-of-field double prism proposed by the present invention;

[0032] Figure 5 It is a flow chart of the dedicated image calibration and enhancement algorithm of the wireless surgical field imaging lighting system based on an 8K ultra-large depth-of-field double prism proposed by the present invention.

[0033] In the figure: 1. 8K ultra-large depth-of-field double prism lens; 2. Wireless surgical field host; 3. Display screen; 4. Front objective end; 5. Middle fuselage; 6. Connecting joint; 7. Rear focusing and magnifying component; 8. Boom connecting piece; 7-1. Focusing ring; 7-2. Aperture ring; 7-3. Snap structure; 8-1. Fixed cavity for mobile charging and discharging device; 8-2. Boom connection port. Detailed Embodiments

[0034] The technical solutions of this patent will be further described in detail below in combination with the specific embodiments.

[0035] The embodiments of this patent are described in detail below. The examples of the embodiments are shown in the drawings, where the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions from beginning to end. The embodiments described below by referring to the drawings are exemplary and are only used to explain this patent and should not be construed as a limitation of this patent.

[0036] Reference Figures 1-5 Figures 1-5 , the wireless operative field camera illumination system based on an 8K ultra-large depth-of-field double prism, includes an 8K ultra-large depth-of-field double prism lens 1, a wireless operative field host 2, and a display screen 3; the 8K ultra-large depth-of-field double prism lens 1 is an optical lens with a total length of 500 mm, and the diameter of the lens body is 28 mm. The lens bayonet end is connected to the wireless operative field host 2, and the body of the wireless operative field host 2 is mounted on the boom of the operating room trolley through a mechanical structure; while the lens can approach the surgical site infinitely, it can avoid the interference with the operation of the medical staff's hands to the greatest extent. A fill light is equipped inside the front objective end of the lens, which is powered by the operative field host or a mobile charging and discharging device, eliminating the hidden danger of unclear video recording images caused by insufficient light intensity.

[0037] The 8K ultra-large depth-of-field double prism lens 1 includes a front objective end 4, a middle body 5, a connecting joint 6, a rear focusing and magnification component 7, and a boom connecting piece 8; inside the front objective end 4, there are an LED lamp bead group, a lens group, and a reflecting prism. At the same time, a reflecting prism is equipped in the inner cavity of the connecting joint. The optical axis direction of the objective lens is parallel to that of the rear focusing and magnification group. Inside the middle body 5 of the front objective end 4, there are a lens group and a power supply cable for the LED lamp bead group. At the front of the connection between the tail of the middle body 5 and the connecting joint 6, there is a TYPE-C power supply port;

[0038] The rear focusing and magnification component 7 includes a focusing ring 7-1, a diaphragm ring 7-2, and a snap structure 7-3. The focusing ring 7-1 is used to adjust the relative distance between the sensor and the lens, the diaphragm ring 7-2 is used to adjust the light input amount, and the snap structure 7-3 is connected to the wireless operative field host 2; the boom connecting piece 8 is fixed to the body of the 8K ultra-large depth-of-field double prism lens 1. There is a mobile charging and discharging device fixing cavity 8-1 in the middle of the boom connecting piece 8, and a boom connection port 8-2 is provided at the end of the boom connecting piece 8;

[0039] The wireless operative field host 2 includes a photoelectric conversion image acquisition module, a digital image processing module, a display control module, an image output module, a storage module, a communication module, and a power supply module;

[0040] Inside the photoelectric conversion image acquisition module, there is a PCB board embedded with a CMOS image sensor. The CMOS image sensor and the peripheral circuit complete the conversion of optical signals into electrical signals.

[0041] The digital image processing module performs real-time image processing on the video stream collected by the front-end image sensor. By obtaining the white light image under white light conditions, it uses the white light imaging image enhancement algorithm to enhance the visualization of the image. The image processing module mainly consists of a main control board and multiple small boards. The main control board, in cooperation with the embedded program, mainly completes functions such as image signal processing, data conversion, RF wireless transmission, power management, button response, and screen display. Each small board mainly serves as a carrier for each data interface. The Type-C power interface, data interface, and SD card storage interface are all embedded on each small board. The small boards and the main control board interact through flexible flat cables. Among them, the high-speed image transmission module realizes the high-speed transmission of images, reducing the delay in the image processing process to only the delay of one frame time, avoiding the display output delay caused by software processing. Two hardware processing chips are used at the image output end of the entire system to complete this function.

[0042] The white light imaging image enhancement algorithm is a complete set of dedicated image calibration and enhancement algorithms for real-time video processing. It uses an adaptive noise reduction model to filter out random noise in the image while maintaining image detail information. It optimizes the retinex algorithm and combines techniques such as the R, G, B sub-channel differences at the image edge and adaptive histogram equalization to correct the uneven illumination of the denoised video image and highlight image details. It uses a grid correction algorithm to eliminate the lens shadow caused by the mismatch between the lens and the main light angle of the sensor. It uses the multiple exposure wide dynamic range technology to increase the image dynamic range. It studies the content-based exposure control method to reasonably select the number of exposures and the exposure time for each exposure. It studies the fast ghost detection and removal algorithm and the multi-exposure image fusion method to overcome the deficiency of the large computational amount of the existing wide dynamic range image fusion algorithm and make it suitable for the real-time requirements of wireless operative field video processing. It uses a special spectral enhancement algorithm based on spectral transformation, combines a high-pass filtering method based on increasing the spatial domain, introduces the Sobel operator and the Laplacian operator, and fuses the Gaussian smoothing filter and the Laplacian sharpening filter to realize the blood vessel and lesion contour enhancement algorithm. It studies the dynamic evaluation method of image quality and, based on this, realizes the adaptive adjustment of algorithm parameters to ensure high-quality video images under different lighting conditions.

[0043] The display control module consists of a small OLED display screen and a button panel with 7 buttons. The display content of the OLED display screen mainly includes the current RF wireless transmission mode, light source status, power status, image status, and the function of the recording status indicator light. The button panel mainly completes the on / off function of the camera and the adjustment or switching of various camera functions, including the adjustment of the image zoom magnification, the start / stop operation of recording, and the white balance operation.

[0044] The video signal processed by the image processing module is output to the display screen through the image output module, which supports HDMI 2.0 and has a maximum output of 4K@60fps; the image storage module mainly includes DDR and Flash. In the present invention, the DDR will adopt a dual-channel mode, each channel supports 32-bit interconnection, the total storage space is 4GB, and the highest working frequency supported is 2666Mbps; the eMMC supports the eMMC 5.1 interface and has a capacity of 1GB.

[0045] The communication module includes an RF transmitting unit and an RF receiving unit; the RF transmitting unit consists of a transmitting modulator, a transmitting phase detector, a transmitting voltage-controlled oscillator, a power amplifier, a power controller, and a transmitting mutual inductor inside the intermediate frequency; during transmission, the transmitted baseband information processed by the logic circuit is modulated into a transmitted intermediate frequency, and the transmitting voltage-controlled oscillator is used to frequency up-convert this transmitted intermediate frequency signal. After being amplified by the power amplifier, it is converted into an electromagnetic wave by the antenna and radiated out. The RF receiving unit consists of circuits such as an antenna, a filter, a high-power tube, and a receiving demodulator. During reception, the antenna converts the electromagnetic wave sent by the base station into a weak alternating current signal, which is filtered and amplified at high frequency, and then sent into the intermediate frequency for demodulation to obtain the received baseband information, which is sent to the logic audio circuit for further processing.

[0046] The power module uses an embedded rechargeable battery, which is a finished lithium battery, to supply power to each module. The battery is charged through the Type-C interface reserved for the camera.

[0047] In the wireless surgical field imaging in the wireless RF mode, the host uses an 8K ultra-large depth-of-field double prism lens 1 and a CMOS image sensor chip to obtain an image signal. After the image signal is processed, the image signal is wirelessly transmitted to the built-in wireless receiving module using the wireless RF transmission protocol. The wireless receiving module processes the received signal and directly presents it on the display screen 3.

[0048] The display screen 3 has a built-in wireless receiving module for receiving the image transmission signal transmitted wirelessly by the surgical field imaging host through RF, processing the received signal, and directly presenting the processed signal on the display screen 3. The display screen 3 uses an ultra-large depth-of-field imaging algorithm to process the image. By introducing a special phase mask in the optical system, light rays in different depth-of-field ranges generate specific blurred images on the detector, and then the clear image is restored through digital image processing algorithms. After that, multiple images are taken at different focus positions, and then these images are synthesized in the digital domain to obtain a clear image within the entire scene range. The measurement method uses the peak signal-to-noise ratio, which is defined through the mean square error.

[0049] The calculation formula for the variance is:

[0050]

[0051] Among them, x, y, I, and K represent two x×y monochromatic images I and K. If the two noises are similar, the peak signal-to-noise ratio is defined as:

[0052]

[0053] Among them, MAX1 represents the maximum color value of the image points. Through this formula, the signal-to-noise ratio value at the color peak can be calculated, with the unit of dB. The larger the value, the less distortion.

[0054] The display screen 3 uses a Gaussian low-pass filter for denoising to remove high-frequency noise in the image while retaining low-frequency information, including edges and contours. For each pixel point, taking it as the center, the weighted average of all pixel gray values within its 3×3 area is used as the gray value of the center point. When calculating each pixel point, the current center point is regarded as the coordinate origin, so that the mean μ = 0.

[0055] The Gaussian low-pass filter includes one-dimensional Gaussian distribution and two-dimensional Gaussian distribution. The one-dimensional Gaussian distribution formula is:

[0056]

[0057] The two-dimensional Gaussian distribution formula is:

[0058]

[0059] As described above, it is only the preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention, according to the technical solution and inventive concept of the present invention, makes equivalent substitutions or changes, and should be covered by the protection scope of the present invention.

Claims

1. A wireless surgical field camera illumination system based on an 8K ultra-large depth of field double prism, characterized in that, It includes an 8K ultra-large depth-of-field double prism lens (1), a wireless surgical field host (2), and a display screen (3). The 8K ultra-large depth-of-field double prism lens (1) includes a front objective lens end (4), a middle body (5), a connecting joint (6), a rear focusing and magnifying component (7), and a boom connecting piece (8); inside the front objective lens end (4), there are LED lamp bead groups, lens groups, and reflecting prisms. At the same time, there is a reflecting prism in the inner cavity of the connecting joint. The optical axis direction of the objective lens is parallel to that of the rear focusing and magnifying group. Inside the middle body (5) of the front objective lens end (4), there are power supply cables for the lens groups and LED lamp bead groups. At the front of the connection between the tail of the middle body (5) and the connecting joint (6), there is a TYPE-C power supply port. The rear focusing and magnifying component (7) includes a focusing ring (7-1), an aperture ring (7-2), and a buckle structure (7-3). The focusing ring (7-1) is used to adjust the relative distance between the sensor and the lens. The aperture ring (7-2) is used to adjust the light input. The buckle structure (7-3) is connected to the wireless surgical field host (2); the boom connecting piece (8) is fixed to the body of the 8K ultra-large depth-of-field double prism lens (1). There is a mobile charging and discharging device fixing cavity (8-1) in the middle of the boom connecting piece (8), and a boom connection port (8-2) is provided at the end of the boom connecting piece (8). The wireless surgical field host (2) includes a photoelectric conversion image acquisition module, a digital image processing module, a display control module, an image output module, a storage module, a communication module, and a power supply module. The display screen (3) is built-in with a wireless receiving module, which is used to receive the video transmission signal transmitted by the surgical field camera host through wireless RF, process the received signal, and directly present the processed signal on the display screen (3). The display screen (3) uses an ultra-large depth-of-field imaging algorithm to process the image. By introducing a special phase mask in the optical system, the light in different depth-of-field ranges generates specific blurred images on the detector, and then the clear image is restored through digital image processing algorithms. After that, multiple images are taken at different focusing positions, and then these images are synthesized in the digital domain to obtain a clear image within the entire scene range. The measurement method uses the peak signal-to-noise ratio, which is defined by the mean square error.

2. The wireless surgical field camera illumination system based on an 8K ultra-large depth of field double prism according to claim 1, wherein The 8K ultra-large depth-of-field double prism lens (1) is an optical lens. The total length of the lens is 500 mm, and the diameter of the lens body is 28 mm. The lens bayonet end is connected to the wireless surgical field host (2), and the body of the wireless surgical field host (2) is mounted on the boom of the operating room trolley through a mechanical structure.

3. The wireless operative field video imaging and illumination system based on an 8K ultra-large depth-of-field double prism according to claim 1, wherein The photoelectric conversion image acquisition module internally contains a PCB board embedded with a CMOS image sensor, and the CMOS image sensor and its peripheral circuits complete the conversion of optical signals to electrical signals.

4. The wireless surgical field camera illumination system based on an 8K ultra-large depth of field double prism according to claim 3, characterized in that, The digital image processing module performs real-time image processing on the video stream collected by the front-end image sensor, and enhances the visualization of the image by using a white light imaging image enhancement algorithm through the obtained white light image under white light conditions.

5. The wireless operative field camera illumination system based on an 8K ultra-large depth of field double prism according to claim 4, characterized in that, The white light imaging image enhancement algorithm is a complete set of dedicated image calibration and enhancement algorithms for real-time video processing. An adaptive noise reduction model is adopted to filter out random noise in the image while maintaining image detail information.

6. The wireless surgical field imaging and illumination system based on the 8K ultra-large depth of field double prism according to claim 5, characterized in that, The display control module consists of a small OLED display screen and a button panel with 7 buttons. The display content of the OLED display screen mainly includes the current RF wireless transmission mode, light source status, power status, image status, and video recording status indicator light functions. The button panel mainly completes the on / off function of the camera and the adjustment or switching of various camera functions, including the adjustment of the image zoom magnification, the start / end operation of video recording, and the white balance operation.

7. The wireless operative field video camera illumination system of the 8K-based large depth of field double prism according to claim 6, wherein The communication module includes an RF transmitting unit and an RF receiving unit. The RF transmitting unit consists of a transmitting modulator, a transmitting phase discriminator, a transmitting voltage-controlled oscillator, a power amplifier, a power controller, and a transmitting mutual inductor inside the intermediate frequency.

8. The wireless operative field camera illumination system based on the 8K ultra-large depth of field double prism according to claim 1, characterized in that, The calculation formula for the variance is as follows: where x, y, and I, K represent two x×y monochromatic images I and K. If the two noises are similar, the peak signal-to-noise ratio is defined as: where MAX1 represents the maximum color value of the image points. Through this formula, the signal-to-noise ratio value at the color peak can be calculated, with the unit of dB. The larger the value, the less distortion.

9. The wireless surgical field camera illumination system based on the 8K ultra-large depth of field double prism according to claim 1, characterized in that, The display screen (3) uses a Gaussian low-pass filter for denoising to remove high-frequency noise in the image while retaining low-frequency information, including edges and contours. For each pixel point, taking it as the center, the weighted average of all pixel gray values within its 3×3 area is used as the gray value of the center point. When calculating each pixel point, the current center point is regarded as the coordinate origin, so that the mean value μ = 0.

10. The wireless operative field camera illumination system based on an 8K ultra-large depth of field double prism according to claim 9, wherein The Gaussian low-pass filter includes a one-dimensional Gaussian distribution and a two-dimensional Gaussian distribution. The one-dimensional Gaussian distribution formula is: The two-dimensional Gaussian distribution formula is:

Images