Image display enhancement method and device, endoscope, storage medium and program product
By processing and enhancing the endoscopic image data, and determining the enhancement strategy using the bit difference value and lookup table, the problem of loss of details and unnatural transitions caused by excessive output bit width in the endoscopic image processing is solved, and clearer and more accurate image display is achieved.
Patent Information
- Application Number
- CN202411977646.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-30
- Publication Date
- 2025-06-03
AI Technical Summary
During the endoscopic image processing, the output bit width is too large due to the enhancement algorithm, resulting in the loss of display details and unnatural transitions.
By acquiring the first bit depth information of the endoscopic display device and the original image of the successive multiple frames of the original image, data processing is performed to obtain multiple image optimization frames, these frames are parsed to obtain the second bit depth information, and a data enhancement strategy is determined based on the bit difference value and lookup table, and data enhancement is performed on multiple image optimization frames.
It effectively solves the problem of picture details loss caused by hardware error of endoscopic display, improves the accuracy and clarity of image display, makes the image display more realistic and clear, and improves user experience and diagnostic accuracy.
Smart Images

Figure CN120088141A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of endoscopes, and particularly to an image display enhancement method, device, endoscope, storage medium and program product. Background Art
[0002] Since the environment where the endoscope camera is located during video acquisition is complex and is affected by electronic noise and other interferences, the acquired images may have degradation problems such as insufficient saturation. To improve the image effect, the endoscope image processing system usually needs to apply a series of enhancement algorithms to enhance the color, brightness and saturation of the images. However, the output bit width of the images processed by these enhancement algorithms usually exceeds the display capacity of the monitor. Currently, the truncation method is usually used to adapt to the monitor, which will cause the loss of picture details and the transition of some pictures to appear unnatural. Summary of the Invention
[0003] In view of this, the present invention provides an image display enhancement method, device, endoscope, storage medium and program product to solve the problems of loss of display details and unnatural transition caused by the excessive output bit width due to the enhancement algorithm in the endoscope image processing process.
[0004] In a first aspect, the present invention provides an image display enhancement method, including: obtaining the first bit depth information of the endoscope display device and a plurality of consecutive original images collected by the endoscope; wherein, the plurality of consecutive original images are multiple image frames collected by the endoscope within a preset time; performing data processing on the plurality of consecutive original images to obtain a plurality of image optimized frames; parsing the image optimized frames to obtain the second bit depth information of the image optimized frames; extracting the first image optimized frame from the plurality of image optimized frames and obtaining the pixel values of each pixel in the first image optimized frame; wherein, the first image optimized frame is the first image optimized frame among the plurality of image optimized frames, and the pixel values are represented by the number of bits of the second bit depth; performing data enhancement on the plurality of image optimized frames within the preset time according to the bit difference corresponding to the first bit depth information and the second bit depth information and the pixel values of each pixel in the first image optimized frame.
[0005] The image display enhancement method provided by the embodiments of the present invention obtains the first bit depth information of the endoscope display device and a continuous multi-frame of original images, processes the continuous multi-frame of original images to obtain multiple image optimization frames. Analyze the image optimization frames to obtain the second bit depth information of the image optimization frames. Extract the first image optimization frame from the multiple image optimization frames, and obtain the pixel values of each pixel in the first image optimization frame. According to the bit difference corresponding to the first bit depth information and the second bit depth information and the pixel values of each pixel in the first image optimization frame, perform data enhancement on the multiple image optimization frames within a preset time, so as to compare the real-time image collected by the front end with the display information stored in the internal module to obtain compensation conditions. According to the obtained compensation conditions, perform frame processing on the data in real time to further enhance the effect of the image algorithm, thereby solving the problem of loss of picture details caused by hardware errors of the endoscope display, and improving the accuracy and clarity of image display. The compensation conditions obtained by comparing the real-time image with the display information can be used to process the image data in real time on the software side, thereby making up for the problems caused by hardware errors and enhancing the picture details. By performing frame processing on the data in real time, the effect of the image algorithm can be further enhanced, making the image display more real and clear, and improving the user experience and diagnostic accuracy.
[0006] In an alternative embodiment, processing the continuous multi-frame of original images to obtain multiple image optimization frames includes: performing image signal processing and denoising processing on the continuous multi-frame of original images to obtain multiple image optimization frames.
[0007] The image display enhancement method provided by the embodiments of the present invention processes a continuous multi-frame of original images by applying various image processing algorithms and techniques to improve the quality, contrast, color, etc. of the images, making the images clearer and easier to analyze. At the same time, during the image processing process, by removing the noise and interference in the images, the clarity and accuracy of the images are improved. Therefore, by performing signal processing and denoising processing on the original images, the quality of the images can be significantly improved, the details can be made clearer, and the visibility and recognition ability of the images can be improved. Removing noise and interference can reduce misunderstandings in the images, making the images more real and accurate, and contributing to the accuracy and reliability in fields such as medical image diagnosis. The obtained image optimization frames can provide a better basis for subsequent image analysis and processing, helping doctors or professionals analyze the images more accurately and make judgments.
[0008] In an alternative embodiment, data enhancement is performed on multiple image optimization frames within a preset time according to the bit difference corresponding to the first bit depth information and the second bit depth information and the pixel values of each pixel in the first image optimization frame, including: intercepting data values of multiple bits of the pixel value according to the bit difference; wherein, the bit information of the multiple bits is the same as the bit difference; determining a data enhancement strategy corresponding to the data value according to the data value and a preset look-up table; wherein, the look-up table includes the corresponding relationship between each data value and each data enhancement strategy; performing data enhancement on multiple image optimization frames within a preset time according to the data enhancement strategy.
[0009] The image display enhancement method provided by the embodiments of the present invention determines the data values of multiple bits that need to be intercepted from the pixel value according to the bit difference corresponding to the first bit depth information and the second bit depth information, and determines the data enhancement strategy corresponding to the data value according to the intercepted data value and a preset look-up table. The look-up table includes the corresponding relationship between different data values and data enhancement strategies. Data enhancement processing is performed on multiple image optimization frames within a preset time according to the determined data enhancement strategy to improve the image quality and the accuracy of information. Therefore, by determining the data enhancement strategy according to the bit depth information and the look-up table, personalized enhancement processing for different data values can be realized, and the flexibility and effect of data enhancement can be improved. By intercepting the data values of multiple bits according to the bit difference and determining the enhancement strategy according to the look-up table, accurate processing and fine adjustment of the data value can be realized, and the image quality and the accuracy of information can be improved. After setting the look-up table, the corresponding data enhancement strategy can be automatically determined according to the parsed data value, realizing automated data enhancement processing of multiple image optimization frames and improving the processing efficiency. The set look-up table includes the corresponding relationship between different data values and data enhancement strategies, which has certain flexibility and scalability. New data enhancement strategies can be added at any time according to requirements to adapt to the processing requirements of different scenarios.
[0010] In an alternative embodiment, intercepting the data values of multiple bits of the pixel value includes: intercepting the low-order data value in the pixel value; wherein, the bit information of the low-order data value is the same as the bit information of the multiple bits.
[0011] The image display enhancement method provided by the embodiments of the present invention intercepts the low-order data part in the pixel value, determines the corresponding data enhancement strategy in the look-up table, and performs data enhancement processing on multiple image optimization frames within a preset time according to the determined data enhancement strategy to improve the image quality and the accuracy of information. Therefore, intercepting the low-order data value of the pixel value can retain the information of smaller changes in the original data, which helps to maintain the details and quality of the image. By extracting the low-order data value, the image can be processed in a refined manner to highlight some subtle features or changes and enhance the expressiveness and clarity of the image.
[0012] In an alternative embodiment, according to the data enhancement strategy, data enhancement is performed on multiple image optimization frames within a preset time, including: determining the number of pre-enhanced images to be data-enhanced among the multiple image optimization frames according to the data enhancement strategy; determining the enhancement coefficient corresponding to the multiple image optimization frames according to the data value; and performing data enhancement on the pre-enhanced image frames that need to be data-enhanced among the multiple image optimization frames according to the enhancement coefficient, the number of pre-enhanced images, and the pixel value.
[0013] The image display enhancement method provided by the embodiments of the present invention determines the number of pre-enhanced image frames to be data-enhanced in each image optimization frame according to the data enhancement strategy. This helps to determine the number of images that need to be enhanced, preparing for subsequent processing. By analyzing the data value, the enhancement coefficient corresponding to the multiple image optimization frames is determined. The enhancement coefficient can determine the degree or manner of enhancement processing on the image to achieve the expected effect. According to the enhancement coefficient and the number of pre-enhanced images, combined with the pixel value, specific enhancement processing is performed on the pre-enhanced image frames that need to be data-enhanced among the multiple image optimization frames. Thus, by determining the number of pre-enhanced images and the enhancement coefficient, refined control of the image enhancement processing can be achieved, making the processing result more in line with expectations. According to the set data enhancement strategy, automated processing of multiple image frames can be realized, improving the processing efficiency and reducing the labor cost. By adopting a unified data enhancement strategy and parameters, the consistency of the enhancement processing of multiple image frames can be ensured, improving the overall quality and consistency of the image sequence.
[0014] In an alternative embodiment, performing data enhancement on the pre-enhanced image frames that need to be data-enhanced among the multiple image optimization frames according to the enhancement coefficient, the number of pre-enhanced images, and the pixel value includes: multiplying the pixel value by the enhancement coefficient to obtain an enhanced value; adding the enhanced value to the pixel value of the pre-enhanced image frame to obtain an image enhancement frame after data enhancement of the pre-enhanced image frame; where the number of enhancements of the image enhancement frame is the same as the number of pre-enhanced images; and controlling the pixel values of the remaining frames among the multiple image optimization frames to remain unchanged.
[0015] The image display enhancement method provided by the embodiments of the present invention multiplies the pixel values of the pre-enhanced image frame by the corresponding enhancement coefficients to obtain enhanced values. This step is to adjust the pixel values according to the set enhancement coefficients to achieve the image enhancement effect. The obtained enhanced values are added to the pixel values of the pre-enhanced image frame to obtain an image enhancement frame after data enhancement of the pre-enhanced image frame. When processing multiple image optimization frames, except for the pre-enhanced image frame for data enhancement, the pixel values of the remaining frames remain unchanged to maintain the stability and consistency of the image sequence. Therefore, through the calculation of pixel values and enhancement coefficients, precise control of image enhancement processing can be achieved, making the enhancement effect more accurate and meeting the requirements. Controlling the pixel values of the remaining frames to remain unchanged can ensure that the image sequence still maintains continuity and smoothness after enhancement processing, improving the overall visual experience.
[0016] In an alternative embodiment, the pixel values include a first pixel value, a second pixel value, and a third pixel value; obtaining the pixel values of each pixel in the first image optimization frame includes: parsing the first pixel value corresponding to the red channel of each pixel in the first image optimization frame, the second pixel value corresponding to the green channel, and the third pixel value corresponding to the blue channel; wherein, the first pixel value, the second pixel value, and the third pixel value are all represented by the number of bits of the second bit depth.
[0017] The image display enhancement method provided by the embodiments of the present invention, in the first image optimization frame, parses the first pixel value corresponding to the red channel of each pixel, the second pixel value corresponding to the green channel, and the third pixel value corresponding to the blue channel. According to the difference in the number of bits corresponding to the first bit depth information and the second bit depth information, respectively determine the data values of multiple bits that need to be intercepted from the first pixel value, the second pixel value, and the third pixel value. According to the intercepted data values and a pre-set look-up table, determine the data enhancement strategy corresponding to the data values. The look-up table includes the corresponding relationships between different data values and data enhancement strategies. According to the determined data enhancement strategy, perform data enhancement processing on multiple image optimization frames within a preset time to improve the image quality and information accuracy. Therefore, by performing data enhancement on multiple image optimization frames, the clarity, contrast, and detail display of the image can be improved, making the image more visible and expressive. According to the data enhancement strategies corresponding to different pixel values, targeted image processing can be achieved, meeting the requirements of different images, and making the processing effect more personalized and precise. Through the pre-set look-up table and data enhancement strategy, automated processing of multiple image frames can be achieved, improving the processing efficiency, reducing manual intervention, and being applicable to the processing requirements of a large amount of image data.
[0018] Second aspect, the present invention provides an image display enhancement device, comprising: an acquisition module, configured to acquire the first bit depth information of an endoscope display device and a plurality of consecutive original images acquired by the endoscope; wherein, the plurality of consecutive original images are multiple image frames acquired by the endoscope within a preset time; a processing module, configured to perform data processing on the plurality of consecutive original images to obtain a plurality of image optimized frames; an analysis module, configured to analyze the image optimized frames to obtain the second bit depth information of the image optimized frames; an extraction module, configured to extract a first image optimized frame from the plurality of image optimized frames and obtain the pixel values of each pixel in the first image optimized frame; wherein, the first image optimized frame is the first image optimized frame among the plurality of image optimized frames, and the pixel values are represented by the number of bits of the second bit depth; an enhancement module, configured to perform data enhancement on the plurality of image optimized frames within a preset time according to the difference in the number of bits corresponding to the first bit depth information and the second bit depth information and the pixel values of each pixel in the first image optimized frame.
[0019] Third aspect, the present invention provides an endoscope, comprising: a memory and a processor, which are communicatively connected to each other, wherein the memory stores computer instructions, and the processor executes the computer instructions to execute the image display enhancement method according to the first aspect or any corresponding embodiment thereof.
[0020] Fourth aspect, the present invention provides a computer-readable storage medium, on which computer instructions are stored, and the computer instructions are used to cause a computer to execute the image display enhancement method according to the first aspect or any corresponding embodiment thereof.
[0021] Fifth aspect, the present invention provides a computer program product, comprising computer instructions, and the computer instructions are used to cause a computer to execute the image display enhancement method according to the first aspect or any corresponding embodiment thereof. Description of the Drawings
[0022] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for the description of the specific embodiments or the prior art. Obviously, the following drawings are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0023] Figure 1 is a schematic flowchart of an image display enhancement method according to an embodiment of the present invention;
[0024] Figure 2 is a schematic flowchart of another image display enhancement method according to an embodiment of the present invention;
[0025] Figure 3It is a schematic flowchart of another image display enhancement method according to an embodiment of the present invention;
[0026] Figure 4 It is a structural block diagram of an image display enhancement device according to an embodiment of the present invention;
[0027] Figure 5 It is a schematic diagram of the hardware structure of an endoscope according to an embodiment of the present invention. Detailed implementation manners
[0028] To make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some but not all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.
[0029] With the continuous progress and development of technology, high-definition electronic medical endoscopes have become one of the essential medical devices in modern medical diagnosis and treatment. High-definition electronic medical endoscopes can provide clear and high-resolution images and videos during endoscopic examinations, helping doctors observe and diagnose internal lesions in the human body more accurately.
[0030] In an electronic endoscope image processing system, due to the influence of factors such as a complex abdominal cavity environment and electronic noise, the acquired images have problems such as insufficient saturation. To improve the image effect, enhancement algorithms need to be introduced to process the images, including enhancing color, brightness, and saturation characteristics. However, since the bit depth of the output result is relatively large during the processing, while the display bit width of the monitor is relatively small, directly using the truncation method will cause serious loss of picture details and unnatural transitions in some parts of the picture.
[0031] In view of this, the technical solution of the present invention identifies and compensates for problems caused by monitor hardware errors through the processing on the software side of the endoscope, by comparing the real-time images collected by the front end of the endoscope with the monitor information stored internally. By performing real-time frame processing on the data and adjusting the image processing algorithm according to the obtained compensation conditions, the quality of the image can be effectively improved, details can be enhanced, and finally the display effect of the endoscope image can be improved, thereby helping doctors observe the detailed information in the endoscope image more accurately and improving the accuracy and efficiency of diagnosis.
[0032] According to an embodiment of the present invention, an embodiment of an image display enhancement method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. And although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.
[0033] In this embodiment, an image display enhancement method is provided, which can be used for an endoscope. Figure 1 It is a flowchart of the image display enhancement method according to an embodiment of the present invention, as Figure 1 shown, the process includes the following steps:
[0034] Step S101, obtain the first bit depth information of the endoscope display device, and a plurality of consecutive original images collected by the endoscope; wherein, the plurality of consecutive original images are a plurality of image frames collected by the endoscope within a preset time.
[0035] The first bit depth information refers to the bit depth when the endoscope display device is used to display images, that is, the number of bits of color information that the endoscope display device can represent. For example, the first bit depth information of the endoscope display device can be 8 bits, 10 bits, 12 bits or a higher bit depth. Specifically, after the endoscope system is initially powered on, the system will read the display device configuration information stored in the internal storage module to obtain the bit depth information of the display device. The image configuration module reads the endoscope memory to configure the front-end sensor to work. The memory stores the configuration register tables of various types of mirror body sensors. When the configuration work is completed, the system starts to collect images.
[0036] The plurality of consecutive original images are images that have not been processed or enhanced, and can be directly obtained by the endoscope acquisition device, and can provide continuous perspective and time series information. Specifically, select a preset acquisition mode on the endoscope acquisition device, set relevant parameters (such as resolution, frame rate, etc.), start the endoscope device to continuously collect images, form an image sequence, and save the original images to a computer or storage device.
[0037] Step S102, perform data processing on the plurality of consecutive original images to obtain a plurality of image optimization frames.
[0038] An image optimization frame refers to an image frame obtained after a series of data processing and enhancement techniques, aiming to improve image quality, clarity, or specific visual effects. Specifically, multiple consecutive frames of images are aligned to eliminate image offsets caused by camera movement or scene changes. The aligned images are then subjected to a fusion process, which can specifically use methods such as averaging, maximization, or other image fusion algorithms to integrate the information of multiple frames together to obtain a clearer and more informative image. Optimization operations are performed on the fused image, such as noise reduction, contrast enhancement, sharpening, color correction, artifact removal, enhancement of specific regions, etc., to obtain multiple image optimization frames.
[0039] Step S103: Analyze the image optimization frame to obtain the second bit depth information of the image optimization frame.
[0040] The second bit depth information refers to the number of bits occupied by the color value of each pixel point in the image optimization frame, which is used to describe the number of bits required for the color information of each pixel in the image optimization frame, and is also called color depth or bit depth. Specifically, after the endoscopic front-end sensor completes the acquisition of multiple consecutive frames of raw images, it enters the image processing module through the MIPI signal transmission line. After the image processing module performs data processing, multiple image optimization frames are obtained. Read the data bit depth of the image optimization frame to ensure that the color value of each pixel point in the image optimization frame is correctly obtained.
[0041] Step S104: Extract the first image optimization frame from multiple image optimization frames and obtain the pixel values of each pixel in the first image optimization frame; among them, the first image optimization frame is the first image optimization frame among multiple image optimization frames, and the pixel values are represented by the number of bits of the second bit depth.
[0042] Reading the data of multiple image optimization frames can be completed through an image processing library (such as OpenCV) or other appropriate tools. Determine and extract the data of the first image optimization frame from multiple image optimization frames. Specifically, the order of multiple image optimization frames can be determined according to the acquisition order of multiple consecutive frames of raw images, that is, the first image optimization frame is the image optimization frame obtained by processing the first raw image collected by the endoscope among multiple consecutive frames of raw images. Analyze the data of the first image optimization frame and process it according to the number of bits of the second bit depth. According to the number of bits of the second bit depth, it is possible to determine the number of bits occupied by each pixel value in the first image optimization frame, and use corresponding algorithms or methods to extract the pixel value of each pixel.
[0043] Step S105: Perform data enhancement on multiple image optimization frames within a preset time according to the difference in the number of bits corresponding to the first bit depth information and the second bit depth information and the pixel values of each pixel in the first image optimization frame.
[0044] Analyze the number of bits represented by the first depth information and the second depth information respectively, calculate the difference in the number of bits between them, and adjust the pixel values of multiple image optimization frames within a preset time according to the difference in the number of bits and the pixel values of each pixel in the first image optimization frame, so as to perform data enhancement.
[0045] The image display enhancement method provided by the embodiments of the present invention obtains the first depth information of the endoscope display device and a continuous plurality of frames of original images, performs data processing on the continuous plurality of frames of original images to obtain a plurality of image optimization frames. Parse the image optimization frames to obtain the second depth information of the image optimization frames. Extract the first image optimization frame from the plurality of image optimization frames, and obtain the pixel values of each pixel in the first image optimization frame. According to the difference in the number of bits corresponding to the first depth information and the second depth information and the pixel values of each pixel in the first image optimization frame, perform data enhancement on the plurality of image optimization frames within a preset time, so as to compare the real-time images collected at the front end with the display information stored in the internal module to obtain compensation conditions, and according to the obtained compensation conditions, perform frame processing on the data in real time, further enhancing the effect of the image algorithm, thereby solving the problem of loss of picture details caused by hardware errors of the endoscope display, and improving the accuracy and clarity of image display. By using the compensation conditions obtained by comparing the real-time image and the display information, the image data can be processed in real time on the software side, thereby making up for the problems caused by hardware errors and enhancing the picture details. By performing frame processing on the data in real time, the effect of the image algorithm can be further enhanced, making the image display more real and clear, and improving the user experience and diagnostic accuracy.
[0046] In this embodiment, an image display enhancement method is provided, which can be used for an endoscope. Figure 2 is a flowchart of the image display enhancement method according to the embodiments of the present invention, as Figure 2 shown, the process includes the following steps:
[0047] Step S201, obtain the first depth information of the endoscope display device, and a continuous plurality of frames of original images collected by the endoscope; wherein, the continuous plurality of frames of original images are a plurality of image frames collected by the endoscope within a preset time. For details, please refer to Figure 1 the steps of the embodiment shown in
[0048] Step S202, perform data processing on the continuous plurality of frames of original images to obtain a plurality of image optimization frames.
[0049] Specifically, the above step S202 includes: performing image signal processing and denoising processing on the continuous plurality of frames of original images to obtain a plurality of image optimization frames.
[0050] The front - end sensor of the endoscope is responsible for collecting the original image data and transmitting it to the image - processing module. A MIPI (Mobile Industry Processor Interface) signal transmission line is used to transmit multiple consecutive frames of original images from the sensor to the image - processing module. The image - processing module performs a complete image ISP (Image Signal Processing) process, including a series of image - processing algorithms such as color correction, white - balance, denoising, sharpening, and exposure control, to improve the image quality and accuracy. On the basis of the ISP process, various image - enhancement algorithms can be applied, such as contrast enhancement, color enhancement, edge enhancement, and detail enhancement, to improve the visual effect and detail performance of the image. After the processing is completed, the image - processing module outputs the final image that has been processed and enhanced by ISP. The image - control module controls the final image to enter the interface - processing module. The image - interface module uses an internal mean - filtering module to perform real - time denoising on the final image to obtain an image - optimized frame, making the parameters of the noise and other pixels in its neighborhood very close to suppress the difference between the noise and other pixel points in its neighborhood.
[0051] The image - display enhancement method provided by the embodiments of the present invention processes multiple consecutive frames of original images by applying various image - processing algorithms and technologies to improve aspects such as the quality, contrast, and color of the images, making the images clearer and easier to analyze. At the same time, during the image - processing process, by removing the noise and interference in the images, the clarity and accuracy of the images are improved. Thus, through signal processing and denoising of the original images, the quality of the images can be significantly improved, the details can be made clearer, and the visibility and recognition ability of the images can be enhanced. Removing noise and interference can reduce misunderstandings in the images, making the images more real and accurate, which is helpful for the accuracy and reliability in fields such as medical - image diagnosis. The obtained image - optimized frame can provide a better basis for subsequent image analysis and processing, helping doctors or professionals analyze the images more accurately and make judgments.
[0052] Step S203: Analyze the image - optimized frame to obtain the second - bit - depth information of the image - optimized frame. For details, please refer to Figure 1 Step S103 of the embodiment shown, which will not be elaborated here.
[0053] Step S204: Extract the first image - optimized frame from multiple image - optimized frames and obtain the pixel values of each pixel in the first image - optimized frame; wherein, the first image - optimized frame is the first image - optimized frame among multiple image - optimized frames, and the pixel values are represented by the number of bits of the second - bit - depth. For details, please refer to Figure 1 Step S104 of the embodiment shown, which will not be elaborated here.
[0054] Step S205: Perform data augmentation on multiple image optimization frames within a preset time according to the bit difference corresponding to the first depth information and the second depth information, and the pixel values of each pixel in the first image optimization frame.
[0055] Specifically, the above step S205 includes:
[0056] Step S2051: Intercept the data values of multiple bits of the pixel value according to the bit difference; among them, the bit information of the multiple bits is the same as the bit difference.
[0057] To intercept the data values of multiple bits according to the bit difference, specifically, bitwise operations can be used, such as left shift or AND operation, to intercept the pixel values of the specified number of bits.
[0058] In some alternative embodiments, the above step S2051 includes: intercepting the low-order data value in the pixel value; among them, the bit information of the low-order data value is the same as the bit information of the multiple bits.
[0059] Intercept the low-order data value from the pixel value. For example, assume the pixel value is A, and the bit range to be intercepted is from 3 to 0, that is, the data value between the 3rd bit and the 0th bit. First, a mask needs to be created, which sets all bits to 1 within the specified bit range and other bits to 0. Create a mask mask that is all 1s, and shift it left by 4 bits (because the range to be intercepted is 3 to 0) through a left shift operation, that is, the final mask is mask = 0b00001111. Perform a bitwise AND operation on the pixel value A and the mask, that is, A & mask, so that the data value between the 3rd bit and the 0th bit can be obtained.
[0060] Step S2052: Determine the data augmentation strategy corresponding to the data value according to the data value and a preset look-up table; among them, the look-up table includes the corresponding relationship between each data value and each data augmentation strategy.
[0061] Find the corresponding data augmentation strategy according to the data value in the preset look-up table. Among them, the look-up table can be implemented by using a dictionary or a hash table, which stores the corresponding relationship between each data value and the corresponding data augmentation strategy.
[0062] Step S2053: Perform data augmentation on multiple image optimization frames within a preset time according to the data augmentation strategy.
[0063] Perform data augmentation on multiple image optimization frames within a preset time according to the augmentation parameters included in the data augmentation strategy. Among them, the augmentation parameters can include parameters such as the number of pre-augmented image frames to be pre-augmented and the augmentation coefficient.
[0064] In some alternative embodiments, the above step S2053 includes:
[0065] Step a1: Determine the number of pre - enhancements for the pre - enhancement image frames to be data - enhanced among multiple image optimization frames according to the data enhancement strategy.
[0066] Determine the number of pre - enhancements for the pre - enhancement image frames to be data - enhanced among multiple image optimization frames according to the data enhancement strategy. For example, assume that each pixel value of the image optimization frame is 12 - bit, while the display device is 8 - bit, and the bit range to be intercepted is from 3 to 0 (the lower 4 bits). If the lower 4 bits of the input pixel value are "0000", then enter the lookup table according to address 0 to find the corresponding number of pre - enhancements 0, that is, the interface output control module keeps the output pixel values of multiple image optimization frames unchanged. If the lower 4 bits of the input pixel value are "0001", then enter the lookup table according to address 1 to find the corresponding number of pre - enhancements 1, that is, the interface output control module performs data enhancement on the first image optimization frame of multiple image optimization frames and keeps the output pixel values of the remaining image optimization frames unchanged.
[0067] Step a2: Determine the enhancement coefficient corresponding to multiple image optimization frames according to the data value.
[0068] The enhancement coefficient refers to the parameter or coefficient used to adjust the image enhancement effect. For example, assume that each pixel value of the image optimization frame is 12 - bit, while the display device is 8 - bit, and the bit range to be intercepted is from 3 to 0 (the lower 4 bits). In the binary system, the digital range that 4 bits can represent is from 0000 (0) to 1111 (15), a total of 16 different numbers. Thus, determine the enhancement coefficient corresponding to multiple image optimization frames according to 4 bits as
[0069] Step a3: Perform data enhancement on the pre - enhancement image frames that need to be data - enhanced among multiple image optimization frames according to the enhancement coefficient, the number of pre - enhancements, and the pixel value.
[0070] Perform compensation on the pre - enhancement image frames that need to be data - enhanced among multiple image optimization frames according to the enhancement coefficient, the number of pre - enhancements, and the pixel value to perform data enhancement.
[0071] In one implementation, according to the data augmentation strategy, determine the number of pre-augmentation image frames to be data-augmented in each image optimization frame. This helps to determine the number of images that need to be augmented, preparing for subsequent processing. By analyzing the data values, determine the augmentation coefficients corresponding to multiple image optimization frames. The augmentation coefficients can determine the degree or method of augmentation for the images to achieve the expected effect. According to the augmentation coefficients and the number of pre-augmentations, combined with the pixel values, perform specific augmentation processing on the pre-augmentation image frames that need to be data-augmented among multiple image optimization frames. Thus, by determining the number of pre-augmentations and the augmentation coefficients, refined control of image augmentation processing can be achieved, making the processing results more in line with expectations. According to the set data augmentation strategy, automated processing of multiple image frames can be realized, improving processing efficiency and reducing labor costs. Adopting a unified data augmentation strategy and parameters can ensure the consistency of multiple image frames in the augmentation process, enhancing the overall quality and consistency of the image sequence.
[0072] In some alternative implementations, step a3 above includes:
[0073] Step a31, multiply the pixel value by the augmentation coefficient to obtain the augmented value.
[0074] The result of multiplying the pixel value by the augmentation coefficient is the augmented value, that is, the adjusted pixel value. Through multiplication operations, linear transformation of the pixel value can be achieved, thereby performing augmentation processing on the image.
[0075] Step a32, add the augmented value to the pixel value of the pre-augmentation image frame to obtain an image augmentation frame after data augmentation of the pre-augmentation image frame; wherein, the number of augmentations of the image augmentation frame is the same as the number of pre-augmentations.
[0076] When performing data augmentation on the pre-augmentation image frame, the augmented value will be calculated. Adding this augmented value to the pixel value of the corresponding pre-augmentation image frame can obtain an image augmentation frame after data augmentation of the pre-augmentation image frame. Among them, corresponding data augmentation processing needs to be performed on each pre-augmentation image frame to generate the corresponding image augmentation frame.
[0077] Step a33, control the pixel values of the remaining frames among multiple image optimization frames to remain unchanged.
[0078] Perform specific processing on the pre-augmentation image frame while keeping the pixel values of other frames unchanged.
[0079] For example, the number of image optimization frames within a preset time is 16. The original 12-bit pixel data is 0x256, with the higher 8 bits being 0x25 and the lower 4 bits being 0x06 (1100). When output to an 8-bit display device, the value for the first 12 frames is 0x25 * (1 + 1 / 16) = 0x27, and the value for the remaining 4 frames remains 0x25 unchanged. That is, when a frame of data 0x256 comes in, 16 frames of 0x27, 0x27, 0x27... 0x27, 0x25, 0x25, 0x25, 0x25 are output. If the original value is 0xFF2, then there is a numerical overflow, and all values are 0xFF for limitation.
[0080] The image display enhancement method provided by the embodiments of the present invention determines the data values of multiple bits that need to be intercepted from the pixel values according to the bit difference corresponding to the first bit depth information and the second bit depth information, and determines the data enhancement strategy corresponding to the data value according to the intercepted data value and a preset look-up table. The look-up table includes the corresponding relationships between different data values and data enhancement strategies. According to the determined data enhancement strategy, data enhancement processing is performed on multiple image optimization frames within a preset time to improve the image quality and information accuracy. Therefore, by determining the data enhancement strategy according to the bit depth information and the look-up table, personalized enhancement processing for different data values can be achieved, improving the flexibility and effect of data enhancement. By intercepting the data values of multiple bits according to the bit difference and determining the enhancement strategy according to the look-up table, accurate processing and fine adjustment of the data values can be achieved, improving the image quality and information accuracy. After setting the look-up table, the corresponding data enhancement strategy can be automatically determined according to the parsed data value, realizing automatic data enhancement processing for multiple image optimization frames and improving the processing efficiency. The set look-up table includes the corresponding relationships between different data values and data enhancement strategies, having a certain degree of flexibility and scalability, and new data enhancement strategies can be added at any time according to requirements to adapt to the processing needs of different scenarios.
[0081] In this embodiment, an image display enhancement method is provided, which can be used for an endoscope. Figure 3 It is a flowchart of the image display enhancement method according to the embodiments of the present invention, as Figure 3 shown. This process includes the following steps:
[0082] Step S301, obtain the first bit depth information of the endoscope display device and multiple consecutive original images collected by the endoscope; among them, the multiple consecutive original images are multiple image frames collected by the endoscope within a preset time. For details, please refer to Figure 1 step S101 of the embodiment shown here, which will not be elaborated further.
[0083] Step S302, perform data processing on the multiple consecutive original images to obtain multiple image optimization frames. For details, please refer to Figure 1Step S102 of the illustrated embodiment will not be elaborated herein.
[0084] Step S303: Analyze the image optimization frame to obtain the second bit depth information of the image optimization frame. For details, please refer to Figure 1 Step S103 of the illustrated embodiment will not be elaborated herein.
[0085] Step S304: Extract the first image optimization frame from multiple image optimization frames, and obtain the pixel values of each pixel in the first image optimization frame; wherein, the first image optimization frame is the first image optimization frame among multiple image optimization frames, and the pixel value is represented by the number of bits of the second bit depth.
[0086] Specifically, the above step S304 includes:
[0087] Step S3041: Extract the first image optimization frame from multiple image optimization frames. For details, please refer to Figure 2 Step S204 of the illustrated embodiment will not be elaborated herein.
[0088] Step S3042: Analyze the first pixel value corresponding to the red channel, the second pixel value corresponding to the green channel, and the third pixel value corresponding to the blue channel of each pixel in the first image optimization frame; wherein, the first pixel value, the second pixel value, and the third pixel value are all represented by the number of bits of the second bit depth.
[0089] Obtain the RGB color value of each pixel in the first image optimization frame. For example, when the number of bits of the second bit depth is 12 bits, convert the obtained RGB color value into a 12-bit binary value. When the pixel value of the red channel is R = 135, the 12-bit binary value of the red channel is 00010000111, and when the pixel value of the green channel is G = 200, the 12-bit binary value of the green channel is 001100100000.
[0090] Step S305: Perform data enhancement on multiple image optimization frames within a preset time according to the bit difference corresponding to the first bit depth information and the second bit depth information, and the first pixel value, the second pixel value, and the third pixel value of each pixel in the first image optimization frame.
[0091] Analyze the number of bits represented by the first bit depth information and the second bit depth information respectively, and calculate the difference in the number of bits. According to the difference in the number of bits and the first pixel value, the second pixel value, and the third pixel value of each pixel in the first image optimization frame, adjust the pixel values of multiple image optimization frames within a preset time to perform data enhancement. For example, assume that the pixel values of the image optimization frame are 12 bits, while the display device is 8 bits, and the bit range to be intercepted is from 3 to 0 (the lower 4 bits). For the first pixel value 00010000111, intercept 0111, and then enter the lookup table according to the 7 address to find the corresponding pre-enhancement number 7, that is, the interface output control module performs data enhancement on the red channels of each pixel of the first seven image optimization frames of multiple image optimization frames, and keeps the output pixel values of the red channels of each pixel of the remaining image optimization frames unchanged. For the second pixel value 001100100000, intercept 0000, and then enter the lookup table according to the 0 address to find the corresponding pre-enhancement number 0, that is, the interface output control module keeps the pixel values of the green channels output by multiple image optimization frames unchanged.
[0092] In the image display enhancement method provided by the embodiments of the present invention, in the first image optimization frame, by analyzing the first pixel value corresponding to the red channel of each pixel, the second pixel value corresponding to the green channel, and the third pixel value corresponding to the blue channel. According to the difference in the number of bits corresponding to the first bit depth information and the second bit depth information, respectively determine the data values of multiple bits that need to be intercepted from the first pixel value, the second pixel value, and the third pixel value. According to the intercepted data values and a preset lookup table, determine the data enhancement strategy corresponding to the data values. The lookup table includes the corresponding relationship between different data values and data enhancement strategies. According to the determined data enhancement strategy, perform data enhancement processing on multiple image optimization frames within a preset time to improve the image quality and information accuracy. Therefore, by performing data enhancement on multiple image optimization frames, the clarity, contrast, and detail display of the image can be improved, making the image more visible and expressive. According to the data enhancement strategies corresponding to different pixel values, targeted image processing can be realized, meeting the needs of different images, and making the processing effect more personalized and accurate. Through the preset lookup table and data enhancement strategy, automatic processing of multiple image frames can be realized, improving the processing efficiency, reducing manual intervention, and being applicable to the processing requirements of a large number of image data.
[0093] In this embodiment, an image display enhancement device is also provided. This device is used to implement the above embodiments and preferred implementation manners, and those that have been described will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that can achieve a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and contemplated.
[0094] This embodiment provides an image display enhancement device, as Figure 4 shown, including:
[0095] An acquisition module 401, configured to acquire the first bit depth information of the endoscope display device and a plurality of consecutive original images acquired by the endoscope; wherein, the plurality of consecutive original images are multiple image frames acquired by the endoscope within a preset time;
[0096] A processing module 402, configured to perform data processing on the plurality of consecutive original images to obtain a plurality of image optimization frames;
[0097] An analysis module 403, configured to analyze the image optimization frames to obtain the second bit depth information of the image optimization frames;
[0098] An extraction module 404, configured to extract the first image optimization frame from the plurality of image optimization frames and obtain the pixel values of each pixel in the first image optimization frame; wherein, the first image optimization frame is the first image optimization frame among the plurality of image optimization frames, and the pixel values are represented by the number of bits of the second bit depth;
[0099] An enhancement module 405, configured to perform data enhancement on the plurality of image optimization frames within a preset time according to the bit difference corresponding to the first bit depth information and the second bit depth information and the pixel values of each pixel in the first image optimization frame.
[0100] In some alternative embodiments, the processing module 402 includes:
[0101] A processing sub-module, configured to perform image signal processing and denoising processing on the plurality of consecutive original images to obtain a plurality of image optimization frames.
[0102] In some alternative embodiments, the enhancement module 405 includes:
[0103] A truncation sub-module, configured to truncate the data values of multiple bits of the pixel values according to the bit difference; wherein, the bit information of the multiple bits is the same as the bit difference;
[0104] A determination sub-module, configured to determine a data enhancement strategy corresponding to the data value according to the data value and a preset look-up table; wherein, the look-up table includes the corresponding relationship between each data value and each data enhancement strategy;
[0105] An enhancement sub-module, configured to perform data enhancement on the plurality of image optimization frames within a preset time according to the data enhancement strategy.
[0106] In some alternative embodiments, the truncation sub-module includes:
[0107] A truncation unit, configured to truncate the low-order data values in the pixel values. Wherein, the bit information of the low-order data values is the same as the bit information of the multiple bits.
[0108] In some alternative embodiments, the enhancer module includes:
[0109] A first determination unit configured to determine the number of pre-enhanced images to be data-enhanced among multiple image optimization frames according to a data enhancement strategy;
[0110] A second determination unit configured to determine an enhancement coefficient corresponding to multiple image optimization frames according to data values;
[0111] An enhancement unit configured to perform data enhancement on the pre-enhanced image frames that need to be data-enhanced among multiple image optimization frames according to the enhancement coefficient, the number of pre-enhanced images, and pixel values.
[0112] In some alternative embodiments, the enhancement unit includes:
[0113] A first calculation unit configured to multiply a pixel value by an enhancement coefficient to obtain an enhanced value;
[0114] A second calculation unit configured to add the enhanced value to the pixel value of the pre-enhanced image frame to obtain an image enhancement frame after data enhancement of the pre-enhanced image frame. Among them, the number of enhancements of the image enhancement frame is the same as the number of pre-enhanced images;
[0115] A control unit configured to control the pixel values of the remaining frames among multiple image optimization frames to remain unchanged.
[0116] In some alternative embodiments, the extraction module 404 includes:
[0117] A parsing sub-module configured to parse a first pixel value corresponding to the red channel of each pixel, a second pixel value corresponding to the green channel, and a third pixel value corresponding to the blue channel in the first image optimization frame; wherein, the first pixel value, the second pixel value, and the third pixel value are all represented by the number of bits of the second bit depth.
[0118] The further function descriptions of the above-mentioned modules and units are the same as those in the corresponding embodiments above, and will not be elaborated here.
[0119] The image display enhancement device in this embodiment is presented in the form of functional units. Here, the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and a memory that execute one or more software or fixed programs, and / or other devices that can provide the above functions.
[0120] The image display enhancement device provided by the embodiment of the present invention obtains the first bit depth information of the endoscope display device and a plurality of consecutive original images, processes the data of the plurality of consecutive original images to obtain a plurality of image optimization frames. Parses the image optimization frames to obtain the second bit depth information of the image optimization frames. Extracts the first image optimization frame from the plurality of image optimization frames, and obtains the pixel values of each pixel in the first image optimization frame. According to the bit difference corresponding to the first bit depth information and the second bit depth information and the pixel values of each pixel in the first image optimization frame, performs data enhancement on the plurality of image optimization frames within a preset time, thereby comparing the real-time image collected by the front end with the display information stored in the internal module to obtain a compensation condition. According to the obtained compensation condition, performs frame processing on the data in real time to further enhance the effect of the image algorithm, thus solving the problem of loss of picture details caused by the hardware error of the endoscope display, and improving the accuracy and clarity of image display. The compensation condition obtained by comparing the real-time image with the display information can be used to process the image data in real time on the software side, thereby making up for the problems brought by the hardware error and enhancing the picture details. By performing frame processing on the data in real time, the effect of the image algorithm can be further enhanced, making the image display more real and clear, and improving the user experience and diagnostic accuracy.
[0121] The embodiment of the present invention also provides an endoscope having the above Figure 4 image display enhancement device.
[0122] Please refer to Figure 5 , Figure 5 which is a schematic structural diagram of an endoscope provided by an optional embodiment of the present invention. As Figure 5 shown, the endoscope includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including a high-speed interface and a low-speed interface. Each component communicates with each other using different buses and can be installed on a common main board or installed in other ways as needed. The processor can process instructions executed within the endoscope, including instructions stored in the memory or on the memory to display graphic information of the GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple endoscopes can be connected, and each device provides some necessary operations (for example, as a server array, a set of blade servers, or a multi-processor system). Figure 5 One processor 10 is taken as an example in
[0123] The processor 10 may be a central processing unit, a network processor, or a combination thereof. Among them, the processor 10 may further include a hardware chip. The above-mentioned hardware chip may be an application-specific integrated circuit, a programmable logic device, or a combination thereof. The above-mentioned programmable logic device may be a complex programmable logic device, a field programmable gate array, a generic array logic, or any combination thereof.
[0124] Among them, the memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiments.
[0125] The memory 20 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system and application programs required for at least one function; the data storage area may store data created according to the use of the endoscope, etc. In addition, the memory 20 may include a high-speed random access memory, and may further include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some alternative embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the endoscope through a network. Examples of the above network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0126] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk, or a solid-state drive; the memory 20 may further include a combination of the above types of memories.
[0127] The endoscope further includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30, and the output device 40 may be connected through a bus or other means, Figure 5 Taking connection through a bus as an example.
[0128] The input device 30 can receive input digital or character information, and generate key signal inputs related to the user settings and function controls of the endoscope, such as a touch screen, a keypad, a mouse, a trackpad, a touchpad, a pointing stick, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 may include a display device, an auxiliary lighting device (such as an LED), and a haptic feedback device (such as a vibration motor), etc. The above display device includes but is not limited to a liquid crystal display, a light-emitting diode, a display, and a plasma display. In some alternative embodiments, the display device may be a touch screen.
[0129] Embodiments of the present invention also provide a computer-readable storage medium. The methods according to the embodiments of the present invention can be implemented in hardware, firmware, or be implemented as computer code that can be recorded on a storage medium, or be implemented as computer code that is originally stored in a remote storage medium or a non-transitory machine-readable storage medium and downloaded through a network and will be stored in a local storage medium, so that the methods described herein can be stored as such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code, and when the software or computer code is accessed and executed by the computer, the processor, or the hardware, the methods shown in the above embodiments are implemented.
[0130] A part of the present invention can be applied as a computer program product, such as computer program instructions, which when executed by a computer, can call or provide the methods and / or technical solutions according to the present invention through the operation of the computer. Those skilled in the art should be able to understand that the forms in which computer program instructions exist in a computer-readable medium include, but are not limited to, source files, executable files, installation package files, etc. Correspondingly, the ways in which computer program instructions are executed by a computer include, but are not limited to: the computer directly executes the instructions, or the computer compiles the instructions and then executes the corresponding compiled program, or the computer reads and executes the instructions, or the computer reads and installs the instructions and then executes the corresponding installed program. Herein, the computer-readable medium can be any available computer-readable storage medium or communication medium accessible by the computer.
[0131] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations all fall within the scope defined by the appended claims.
Claims
1. A method for enhancing image display, characterized in that: The method comprises: Acquire the first bit depth information of the endoscope display device and the continuous multiple frames of original images collected by the endoscope; wherein the continuous multiple frames of original images are multiple image frames collected by the endoscope within a preset time; Performing data processing on the continuous multiple frames of original images to obtain multiple image optimized frames; Parsing the image optimized frame to obtain second bit depth information of the image optimized frame; Extracting a first image optimized frame from the multiple image optimized frames, and obtaining pixel values of each pixel in the first image optimized frame; wherein the first image optimized frame is the first image optimized frame from the multiple image optimized frames, and the pixel values are represented by the number of bits of the second bit depth; Data enhancement is performed on the multiple image optimized frames within the preset time according to the bit number difference corresponding to the first bit depth information and the second bit depth information and the pixel value of each pixel in the first image optimized frame.
2. The image display enhancement method according to claim 1, characterized in that: The step of performing data processing on the continuous multiple frames of original images to obtain multiple image optimized frames includes: Image signal processing and denoising are performed on the plurality of consecutive frames of original images to obtain the plurality of image optimized frames.
3. The image display enhancement method according to claim 1 or 2, characterized in that: The performing data enhancement on the multiple image optimized frames within the preset time according to the bit number difference corresponding to the first bit depth information and the second bit depth information and the pixel value of each pixel in the first image optimized frame includes: According to the bit difference, intercepting the data values of multiple bits of the pixel value; wherein the bit information of the multiple bits is the same as the bit difference; Determine a data enhancement strategy corresponding to the data value according to the data value and a preset lookup table; wherein the lookup table includes a correspondence between each of the data values and each of the data enhancement strategies; According to the data enhancement strategy, data enhancement is performed on the multiple image optimization frames within the preset time.
4. The image display enhancement method according to claim 3, characterized in that: The data value of the plurality of digits of the pixel value is intercepted, comprising: A low-order data value in the pixel value is intercepted; wherein the number of bits of the low-order data value is the same as the number of bits of the plurality of bits.
5. The image display enhancement method according to claim 3, characterized in that: The step of performing data enhancement on the plurality of image optimization frames within the preset time according to the data enhancement strategy includes: Determining the number of pre-enhanced image frames to be data enhanced among the plurality of image optimization frames according to the data enhancement strategy; Determining enhancement coefficients corresponding to the plurality of image optimization frames according to the data values; Data enhancement is performed on the pre-enhanced image frames that need to be data enhanced among the multiple image optimization frames according to the enhancement coefficient, the number of pre-enhancements and the pixel value.
6. The image display enhancement method according to claim 5, characterized in that: The performing data enhancement on the pre-enhanced image frame that needs to be data enhanced among the multiple image optimization frames according to the enhancement coefficient, the number of pre-enhancements, and the pixel value, comprises: Multiplying the pixel value and the enhancement coefficient to obtain an enhancement value; Adding the enhancement value to the pixel value of the pre-enhanced image frame to obtain an image enhancement frame after data enhancement of the pre-enhanced image frame; wherein the number of enhancements of the image enhancement frame is the same as the number of pre-enhancements; The pixel values of the remaining frames in the plurality of image optimized frames are controlled to remain unchanged.
7. The image display enhancement method according to claim 1, characterized in that: The pixel values include a first pixel value, a second pixel value and a third pixel value; The obtaining the pixel value of each pixel in the first image optimization frame includes: Analyze a first pixel value corresponding to a red channel, a second pixel value corresponding to a green channel, and a third pixel value corresponding to a blue channel of each pixel in the first image optimization frame; The first pixel value, the second pixel value, and the third pixel value are all represented by the number of bits of the second bit depth.
8. An image display enhancement device, characterized in that: The device comprises: An acquisition module, used to acquire first bit depth information of an endoscope display device and a plurality of continuous frames of original images acquired by the endoscope; wherein the plurality of continuous frames of original images are a plurality of image frames acquired by the endoscope within a preset time; A processing module, used for performing data processing on the continuous multiple frames of original images to obtain multiple image optimized frames; A parsing module, used for parsing the image optimized frame to obtain second bit depth information of the image optimized frame; an extraction module, configured to extract a first image optimized frame from the plurality of image optimized frames, and obtain a pixel value of each pixel in the first image optimized frame; wherein the first image optimized frame is the first image optimized frame from the plurality of image optimized frames, and the pixel value is represented by the number of bits of the second bit depth; An enhancement module is used to perform data enhancement on the multiple image optimized frames within the preset time according to the bit number difference corresponding to the first bit depth information and the second bit depth information and the pixel value of each pixel in the first image optimized frame.
9. An endoscope, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the image display enhancement method according to any one of claims 1 to 7 by executing the computer instructions.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the image display enhancement method according to any one of claims 1 to 7.
11. A computer program product, characterized in that The method comprises computer instructions, wherein the computer instructions are used to cause a computer to execute the image display enhancement method according to any one of claims 1 to 7.