Endoscope video image processing method and device based on AIGC
By discarding some frame images based on AIGC during the endoscopic video recording process and generating supplementary frame images, the storage space occupation problem caused by the large amount of video data is solved, and the video generation speed is improved and content integrity is guaranteed.
Patent Information
- Application Number
- CN202411212222.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2044-08-30
AI Technical Summary
The video data generated during endoscopic video recording is large and takes up a lot of storage space, which increases the cost and challenges of data storage and management.
Using AIGC-based video image processing method, by discarding some frame images when the recording time is extended, and using AIGC technology to generate supplementary frame images to fill the deleted frame images, generate target video files, reduce the space occupation of video and improve the generation speed. .
It effectively reduces the space occupation of recorded videos and improves the video generation speed. At the same time, it generates three-dimensional models through AIGC technology to support doctors' judgment and research, ensuring the integrity and continuity of video content.
Smart Images

Figure CN119094678A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of endoscope technology, and in particular to an AIGC-based endoscope video image processing method and device. Background Art
[0002] As an advanced medical device that integrates traditional optics, ergonomics, precision machinery, modern electronic technology and software technology, endoscopes are widely used in the field of medical diagnosis. Its principle is mainly to capture images in the body through optical lenses and image sensors, and then convert these images into electrical signals, which are then presented on a display device for doctors to observe and analyze. Endoscopes can enter the human body through the mouth or other natural body cavities, providing doctors with visual information that is difficult to obtain with traditional imaging technologies such as X-rays, which is of great significance for the early detection and precise treatment of diseases.
[0003] During the endoscopic detection process, recording and saving the detection video is crucial for doctors' subsequent research. These video materials can not only help doctors review and analyze the condition, but also serve as valuable teaching materials and case study materials. However, as the detection time increases, the amount of video data generated will also increase rapidly.
[0004] Saving this large amount of video data faces a significant problem: huge memory consumption. Continuous video recording takes up a lot of storage space, which not only increases the cost of data storage, but also brings challenges to data transmission and management. Summary of the invention
[0005] The purpose of this application is to provide an endoscopic video image processing method and device based on AIGC, which can improve the above-mentioned problems.
[0006] The embodiment of the present application is implemented as follows:
[0007] In the first aspect, the present application provides an endoscopic video image processing method based on AIGC, including steps S10 to S40, wherein S10, S20, etc. are merely step identifiers, and the execution order of the method is not necessarily in ascending order of numbers, for example, step S20 may be executed first and then step S10, and the present application does not impose any restrictions thereon.
[0008] S10: In response to the recording operation, storing the frame images fed back by the endoscope probe in a temporary library;
[0009] S20: when the first preset condition is met, discarding some frames in the temporary library that meet the second preset condition according to the first preset rule;
[0010] S30: Generate a target video file according to the remaining frames in the temporary library.
[0011] It can be understood that the present application discloses an endoscopic video image processing method based on AIGC, which enters the video recording state when the doctor's recording operation is started, and records each frame of the endoscope feedback; at the same time, as the recording time increases, some frames are discarded according to the first preset rule to shorten the content of the recorded video, which not only improves the generation speed of the recorded video, but also reduces the space occupied by the recorded video.
[0012] In an optional embodiment of the present application, satisfying the first preset condition includes at least one of the following: the current remaining memory is lower than a preset memory threshold; the current remaining storage space is lower than a preset space threshold.
[0013] In an optional embodiment of the present application, the first preset rule includes at least one of the following:
[0014] The number of dropped frames increases with the length of the recording;
[0015] Periodically discard some frames over time;
[0016] The discard period decreases as the recording time increases.
[0017] It is understandable that if the recording time is too long and too many frames are obtained, the waiting time for synthesis will be longer, and more memory or storage space or other system resources will be occupied, resulting in a poor endoscopic experience. Therefore, as the recording time increases, the number of discarded frames should be appropriately increased to further speed up video synthesis. In addition, periodically discarding some frames instead of discarding frames in a certain period of time can better preserve the integrity of the video content.
[0018] In an optional embodiment of the present application, satisfying the second preset condition includes at least one of the following:
[0019] Frames whose image quality parameters are lower than parameter thresholds; wherein the image quality parameters include at least one of the following: resolution, brightness, color gamut, and contrast;
[0020] A frame image whose viewing angle range is smaller than the first requirement. When the viewing angle range is smaller than the first requirement, the corresponding frame image only includes a partial image of the target object;
[0021] The frame picture whose viewing angle range is greater than the first requirement, when the viewing angle range is greater than the first requirement, the corresponding frame picture includes the overall image of the target object.
[0022] It can be understood that frames that meet the first preset rule can be selectively discarded according to different purposes. Among them, frames with unsatisfactory image quality parameters can be deleted from the perspective of ensuring video quality; frames with too small a viewing angle can be deleted from the perspective of obtaining the overall appearance of a target object such as a tumor; and frames with too large a viewing angle can be deleted from the perspective of obtaining lesion details of a target object such as the heart, liver, and lungs.
[0023] In an optional embodiment of the present application, the above-mentioned AIGC-based endoscopic video image processing method also includes step S40: generating a three-dimensional model of the target object through generative artificial intelligence (Artificial Intelligence Generated Content, AIGC) according to a frame image with a viewing angle range smaller than the first requirement.
[0024] It can be understood that in order to further obtain the overall shape of a target object such as a tumor, the AIGC technology can be used to generate a three-dimensional model of the target object based on all frame images with a viewing angle range smaller than the first requirement, that is, frame images that include the overall shape of the target object, to further provide doctors with judgment and research.
[0025] In an optional embodiment of the present application, the above-mentioned AIGC-based endoscopic video image processing method further includes step S200 between step S20 and step S30: generating a supplementary frame according to a second preset rule, and inserting it into the temporary library to fill the deleted frame.
[0026] It can be understood that in order to reduce the impact of deleted frames on the content continuity of the recorded video, the deleted frames can be filled through AIGC technology or replication technology to ensure the continuity of the overall recorded video.
[0027] In an optional embodiment of the present application, the second preset rule includes at least one of the following: copying the previous frame or the next frame as a supplementary frame; generating an intermediate supplementary frame according to the picture content of the previous frame and the next frame through AIGC technology.
[0028] In the second aspect, the present application discloses an AIGC-based endoscopic video image processing method and device, comprising an endoscope handle, a host processor, a light source driving module and a display; the end of the endoscope handle is provided with an endoscopic probe for collecting detection frame images of target living tissue; the host processor is connected to the endoscope handle through a transmission optical fiber to receive the detection frame images; the host processor is also electrically connected to the display and the light source driving module, and the light source driving module is connected to the endoscope handle through a light source transmission optical fiber to provide an illumination light source for the endoscope handle; the host processor is configured to execute a method as described in any one of the first aspects.
[0029] Beneficial effects:
[0030] The present application discloses an endoscopic video image processing method based on AIGC. When the doctor's recording operation is started, the method enters the video recording state and records each frame of the endoscope feedback. At the same time, as the recording time increases, some frames are discarded according to the first preset rule to shorten the content of the recorded video, which not only improves the generation speed of the recorded video, but also reduces the space occupied by the recorded video.
[0031] As the recording time increases, the number of discarded frames should be appropriately increased to further speed up video synthesis. In addition, periodically discarding some frames instead of discarding frames in a certain period of time can better preserve the integrity of the video content.
[0032] Frames that meet the first preset rule can be selectively discarded according to different purposes. In order to ensure the video quality, frames with unsatisfactory image quality parameters can be deleted; in order to obtain the overall appearance of a target object such as a tumor, frames with a too small viewing angle can be deleted; in order to obtain the details of lesions of a target object such as the heart, liver, and lungs, frames with too large a viewing angle can be deleted.
[0033] In order to further obtain the overall shape of a target object such as a tumor, AIGC technology can be used to generate a three-dimensional model of the target object based on all frames with a viewing angle range smaller than the first requirement, that is, frames that include the overall shape of the target object, to further provide doctors with judgment and research.
[0034] In order to reduce the impact of deleted frames on the content continuity of the recorded video, the deleted frames can be filled through AIGC technology or replication technology to ensure the continuity of the overall recorded video.
[0035] In order to make the above-mentioned objects, features and advantages of the present application more obvious and understandable, optional embodiments are specifically listed below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0037] Figure 1 It is a schematic diagram of an endoscope video image processing method based on AIGC provided by the present application;
[0038] Figure 2 This is a schematic diagram of an embodiment of the first preset rule in this application;
[0039] Figure 3 This is a schematic diagram of an embodiment of the second preset rule in this application;
[0040] Figure 4 is another embodiment schematic diagram of the second preset rule in the present application;
[0041] Figure 5 It is a schematic diagram of an endoscopic video image processing method and device based on AIGC provided in the present application. DETAILED DESCRIPTION
[0042] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0043] First, as Figure 1 As shown, the present application provides an endoscopic video image processing method based on AIGC, including steps S10 to S40, wherein S10, S20, etc. are only step identifiers, and the execution order of the method is not necessarily in the order of numbers from small to large, for example, step S20 may be executed first and then step S10, and the present application does not impose any restrictions.
[0044] S10: In response to the recording operation, the frame images fed back by the endoscope probe are stored in a temporary library.
[0045] The recording operation mainly includes the operator triggering of the endoscope device. Before the recording operation is performed, the endoscope device only displays the frame images detected by the endoscope probe in real time.
[0046] S20: When the first preset condition is met, discard some frames in the temporary library that meet the second preset condition according to the first preset rule.
[0047] In an optional embodiment of the present application, satisfying the first preset condition includes at least one of the following: the current remaining memory is lower than a preset memory threshold; the current remaining storage space is lower than a preset space threshold.
[0048] S30: Generate a target video file according to the remaining frames in the temporary library.
[0049] It can be understood that the present application discloses an endoscopic video image processing method based on AIGC, which enters the video recording state when the doctor's recording operation is started, and records each frame of the endoscope feedback; at the same time, as the recording time increases, some frames are discarded according to the first preset rule to shorten the content of the recorded video, which not only improves the generation speed of the recorded video, but also reduces the space occupied by the recorded video.
[0050] In an optional embodiment of the present application, the first preset rule includes at least one of the following:
[0051] The number of dropped frames increases with the length of the recording;
[0052] Periodically discard some frames over time;
[0053] The discard period decreases as the recording time increases.
[0054] It is understandable that if the recording time is too long and too many frames are obtained, the waiting time for synthesis will be longer, and more memory or storage space or other system resources will be occupied, resulting in a poor endoscopic experience. Therefore, as the recording time increases, the number of discarded frames should be appropriately increased to further speed up video synthesis. In addition, periodically discarding some frames instead of discarding frames in a certain period of time can better preserve the integrity of the video content.
[0055] Optionally, in the first preset rule, the discarding period can be determined according to the associated period of the duration threshold interval to which the recording duration belongs. Different duration threshold intervals have different associated periods. For example, the associated period associated with the first duration threshold is the first period, the associated period associated with the second duration threshold is the second period, the associated period associated with the third duration threshold is the third period, and so on. Among them, the maximum value of the first duration threshold interval is less than the minimum value of the second duration threshold interval, and the first period is greater than the second period; the maximum value of the second duration threshold interval is less than the minimum value of the second duration threshold interval, and the second period is greater than the third period.
[0056] For example, Figure 2 As shown, each frame of the endoscope probe feedback is stored in the temporary library; when the recording duration is less than the duration threshold T, the association period associated with the current recording duration is the first period, that is, a frame is dropped every 20 frames; when the recording duration exceeds the duration threshold T, the association period associated with the current recording duration is the second period, that is, a frame is dropped every 40 frames.
[0057] In an optional embodiment of the present application, satisfying the second preset condition includes at least one of the following:
[0058] Frames whose image quality parameters are lower than the parameter threshold; wherein the image quality parameters include at least one of the following: resolution, brightness, color gamut, and contrast;
[0059] A frame image whose viewing angle range is smaller than the first requirement. When the viewing angle range is smaller than the first requirement, the corresponding frame image only includes a partial image of the target object;
[0060] The frame picture whose viewing angle range is greater than the first requirement, when the viewing angle range is greater than the first requirement, the corresponding frame picture includes the overall image of the target object.
[0061] It can be understood that frames that meet the first preset rule can be selectively discarded according to different purposes. Among them, frames with unsatisfactory image quality parameters can be deleted from the perspective of ensuring video quality; frames with too small a viewing angle can be deleted from the perspective of obtaining the overall appearance of a target object such as a tumor; and frames with too large a viewing angle can be deleted from the perspective of obtaining lesion details of a target object such as the heart, liver, and lungs.
[0062] In an optional embodiment of the present application, the above-mentioned AIGC-based endoscopic video image processing method also includes step S40: generating a three-dimensional model of the target object through generative artificial intelligence (Artificial Intelligence Generated Content, AIGC) according to a frame image with a viewing angle range smaller than the first requirement.
[0063] Through the InstantMesh technology, a high-quality 3DMesh model can be generated from a single picture within 10 seconds. It combines the multi-view diffusion generation model and the sparse view reconstruction model of the LRM architecture to improve the efficiency and consistency of the generation model. In addition, another technology, Shap-E, is a breakthrough model developed by OpenAI that can use text or images as input to generate a series of 3D objects, demonstrating the versatility of AIGC in 3D generation.
[0064] It can be understood that in order to further obtain the overall shape of a target object such as a tumor, the AIGC technology can be used to generate a three-dimensional model of the target object based on all frame images with a viewing angle range smaller than the first requirement, that is, frame images that include the overall shape of the target object, to further provide doctors with judgment and research.
[0065] In an optional embodiment of the present application, the above-mentioned AIGC-based endoscopic video image processing method further includes step S200 between step S20 and step S30: generating a supplementary frame according to a second preset rule, and inserting it into a temporary library to fill the deleted frame.
[0066] It is understandable that after dropping frames according to the first rule, the spare frames may cause the previous and next frames to be incoherent, affecting the operator's judgment. In order to reduce the impact of the deleted frames on the continuity of the recorded video content, the deleted frames can be filled by AIGC technology or replication technology to ensure the continuity of the overall recorded video.
[0067] In an optional embodiment of the present application, the second preset rule includes at least one of the following: copying the previous frame or the next frame as a supplementary frame; generating an intermediate supplementary frame according to the content of the previous frame and the next frame through AIGC technology.
[0068] For example, Figure 3 As shown, after dropping frames according to the first rule, the previous frame of the spare frame can be directly copied and inserted as a supplementary frame. Although the figure only illustrates the situation of copying the previous frame as a supplementary frame, in fact, the next frame can also be copied as a supplementary frame, which will not be repeated here.
[0069] For example, Figure 4 As shown, after the frame is dropped according to the first rule, the AIGC technology can be used to generate an intermediate supplementary frame according to the picture contents of the previous frame and the next frame using a suitable AIGC model.
[0070] AIGC can generate an intermediate frame based on the previous frame and the next frame. This process mainly relies on artificial intelligence algorithms and computer vision technology. The following are the specific implementation methods and steps:
[0071] 1. Data training:
[0072] AI needs to be trained with a large amount of image data to learn the features and styles of images. These data usually include pictures or video sequences of various scenes, actions and objects.
[0073] Through deep learning algorithms, AI builds a model of image features, so that it can understand and analyze the composition and structure of the image.
[0074] 2. Feature extraction and fusion:
[0075] For a given previous and next frame, AI will first extract key features from the two frames, such as edges, corners, textures, etc.
[0076] Then, these features are fused using interpolation algorithms or other computer vision techniques to generate features of the intermediate frames.
[0077] 3. Intermediate frame generation:
[0078] Based on the fused features, AI constructs the intermediate frame. This process may involve interpolating the motion trajectory of the object in the previous and next frames to ensure that the motion of the object in the intermediate frame is coherent.
[0079] At the same time, AI will also consider environmental factors such as lighting and shadows to ensure the picture quality of the intermediate frames.
[0080] 4. Optimization and adjustment:
[0081] After generating the intermediate frames, AI will optimize and adjust them to eliminate possible artifacts, blur and other undesirable effects.
[0082] This step may involve a variety of image processing techniques, such as denoising, sharpening, etc.
[0083] 5. Output and evaluation:
[0084] Finally, AI will output the generated intermediate frame, which should be consistent with the previous and next frames and have high quality.
[0085] To evaluate the quality of the generated intermediate frames, various metrics and methods can be used, such as Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index (SSIM), etc.
[0086] Second, as Figure 5 As shown, the present application discloses an AIGC-based endoscopic video image processing method and device, including an endoscope handle 101, a host processor 102, a light source driving module 103 and a display 104; the end of the endoscope handle 101 is provided with an endoscopic probe for collecting detection frame images of the target living tissue.
[0087] The host processor 102 is connected to the endoscope handle 101 via the transmission optical fiber 105 to receive the detection frame image; the host processor 102 is also electrically connected to the display 104 and the light source driving module 103, and the light source driving module 103 is connected to the endoscope handle 101 via the light source transmission optical fiber 106 to provide an illumination light source for the endoscope handle 101; the host processor 102 is configured to execute any method as in the first aspect.
[0088] After the endoscope handle 101 collects the optical signal of the target living tissue, it converts the optical signal into an electrical signal through the photoelectric conversion module; in order to prevent electromagnetic interference, the sensor adapter board in the endoscope handle 101 will sample and process the transmitted electrical signal and convert the parallel-to-serial signal format, and convert the serialized electrical signal into an optical signal again, so that it can be transmitted to the host processor 102 through the transmission optical fiber 105 for further photoelectric conversion, and finally the detection frame image is output on the display 104.
[0089] It should be understood that in the embodiments of the present invention, the host processor may be a central processing unit (CPU), and the host processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0090] In a specific implementation, the host processor described in the embodiment of the present invention may execute the implementation method described in any method of the first aspect, and may also execute the implementation method of the terminal device described in the embodiment of the present invention, which will not be repeated here.
[0091] In a third aspect, the present invention provides a computer-readable storage medium storing a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the steps of any method of the first aspect are implemented.
[0092] The computer-readable storage medium may be an internal storage unit of the terminal device of any of the aforementioned embodiments, such as a hard disk or memory of the terminal device. The computer-readable storage medium may also be an external storage device of the terminal device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the terminal device. Furthermore, the computer-readable storage medium may also include both an internal storage unit of the terminal device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the terminal device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.
[0093] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.
[0094] In the several embodiments provided in the present application, it should be understood that the disclosed terminal device and method can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, or it can be an electrical, mechanical or other form of connection.
[0095] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present invention.
[0096] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0097] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.
[0098] The expressions "first", "second", "the first" or "the second" used in various embodiments of the present disclosure may modify various components regardless of order and / or importance, but these expressions do not limit the corresponding components. The above expressions are only configured for the purpose of distinguishing an element from other elements. For example, a first user device and a second user device represent different user devices, although both are user devices. For example, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element without departing from the scope of the present disclosure.
[0099] When one element (e.g., a first element) is referred to as being "(operably or communicatively) coupled" or "(operably or communicatively) coupled to" or "connected to" another element (e.g., a second element), it is understood that the one element is directly connected to the other element or the one element is indirectly connected to the other element via yet another element (e.g., a third element). Conversely, it is understood that when an element (e.g., a first element) is referred to as being "directly connected" or "directly coupled" to another element (the second element), no element (e.g., a third element) is interposed between the two.
[0100] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.
[0101] The above description is only an optional embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other.
[0102] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.
[0103] The above description is only an optional embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other.
[0104] The above description is only an optional embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. An endoscope video image processing method based on AIGC, It is characterized in that The following steps are involved: S10: In response to the recording operation, storing the frame images fed back by the endoscope probe in a temporary library; S20: when the first preset condition is met, discarding some frames in the temporary library that meet the second preset condition according to the first preset rule; S30: Generate a target video file according to the remaining frames in the temporary library.
2. The AIGC-based endoscopic video image processing method according to claim 1, It is characterized in that The first preset condition is satisfied, including at least one of the following: The current remaining memory is lower than the preset memory threshold; The current remaining storage space is lower than the preset space threshold.
3. The endoscopic video image processing method based on AIGC according to claim 1, It is characterized in that The first preset rule includes at least one of the following: The number of dropped frames increases with the length of the recording; Periodically discard some frames over time; The discard period decreases as the recording time increases.
4. The AIGC-based endoscopic video image processing method according to claim 3, It is characterized in that The second preset condition is satisfied, including at least one of the following: Frames whose image quality parameters are lower than the parameter threshold; The viewing angle range is smaller than the frame required by the first requirement; The viewing angle range is greater than the first required frame.
5. The AIGC-based endoscopic video image processing method according to claim 4, It is characterized in that The image quality parameters include at least one of the following: resolution, brightness, color gamut, and contrast.
6. The AIGC-based endoscopic video image processing method according to claim 4, It is characterized in that When the viewing angle range is smaller than the first requirement, the corresponding frame image only includes a partial image of the target object; When the viewing angle range is greater than the first requirement, the corresponding frame image includes the entire image of the target object.
7. The AIGC-based endoscopic video image processing method according to claim 6, It is characterized in that The method further includes step S40: generating a three-dimensional model of the target object through AIGC according to a frame image whose viewing angle range is smaller than the first requirement.
8. The AIGC-based endoscopic video image processing method according to any one of claims 1 to 7, It is characterized in that Between step S20 and step S30, step S200 is also included: generating a supplementary frame picture according to a second preset rule, and inserting the supplementary frame picture into the temporary library to fill the deleted frame picture.
9. The AIGC-based endoscopic video image processing method according to claim 1, It is characterized in that The second preset rule includes at least one of the following: Copy the previous frame or the next frame as a supplementary frame; Through AIGC technology, an intermediate supplementary frame is generated according to the picture content of the previous frame and the next frame.
10. An endoscope video image processing method and device based on AIGC, It is characterized in that It includes an endoscope handle, a host processor, a light source driving module and a display; the end of the endoscope handle is provided with an endoscope probe for collecting detection frame images of target living tissue; the host processor is connected to the endoscope handle through a transmission optical fiber to receive the detection frame images; the host processor is also electrically connected to the display and the light source driving module, and the light source driving module is connected to the endoscope handle through a light source transmission optical fiber to provide an illumination light source for the endoscope handle; the host processor is configured to execute the method as described in any one of claims 1 to 9.
Citation Information
Patent Citations
Motor vehicle digital image frequency conversion recording system and method
CN102320273A
Video data management method and device, and video recorder
CN108668096A
Video monitoring method, device, system, and equipment and computer readable storage medium
CN110062212A
Spliced screen picture recording method and device, computer device and storage medium
CN111182235A
Endoscope camera host, video recording method, imaging system, and storage medium
CN114072040A
