Transmission delay detection method and related equipment for endoscope camera system
By acquiring display delay information and calculating interface delay in dark room scenarios, the problem of inaccurate transmission delay measurement of endoscopic imaging system in the prior art is solved, and accurate detection and performance evaluation of system transmission delay are achieved.
Patent Information
- Application Number
- CN202411229214.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-03
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2044-09-03
AI Technical Summary
The prior art is difficult to accurately measure the transmission delay of the endoscopic imaging system, especially ignoring the variability of the display's own delay, which makes it difficult for the measurement results to reflect the system performance.
By using the detection component in a dark room scene, the first and second display delay information are obtained, the interface delay information is calculated, and the transmission delay of the endoscopic imaging system is accurately detected, thereby avoiding the delay of the display processing.
It realizes accurate detection of the transmission delay of the endoscopic imaging system, and can be used as a performance parameter for evaluating the advantages and disadvantages of the image transmission characteristics of the system, helping manufacturers and users to distinguish the differences between different systems.
Smart Images

Figure CN118869982B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image transmission technology, and in particular to a transmission delay detection method and related equipment for an endoscope camera system. Background Art
[0002] As an important tool of modern medical technology, medical endoscopes are widely used in clinical minimally invasive surgeries. The core components of the endoscope camera system include high-definition cameras, precision endoscope camera hosts, and stable cold light source systems. These components work together to capture real-time images of lesions in the body through the camera, perform advanced image processing such as denoising and enhancement through the camera host, and then quickly transmit them to the display for doctors to diagnose and analyze. However, the inevitable image delay problem in this process, that is, the time difference of image signals caused by signal transmission, processing, and caching, has become a key indicator for measuring the performance of endoscope systems.
[0003] Currently, the measurement methods for the delay time of endoscopic camera systems on the market mostly focus on the complete process from camera acquisition to final display. This method ignores the variability of the display's own delay, resulting in the measurement results being difficult to accurately reflect the performance of the endoscope system itself.
[0004] There is currently no effective technical solution to the above problems. Summary of the invention
[0005] The purpose of the present application is to provide a transmission delay detection method and related equipment for an endoscope camera system, so as to more accurately detect the transmission delay of the endoscope camera system while avoiding the delay of display processing.
[0006] In a first aspect, the present application provides a method for detecting transmission delay of an endoscope camera system, the method comprising the following steps:
[0007] S1. In a darkroom scenario, first display delay information is obtained based on a detection component, wherein the detection component includes a light source and a first photoelectric detection module provided on one side of a camera of the endoscope camera system, a display connected to an output interface of the endoscope camera system, and a second photoelectric detection module provided on the display, wherein the first display delay information is a response time difference between the second photoelectric detection module and the first photoelectric detection module with respect to the light source switch;
[0008] S2. In a darkroom scenario, second display delay information is obtained based on the detection component, wherein the detection component further includes a picture push module and a test fixture electrically connected to the picture push module via an output interface similar to that of the endoscope camera system, and the picture push module is also connected to the display via an output interface similar to that of the endoscope camera system, and the second display delay information is a response time difference between the second photoelectric detection module and the test fixture regarding the picture push module pushing the picture;
[0009] S3. Calculate and obtain interface delay information according to the first display delay information and the second display delay information.
[0010] The transmission delay detection method of the endoscopic camera system of the present application can accurately remove the display processing delay of the display to detect interface delay information that can accurately characterize the transmission time consumed by the endoscopic camera system when using different output interfaces for image transmission, so that the interface delay information can be used as a performance parameter for accurately evaluating the advantages and disadvantages of the image transmission characteristics of the endoscopic camera system, so as to facilitate manufacturers and users to distinguish the differences between different endoscopic camera systems.
[0011] The transmission delay detection method of the endoscope camera system, wherein the output interface of the endoscope camera system is an HDMI interface or an SDI interface.
[0012] HDMI interface and SDI interface are commonly used output interfaces in endoscope camera systems. The transmission delay detection method of the endoscope camera system of the present application is particularly suitable for the detection of these two types of interfaces.
[0013] The transmission delay detection method of the endoscopic camera system, wherein, when the output interface of the endoscopic camera system is an HDMI interface, the test tool is used to convert the minimized transmission differential signal in the HDMI signal transmitted by the HDMI interface into a parallel RGB signal, and respond based on a type of signal in the RGB signal.
[0014] In this example, the parallel R signal, G signal and B signal all change synchronously, and can be used to reflect whether the picture pushed by the picture push module is a black image or a white image. Therefore, the test tooling can respond based on any type of signal in the RGB signal, that is, detect and respond based on any one of the R signal, G signal and B signal to determine the type of picture pushed by the picture push module in the current state, and the display processes the corresponding HDMI signal into the corresponding picture after receiving it, and then displays it, and then detects and responds through the second photoelectric detection module; unlike the display, the test tooling does not need to perform image processing, that is, there is no need to consider reconstructing the image according to the parallel RGB signals, and there is almost no processing delay, so the difference between the response time of the test tooling and the response time of the second photoelectric detection module is equal to the display processing delay of the display.
[0015] The transmission delay detection method of the endoscopic camera system, wherein, when the output interface of the endoscopic camera system is an SDI interface, the test tool is used to convert the SDI signal transmitted by the SDI interface into a parallel signal in the YCrCb format, and respond based on the brightness component signal in the parallel signal in the YCrCb format.
[0016] The transmission delay detection method of the endoscopic camera system, wherein, when the output interface of the endoscopic camera system is an SDI interface, the test tool is used to convert the SDI signal transmitted by the SDI interface into a parallel signal in the YCrCb format, convert the parallel signal in the YCrCb format into a parallel RGB signal, and then respond based on a type of signal in the RGB signal.
[0017] The transmission delay detection method of the endoscope camera system, wherein the method further comprises the steps of:
[0018] S4. After switching to a different display, re-execute steps S1 to S3 to obtain new interface delay information to verify the interface delay information.
[0019] The transmission delay detection method of the endoscopic camera system, wherein the detection component also includes an oscilloscope, the first photoelectric detection module, the second photoelectric detection module and the test fixture are all connected to the oscilloscope, and the first display delay information and the second display delay information are both calculated and obtained based on the output image of the oscilloscope.
[0020] In a second aspect, the present application further provides a transmission delay detection device for an endoscope camera system, the device comprising:
[0021] A first acquisition module is used to obtain first display delay information based on a detection component in a darkroom scene, wherein the detection component includes a light source and a first photoelectric detection module provided on one side of a camera of the endoscopic camera system, a display connected to an output interface of the endoscopic camera system, and a second photoelectric detection module provided on the display, wherein the first display delay information is a response time difference between the second photoelectric detection module and the first photoelectric detection module with respect to the light source switch;
[0022] A second acquisition module is used to obtain second display delay information based on the detection component in a darkroom scene, the detection component also includes a picture push module and a test fixture electrically connected to the picture push module through an output interface similar to that of the endoscopic camera system, the picture push module is also connected to the display through an output interface similar to that of the endoscopic camera system, and the second display delay information is a response time difference between the second photoelectric detection module and the test fixture regarding the picture pushed by the picture push module;
[0023] A calculation module is used to calculate and obtain interface delay information according to the first display delay information and the second display delay information.
[0024] The transmission delay detection device of the endoscopic camera system of the present application can accurately remove the display processing delay of the display to detect interface delay information that can accurately characterize the transmission time consumed by the endoscopic camera system when using different output interfaces for image transmission, so that the interface delay information can be used as a performance parameter for accurately evaluating the advantages and disadvantages of the image transmission characteristics of the endoscopic camera system, so as to facilitate manufacturers and users to distinguish the differences between different endoscopic camera systems.
[0025] In a third aspect, the present application further provides an electronic device, comprising a processor and a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the steps in the method provided in the first aspect are executed.
[0026] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the steps in the method provided in the first aspect are executed.
[0027] From the above, it can be seen that the present application provides a transmission delay detection method and related equipment for an endoscopic camera system, wherein the transmission delay detection method for an endoscopic camera system can accurately remove the display processing delay of the display to detect interface delay information that can accurately characterize the transmission time consumed by the endoscopic camera system when using different output interfaces for image transmission, so that the interface delay information can be used as a performance parameter for accurately evaluating the advantages and disadvantages of the image transmission characteristics of the endoscopic camera system, so as to facilitate manufacturers and users to distinguish the differences between different endoscopic camera systems. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] Figure 1 This is a flow chart of a transmission delay detection method for an endoscope camera system provided in an embodiment of the present application.
[0029] Figure 2 A partial structural diagram of the detection components used in executing step S1 of the transmission delay detection method for an endoscopic camera system provided in an embodiment of the present application.
[0030] Figure 3 A partial structural schematic diagram of the detection component used in executing step S2 of the transmission delay detection method of the endoscopic camera system provided in an embodiment of the present application in some implementations.
[0031] Figure 4 A partial structural schematic diagram of the detection component used in executing step S2 of the transmission delay detection method of the endoscopic camera system provided in an embodiment of the present application in other implementations.
[0032] Figure 5 Schematic diagram of the structure of a test tool in some embodiments.
[0033] Figure 6 Schematic diagram of the structure of the test tool in some other embodiments.
[0034] Figure 7 This is a schematic diagram of the connection structure of the oscilloscope.
[0035] Figure 8 A schematic diagram of the structure of a transmission delay detection device for an endoscopic camera system provided in an embodiment of the present application.
[0036] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
[0037] Figure numerals: 1. light source; 2. endoscope camera system; 3. first photoelectric detection module; 4. second photoelectric detection module; 5. display; 6. picture push module; 7. test tooling; 8. hub; 9. oscilloscope; 21. camera; 22. endoscope camera host; 201. first acquisition module; 202. second acquisition module; 203. computing module; 301. processor; 302. memory; 303. communication bus. DETAILED DESCRIPTION
[0038] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.
[0039] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as an indication or relative importance of the darkroom.
[0040] First, please refer to Figure 1-Figure 7 Some embodiments of the present application provide a method for detecting transmission delay of an endoscope camera system, the method comprising the following steps:
[0041] S1. In a darkroom scene, first display delay information is obtained based on a detection component, wherein the detection component includes a light source 1 and a first photoelectric detection module 3 provided on one side of a camera 21 of an endoscope camera system 2, a display 5 connected to an output interface of the endoscope camera system 2, and a second photoelectric detection module 4 provided on the display 5, wherein the first display delay information is a response time difference between the second photoelectric detection module 4 and the first photoelectric detection module 3 regarding the switch of the light source 1;
[0042] S2. In a darkroom scenario, the second display delay information is obtained based on the detection component, the detection component also includes a picture push module 6 and a test fixture 7 electrically connected to the picture push module 6 through an output interface similar to the endoscope camera system 2, the picture push module 6 is also connected to the display 5 through an output interface similar to the endoscope camera system 2, and the second display delay information is the response time difference between the second photoelectric detection module 4 and the test fixture 7 regarding the picture push module 6 pushing the picture;
[0043] S3. Calculate and obtain interface delay information according to the first display delay information and the second display delay information.
[0044] Specifically, the medical endoscopic camera system 2 is generally composed of a camera head 21, an endoscopic camera host 22 and a cold light source. The camera head 21 collects in vivo images under the illumination of the cold light source and transmits them to the outside through its output interface after processing by the endoscopic camera host 22. The transmission delay detection method of the endoscopic camera system in an embodiment of the present application is intended to detect the time taken for the image collected by the camera head 21 in the endoscopic camera system 2 to be transmitted to the display 5. In order to avoid interference with the detection, the cold light source of the medical endoscopic camera system 2 should be kept closed during the detection process.
[0045] More specifically, the camera head 21 of the endoscope camera system 2 is electrically connected to the endoscope camera host 22 via a signal line, the output interface is provided on the endoscope camera host 22, and the display 5 can be electrically connected to the output interface via a video line paired with the output interface.
[0046] More specifically, in the embodiment of the present application, the light source 1 is used to generate a light signal for detection through changes in brightness, the camera 21 and the first photoelectric detection module 3 are both located on one side of the light source 1, and can simultaneously receive the light signal generated by the light source 1, the display 5 is used to display the image captured by the output camera 21, and the second photoelectric detection module 4 is disposed on the display 5, for receiving the light signal on the display 5; in a darkroom scene, the camera 21, the first photoelectric detection module 3 and the second photoelectric detection module 4 can better detect changes in the corresponding light signal, and can effectively avoid the influence of other light on the detection effect, thereby improving the detection accuracy.
[0047] It should be noted that the second photoelectric detection module 4 should be set at a position where it cannot receive the signal from the light source 1. For example, the display 5 is preferably set back to the light source 1 and the second photoelectric detection module 4 is set on the display panel of the display 5. For example, a partition is provided on one side of the display 5 to isolate the light source 1.
[0048] More specifically, the first photoelectric detection module 3 and the second photoelectric detection module 4 will generate a high-level signal when receiving a light signal, and output a low-level signal when not receiving a light signal. Therefore, the on-off change of the light source 1 will cause the level signal output by the first photoelectric detection module 3 and the second photoelectric detection module 4 to change. The first display delay information corresponds to the time difference between the on-off change detected by the second photoelectric detection module 4 and the on-off change detected by the first photoelectric detection module 3, that is, the response time difference; wherein, the first photoelectric detection module 3 outputs a high-level signal indicating that the light source 1 is in a light-emitting state, and the second photoelectric detection module 4 outputs a high-level signal indicating that the display 5 is in a light-emitting state, corresponding to the camera 21 shooting to the light source 1 being in a light-emitting state; in step S1, there is a certain delay in the process in which the light source 1 turns on and off and causes the display 5 to turn on and off, and the delay includes the endoscope camera system processing delay, transmission delay and display processing delay, wherein the interface delay information corresponds to the time taken for the image captured by the camera 21 in the endoscope camera system 2 to be transmitted from the camera 21 end to the transmission interface (including the data processing process of the endoscope camera system) and the image transmission time of the video line, taking into account that different types of transmission interfaces need to be used with corresponding video lines, and the transmission delay of the video line is relatively stable, therefore, the transmission delay detection method of the endoscope camera system of the embodiment of the present application detects the endoscope camera system processing delay The delay and transmission delay are integrated into the interface delay information for detection; in some preferred embodiments, since the transmission delay is much smaller than the interface delay information and the display processing delay and can be ignored, the endoscope camera system processing delay can also be directly defined as the interface delay information; the display processing delay corresponds to the time taken for the display 5 to display the corresponding data after receiving it from the video line; after determining the first display delay information including all the above delays in step S1, in order to detect and obtain the interface delay information, the display processing delay needs to be measured; in step S2, the picture push module 6 is a component for pushing and outputting the corresponding picture signal, such as a computer or other control device capable of outputting the picture signal, for outputting the black The screen switches between white and black to simulate the on / off changes of the light source 1. The test fixture 7 is a trigger component that does not need to consider processes such as image reconstruction processing and can determine whether the data is delivered based on the screen signal. It can detect the on / off changes corresponding to the screen signal (equivalent to the light signal). The second display delay information is the time difference between the on / off changes detected by the second photoelectric detection module 4 and the on / off changes detected by the test fixture 7, that is, the response time difference; therefore, the second display delay information obtained in step S2 represents the display processing delay corresponding to the display 5; on this basis, step S3 combines the first display delay information obtained in step S1 and the second display delay information obtained in step S2 to calculate the interface delay information.
[0049] More specifically, the connection mode of the display 5 when collecting the first display delay information in step S1 is as follows: Figure 2 As shown, the connection mode of the display 5 when executing step S2 to collect the second display delay information is as follows Figure 3 or Figure 4 shown in Figure 4 In the embodiment, the picture push module 6 generates two identical data through the hub 8 for output to connect the display 5 and the test fixture 7 respectively, which is particularly suitable for the case where the picture push module 6 is a computer. Figure 3 In the example, the picture push module 6 directly generates two outputs which are respectively connected to the display 5 and the test fixture 7, which is particularly suitable for the case where the picture push module 6 is the main control chip.
[0050] More specifically, the first display delay information and the second display delay information are both measured based on the on-off changes of the light signal. They can be measured based on the change process of the light signal from off to on, or based on the change process of the light signal from on to off. They can also be determined by combining the average value of the delay measured from the change process of the light signal from off to on and the change process of the light signal from on to off, so as to further improve the reliability of the detection results.
[0051] It should be noted that the display 5 is connected to the endoscopic camera system 2 and the image push module 6 respectively in step S1 and step S2. It can switch the connection between the endoscopic camera system 2 and the image push module 6 based on one input interface, or it can connect the endoscopic camera system 2 and the image push module 6 respectively based on two identical input interfaces.
[0052] It should be noted that the endoscopic camera system 2 generally has multiple types of output interfaces, and different interface delay information is generated when video is transmitted based on different types of output interfaces. The transmission delay detection method of the endoscopic camera system of an embodiment of the present application is suitable for detecting interface delay information of different types of output interfaces, and has the characteristic of wide applicability.
[0053] It should be noted that the transmission delay detection method of the endoscope camera system of the embodiment of the present application is applicable to the endoscope camera system that transmits 2D images or 3D images.
[0054] The transmission delay detection method of the endoscope camera system in the embodiment of the present application can accurately remove the display processing delay of the display 5 to detect the interface delay information that can accurately characterize the transmission time of the endoscope camera system 2 when using different output interfaces for image transmission, so that the interface delay information can be used as a performance parameter for accurately evaluating the advantages and disadvantages of the image transmission characteristics of the endoscope camera system 2, so as to facilitate manufacturers and users to distinguish the differences between different endoscope camera systems 2.
[0055] In some preferred embodiments, the output interface of the endoscope camera system 2 is an HDMI interface or an SDI interface.
[0056] Specifically, the HDMI interface and the SDI interface are relatively commonly used output interfaces in the endoscope camera system 2, and the transmission delay detection method of the endoscope camera system of the embodiment of the present application is particularly suitable for the detection of these two types of interfaces.
[0057] In some preferred embodiments, when the output interface of the endoscope camera system 2 is an HDMI interface, the test tool 7 is used to convert the minimized transmission differential signal in the HDMI signal transmitted by the HDMI interface into a parallel RGB signal, and respond based on a type of signal in the RGB signal.
[0058] Specifically, the transmission channel of HDMI includes three TMDS transmission channels for transmitting data and one independent TMDS clock channel, which are respectively used to transmit the corresponding minimized transmission differential signals (TMDS, Transition Minimized Differential Signaling). Therefore, the HDMI signal includes four minimized transmission differential signals, among which the TMDS clock channel is used to ensure the unified timing required for transmission, and the remaining three TMDS transmission channels are used to transmit minimized transmission differential signals for data such as video, audio and additional information. In the embodiment of the present application, considering the structural particularity of the endoscope camera system 2, the three TMDS transmission channels are used to transmit minimized transmission differential signals for video data, and the TMDS clock channel is used to transmit the pixel clock of the video.
[0059] More specifically, in the embodiment of the present application, the image received by the test fixture 7 and the display 5 based on the HDMI interface corresponds to the black and white changing image pushed by the image push module 6, and the test fixture 7 can parse the RGB value of the corresponding black and white changing image according to the 4 pairs of minimized transmission differential signals transmitted by the 4 TMDS channels, wherein the RGB value is expressed as a parallel RGB signal, that is, corresponding to a parallel R signal, a G signal and a B signal, respectively representing the intensity of the corresponding color, and each type of signal is transmitted as 8-bit data, the RBG value corresponding to the black image is (0,0,0), and the RBG value corresponding to the white image is (255, 255,255); it can be seen that, under normal circumstances, the parallel R signal, G signal and B signal all change synchronously, and can be used to reflect whether the picture pushed by the picture push module 6 is a black image or a white image, so the test fixture 7 can respond based on any type of signal in the RGB signal, that is, detect and respond based on any one of the R signal, G signal and B signal to determine the type of the picture pushed by the picture push module 6 in the current state, and the display 5 processes the corresponding HDMI signal into the corresponding picture after receiving it and then displays it, and then detects and responds through the second photoelectric detection module 4; unlike the display 5, the test fixture 7 does not need to perform image processing, that is, there is no need to consider reconstructing the image according to the parallel RGB signals, and there is almost no processing delay, so the difference between the response time of the test fixture 7 and the response time of the second photoelectric detection module 4 is equal to the display processing delay of the display 5.
[0060] More specifically, the response of the test tool 7 refers to the detection by the test tool 7 that the HDMI signal it receives represents that the picture changes from black to white or from white to black, and the response of the second photoelectric detection module 4 refers to the detection that the picture displayed on the display 5 changes from black to white or from white to black, that is, corresponding to the switching from the state of never receiving the light signal to the state of receiving the light signal or from the state of receiving the light signal to the state of not receiving the light signal.
[0061] In order to enable the test fixture 7 to more accurately capture the time nodes of the picture changes and simplify the response logic, in some preferred embodiments, the test fixture 7 preferably responds based on the highest bit data of a type of signal in the RGB signal.
[0062] Specifically, based on the foregoing content, it can be known that the data transmitted by each type of signal in the parallel RGB signal is 8-bit data. Therefore, the change node of the highest-bit data corresponds to the median data of the change between the black screen and the white screen, that is, it is determined whether the data transmitted by the corresponding signal switches from above 10000000 to below 10000000 or from below 10000000 to above 10000000 in response, wherein the color intensity value corresponding to the 8-bit 10000000 is 128.
[0063] More specifically, in this embodiment, the test tool 7 can be used as follows Figure 5 The circuit architecture shown.
[0064] In some preferred embodiments, when the output interface of the endoscope camera system 2 is an SDI interface, the test tool 7 is used to convert the SDI signal transmitted by the SDI interface into a parallel signal in the YCrCb format, and respond based on the brightness component signal in the parallel signal in the YCrCb format.
[0065] Specifically, the YCrCb (also known as YUV) format is a commonly used video data format in SDI transmission, and generally exists in the SDI signal in the form of a serial signal. In the embodiment of the present application, in order to accurately analyze the black and white changes of the picture output by the picture push module 6, the test tool 7 needs to convert the SDI signal into a parallel signal in the YCrCb format with parallel characteristics, wherein the parallel signal includes a brightness (Y) component signal and a chrominance (CrCb) component signal. The parallel signal in the YCrCb format is expressed as a 20-bit parallel signal, wherein the high-order part ([19:10]) represents the brightness component signal, The low-order part ([9:0]) represents the chrominance component signal. The test fixture 7 detects and responds based on the brightness component signal to determine the type of the picture pushed by the picture push module 6 in the current state. The display 5 processes the corresponding SDI signal into the corresponding picture after receiving it and then displays it, and then detects and responds through the second photoelectric detection module 4. Unlike the display 5, the test fixture 7 does not need to perform image processing, that is, there is no need to consider reconstructing the image according to the SDI signal, and there is almost no processing delay. Therefore, the difference between the response time of the test fixture 7 and the response time of the second photoelectric detection module 4 is equal to the display processing delay of the display 5.
[0066] In order to enable the test fixture 7 to more accurately capture the time nodes of the picture changes and simplify the response logic, in some preferred embodiments, the test fixture 7 preferably responds based on the highest bit data of the brightness component signal.
[0067] Specifically, based on the foregoing content, it can be known that the luminance component signal occupies 10 bits of data in the parallel signal of the YCrCb format. Therefore, the change node of the highest bit data of the luminance component signal corresponds to the median data of the change between the black picture and the white picture.
[0068] More specifically, in this embodiment, the test tool 7 can be used as follows Figure 6 The circuit architecture shown.
[0069] In some other implementations, after obtaining the parallel signals in the YCrCb format, the test fixture 7 may convert the parallel signals in the YCrCb format into parallel RGB signals, and then respond based on one type of signal in the RGB signals.
[0070] Specifically, the parallel signal in the YCrCb format has a conversion relationship with the parallel RGB signal, and the conversion relationship satisfies:
[0071] Y=0.299R+0.587G+0.114B(1)
[0072] Cb=0.564(BY)≈-0.1687R-0.3313G+0.5B (2)
[0073] Cr=0.713(RY)≈0.5R-0.4187G-0.0813B (3)
[0074] Therefore, the test fixture 7 can convert the parallel signal in the YCrCb format into a parallel RGB signal based on formula (1), (2) and (3), and then respond based on a type of signal in the RGB signal. The process of responding based on a type of signal in the RGB signal is similar to the response process of the aforementioned HDMI and will not be repeated here. Under this embodiment, the test fixture 7 can set different signal processing modules to perform signal preprocessing for different types of output interfaces to obtain parallel RGB signals, and then respond based on the parallel RGB signals in the same manner.
[0075] It should be noted that this implementation adds the conversion process of the RGB signal, resulting in the accuracy of the interface delay information obtained by detection being slightly lower than that of the previous implementation.
[0076] In some preferred embodiments, when the output interface of the endoscope camera system 2 is an HDMI interface, the picture pushing module 6 in step S2 is preferably a computer, and is connected to the display 5 and the test tool 7 through a one-to-two HDMI hub; when the output interface of the endoscope camera system 2 is an SDI interface, the picture pushing module 6 in step S2 is preferably a main control chip, and is respectively connected to the display 5 and the test tool 7 through two SDI interfaces on the main control chip, wherein the video format of the picture pushed by the main control chip is generated according to the YCrCb format, and finally outputs two-way black and white picture switching SDI video signal in the form of parallel-to-serial conversion.
[0077] In some preferred embodiments, the method further comprises the steps of:
[0078] S4. After switching to a different display 5, re-execute steps S1 to S3 to obtain new interface delay information to verify the interface delay information.
[0079] Specifically, step S4 is an optional verification step. Based on the foregoing content, it can be known that different displays 5 have different display processing delays. By switching different displays 5 to obtain different first display delay information and second display delay information to calculate and obtain more interface delay information, the accuracy of the previously obtained interface delay information can be verified; in other embodiments, it is also possible to obtain multiple interface delay information corresponding to the same output interface by switching and using different displays 5, and calculate the average of the multiple interface delay information as the final interface delay information of the corresponding output interface to improve the reliability of the detection result.
[0080] In some preferred embodiments, Figure 7 As shown, the detection component also includes an oscilloscope 9, the first photoelectric detection module 3, the second photoelectric detection module 4 and the test fixture 7 are all connected to the oscilloscope 9, and the first display delay information and the second display delay information are both calculated and obtained based on the output image of the oscilloscope 9.
[0081] Specifically, the first photoelectric detection module 3, the second photoelectric detection module 4 and the test fixture 7 all respond by outputting level signals. The oscilloscope 9 can accurately capture the change nodes and matching relationships of these level signals to calculate the corresponding response time difference, which can effectively ensure the accuracy of the first display delay information and the second display delay information obtained; and the oscilloscope 9 can store multiple sets of data for analysis and verification.
[0082] Second, please refer to Figure 8 Some embodiments of the present application also provide a transmission delay detection device for an endoscope camera system, the device comprising:
[0083] The first acquisition module 201 is used to obtain the first display delay information based on the detection component in the darkroom scene, the detection component includes a light source 1 and a first photoelectric detection module 3 arranged on one side of the camera 21 of the endoscope camera system 2, a display 5 connected to the output interface of the endoscope camera system 2, and a second photoelectric detection module 4 arranged on the display 5, and the first display delay information is the response time difference between the second photoelectric detection module 4 and the first photoelectric detection module 3 with respect to the switch of the light source 1;
[0084] The second acquisition module 202 is used to obtain the second display delay information based on the detection component in the darkroom scene. The detection component also includes a picture push module 6 and a test fixture 7 electrically connected to the picture push module 6 through an output interface similar to the endoscope camera system 2. The picture push module 6 is also connected to the display 5 through an output interface similar to the endoscope camera system 2. The second display delay information is the response time difference between the second photoelectric detection module 4 and the test fixture 7 regarding the picture push module 6 pushing the picture;
[0085] The calculation module 203 is used to calculate and obtain the interface delay information according to the first display delay information and the second display delay information.
[0086] The transmission delay detection device of the endoscope camera system of the embodiment of the present application can accurately remove the display processing delay of the display 5 to detect the interface delay information that can accurately characterize the transmission time of the endoscope camera system 2 when using different output interfaces for image transmission, so that the interface delay information can be used as a performance parameter for accurately evaluating the advantages and disadvantages of the image transmission characteristics of the endoscope camera system 2, so as to facilitate manufacturers and users to distinguish the differences between different endoscope camera systems 2.
[0087] In some preferred embodiments, the transmission delay detection device of the endoscopic camera system of the embodiment of the present application is used to execute the transmission delay detection method of the endoscopic camera system provided in the first aspect above.
[0088] Third, please refer to Fig. 9 Some embodiments of the present application also provide a structural diagram of an electronic device. The present application provides an electronic device, including: a processor 301 and a memory 302. The processor 301 and the memory 302 are interconnected and communicate with each other through a communication bus 303 and / or other forms of connection mechanisms (not marked). The memory 302 stores computer-readable instructions executable by the processor 301. When the electronic device is running, the processor 301 executes the computer-readable instructions to execute the method in any optional implementation of the above embodiments.
[0089] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the method in any optional implementation of the above embodiment is executed. The computer-readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, disk or optical disk.
[0090] In summary, the embodiments of the present application provide a transmission delay detection method and related equipment for an endoscopic camera system, wherein the transmission delay detection method for an endoscopic camera system can accurately remove the display processing delay of the display 5 to detect interface delay information that can accurately characterize the transmission time consumed by the endoscopic camera system 2 when using different output interfaces for image transmission, so that the interface delay information can be used as a performance parameter for accurately evaluating the advantages and disadvantages of the image transmission characteristics of the endoscopic camera system 2, so as to facilitate manufacturers and users to distinguish the differences between different endoscopic camera systems 2.
[0091] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.
[0092] In addition, the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0093] Furthermore, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
[0094] In this document, relational terms such as first and second, etc. are used merely to distinguish one entity or operation from another entity or operation, but do not necessarily require or imply any actual relationship or order between these entities or operations.
[0095] The above description is only an embodiment of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A transmission delay detection method for an endoscope camera system, characterized in that: The method comprises the following steps: S1. In a darkroom scenario, first display delay information is obtained based on a detection component, wherein the detection component includes a light source and a first photoelectric detection module provided on one side of a camera of the endoscope camera system, a display connected to an output interface of the endoscope camera system, and a second photoelectric detection module provided on the display, wherein the first display delay information is a response time difference between the second photoelectric detection module and the first photoelectric detection module with respect to the light source switch; S2. In a darkroom scenario, second display delay information is obtained based on the detection component, wherein the detection component further includes a picture push module and a test fixture electrically connected to the picture push module via an output interface similar to that of the endoscope camera system, and the picture push module is also connected to the display via an output interface similar to that of the endoscope camera system, and the second display delay information is a response time difference between the second photoelectric detection module and the test fixture regarding the picture pushed by the picture push module, which characterizes the display processing delay corresponding to the display; S3. Calculate and obtain interface delay information according to the first display delay information and the second display delay information.
2. The transmission delay detection method of the endoscope camera system according to claim 1, characterized in that: The output interface of the endoscope camera system is an HDMI interface or an SDI interface.
3. The transmission delay detection method of the endoscope camera system according to claim 2, characterized in that: When the output interface of the endoscope camera system is an HDMI interface, the test fixture is used to convert the minimized transmission differential signal in the HDMI signal transmitted by the HDMI interface into a parallel RGB signal, and respond based on a type of signal in the RGB signal.
4. The transmission delay detection method of the endoscope camera system according to claim 2, characterized in that: When the output interface of the endoscope camera system is an SDI interface, the test fixture is used to convert the SDI signal transmitted by the SDI interface into a parallel signal in the YCrCb format, and respond based on the brightness component signal in the parallel signal in the YCrCb format.
5. The transmission delay detection method of the endoscope camera system according to claim 2, characterized in that: When the output interface of the endoscope camera system is an SDI interface, the test tool is used to convert the SDI signal transmitted by the SDI interface into a parallel signal in the YCrCb format, convert the parallel signal in the YCrCb format into a parallel RGB signal, and then respond based on a type of signal in the RGB signal.
6. The transmission delay detection method of an endoscope camera system according to claim 1, characterized in that: The method further comprises the steps of: S4. After switching to a different display, re-execute steps S1 to S3 to obtain new interface delay information to verify the interface delay information.
7. The transmission delay detection method of an endoscope camera system according to claim 1, characterized in that: The detection component also includes an oscilloscope, the first photoelectric detection module, the second photoelectric detection module and the test fixture are all connected to the oscilloscope, and the first display delay information and the second display delay information are both calculated and obtained based on the output image of the oscilloscope.
8. A transmission delay detection device for an endoscope camera system, characterized in that: The device comprises: A first acquisition module is used to obtain first display delay information based on a detection component in a darkroom scene, wherein the detection component includes a light source and a first photoelectric detection module provided on one side of a camera of the endoscopic camera system, a display connected to an output interface of the endoscopic camera system, and a second photoelectric detection module provided on the display, wherein the first display delay information is a response time difference between the second photoelectric detection module and the first photoelectric detection module with respect to the light source switch; A second acquisition module is used to obtain second display delay information based on the detection component in a darkroom scene, the detection component also includes a picture push module and a test fixture electrically connected to the picture push module through an output interface similar to that of the endoscope camera system, the picture push module is also connected to the display through an output interface similar to that of the endoscope camera system, the second display delay information is a response time difference between the second photoelectric detection module and the test fixture regarding the picture pushed by the picture push module, and represents a display processing delay corresponding to the display; A calculation module is used to calculate and obtain interface delay information according to the first display delay information and the second display delay information.
9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the steps in the method according to any one of claims 1 to 7 are executed.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are executed.
Citation Information
Patent Citations
Endoscope camera system delay test method, device, equipment and system
CN117082233A
Surgical robot remote surgery transmission delay judgment and safety protection method, control system, readable storage medium and electronic equipment
CN117541648A