System and method for processing video image data during surgery

By adopting wireless transmission technology in the surgical field camera system, video image data with non-compressed or low compression ratios less than the set threshold are transmitted in the 5GHz to 60GHz frequency band, the problems of inflexible signal transmission and easy damage in the prior art are solved, and video image transmission with low latency, low loss truth, and high definition are achieved.

CN108924490BActive Publication Date: 2025-03-28NANJING MINDRAY BIO MEDICAL ELECTRONICS
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN201810724685.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2018-07-04
Publication Date
2025-03-28
Estimated Expiration
2038-07-04

AI Technical Summary

Technical Problem

The signal transmission methods of existing surgical lamp field cameras have poor flexibility, troublesome connection, easy damage and cumbersome wiring, which affect the neatness and post-maintenance of the operating room.

Method used

A low-latency, low-loss true surgical process video image data processing system is adopted. The system includes a camera module, a format converter, a video output device and a video receiving device. Through wireless transmission technology, video image data with a non-compressed or low compression ratio less than a set threshold is transmitted in the frequency band of 5GHz to 60GHz.

Benefits of technology

It realizes low-latency and low-loss true transmission of the surgical process video image data, avoids image distortion and display delay, improves clarity and transmission delay, and has strong anti-interference ability, which is suitable for high-demand environments in the operating room.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN108924490B_ABST
    Figure CN108924490B_ABST
Patent Text Reader

Abstract

The present invention provides a surgical procedure video image data processing system, including a camera module, a format converter, a video output device and a video receiving device; the camera module is used to collect surgical procedure video image data, and the camera module is arranged on a medical device; the format converter is used to convert the surgical procedure video image data into a format, and the format conversion is performed into non-compressed data processing or data processing with a compression rate less than a set threshold; the video output device wirelessly transmits the surgical procedure video image data after the format conversion through at least one frequency band in the frequency band of 5 GHz to 60 GHz; the video receiving device is used to receive the surgical procedure video image data after the wireless transmission. With such a configuration, on the one hand, image distortion caused by compression processing of video image data is avoided or reduced. On the other hand, the influence caused by display delay caused by using network broadband for data transmission is also avoided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of multimedia technology, and in particular to a system and method for processing video image data during an operation. Background Art

[0002] Disclaimer: Throughout the specification, any discussion of the background art should in no way be considered as an admission that such art is well known or forms part of the common general knowledge in the field.

[0003] Usually, most surgical lights are equipped with surgical field cameras, so that other medical staff can watch the images of the surgical field during the operation through the monitor. At present, the signal transmission of the surgical field camera of the surgical light is mainly to connect the surgical field camera and the monitor using a signal cable (for example, directly connected by a signal cable, or using a wired network transmission, etc.). This method not only limits the installation position of the monitor, making the installation of the monitor inflexible, but also the signal cable connection is troublesome and easy to damage, and the wiring is cumbersome, which is not conducive to the cleanliness of the operating room and the later maintenance of the surgical light. Summary of the invention

[0004] Based on the above, a low-latency, low-loss surgical process video image data processing system is provided.

[0005] A system for processing surgical process video image data, comprising a camera module, a format converter, at least one video output device and at least one video receiving device; the camera module is used to collect surgical process video image data, and the camera module is arranged on a medical device; the format converter is used to convert the format of the surgical process video image data, and the format conversion is used for non-compressed data processing or data processing with a compression rate less than a set threshold; at least one of the video output devices wirelessly transmits the surgical process video image data after the format conversion through at least one frequency band in the frequency band of 5 GHz to 60 GHz; and at least one of the video receiving devices is used to receive the surgical process video image data after the wireless transmission.

[0006] In addition, a low-latency, low-loss method for processing surgical process video image data is also provided.

[0007] A method for processing video image data of a surgical procedure, the method comprising: collecting video image data of the surgical procedure by a camera module, the camera module being arranged on a medical device; converting the format of the video image data of the surgical procedure by a format converter, the format conversion being for processing uncompressed data or processing data with a compression rate less than a set threshold; wirelessly transmitting the video image data of the surgical procedure after the format conversion through at least one frequency band in a frequency band of 5 GHz to 60 GHZ by at least one video output device; and receiving the wirelessly transmitted video image data of the surgical procedure by at least one video receiving device.

[0008] The above method or system converts the video image data into non-compressed video data or data with a compression rate less than a set threshold, and transmits it in at least one frequency band of 5 GHz to 60 GHz in a wireless data transmission mode. On the one hand, it avoids or reduces the image distortion caused by the compression processing of the video image data. On the other hand, it also avoids the influence caused by display delay caused by using network broadband for data transmission. At the same time, it can effectively improve the clarity and transmission delay.

[0009] In the above content, at least in some embodiments, the purpose of the present invention is to overcome or improve at least one disadvantage of the prior art, or to provide a useful alternative. The collection of overview embodiments provided is to predict potential patent claims based on the selection of technical features disclosed in the following "Detailed Description", and these collections of overview embodiments are not intended to limit the scope of the claims that can be expanded in any way. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 A schematic diagram of a hardware system in an image acquisition device provided by an embodiment;

[0011] Figure 2 A schematic diagram of the hardware system in a communication power supply module and a schematic diagram of its external connection relationship provided by an embodiment;

[0012] Figure 3 A schematic diagram of the installation position structure of an image acquisition device provided by an embodiment on a surgical light;

[0013] Figure 4 A schematic diagram of an image data wireless transmission system in which a video output device transmits video data to multiple video receiving devices simultaneously, provided by an embodiment;

[0014] Figure 5 A schematic diagram of a wireless transmission system for image data in which multiple video output devices are connected to the same video receiving device according to an embodiment;

[0015] Figure 6A schematic diagram of an image data wireless transmission system in which multiple video receiving devices simultaneously transmit video data to a display device according to an embodiment;

[0016] Figure 7 A schematic diagram of an image data wireless transmission system in which a video receiving device transmits video data to multiple display devices simultaneously, provided by an embodiment;

[0017] Figure 8 The present invention is a flowchart of a method for wirelessly transmitting image data provided by an embodiment.

[0018] Description of the drawings: 100. Camera module; 200. Format converter; 300. Video output device; 400. Communication power module; 410. First communication interface; 420. Second communication interface; 430. First power input terminal; 440. First power output terminal; 450. Second power input terminal; 460. Second power output terminal; 470. Third power input terminal; 500. Arm control module; 600. Video receiving device; 700. Display device. DETAILED DESCRIPTION

[0019] In this patent document, the following discussion Figure 1-8 The various embodiments used to describe the principles or methods of the present disclosure are for illustration only and should not be interpreted as limiting the scope of the present disclosure in any way. It should be understood by those skilled in the art that the principles or methods of the present disclosure can be implemented in any appropriately arranged image acquisition device, image data wireless transmission system and method. With reference to the accompanying drawings, the preferred embodiments of the present disclosure will be described below. In the following description, detailed descriptions of well-known functions or configurations will be omitted so as not to obscure the subject matter of the present disclosure with unnecessary details. Moreover, the terms used herein will be defined according to the functions of the present invention. Therefore, the terms may vary depending on the intention or usage of the user or operator. Therefore, the terms used herein must be understood based on the descriptions made herein.

[0020] A surgical procedure video image data processing system, such as Figure 4As shown, it includes a camera module 100, a format converter 200, at least one video output device 300 and at least one video receiving device 600. The camera module 100 is used to collect video image data of the surgical process, and the camera module 100 is set on the medical device. The format converter 200 is used to convert the video image data of the surgical process, and the format conversion is to non-compressed data processing or data processing with a compression rate less than a set threshold. At least one video output device 300 wirelessly transmits the video image data of the surgical process after format conversion through at least one frequency band in the frequency band of 5GHz to 60GHz. At least one video receiving device 600 is used to receive the video image data of the surgical process after wireless transmission. Among them, the video output device 300 includes a processor for converting video data into data suitable for wireless transmission and an antenna for sending video data signals to the outside. The video receiving device 600 includes an antenna for receiving video data signals and a processor for converting the received wireless video data signal into video data. In addition, the camera module 100 can be arranged on the surgical lamp or on the laparoscope, for example, the camera module 100 is arranged on the hysteroscope or on the laparoscope, or on the flexible laparoscope of the gastroscope. Among them, in the case where the camera module 100 can be arranged on the surgical lamp, specifically, the camera module 100 can be arranged on the lamp head of the surgical lamp, or can be arranged separately on the spring arm of the surgical lamp. The system of the present invention converts the video image data into non-compressed high-definition video data through the format converter 200, and wirelessly outputs at least one frequency band in the frequency band of 5GHz to 60GHz through the video output device 300 in a wireless data transmission mode, and transmits the video data between the video receiving device 600. Such a setting, on the one hand, avoids or reduces the image distortion caused by the compression processing of the video image data. On the other hand, it also avoids the influence caused by the display delay caused by the use of network broadband for data transmission. At the same time, it can effectively improve the clarity and transmission delay, and has strong anti-interference ability. In addition, it can achieve a higher data transmission rate, so that it can more reliably provide the bandwidth necessary for transmitting high-quality, high-definition uncompressed video.

[0021] In one embodiment, if Figure 6As shown, the system of the present invention also includes at least one display device 700. The display device 700 is used to display the received surgical process video image data. Among them, one display device 700 is connected to two or more video receiving devices 600 to present the uncompressed high-definition video data received by two or more video receiving devices 600 through one display device 700. In this embodiment, one display device 700 establishes a connection relationship with two or more video receiving devices 600 to obtain two or more wireless video data, and then performs overall operation processing and output display on them. In actual applications, the display device 700 uses a "picture-in-picture" display mode to simultaneously display image screens of multiple video data sources on one display device 700.

[0022] In one embodiment, the format of the surgical process video image data acquired by the camera module 100 is YCbCr. In this embodiment, YCbCr or Y'CbCr is sometimes written as: YCBCR or Y'CBCR. YCbCr or Y'CbCr is a type of color space. It is usually used for continuous image processing in movies or in digital photography systems. Among them, Y' is the brightness (luma) component of the color, and CB and CR are the concentration offset components of blue and red. It is worth noting that Y' and Y in this embodiment are different, among which Y refers to lumen, which represents the concentration of light and is nonlinear, and is mainly processed by gamma correction encoding.

[0023] In one of the embodiments, the main sampling formats of the video image data collected by the image acquisition device are YCbCr4:2:0, YCbCr 4:2:2, YCbCr 4:1:1 and YCbCr 4:4:4. Among them, 4:2:0 means that every 4 pixels have 4 brightness components and 2 chrominance components (i.e., YYYYCbCr), that is, only odd scan lines are sampled. It is the most commonly used format for portable video devices (e.g., MPEG-4) and video conferencing (e.g., H.263). 4:2:2 means that every 4 pixels have 4 brightness components and 4 chrominance components (i.e., YYYYCbCrCbCr). It is the most commonly used format for DVD, digital TV, HDTV and other consumer video devices. 4:4:4 means full pixel dot matrix (i.e., YYYYCbCrCbCrCbCr). It is mainly used in high-quality video applications, studios and professional video products. In this case, YCbCr 4:1:1 is more commonly used, which means: each point stores an 8-bit brightness value (that is, Y value), and each 2x2 point stores a Cr and Cb value. Since the human eye is more sensitive to the Y component of the video, after the chrominance component is reduced by subsampling the chrominance component, the naked eye will not be able to detect the change in image quality. Therefore, the original RGB (R, G, B are all 8-bit unsigned) model requires 8x3=24 bits for each point. The solution of the present invention uses video image data in the form of YCbCr or Y'CbCr, which only requires 8+(8 / 4)+(8 / 4)=12 bits, that is, each point occupies 12 bits on average. In this way, the image data is compressed by half. Therefore, such a setting also greatly shortens the time for video data transmission.

[0024] In one of the embodiments, preferably, the format of the surgical process video image data after format conversion by the format converter 200 is 1080P, 1080I, 4K or 720P.

[0025] In one embodiment, if Figure 1 As shown, it also includes a communication interface for receiving control instructions to the camera module 100 or feeding back parameter information of the camera module.

[0026] In one of the embodiments, the device further includes a power supply circuit for supplying power to the format converter and / or the video output device.

[0027] In one embodiment, it also includes a communication interface for receiving control instructions for the camera module 100 or feeding back parameter information of the camera module 100. And a power supply circuit for powering the format converter and / or the video output device. The communication interface and the power supply circuit are arranged on a circuit board. Or the communication interface, the power supply circuit and the format converter are arranged on a circuit board.

[0028] In one embodiment, the camera module 100 is disposed on the lamp head of the surgical lamp. The format converter 200 is disposed between the lamp head of the surgical lamp and the rear cover of the surgical lamp. The video output device 300 is disposed on the rear cover of the surgical lamp. In this embodiment, the camera module 100 is not limited to the above-mentioned arrangement. Specifically, the camera module 100 can also be disposed in the middle of the lamp head of the surgical lamp or on the side of the lamp head of the surgical lamp. In addition, due to the special purpose of the surgical lamp, the packaging of the camera module 100 disposed on the surgical lamp needs to meet strict sterility requirements.

[0029] In one embodiment, the system of the present invention further comprises a housing, in which a camera module 100, a format converter 200 and a video output device 300 are arranged. The housing is arranged on the lamp head of the surgical lamp or on the spring arm of the surgical lamp.

[0030] In one embodiment, the video output device 300 includes a pairing information transmitter for sending pairing information. The video receiving device 600 includes a pairing information receiver. The pairing information receiver is used to receive the pairing information, store the address code of the pairing information transmitter corresponding to the pairing information, and send a pairing success prompt message to the pairing information transmitter. In this embodiment, the information transmission between the pairing information transmitter and the pairing information receiver can also be transmitted via infrared, Bluetooth and WiFi.

[0031] In one embodiment, the video receiving device 600 includes a pairing information transmitter for sending pairing information. The video output device 300 includes a pairing information receiver, which is used to receive the pairing information, store the address code of the pairing information transmitter corresponding to the pairing information, and send a pairing success prompt message to the pairing information transmitter. In this embodiment, the information transmission between the pairing information transmitter and the pairing information receiver can also be transmitted via infrared, Bluetooth and WiFi.

[0032] In one embodiment, the system of the present invention also includes a processor for determining whether the received surgical process video image data meets a preset quality condition after the video receiving device receives the surgical process video image data after wireless transmission, and if the surgical process video image data meets the preset quality condition, enabling at least one display device 700 to display the received surgical process video image data.

[0033] In one embodiment, the system of the present invention also includes a processor, which is used to determine whether the received surgical process video image data meets a preset quality condition after the video receiving device 600 receives the surgical process video image data after wireless transmission, and if the received surgical process video image data does not meet the preset quality condition, adjust the sending frequency band of the video output device 300 and the receiving frequency band of the video receiving device 600, so that at least one video output device 300 wirelessly transmits the surgical process video image data after format conversion through an adjusted frequency band in the frequency band of 5 GHz to 60 GHZ, and enables at least one video receiving device 600 to receive the surgical process video image data transmitted through the adjusted frequency band.

[0034] In one embodiment, the system of the present invention further includes a processor, which is used to determine whether the received surgical process video image data sent through the adjusted frequency band meets the preset quality conditions after the video receiving device 600 receives the surgical process video image data after wireless transmission, and if the received surgical process video image data sent through the adjusted frequency band does not meet the preset quality conditions, adjust the transmission power of the video output device 300 so that at least one video output device performs wireless transmission with the adjusted transmission power.

[0035] In one embodiment, the system of the present invention further includes a processor, which is used to determine the transmission power of the video output device 300 according to the distance or position relationship between the video output device 300 and the video receiving device 600, so that at least one video output device 300 sends the video image data of the surgical process after format conversion with the transmission power and transmits it wirelessly through at least one frequency band in the frequency band of 5GHz to 60GHZ. In this embodiment, since the installation distance of the video output device 300 and the video receiving device 600 in the actual use of the scheme of the present invention in the operating room usually needs to be carried out according to the actual layout of the operating room, sometimes the distance is short, sometimes the distance is long, sometimes the space structure of the middle distance is simple, and sometimes the space structure of the middle distance is complex. Therefore, it is necessary to appropriately adjust the transmission power of the video output device 300 to reduce the signal transmission power of the video output device 300 as much as possible under the condition of meeting the data transmission conditions to reduce radiation and save energy.

[0036] The above system converts the video image data into non-compressed or low-compression video data through the format converter 200, and transmits the video data between the video receiving device and at least one frequency band in the 5GHz to 60GHz frequency band through the video output device 300 in a wireless data transmission manner. On the one hand, image distortion caused by compression processing of video image data is avoided or reduced. On the other hand, the influence caused by display delay caused by using network broadband for data transmission is also avoided. At the same time, it can effectively improve clarity and transmission delay, and has strong anti-interference ability. In addition, a higher data transmission rate can be achieved, so that the bandwidth necessary for transmitting high-quality, high-definition uncompressed video can be more reliably provided.

[0037] In addition, a method for processing surgical process video image data with low latency and low loss is also provided. A method for processing surgical process video image data, the method comprising: collecting surgical process video image data through a camera module 100, and the camera module is set on a medical device. The surgical process video image data is format converted through a format converter 200, and the format conversion is performed to non-compressed data processing or data processing with a compression rate less than a set threshold. The surgical process video image data after format conversion is wirelessly transmitted through at least one frequency band in the frequency band of 5GHz to 60GHZ through at least one video output device 300. The surgical process video image data after wireless transmission is received through at least one video receiving device 600. In this method, the acquired video image data can be first-hand video image data directly collected by the camera module 100, or it can be existing (i.e., it has existed in the past and is stored by a storage device) video image data. Since the compression algorithms in the data processing process are lossy, they affect the image quality and may cause image distortion. Therefore, the image data processing process of the method of the present invention does not compress the image data or process the data with a compression rate less than a set threshold. The acquired video image data is directly transmitted in the form of non-compressed data or video data with a compression rate less than a set threshold. And the above video data is output wirelessly in at least one frequency band from 5GHz to 60GHz. Transmission is performed in the frequency band of 5GHz or 60GHz in the form of wireless data transmission. On the one hand, image distortion caused by compression processing of video image data is avoided or reduced. On the other hand, the impact of display delay caused by data transmission using network broadband is also avoided. At the same time, its unique algorithm can effectively improve clarity and transmission delay, and has strong anti-interference ability (such as the frequency band of WHDI). In addition, a higher data transmission rate can be achieved, so that the bandwidth necessary for transmitting high-quality, high-definition uncompressed video can be more reliably provided (such as the frequency bands of WIHD and WiGig).

[0038] In one of the embodiments, the method further includes: displaying the received surgical procedure video image data via at least one display device 700 .

[0039] In one embodiment, the method further includes: the format of the surgical process video image data acquired by the camera module 100 is YCbCr. In this embodiment, YCbCr or Y'CbCr is sometimes written as: YCBCR or Y'CBCR. YCbCr or Y'CbCr is a color space. It is usually used for continuous image processing in movies or in digital photography systems. Among them, Y' is the brightness (luma) component of the color, and CB and CR are the concentration offset components of blue and red. It is worth noting that Y' and Y in this embodiment are different, wherein Y refers to lumen, which represents the concentration of light and is nonlinear, and is mainly processed by gamma correction encoding. Among them, the main sampling formats of the image acquisition device to collect video image data are YCbCr 4:2:0, YCbCr 4:2:2, YCbCr 4:1:1 and YCbCr4:4:4. Among them, 4:2:0 means that every 4 pixels have 4 brightness components and 2 chrominance components (ie, YYYYCbCr), that is, only odd scan lines are sampled. It is the most commonly used format for portable video devices (such as MPEG-4) and video conferencing (such as H.263). 4:2:2 means that every 4 pixels have 4 brightness components and 4 chrominance components (ie, YYYYCbCrCbCr). It is the most commonly used format for DVD, digital TV, HDTV and other consumer video devices. 4:4:4 means full pixel dot matrix (ie, YYYYCbCrCbCrCbCrCbCr). It is mainly used in high-quality video applications, studios and professional video products. In this case, YCbCr 4:1:1 is more commonly used, which means: each point stores an 8-bit brightness value (that is, Y value), and each 2x2 point stores a Cr and Cb value. Since the human eye is more sensitive to the Y component of the video, after the chrominance component is reduced by subsampling the chrominance component, the naked eye will not be able to detect the change in image quality. Therefore, the original RGB (R, G, B are all 8-bit unsigned) model requires 8x3=24 bits for each point. The solution of the present invention uses video image data in the form of YCbCr or Y'CbCr, which only requires 8+(8 / 4)+(8 / 4)=12 bits, that is, each point occupies 12 bits on average. In this way, the image data is compressed by half. Therefore, such a setting also greatly shortens the time for video data transmission.

[0040] In one embodiment, the method further includes: the format of the surgical process video image data after format conversion is 1080P, 1080I, 4K or 720P. In this embodiment, the format of the surgical process video image data after format conversion is high-definition video data.

[0041] In one embodiment, before receiving the surgical process video image data after wireless transmission through at least one video receiving device 600, the method further includes: pairing the at least one video receiving device 600 with the at least one video output device 300. Receiving the surgical process video image data after wireless transmission through at least one video receiving device 600 includes: if the at least one video receiving device 600 is successfully paired with the at least one video output device 300, receiving the surgical process video image data after wireless transmission through at least one video receiving device 600.

[0042] In one embodiment, the video receiving device 600 includes a pairing information receiver, the video output device 300 includes a pairing information transmitter, and the video receiving device 600 and the video output device 300 are paired, including: sending the pairing information through the pairing information transmitter. Determining whether the pairing information receiver receives the pairing information. If the pairing information receiver receives the pairing information, the address code of the pairing information transmitter corresponding to the pairing information is stored, and a pairing success prompt message is sent to the pairing information transmitter.

[0043] In one embodiment, the video output device 300 includes a pairing information receiver, the video receiving device 600 includes a pairing information transmitter, and the video receiving device and the video output device are paired, including: sending the pairing information through the pairing information transmitter. Determining whether the pairing information receiver receives the pairing information. If the pairing information receiver receives the pairing information, the address code of the pairing information transmitter corresponding to the pairing information is stored, and a pairing success prompt message is sent to the pairing information transmitter.

[0044] In one embodiment, the method further includes: if the pairing information receiver does not receive the pairing information, determining whether the pairing time satisfies a preset time condition. If the pairing time satisfies the preset time condition, re-performing the pairing. In this embodiment, "re-performing" means performing the pairing process of the pairing information transmitter and the pairing information receiver again.

[0045] In one embodiment, the method further includes: after receiving the surgical process video image data after wireless transmission through at least one video receiving device 600, it also includes: determining whether the received surgical process video image data meets the preset quality condition. If the received surgical process video image data meets the preset quality condition, the received surgical process video image data is displayed through at least one display device 700.

[0046] In one embodiment, the method further includes: after receiving the surgical process video image data after wireless transmission through at least one video receiving device 600, it also includes: determining whether the received surgical process video image data meets the preset quality condition. If the received surgical process video image data does not meet the preset quality condition, adjusting the transmission frequency band of the video output device 300 and the receiving frequency band of the video receiving device, wirelessly transmitting the surgical process video image data after format conversion through the adjusted frequency band in the frequency band of 5 GHz to 60 GHZ through at least one video output device 300, and receiving the surgical process video image data transmitted through the adjusted frequency band through at least one video receiving device 600.

[0047] In one embodiment, the method further includes: after receiving the surgical process video image data after wireless transmission through at least one video receiving device 600, it also includes: determining whether the surgical process video image data received and sent through the adjusted frequency band meets the preset quality condition. If the surgical process video image data received and sent through the adjusted frequency band does not meet the preset quality condition, adjusting the transmission power of the video output device, and performing wireless transmission through at least one video output device with the adjusted transmission power.

[0048] In one embodiment, the method further includes: determining the transmission power of the video output device according to the distance or position relationship between the video output device 300 and the video receiving device 600. The video image data of the surgical process after the format conversion is wirelessly transmitted through at least one frequency band in the frequency band of 5GHz to 60GHZ by at least one video output device 300, including: the video image data of the surgical process after the format conversion is transmitted with the transmission power by at least one video output device and wirelessly transmitted through at least one frequency band in the frequency band of 5GHz to 60GHZ. In this embodiment, since the installation distance of the video output device 300 and the video receiving device 600 is usually required to be carried out according to the actual layout of the operating room during the actual use of the scheme of the present invention in the operating room, sometimes the distance is short, sometimes the distance is long, sometimes the space structure of the middle distance is simple, and sometimes the space structure of the middle distance is complex. Therefore, it is necessary to appropriately adjust the transmission power of the video output device 300 to reduce the signal transmission power of the video output device 300 as much as possible under the condition of meeting the data transmission conditions to reduce radiation and save energy.

[0049] The above method converts the video image data into non-compressed high-definition video data and transmits it in at least one frequency band of 5GHz to 60GHz in a wireless data transmission mode. On the one hand, it avoids or reduces the image distortion caused by the compression processing of the video image data. On the other hand, it also avoids the impact caused by display delay caused by using network broadband for data transmission. At the same time, it can effectively improve the clarity and transmission delay, and has strong anti-interference ability. In addition, it can achieve a higher data transmission rate, so that it can more reliably provide the bandwidth necessary for transmitting high-quality, high-definition uncompressed video.

[0050] The invention also provides an image acquisition device.

[0051] An image acquisition device, such as Figure 1As shown, it includes a camera module 100, a format converter 200 and a video output device 300. The camera module 100 is used to collect video image data. The format converter 200 is used to convert the video image data into a non-compressed data format, or a data format conversion with a compression rate less than a set threshold, to obtain low-loss video data. The video output device 300 is used to output video data in at least one frequency band of 5GHz to 60GHz by wireless means. In this way, the transmission characteristics of the 5GHz to 60GHz wireless transmission frequency band can be utilized, and on the one hand, image distortion caused by compression processing of video image data can be avoided or reduced. On the other hand, the influence caused by display delay caused by using network broadband for data transmission is also avoided. At the same time, it can effectively improve clarity and transmission delay, and has strong anti-interference ability. In addition, a higher data transmission rate can be achieved, so that the bandwidth necessary for transmitting high-quality, high-definition uncompressed video can be more reliably provided. For example, the frequency band of WHDIWHDI is 5GHz, and its unique algorithm significantly improves clarity and transmission delay, and has strong anti-interference ability. The frequency band of Wireless HD (WiHD) and Wireless Gigabit (WiGig) is 60GHz, which can achieve a higher data transmission rate, thereby more reliably providing the bandwidth necessary to transmit high-quality, high-definition uncompressed video.

[0052] The image acquisition device disclosed in the present invention is widely used. For example, in the medical field, most surgical lamps are equipped with surgical field cameras so that other medical staff can watch the images of the surgical field during the operation through the display. There are two main ways to transmit signals for the surgical field cameras of traditional surgical lamps. One is to use a signal line to connect the surgical field camera and the display (for example, directly connected by a signal line, or using a wired network transmission, etc.). This method not only limits the installation position of the display, making the installation of the display inflexible, but also the signal line connection is troublesome and easy to damage, and the wiring is cumbersome, which is not conducive to the cleanliness of the operating room and the later maintenance of the surgical lamp. Another way is to transmit signals through a wireless network (for example, signal transmission through Bluetooth, Wifi, etc.). In this way, on the one hand, since the compression algorithms during signal processing are lossy, it will affect the image quality and easily cause image distortion. On the other hand, this signal transmission method is significantly affected by the network bandwidth, which easily leads to significant image delay. If the solution of the present invention is applied to surgical lights in the medical field, not only can the various disadvantages of wired connection be avoided, but also the video image data can be converted into non-compressed high-definition video data through the format converter 200, and output in the 5GHz or 60GHz frequency band through the video output device 300 in a wireless data transmission mode. It can effectively improve the authenticity of the image reflecting the scene, and the low latency performance can also timely reflect the degree of the operation at the surgical site. It provides a realistic basis for remote consultation, treatment and teaching.

[0053] In one of the embodiments, the format converter 200 is also used to provide power to the camera module 100. In this embodiment, the format converter 200 is not only connected to the camera module 100 for video data transmission, but also connected to the camera module 100 for power supply. Since the most direct function of the format converter 200 is to convert the video image data acquired by the camera module 100 into uncompressed high-definition video data. Therefore, the physical positions of the two on the device of the present invention are also closer than other functional modules. While the format converter 200 is connected to the camera module 100 for video data transmission, it is also configured to provide power to the camera module 100, thereby making full use of the physical position relationship between the two, making the functional module setting of the device of the present invention more reasonable, and also making the overall structure of the device of the present invention more concise and optimized.

[0054] In one embodiment, if Figure 1As shown, a communication power module 400 is also included. The communication power module 400 is used to provide power to the format converter 200 and the video output device 300. The communication power module 400 is provided with a communication interface for transmitting control instructions to the camera module 100. Generally, when the camera module 100 captures images, it is necessary to make automatic, semi-automatic or passive adjustments according to changes in the captured images, the capture environment, etc., to adapt to the new capture environment and set the corresponding image capture parameters to capture the most preferred and highest definition images. In this embodiment, the camera module 100 obtains control instructions or new adjustment programs from the outside through the communication power module 400 to make adaptive adjustments to the current image capture situation (for example, controlling the camera module 100 to adjust parameters such as focus, zoom in, zoom out, freeze, white balance and aperture).

[0055] In one embodiment, if Figure 1 As shown, a communication power module 400 is also included. The communication power module 400 is used to provide power to the format converter 200 and the video output device 300. The communication power module 400 is provided with a communication interface for feeding back various parameters of the camera module 100. Normally, when the camera module 100 captures images, it is necessary to make automatic, semi-automatic or passive adjustments according to changes in the captured images, the capture environment, etc., so as to adapt to the new capture environment and set the corresponding image capture parameters to capture the most preferred and highest definition images. In this embodiment, the various parameters of the camera module 100 are fed back to the outside through the signal transmission interface so that the various setting parameters during image capture are displayed to the outside or retained for record (for example, the parameters can be output for parameter monitoring, or they can be incorporated into the captured image data).

[0056] In one embodiment, if Figure 1 As shown, a communication power module 400 is also included. The communication power module 400 is used to provide power for the format converter 200 and the video output device 300. The communication power module 400 is provided with a communication interface for transmitting control instructions to the camera module 100 and feedback of various parameters of the camera module 100. Under normal circumstances, when the camera module 100 collects images, it is necessary to make automatic, semi-automatic or passive adjustments according to changes in the collected images, the collection environment, etc., to adapt to the new collection environment and set the corresponding image collection parameters to collect the most preferred and highest definition images. In this embodiment, the camera module 100 obtains control instructions or new adjustment programs from the outside through the communication power module 400 to make adaptive adjustments to the current image collection situation (for example, control the camera module 100 to adjust the focus, zoom in, zoom out, freeze, white balance and aperture parameters). At the same time, the various parameters of the camera module 100 are also fed back to the outside through the signal transmission channel to display or retain the various setting parameters during image collection (for example, the parameters are incorporated into the captured image data).

[0057] In one embodiment, if Figure 2 As shown, the communication power module 400 is provided with a first communication interface 410 and a second communication interface 420. The first communication interface 410 is connected to the camera module 100 to output control instructions to the camera module 100 and / or obtain various parameters of the camera module 100. The second communication interface 420 is externally connected to a signal source to obtain control instructions and / or output various parameters of the camera module 100. Under normal circumstances, when the camera module 100 captures an image, it is necessary to make automatic, semi-automatic or passive adjustments according to changes in the captured image, the capture environment, etc., to adapt to the new capture environment and set the corresponding image capture parameters to capture the most preferred and highest definition image. In this embodiment, the camera module 100 obtains control instructions or new adjustment programs from the outside through the communication power module 400 to make adaptive adjustments to the current image capture situation (for example, controlling the camera module 100 to adjust parameters such as focal length, zoom in, zoom out, freeze, white balance and aperture). At the same time, various parameters of the camera module 100 are also fed back to the outside through the signal transmission channel, so that various setting parameters during image acquisition can be displayed to the outside or retained for record (for example, the parameters can be output for parameter monitoring or compiled into the captured image data). The first communication interface 410 and the second communication interface 420 are signal transmission channel connection ports connecting the camera module 100 and the external control signal source.

[0058] In one embodiment, if Figure 2 As shown, the communication power supply module 400 is provided with a first power input terminal 430, a second power input terminal 450, a first power output terminal 440 and a second power output terminal 460. The first power input terminal 430 and the second power input terminal 450 are both used for external power supply to obtain electric energy. The first power output terminal 440 is used to provide electric energy for the video output device 300. The second power output terminal 460 is used to provide electric energy for the format converter 200. The first power input terminal 430 is connected to the first power output terminal 440 to transmit electric energy. The second power input terminal 450 is connected to the second power output terminal 460 to transmit electric energy. The input voltage of the second power input terminal 450 is greater than the input voltage of the first power input terminal 430. The output voltage of the second power output terminal 460 is greater than the output voltage of the first power output terminal 440.

[0059] In one embodiment, if Figure 2As shown, the communication power supply module 400 is provided with a third power input terminal 470, a first power output terminal 440, a second power output terminal 460, a first power conversion module and a second power conversion module. The third power input terminal 470 is used for an external power supply to obtain electric energy. The first power output terminal 440 is used to provide electric energy for the video output device 300. The second power output terminal 460 is used to provide electric energy for the format converter 200. The first power output terminal 440 is connected to the third power input terminal 470 through the first power conversion module to transmit electric energy. The second power output terminal 460 is connected to the third power input terminal 470 through the second power conversion module to transmit electric energy. The power conversion ratio of the first power conversion module is greater than the power conversion ratio of the second power conversion module, so that the output voltage of the second power output terminal 460 is greater than the output voltage of the first power output terminal 440.

[0060] In one embodiment, the first power conversion module includes an electromagnetic transformer or a resistor. The second power conversion module includes an electromagnetic transformer or a resistor.

[0061] In one embodiment, the camera module 100 is disposed on a medical device.

[0062] In one embodiment, the medical instrument is a surgical light or a laparoscope.

[0063] In one embodiment, the camera module 100 is disposed on the lamp head of the surgical lamp, or on the spring arm of the surgical lamp.

[0064] In one embodiment, if Figure 3 As shown, the camera module 100 is arranged outside the light-transmitting panel of the surgical lamp.

[0065] In one embodiment, if Figure 3 As shown, the communication power module 400 is arranged between the camera module 100 and the light-transmitting panel.

[0066] In one embodiment, if Figure 3 As shown, the format converter 200 is disposed between the rear cover and the light-transmitting panel of the surgical lamp.

[0067] In one embodiment, if Figure 3 As shown, the video output device 300 is arranged outside the rear cover of the surgical lamp.

[0068] In one embodiment, the video image data is in YCbCr format.

[0069] In this embodiment, YCbCr or Y'CbCr is sometimes written as: YCBCR or Y'CBCR. YCbCr or Y'CbCr is a color space. It is usually used for continuous image processing in movies or in digital photography systems. Among them, Y' is the brightness (luma) component of the color, and CB and CR are the concentration offset components of blue and red. It is worth noting that Y' and Y in this embodiment are different, among which Y refers to lumen, which represents the concentration of light and is nonlinear, and is mainly encoded using gamma correction.

[0070] In one of the embodiments, the main sampling formats of the video image data collected by the image acquisition device are YCbCr4:2:0, YCbCr 4:2:2, YCbCr 4:1:1 and YCbCr 4:4:4. Among them, 4:2:0 means that every 4 pixels have 4 brightness components and 2 chrominance components (i.e., YYYYCbCr), that is, only odd scan lines are sampled. It is the most commonly used format for portable video devices (e.g., MPEG-4) and video conferencing (e.g., H.263). 4:2:2 means that every 4 pixels have 4 brightness components and 4 chrominance components (i.e., YYYYCbCrCbCr). It is the most commonly used format for DVD, digital TV, HDTV and other consumer video devices. 4:4:4 means full pixel dot matrix (i.e., YYYYCbCrCbCrCbCr). It is mainly used in high-quality video applications, studios and professional video products. In this case, YCbCr 4:1:1 is more commonly used, which means: each point stores an 8-bit brightness value (that is, Y value), and each 2x2 point stores a Cr and Cb value. Since the human eye is more sensitive to the Y component of the video, after the chrominance component is reduced by subsampling the chrominance component, the naked eye will not be able to detect the change in image quality. Therefore, the original RGB (R, G, B are all 8-bit unsigned) model requires 8x3=24 bits for each point. The solution of the present invention uses video image data in the form of YCbCr or Y'CbCr, which only requires 8+(8 / 4)+(8 / 4)=12 bits, that is, each point occupies 12 bits on average. In this way, the image data is compressed by half. Therefore, such a setting also greatly shortens the time for video data transmission.

[0071] In one embodiment, the video data is high-definition video data in a format suitable for HDMI interface transmission. In this embodiment, since HDMI has a higher bandwidth and the interface becomes smaller, the device of the present invention can obtain more data transmission frequency bands, which helps to avoid or reduce interference in the wireless transmission process and improve the anti-interference performance of wireless transmission in the practical application of the present invention. At the same time, the compact interface also helps to make the volume of the device of the present invention more compact and flexible.

[0072] In one embodiment, the format of the high-definition video data is 1080P, 1080I, 4K or 720P.

[0073] The above device converts the video image data into non-compressed high-definition video data through the format converter 200, and outputs it in at least one frequency band of 5GHz to 60GHz through the video output device 300 in a wireless data transmission mode. On the one hand, the image distortion caused by the compression processing of the video image data is avoided or reduced. On the other hand, the influence caused by the display delay caused by the use of network broadband for data transmission is also avoided. At the same time, the clarity and transmission delay can be effectively improved, and the anti-interference ability is strong. In addition, a higher data transmission rate can be achieved, so that the bandwidth necessary for transmitting high-quality, high-definition uncompressed video can be provided more reliably.

[0074] According to the image acquisition device provided above, the present invention also provides an image data wireless transmission system including the image acquisition device.

[0075] A wireless transmission system for image data, such as Figure 4As shown, it includes a camera module 100, a format converter 200, a video output device 300 and a video receiving device 600. The camera module 100 is used to collect video image data. The format converter 200 is used to convert the video image data into a non-compressed data format, or a data format conversion with a compression rate less than a set threshold, to obtain low-loss video data. The video output device 300 is used to output video data in at least one frequency band of 5GHz to 60GHz in a wireless manner. The video receiving device 600 is used to receive video data. The system of the present invention converts the video image data into non-compressed high-definition video data through the format converter 200, and outputs it in a frequency band of 5GHz or 60GHz through the video output device 300 in a wireless data transmission manner, and transmits non-compressed high-definition video data between the video receiving device 600. Such a setting, on the one hand, avoids or reduces the image distortion caused by the compression processing of the video image data. On the other hand, it also avoids the influence caused by display delay caused by using network broadband for data transmission. At the same time, it can effectively improve the clarity and transmission delay, and has strong anti-interference ability. Additionally, greater data rates can be achieved, more reliably providing the bandwidth necessary to transmit high-quality, high-definition uncompressed video.

[0076] In one embodiment, if Figure 4As shown, a communication power module 400 is also included. The communication power module 400 is used to provide power for the format converter 200 and the video output device 300. The communication power module 400 is provided with a communication interface for transmitting control instructions to the camera module 100 and / or feedback of various parameters of the camera module 100. Under normal circumstances, when the camera module 100 collects images, it is necessary to make automatic, semi-automatic or passive adjustments according to changes in the collected images, the collection environment, etc., to adapt to the new collection environment and set the corresponding image collection parameters to collect the most preferred and highest definition images. In this embodiment, the camera module 100 obtains control instructions or new adjustment programs from the outside through the communication power module 400 to make adaptive adjustments to the current image collection situation (for example, control the camera module 100 to adjust the focus, zoom in, zoom out, freeze, white balance and aperture parameters). At the same time, the various parameters of the camera module 100 are also fed back to the outside through the signal transmission channel to display or retain the various setting parameters during image collection (for example, the parameters are incorporated into the captured image data). In this embodiment, since the format converter 200 and the video output device 300 are mainly functional modules, they mainly undertake functions such as data calculation and processing. The communication task undertaken by the communication power supply module 400 is mainly to transmit control instructions to the camera module 100 and / or feedback various parameters of the camera module 100, and the data to be processed by it is relatively small. Therefore, in the design of the present invention, the communication power supply module 400 is also used as a power supply hub, and the communication power supply module 400 is used to provide power for the format converter 200 and the video output device 300, as well as other modules that may be included. Furthermore, the comprehensive physical position of the communication power supply module 400 in the layout of the entire device module is also closer than that of other functional modules. Therefore, such a setting also makes the functional module setting of the device of the present invention more reasonable, and the overall structure is more concise and optimized.

[0077] In one embodiment, if Figure 2 and Figure 4As shown, an arm control module 500 is also included. The arm control module 500 is connected to the communication power module 400 to transmit control signals and / or obtain various parameters of the camera module 100. In this embodiment, the arm control module 500 is mainly used to control various functional modules, and is usually used as a sending end of control instructions. For example, when the camera module 100 collects images, it is necessary to make automatic, semi-automatic or passive adjustments according to changes in the collected images, the collection environment, etc., to adapt to the new collection environment and set the corresponding image collection parameters to collect the most preferred and highest definition images. In this embodiment, the camera module 100 obtains control instructions or new adjustment programs from the arm control module 500 through the communication power module 400 to make adaptive adjustments to the current image collection situation (for example, control the camera module 100 to adjust the focus, zoom in, zoom out, freeze, white balance and aperture parameters). At the same time, the various parameters of the camera module 100 can also be fed back to the arm control module 500 through the signal transmission channel to display or retain the various setting parameters during image collection.

[0078] In one embodiment, if Figure 2 As shown, the arm control module 500 is also used to provide electrical energy to the communication power module 400 .

[0079] In one embodiment, if Figure 4 As shown, a video output device 300 outputs uncompressed high-definition video data to at least one video receiving device 600. Since the data transceiver module in the system of the present invention adopts a wireless transmission method for data transmission, during the wireless transmission process, through the data transmission protocol, one-to-one transmission between the signal source and the receiving device can be achieved, and one-to-many transmission can also be achieved. For example, the wireless transceiver module establishes a data transmission relationship through a code pairing method. It is only necessary for the wireless receiving module to "remember" the address code of the wireless signal transmitting module. Similarly, other wireless receiving modules can also "remember" the address code of the wireless signal transmitting module through a code pairing method. Therefore, a wireless signal transmitting module can establish a data transmission relationship with one or more wireless receiving modules. In practical applications, it mainly serves to output the information data sent by the same data signal source through multiple video output devices 300. For example, in the medical field, this method can be used to simultaneously present the images of the same surgical field camera on multiple displays.

[0080] In one embodiment, if Figure 5As shown, a video receiving device 600 receives at least one uncompressed high-definition video data output by a video output device 300. Since the data transceiver module in the system of the present invention adopts a wireless transmission method for data transmission, during the wireless transmission process, through the data transmission protocol, one-to-one transmission between the signal source and the receiving device can be achieved, and multiple-to-one transmission can also be achieved. For example, the wireless transceiver module establishes a data transmission relationship through a pairing method. It is only necessary for the wireless receiving module to "remember" the address code of the wireless signal transmitting module. Similarly, the wireless receiving module can also "remember" the address code of other wireless signal transmitting modules through the pairing method. Therefore, a wireless signal receiving module can establish a data transmission relationship with one or more wireless transmitting modules. In practical applications, it mainly plays a role in outputting information data sent by multiple data signal sources through a video output device 300. For example, in the medical field, there may be multiple video data sources collected by cameras in an operating room. Through this method of the present invention, it can be realized through a "picture-in-picture" display mode, and the image screens of multiple video data sources can be displayed on a display device 700 at the same time.

[0081] In one embodiment, if Figure 4 As shown, at least one display device 700 is also included. The display device 700 is connected to the video receiving device 600 to convert the uncompressed high-definition video data into high-definition image driving data for output and display.

[0082] In one embodiment, if Figure 6 As shown, one display device 700 is connected to two or more video receiving devices 600 to present the uncompressed high-definition video data received by the two or more video receiving devices 600 through one display device 700. In this embodiment, one display device 700 establishes a connection relationship with two or more video receiving devices 600 to obtain two or more wireless video data, and then performs overall operation processing on them for output and display. In actual applications, the display device 700 uses a "picture-in-picture" display mode to simultaneously display image screens of multiple video data sources on one display device 700.

[0083] In one embodiment, if Figure 7As shown, a video receiving device 600 is connected to two or more display devices 700 to present the uncompressed high-definition video data received by the same video receiving device 600 through the two or more display devices 700. In this embodiment, the uncompressed high-definition video data received by the same video receiving device 600 can be a collection of uncompressed high-definition video data output by one or two or more wireless video data sending modules. Therefore, the multiple display devices 700 in this embodiment can be images of uncompressed high-definition video data output by one wireless video data sending module, or can be images of uncompressed high-definition video data output by multiple wireless video data sending modules simultaneously displayed on each display device 700 in a "picture-in-picture" display mode.

[0084] The above system converts the video image data into non-compressed high-definition video data through the format converter 200, and outputs it in the frequency band of 5GHz or 60GHz through the video output device 300 in a wireless data transmission mode, and transmits the non-compressed high-definition video data between the video receiving device 600. On the one hand, the image distortion caused by the compression processing of the video image data is avoided or reduced. On the other hand, the influence caused by the display delay caused by the use of network broadband for data transmission is also avoided. At the same time, it can effectively improve the clarity and transmission delay, and has strong anti-interference ability. In addition, it can achieve a higher data transmission rate, so that the bandwidth necessary for transmitting high-quality, high-definition uncompressed video can be provided more reliably.

[0085] In one embodiment, the video output device 300 is provided with a pairing information transmitting unit for transmitting pairing information. The video receiving device 600 is provided with a pairing information receiving unit for receiving pairing information. The pairing information transmitting unit and the pairing information receiving unit are paired through pairing, so that the video output device and the video receiving device establish a video data transmission relationship.

[0086] In one embodiment, the system of the present invention further comprises a central processing unit and a memory. The central processing unit is used to perform comprehensive control on each functional module and functional block. The memory stores a computer program that can be read and executed by the central processing unit to perform comprehensive control on each functional module and functional block.

[0087] According to the image acquisition device provided above, the present invention also provides a low-loss and low-latency wireless transmission method for image data.

[0088] A method for processing image data, comprising:

[0089] Acquired video image data. In this step, the acquired video image data may be first-hand video image data directly acquired by a camera device, or may be existing video image data (ie, video image data that has existed in the past and is stored by a storage device).

[0090] The video image data is converted into a non-compressed data format, or a data format with a compression rate less than a set threshold, to obtain low-loss video data. In this step, since the compression algorithms in the data processing process are lossy, they affect the image quality and may cause image distortion. Therefore, the image data processing process of the method of the present invention does not compress the image data or processes the image data with a compression rate less than a set threshold. The acquired video image data is directly transmitted in the form of non-compressed data or video data with a compression rate less than a set threshold.

[0091] Output video data in at least one frequency band from 5GHz to 60GHz by wireless data transmission. Transmit in the frequency band from 5GHz to 60GHz by wireless data transmission. On the one hand, it avoids or reduces image distortion caused by compression processing of video image data. On the other hand, it also avoids the impact of display delay caused by using network broadband for data transmission. At the same time, its unique algorithm can effectively improve clarity and transmission delay, and has strong anti-interference ability (such as WHDI frequency band). In addition, it can achieve a higher data transmission rate, so as to more reliably provide the bandwidth necessary for transmitting high-quality, high-definition uncompressed video (such as WIHD and WiGig frequency bands).

[0092] Specifically, the method of the present invention includes: obtaining video image data through a camera module. Converting the video image data into a non-compressed data format or a data format with a compression rate less than a set threshold through a format converter to obtain low-loss video data. Outputting the video data in at least one frequency band of 5 GHz to 60 GHz in a wireless data transmission mode through at least one video output device.

[0093] In one of the embodiments, the method further includes: receiving the video data in at least one frequency band of 5 GHz to 60 GHz in a wireless data transmission manner.

[0094] Specifically, the method of the present invention includes: receiving video data in at least one frequency band of 5 GHz to 60 GHz in a wireless data transmission manner through at least one video receiving device 600. The frequency band in which the wireless video data receiving module 600 receives video data is the same as the frequency band in which the video output device 300 outputs video data.

[0095] In one embodiment, the method further includes: the video output device 300 and the video receiving device 600 establish a video data transmission relationship through code pairing.

[0096] In one embodiment, the video output device 300 is provided with a pairing information transmitting unit for transmitting pairing information. The video receiving device 600 is provided with a pairing information receiving unit for receiving pairing information. The pairing information transmitting unit and the pairing information receiving unit are paired through pairing so that the video output device 300 and the video receiving device 600 establish a video data transmission relationship. The method further includes: determining whether the pairing information receiving unit receives the pairing information, and if so, storing the address code of the pairing information transmitting unit corresponding to the pairing information in the pairing information receiving unit to establish a video data transmission relationship between the video output device 300 and the video receiving device 600, and the pairing information receiving unit feeds back a prompt message of successful pairing.

[0097] In one of the embodiments, the method further includes: if the pairing information receiving unit does not receive the pairing information, determining whether the pairing process is within a set time period; if so, continuing the pairing process; otherwise, determining that the pairing has failed, and the pairing information receiving unit feeds back a pairing failure prompt message.

[0098] For example, the following pairing method may be used: comprising steps S110-S140:

[0099] S110: Start the pairing information receiving unit and keep the pairing information receiving unit in the turned-on state within a set time period.

[0100] S120: Determine whether the pairing information receiving unit has received the pairing information, if so, execute step S130, otherwise execute step S140.

[0101] S130: storing the address code of the pairing information sending unit corresponding to the pairing information, and sending a pairing success prompt message.

[0102] S140: Determine whether the code pairing process is within a set time period, if so, execute step S120, otherwise execute step S150.

[0103] S150: Determine that the code pairing fails, and issue a code pairing failure prompt message.

[0104] In one embodiment, the length of the set time period is 30 seconds.

[0105] In one of the embodiments, the code pairing information sending module is started within a set time period and the code pairing information is sent.

[0106] In one embodiment, if Figure 5As shown, the method also includes: a video receiving device 600 establishes a video data transmission relationship with at least one video output device 300 through code pairing. In the wireless transmission process, through the data transmission protocol, one-to-one transmission between the signal source and the receiving device can be achieved, and multiple-to-one transmission can also be achieved. In this embodiment, the video receiving device 600 and the video output device 300 establish a data transmission relationship through code pairing. It is only necessary for the video receiving device 600 to "remember" the address code of the video output device 300. Similarly, the video receiving device 600 can also "remember" the address codes of other video output devices 300 through the code pairing method. Therefore, a video receiving device 600 can establish a data transmission relationship with one or more video output devices 300. In practical applications, it mainly serves to receive information data sent by multiple video output devices 300 through a video receiving device 600. Then it is output to the outside through the terminal video output device 300 connected to the video receiving device 600. For example, in the medical field, there may be multiple video data sources collected by cameras in an operating room. Through the method of the present invention, it is possible to display images of multiple video data sources simultaneously on a display device 700 through a "picture-in-picture" display mode.

[0107] In one embodiment, if Figure 4 As shown, a video output device 300 establishes a data transmission relationship with at least one video receiving device 600 through code pairing. During the wireless transmission process, through the data transmission protocol, one-to-one transmission between the signal source and the receiving device can be achieved, and one-to-many transmission can also be achieved. In this embodiment, the data transmission relationship established by the video receiving device 600 and the video output device 300 is established by the code pairing method. It is only necessary for the video receiving device 600 to "remember" the address code of the video output device 300. Similarly, other video receiving devices 600 can also "remember" the address code of the video output device 300 through the code pairing method. Therefore, a video receiving device 600 can establish a data transmission relationship with one or more video output devices 300. In practical applications, it mainly serves to receive the information data sent by the same video output device 300 through multiple video receiving devices 600. Then it is output to the outside through the terminal video output device 300 connected to the video receiving device 600. For example, in the medical field, this method can be used to realize that the image of the same surgical field camera is presented on multiple displays at the same time.

[0108] In one embodiment, the method further includes: adjusting the transmission power of the wireless data transmission signal to adjust the coverage of the wireless data transmission signal. The signal coverage can be adjusted by setting the power. In practical applications, such as in the medical field, the coverage can be adjusted to only within the operating room according to actual needs.

[0109] In one embodiment, the method further includes: setting a plurality of wireless data transmission frequency bands within the frequency band of 5 GHz to 60 GHz to improve the anti-interference performance of the wireless video data transmission signal between the video output device 300 and the video receiving device 600. The receiving frequency band of the wireless data transmission signal of the video receiving device 600 is the same as the transmitting frequency band of the wireless data transmission signal of the video output device 300 that has been successfully paired. With such a setting, multiple different frequency bands can be used for wireless data transmission within a certain area, thereby reducing interference between the data transmission frequency bands and improving the anti-interference performance of wireless transmission.

[0110] In one embodiment, the method further includes: determining whether the signal strength of the wireless data transmission signal received by the video receiving device is lower than a first set threshold value, and if so, increasing the transmission power of the wireless data transmission signal of the video output device. When any video receiving device 600 and the video output device 300 are successfully paired, both parties will save the identification code of the other party. When the signal between them deteriorates and is lower than the first set threshold value, through dynamic adjustment of power, the video output device 300 will increase the transmission power (the transmission power value is included in the communication protocol between the two parties) to ensure normal communication.

[0111] In one embodiment, the method further includes: determining whether the signal strength of the wireless data transmission signal received by the video receiving device 600 is higher than the second set threshold, and if so, reducing the transmission power of the wireless data transmission signal of the video output device 300. The signal strength of the second set threshold is greater than the signal strength of the first set threshold. When any video receiving device 600 and the video output device 300 are paired successfully, both parties will save the identification code of the other party. When the signal strength between them (meaning that the transmission power of the video output device 300 is too strong at this spatial distance) exceeds a certain value (i.e., the second set threshold), the transmission power of the video output device 300 is reduced (the transmission power value is included in the communication protocol between the two parties) through dynamic power adjustment, and the transmission power value is reduced as much as possible under the premise of ensuring the quality of video transmission, so as to prevent the video output device 300 from being overloaded and improve the service life of the video output device 300. At the same time, it also plays a certain energy-saving role and reduces the adverse effects of signal radiation on the body and electronic components of other devices.

[0112] In one embodiment, the method further includes: determining whether the video receiving device 600 has received the wireless data transmission signal of the second video output device, and if so, reducing the transmission power of the wireless data transmission signal of the video output device 300 paired with the video receiving device 600. The wireless data transmission frequency band of the second video output device is the same as the receiving frequency band of the video receiving device 600, but there is no code pairing relationship between the second video output device and the video receiving device 600. In this embodiment, if the video receiving device 600 simultaneously receives data signals of two wireless video output devices 300 in the same frequency band, but there is no mutually trusted identification code between one of the wireless video output devices 300 and the video receiving device 600. At this time, the video receiving device 600 will send a control instruction to the wireless video output device 300 through the established data transmission relationship, and control the wireless video output device 300 to reduce the transmission power to minimize the interference with other wireless data signals in the same frequency band (the reduced power value will not affect the quality of video transmission). In practical applications, such as in the medical field, this method can effectively reduce the interference of wireless data transmission between different operating rooms.

[0113] The above method converts video image data into non-compressed high-definition video data and transmits it in the frequency band of 5GHz to 60GHz by wireless data transmission. On the one hand, it avoids or reduces the image distortion caused by the compression processing of video image data. On the other hand, it also avoids the impact caused by display delay caused by using network broadband for data transmission. At the same time, it can effectively improve the clarity and transmission delay, and has strong anti-interference ability. In addition, it can achieve a higher data transmission rate, so that it can more reliably provide the bandwidth necessary for transmitting high-quality, high-definition uncompressed video.

[0114] In addition, the present invention also provides a computer-readable storage medium.

[0115] A computer-readable storage medium stores a computer program that can be run on a processor. When the computer program is executed by the processor, the method steps of any of the above method embodiments are implemented.

[0116] According to the above-mentioned computer readable storage medium, the present invention also provides a computer device.

[0117] A computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the method steps of any of the above method embodiments are implemented.

[0118] This document is described with reference to various exemplary embodiments. However, those skilled in the art will recognize that changes and modifications may be made to the exemplary embodiments without departing from the scope of this document. For example, various operating steps and components for performing the operating steps may be implemented in different ways (e.g., one or more steps may be deleted, modified, or incorporated into other steps) depending on the specific application or considering any number of cost functions associated with the operation of the system.

[0119] In addition, as will be appreciated by those skilled in the art, the principles of the present invention may be reflected in a computer program product on a computer-readable storage medium, which is pre-installed with a computer-readable program code. Any tangible, non-temporary computer-readable storage medium may be used, including magnetic storage devices (hard disks, floppy disks, etc.), optical storage devices (CD-ROMs, DVDs, Blu Ray disks, etc.), flash memory, and / or the like. These computer program instructions may be loaded onto a general-purpose computer, a special-purpose computer, or other programmable data processing device to form a machine, so that these instructions executed on a computer or other programmable data processing device may generate a device that implements a specified function. These computer program instructions may also be stored in a computer-readable memory, which may instruct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory may form a manufactured product, including an implementation device that implements a specified function. The computer program instructions may also be loaded onto a computer or other programmable data processing device, so that a series of operating steps are performed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device may provide steps for implementing a specified function.

[0120] Although the principles of this invention have been shown in various embodiments, many modifications of structures, arrangements, proportions, elements, materials and components particularly suitable for specific environments and operational requirements can be used without departing from the principles and scope of this invention. The above modifications and other changes or amendments will be included in the scope of this invention.

[0121] The foregoing specific description has been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes can be made without departing from the scope of the present disclosure. Therefore, the consideration of the present disclosure will be illustrative rather than restrictive, and all these modifications will be included in its scope. Similarly, the advantages, other advantages and solutions to the problems of various embodiments have been described above. However, the benefits, advantages, solutions to the problems and any elements that can produce these, or make them more clear, should not be interpreted as critical, necessary or necessary. The term "include" and any other variants used in this article are all non-exclusive inclusions, so that the process, method, article or device including the list of elements not only includes these elements, but also includes other elements that are not explicitly listed or do not belong to the process, method, system, article or device. In addition, the term "coupled" and any other variants used in this article refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections and / or any other connections.

[0122] Those skilled in the art will appreciate that many changes may be made to the details of the above-described embodiments without departing from the basic principles of the invention. Therefore, the scope of the present invention should be determined solely by the following claims.

Claims

1. A surgical procedure video image data processing system, characterized in that: It includes a camera module, a format converter, at least one video output device, at least one video receiving device and a processor; The camera module is used to collect video image data of the surgical process, and the camera module is arranged on the medical device; The format converter is used to convert the format of the surgical process video image data, and the format conversion is used for non-compressed data processing or data processing with a compression rate less than a set threshold; At least one of the video output devices wirelessly transmits the format-converted surgical process video image data through at least one frequency band in the frequency band of 5 GHz to 60 GHz; At least one of the video receiving devices is used to receive the surgical procedure video image data after the wireless transmission; The processor is configured to determine whether the received surgical process video image data meets a preset quality condition after the video receiving device receives the surgical process video image data after the wireless transmission, and if the received surgical process video image data does not meet the preset quality condition, adjust the sending frequency band of the video output device and the receiving frequency band of the video receiving device, so that at least one video output device wirelessly transmits the surgical process video image data after the format conversion through the adjusted frequency band in the frequency band of 5 GHz to 60 GHZ, and enables at least one video receiving device to receive the surgical process video image data transmitted through the adjusted frequency band; It also includes: a communication interface for receiving control instructions for the camera module or feeding back parameter information of the camera module, and a power supply circuit for supplying power to the format converter and / or the video output device.

2. The system according to claim 1, characterized in that Also comprising at least one display device; The display device is used to display the received surgical procedure video image data.

3. The system according to claim 1 or 2, characterized in that: The format of the surgical process video image data acquired by the camera module is YCbCr.

4. The system according to claim 1 or 2, characterized in that: The format of the surgical process video image data after format conversion is 1080P, 1080I, 4K or 720P.

5. The system according to claim 1 or 2, characterized in that: It also includes a communication interface for receiving control instructions for the camera module or feeding back parameter information of the camera module; and a power supply circuit for supplying power to the format converter and / or the video output device; The communication interface and the power supply circuit are arranged on a circuit board; or the communication interface, the power supply circuit and the format converter are arranged on a circuit board.

6. The system according to claim 1 or 2, characterized in that: The camera module is arranged on the lamp head of the surgical lamp; the format converter is arranged between the lamp head of the surgical lamp and the rear cover of the surgical lamp; and the video output device is arranged on the rear cover of the surgical lamp.

7. The system according to claim 1 or 2, characterized in that: It also includes a shell, in which a camera module, the format converter and a video output device are arranged; the shell is arranged on the lamp head of the surgical lamp or on the spring arm of the surgical lamp.

8. The system according to claim 1 or 2, characterized in that: The video output device includes a pairing information transmitter for sending pairing information, and the video receiving device includes a pairing information receiver, which is used to receive the pairing information, store the address code of the pairing information transmitter corresponding to the pairing information, and send a pairing success prompt message to the pairing information transmitter.

9. The system according to claim 1 or 2, characterized in that: The video receiving device includes a pairing information transmitter for sending pairing information; the video output device includes a pairing information receiver, which is used to receive the pairing information, store the address code of the pairing information transmitter corresponding to the pairing information, and send a pairing success prompt message to the pairing information transmitter.

10. The system according to claim 1 or 2, characterized in that: It also includes a processor for determining whether the received surgical process video image data meets a preset quality condition after the video receiving device receives the surgical process video image data after the wireless transmission, and if the surgical process video image data meets the preset quality condition, enabling at least one display device to display the received surgical process video image data.

11. The system according to claim 1 or 2, characterized in that: The sampling formats of the video image data collected by the camera module include YCbCr 4:2:0, YCbCr 4:2:2, YCbCr 4:1:1 and YCbCr4:4:

4.

12. The system according to claim 1 or 2, characterized in that: The system also includes a processor, which is used to determine whether the received video image data of the surgical process sent through the adjusted frequency band meets the preset quality conditions after the video receiving device receives the surgical process video image data after the wireless transmission, and if the received video image data of the surgical process sent through the adjusted frequency band does not meet the preset quality conditions, adjust the transmission power of the video output device so that at least one video output device performs wireless transmission with the adjusted transmission power.

13. The system according to claim 1 or 2, characterized in that: It also includes a processor, which is used to determine the transmission power of the video output device according to the distance or position relationship between the video output device and the video receiving device, so that at least one video output device sends the surgical process video image data after the format conversion at the transmission power and wirelessly transmits it through at least one frequency band in the frequency band of 5GHz to 60GHZ.

14. A method for processing video image data of a surgical procedure, characterized in that: The method comprises: Collecting video image data of the surgical process through a camera module, wherein the camera module is arranged on the medical device; Converting the video image data of the surgical process into a format using a format converter, wherein the format conversion is performed for uncompressed data processing or data processing with a compression rate less than a set threshold; Wirelessly transmitting the format-converted surgical process video image data through at least one frequency band in a range of 5 GHz to 60 GHZ through at least one video output device; Receiving the surgical procedure video image data after the wireless transmission through at least one video receiving device; Determining whether the received surgical procedure video image data meets a preset quality condition; If the received surgical process video image data does not meet the preset quality conditions, the sending frequency band of the video output device and the receiving frequency band of the video receiving device are adjusted, and the surgical process video image data after the format conversion is wirelessly transmitted through the adjusted frequency band in the frequency band of 5GHz to 60GHZ through at least one video output device, and the surgical process video image data transmitted through the adjusted frequency band is received by at least one video receiving device.

15. The method according to claim 14, characterized in that Also includes, The received surgical procedure video image data is displayed via at least one display device.

16. The method according to claim 14 or 15, characterized in that The format of the surgical process video image data acquired by the camera module is YCbCr.

17. The method according to claim 14 or 15, characterized in that The format of the surgical process video image data after format conversion is 1080P, 1080I, 4K or 720P.

18. The method according to claim 14 or 15, characterized in that Before receiving the surgical procedure video image data after the wireless transmission by at least one video receiving device, the method further includes: The at least one video receiving device is paired with the at least one video output device; The step of receiving the surgical procedure video image data after the wireless transmission by at least one video receiving device comprises: If the at least one video receiving device is successfully paired with the at least one video output device, the surgical process video image data after the wireless transmission is received by the at least one video receiving device.

19. The method according to claim 18, characterized in that The video receiving device includes a pairing information receiver, the video output device includes a pairing information transmitter, and the video receiving device performs pairing with the video output device, including: Sending the pairing information through the pairing information transmitter; Determining whether the pairing information receiver has received the pairing information; If the pairing information receiver receives the pairing information, the address code of the pairing information transmitter corresponding to the pairing information is stored, and a pairing success prompt message is sent to the pairing information transmitter.

20. The method according to claim 18, characterized in that The video output device includes a pairing information receiver, the video receiving device includes a pairing information transmitter, and the video receiving device performs pairing with the video output device, including: Sending the pairing information through the pairing information transmitter; Determining whether the pairing information receiver has received the pairing information; If the pairing information receiver receives the pairing information, the address code of the pairing information transmitter corresponding to the pairing information is stored, and a pairing success prompt message is sent to the pairing information transmitter.

21. The method according to claim 19 or 20, characterized in that Also includes: If the pairing information receiver does not receive the pairing information, determining whether the pairing time meets a preset time condition; If the time of the code pairing meets the preset time condition, the code pairing is performed again.

22. The method according to claim 14 or 15, characterized in that After receiving the surgical procedure video image data after the wireless transmission through at least one video receiving device, the method further includes: Determining whether the received surgical procedure video image data meets a preset quality condition; If the received surgical procedure video image data meets the preset quality condition, the received surgical procedure video image data is displayed through at least one display device.

23. The method according to claim 14 or 15, characterized in that The sampling formats of the video image data collected by the camera module include YCbCr 4:2:0, YCbCr 4:2:2, YCbCr 4:1:1 and YCbCr4:4:

4.

24. The method according to claim 14 or 15, characterized in that After receiving the surgical procedure video image data after the wireless transmission through at least one video receiving device, the method further includes: Determining whether the received surgical procedure video image data sent through the adjusted frequency band meets a preset quality condition; If the received surgical process video image data transmitted through the adjusted frequency band does not meet the preset quality condition, the transmission power of the video output device is adjusted, and wireless transmission is performed through at least one video output device with the adjusted transmission power.

25. The method according to claim 14 or 15, characterized in that Also includes: Determining the transmission power of the video output device according to the distance or position relationship between the video output device and the video receiving device; The step of wirelessly transmitting the format-converted surgical process video image data through at least one frequency band in a frequency band of 5 GHz to 60 GHZ through at least one video output device comprises: The format-converted surgical process video image data is transmitted at the transmission power through at least one video output device and wirelessly transmitted through at least one frequency band in a frequency band of 5 GHz to 60 GHZ.

Citation Information

Patent Citations

  • Image processing system and transmission method capable of transmitting image in 360 DEG by utilizing millimetre wave

    CN107979734A

  • Operation process video image data process system

    CN208581314U