Open surgery space pose indicator based on visual recognition
By using a vision-based open surgical space pose indicator with QR codes and laser pointers, the surgical video recording equipment can autonomously adjust its angle within a sterile area, solving the problem of difficult adjustment of existing equipment and improving recording efficiency and ease of operation.
Patent Information
- Application Number
- CN202411956922.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-29
- Publication Date
- 2025-11-18
- Estimated Expiration
- 2044-12-29
AI Technical Summary
Existing surgical video recording equipment has difficulties in adjusting the shooting angle, especially in the sterile environment of the operating room, where the surgeon cannot adjust it himself, resulting in poor video recording quality.
An open surgical space pose indicator based on visual recognition was designed. It uses a QR code shell and an indicator handle, and points a laser light at the desired target. Combined with a wireless communication module and surgical video recording equipment, it automatically adjusts the shooting angle and position.
It allows surgeons to independently adjust the shooting position and angle within a sterile area, simplifying the operation process, improving recording efficiency, meeting the sterile requirements of the operating room, and requiring no assistance from others; the operation is simple and intuitive.
Smart Images

Figure CN119908852B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of clinical medical teaching instruments, specifically to an open surgical space pose indicator based on visual recognition. Background Technology
[0002] With the continuous development of modern medical technology, more and more information technology equipment is being introduced into surgical operating rooms, including surgical video recording equipment. This type of equipment is mainly used to film the surgeon's surgical process and record surgical procedures. Furthermore, due to the continuous development of 5G communication technology, the transmission speed of video information has greatly improved, no longer limited by spatial distance. Surgical videos can also be used for remote consultations to address the problem of uneven distribution of surgical resources across different regions. However, to achieve all these functions, high-definition, unobstructed, and appropriately angled surgical videos are required, and existing surgical video recording equipment struggles to meet these requirements.
[0003] Most surgical video recording devices currently in use require manual adjustment of the shooting angle. However, due to the sterile requirements of the operating room, the surgeon is often unable to adjust the angle themselves and needs the assistance of nurses. This method of assisted shooting often results in the recorded surgical video failing to highlight the key points. Furthermore, some surgical video recording devices are difficult to operate and require a certain level of prior training, making them inconvenient for medical staff to use. Summary of the Invention
[0004] To address the difficulty in adjusting the shooting angle of surgical video recording equipment, this invention proposes an open surgical space pose indicator based on visual recognition, enabling the surgeon to conveniently and quickly control the shooting position and angle of the surgical video recording equipment within the sterile surgical area.
[0005] This invention discloses a visual recognition-based open surgical space pose indicator, comprising a QR code housing and an indicator handle. The QR code housing is a hollow frustum structure, with a QR code pattern attached to the upper surface and four sides of the frustum structure. The surgical video recording device obtains the desired shooting pose through the QR code pattern, adjusts the camera pose, and captures the desired target. The indicator handle has a battery compartment, a laser light, laser light control buttons, and a power control switch mounted on a handle bracket. The indicator handle also includes a handle housing and a handle battery housing. The hardware circuit of the pose indicator includes an indicator wireless communication module, an indicator main control board, and an indicator button control board.
[0006] The upper end of the handle bracket is a platform with a central through hole. The indicator wireless communication module and the indicator main control board are placed on the platform and installed inside the QR code shell. The power connection lines of the indicator wireless communication module and the indicator main control board are connected to the battery compartment of the handle bracket through the central through hole. The platform is fixedly connected to the bottom of the QR code shell and the contact is sealed, so that the hardware circuit inside the QR code shell is isolated from the outside.
[0007] The indicator button control board is connected to the indicator main control board, the laser light control button, and the power control switch. It identifies the button information of the laser light control button and the power control switch and sends it to the indicator main control board. The laser light control button is used to control the laser light to turn on and off. When the laser light is on, the operator moves the pose indicator to point to the desired target so that the laser point falls on the desired shooting position.
[0008] The indicator's main control board integrates a buzzer to process received button information, including: when receiving button information for the power control switch, controlling the activation and deactivation of the posture indicator, and prompting successful activation via the buzzer; when receiving button information for the laser light control button, if the button information for activating the laser light is received, controlling the laser light to illuminate; if the button information for activating the laser light is received, sending the posture indicator's recognition command to the surgical video recording device via the indicator's wireless communication module, and controlling the laser light to turn off.
[0009] The handle housing is provided with mounting holes for a laser light, a laser light control button, and a power control switch. Sealing adhesive is applied to the contact surface where the handle housing is assembled to the handle bracket to isolate the hardware circuitry inside the handle housing from the outside world.
[0010] The advantages and positive effects of this invention are as follows:
[0011] (1) The posture indicator of the present invention takes into account the usage conditions of medical staff when it is designed, so that its structure meets the requirements of disinfection treatment. The surgeon can use it directly in the sterile area of the operating room after the posture indicator is disinfected, and adjust the shooting position and angle independently without the assistance of others, thus improving efficiency.
[0012] (2) The pose indicator of this invention has very few buttons, only two, making it simple to control and operate. It is easy for medical staff to quickly learn and use without prior training.
[0013] (3) The pose indicator of the present invention can directly reflect the spatial position of the target to be photographed and the desired shooting angle. It is simple and intuitive to operate and easy for medical staff to use. Using the pose indicator of the present invention, the operator can control the shooting position and angle without touching the surgical video recording equipment, which meets the sterile requirements of the operating room.
[0014] (4) The QR code pattern on the surface of the posture indicator of the present invention is treated with a special matte paint, which will not cause glare under the strong light of the operating room. The posture indicator of the present invention uses QR codes to assist the surgical video recording equipment in shooting and positioning. The surgical video recording equipment automatically positions the shooting angle by recognizing the QR code on the indicator, which solves the current problem of difficulty in adjusting the shooting angle.
[0015] (5) The posture indicator of the present invention has a built-in power supply and wireless communication module, which does not require any external cables and is convenient to use. The QR code shell of the posture indicator is designed with the hand holding method of medical staff in mind, and has a specific tilt angle to record the most QR codes and improve recognition accuracy. Attached Figure Description
[0016] Figure 1 This is an isometric view of the pose indicator according to an embodiment of the present invention;
[0017] Figure 2 This is an isometric view of the composition structure of the pose indicator according to an embodiment of the present invention;
[0018] Figure 3 This is a left view of the composition structure of the pose indicator according to an embodiment of the present invention;
[0019] Figure 4 This is a rendering of the pose indicator according to an embodiment of the present invention;
[0020] In the diagram: 1-QR code housing, 2-Indicator wireless communication module, 3-Indicator handle housing, 4-Laser light, 5-Indicator handle battery housing, 6-Indicator battery, 7-Laser light control button, 8-Power control switch, 9-Indicator button control board, 10-Indicator handle bracket, 11-Battery spring, 12-Indicator main control board. Detailed Implementation
[0021] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments.
[0022] This invention addresses the problems of existing surgical video recording equipment by providing a handheld posture indicator. This indicator meets hospital sterilization requirements. After sterilization, the surgeon can hold the posture indicator and move it to the sterile area of the operating room, controlling it to point at the desired target at the desired shooting angle. Then, by pressing a designated button, the posture indicator sends a command to the surgical video recording equipment. Finally, the surgical video recording equipment recognizes the posture of the indicator and controls the camera to capture the desired target. This handheld, small posture indicator solution solves the problem of difficult shooting angle adjustment in existing surgical video recording equipment, which prevents the surgeon from directly adjusting the angle.
[0023] like Figure 1-3 As shown, the overall structure of the pose indicator in this embodiment mainly includes a QR code housing 1 and an indicator handle; the indicator handle consists of three parts: an indicator handle bracket 10, an indicator handle housing 3, and an indicator handle battery housing 5. Inside the QR code housing 1, an indicator wireless communication module 2 and an indicator main control board 12 are installed. A laser light 4, a battery, a laser light control switch, and a main power control switch are installed on the indicator handle.
[0024] In the pose indicator, the main component related to visual processing is the QR code housing 1. The basic shape of the QR code housing 1 is a hollow frustum, with five faces on which QR codes are drawn. The QR codes used are AprilTag tags. By acquiring and processing images of these QR code tags using surgical video recording equipment, the pose of the indicator in three-dimensional space can be calculated. Figure 1-4 As shown, the QR code shell 1 of this embodiment has a QR code attached to its upper surface and four sides. The QR code shell 1 of this embodiment is processed based on a truncated pyramid structure. Excess area of the trapezoidal side is removed from each edge of the side, transforming the trapezoid into a square for attaching the square QR code, while also reducing the volume of the truncated pyramid. The beveled design of the truncated pyramid in the QR code shell 1 of this invention takes into account the way medical personnel hold the device and the fact that surgical video acquisition equipment is often located above the surgical space, giving the QR code a specific tilt angle. This allows the surgical video recording equipment to record the maximum number of QR codes, improving recognition accuracy. Simultaneously, to ensure the indicator's compact size, the tilt angle should not be too large; 10° is suitable. The QR code pattern of this invention uses a special matte spray paint treatment, preventing glare under the strong light of the operating room.
[0025] like Figure 1-2As shown, the upper end of the indicator handle bracket 10 is a platform with a central through hole, which is fixedly connected to the bottom of the QR code housing 1. The indicator wireless communication module 2 and the indicator main control board 12 are located above the platform and installed on the top surface inside the QR code housing 1. The power connection lines of the indicator wireless communication module 2 and the indicator main control board 12 are connected to the power supply of the handle bracket through the central through hole. After the upper end of the handle bracket 10 is fixedly connected to the bottom of the QR code housing 1, the contact surface is sealed to isolate the hardware circuitry inside the QR code housing 1 from the outside.
[0026] The pose indicator is controlled by two buttons: a laser light control button 7 and a power control switch 8. The laser light control button 7 controls the on / off state of the laser light 4. Located at the bottom of the indicator handle, the laser light 4 emits a green laser dot, helping the user determine if they are correctly pointing to the desired shooting position. The power control switch 8 controls the power on / off state of the entire pose indicator. Openings for the two buttons 7 and 8 and the laser light 4 are provided at corresponding positions on the indicator handle housing 3 for assembly. After assembly, the contact surfaces between the housing 3 and the indicator handle bracket 10 are sealed with sealant.
[0027] The hardware circuit of the indicator mainly consists of an indicator wireless communication module 2, an indicator main control board 12, an indicator button control board 9, a battery spring 11, and an indicator battery 6. The indicator main control board 12 processes the information transmitted and received by the posture indicator and also integrates a buzzer that emits a specified prompt tone to indicate the control status of the posture indicator. The indicator wireless communication module 2 is used for communication between the posture indicator and the surgical video recording device. The indicator button control board 9 is connected to the indicator main control board 12, the laser light control button 7, and the power control switch 8. The indicator button control board 9 identifies the button information of the posture indicator and sends it to the indicator main control board 12 for processing. The battery spring 11 is located in the battery compartment for easy removal and installation of the battery by the user. The indicator battery 6 in this embodiment uses a 14500 lithium battery with a supply voltage of 3.7V.
[0028] The indicator button control board 9 identifies the button information of the pose indicator and sends it to the indicator main control board 12. The button information includes which button was pressed or released, and the duration of the press. In this embodiment of the invention, the main control board 12 is pre-set with button information for starting and stopping the pose indicator, button information for illuminating the laser light 4, button information for positioning the laser light 4, and corresponding processing operations for the button information. The indicator button control board 9 sends the identified button information to the main control board 12 for processing. When the main control board 12 receives the power control switch 8's "on" button information, it starts the pose indicator and provides a prompt via a buzzer. When it receives the power control switch 8's "off" button information, it turns off the pose indicator. When the main control board 12 receives the laser light 4's "on" button information, it controls the laser light 4 to illuminate. When it receives the laser light 4's "positioned" button information, it sends an identification command to the surgical video recording device and simultaneously controls the laser light 4 to turn off.
[0029] The pose indicator's recognition command is used to notify the surgical video recording equipment that the indicator is now correctly pointing at the target and that the QR code pattern on the indicator can be recognized. The pose indicator continuously sends recognition commands to the surgical video recording equipment from the moment the transmission is initiated until it receives a confirmation message from the equipment that the recognition command has been successfully received. This communication method ensures that the pose indicator's recognition commands are always transmitted to the surgical video recording equipment.
[0030] In this embodiment of the invention, when the device is powered off, pressing and holding the power control switch will start the device; when the device is powered on, pressing and holding the power control switch will turn the device off; when the laser light is off, pressing the laser light control button briefly will turn the laser light on; when the laser light is on, pressing the laser light control button briefly will turn the laser light off; when the laser light is on, pressing and holding the laser light control button will send a recognition command to the surgical video recording device.
[0031] The overall structure of the posture indicator is connected and fixed by bolts. Sealing rings are installed on the contact surfaces of each component for isolation. Sealing glue is also applied to the contact surfaces of the indicator handle bracket 10 and the indicator handle housing 3 to isolate the external environment and prevent it from affecting the internal circuit hardware during disinfection.
[0032] like Figure 4 The image shown is a rendering of a pose indicator obtained in an embodiment of the present invention.
[0033] One step in using the pose indicator according to an embodiment of the present invention is as follows:
[0034] (1) The operator presses and holds the power control switch 8 of the posture indicator for three seconds until the posture indicator emits a "beep beep beep" prompt sound, and then releases the switch. At this time, the posture indicator has been started normally. The operation to turn off the posture indicator is the same.
[0035] (2) When the operator briefly presses the laser light control button 7 on the posture indicator, the laser light 4 at the bottom of the posture indicator lights up and emits a green laser dot.
[0036] (3) The operator holds the position indicator and points it at the desired shooting angle to the desired shooting target, so that the green laser dot falls on the desired shooting position. This means that the position indicator is correctly pointing to the shooting target.
[0037] (4) After confirming that the pose indicator is correctly pointing to the target, press and hold the laser light control button 7 until the pose indicator emits a "beep beep" prompt sound, then release it. At this time, the laser light 4 at the bottom of the pose indicator will also turn off automatically, and the recognition command of the pose indicator has been sent to the surgical video recording device.
[0038] The surgical video recording device obtains the desired shooting pose by recognizing the QR code on the pose indicator, controls the camera movement, and captures the desired target.
[0039] Except for the technical features described in the specification, all other technologies are known to those skilled in the art. Descriptions of well-known components and technologies are omitted in this invention to avoid redundancy and unnecessary limitation. The embodiments described above do not represent all embodiments consistent with this application. Various modifications or variations that can be made by those skilled in the art without creative effort based on the technical solutions of this invention are still within the protection scope of this invention.
Claims
1. A visual recognition-based open surgical space pose indicator, characterized in that, The indicator includes a QR code housing and an indicator handle. The QR code housing is a hollow frustum structure, with a QR code pattern attached to the upper surface and four sides of the frustum structure. The surgical video recording device obtains the desired shooting pose through the QR code pattern, adjusts the camera pose, and captures the desired target. The indicator handle has a battery compartment, a laser light, laser light control buttons, and a power control switch on its handle bracket. The indicator handle also includes a handle housing and a handle battery housing. The hardware circuit of the pose indicator includes an indicator wireless communication module, an indicator main control board, and an indicator button control board. The upper end of the handle bracket is a platform with a central through hole. The indicator wireless communication module and the indicator main control board are placed on the platform and installed inside the QR code shell. The power connection lines of the indicator wireless communication module and the indicator main control board are connected to the battery compartment of the handle bracket through the central through hole. The platform is fixedly connected to the bottom of the QR code shell and the contact surface is sealed to isolate the hardware circuit inside the QR code shell from the outside. The indicator button control board is connected to the indicator main control board, the laser light control button, and the power control switch. It identifies the button information of the laser light control button and the power control switch and sends it to the indicator main control board. The laser light control button is used to control the laser light to turn on and off. When the laser light is on, the operator moves the pose indicator to point to the desired target so that the laser point falls on the desired shooting position. The indicator's main control board integrates a buzzer to process the received button information, including: when receiving button information from the power control switch, controlling the activation and deactivation of the posture indicator, and prompting successful activation through the buzzer after successful activation; When receiving button information from the laser light control button, if the button information is received to turn on the laser light, the laser light is turned on; if the button information is received that the laser light has been positioned, the recognition command of the pose indicator is sent to the surgical video recording device through the indicator wireless communication module, and the laser light is turned off. The handle housing is provided with mounting holes for a laser light, a laser light control button, and a power control switch. Sealing adhesive is applied to the contact surface between the handle housing and the handle bracket to isolate the hardware circuitry inside the handle housing from the outside world.
2. The pose indicator according to claim 1, characterized in that, The QR code shell is made by further processing the structure of a regular square truncated pyramid, so that the trapezoidal side shape becomes a square.
3. The pose indicator according to claim 1, characterized in that, The QR code shell has a truncated pyramid structure with a side tilt angle of 10°.
4. The pose indicator according to claim 1, characterized in that, The QR code pattern has a matte finish.
5. The pose indicator according to claim 1, characterized in that, The indicator main control board continuously sends recognition commands to the surgical video recording device after recognizing the button information where the laser light has been positioned, until it receives a message from the surgical video recording device indicating successful reception, at which point it stops sending recognition commands.
6. The pose indicator according to claim 1, characterized in that, The posture indicator, when powered off, can be turned on by pressing and holding the power control switch; when powered on, it can be turned off by pressing and holding the power control switch; when the laser light is off, the laser light control button can be turned on by pressing briefly; when the laser light is on, the laser light control button can be turned off by pressing briefly; when the laser light is on, the indicator sends a recognition command to the surgical video recording device by pressing and holding the laser light control button.
Citation Information
Patent Citations
Monocular 6D pose estimation method based on regular octahedron
CN112734844A
Robot and two-dimensional code pose detection method
CN114619441A