Unlock instant, AI-driven research and patent intelligence for your innovation.

Operation video three-dimensional reconstruction method and device, equipment and storage medium

A technology of 3D reconstruction and surgical video, which is applied in the field of video processing and can solve problems such as inability to record effectively and completely

Pending Publication Date: 2022-03-18
桑瑞思医疗科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Therefore, the present application aims to solve the technical problem that the entire surgical process cannot be effectively and completely recorded by taking pictures from a single perspective, thereby providing a method, device, equipment, and storage medium for three-dimensional reconstruction of surgical video. The technical solution is as follows:

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Operation video three-dimensional reconstruction method and device, equipment and storage medium
  • Operation video three-dimensional reconstruction method and device, equipment and storage medium
  • Operation video three-dimensional reconstruction method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] This embodiment provides a method for three-dimensional reconstruction of surgical video, figure 1 It is a flow chart illustrating three-dimensional reconstruction of a video captured by a video capture matrix according to some embodiments of the present application. Although the processes described below include operations in a particular order, it should be clearly understood that these processes may also include more or fewer operations, which may be performed sequentially or in parallel (e.g., using parallel processors) or multi-threaded environment).

[0055] Such as figure 2 As shown, it is a schematic structural diagram of the video acquisition matrix. In this embodiment, the video acquisition matrix is ​​used to record the operation process. The video acquisition matrix includes a reference camera 101 and a plurality of acquisition cameras 102 , and the plurality of acquisition cameras 102 surround the reference camera 101 . During the video recording of the...

Embodiment 2

[0101] This embodiment provides an apparatus for three-dimensional reconstruction of surgical video, and the apparatus may be a computer device, or may be set in the computer device. It includes a video acquisition matrix, the video acquisition matrix includes a reference camera and multiple acquisition cameras, the multiple acquisition cameras surround the reference camera, and the video acquisition matrix is ​​located above the patient's operation site. Such as Figure 6 As shown, the device includes: a first acquisition module 301 , a second acquisition module 302 , a third acquisition module 303 and a reconstruction module 304 .

[0102] The first acquisition module 301 is configured to acquire the image taken by the reference camera when the operation is not started, the image taken includes the operation site layer, and the image of the operation site layer is used as the reference image; for details, please refer to Embodiment 1 The related descriptions will not be rep...

Embodiment 3

[0118] This embodiment provides a computer device, such as Figure 7 As shown, the computer device includes a processor 401 and a memory 402, wherein the processor 401 and the memory 402 can be connected by a bus or other methods, Figure 7 Take connection via bus as an example.

[0119] The processor 401 may be a central processing unit (Central Processing Unit, CPU). The processor 401 can also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), graphics processors (Graphics Processing Unit, GPU), embedded neural network processors (Neural-network Processing Unit, NPU) or other Dedicated deep learning coprocessor, application specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components and other chips, or a combination of the above-mentioned...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the field of video processing, in particular to an operation video three-dimensional reconstruction method and device, equipment and a storage medium, and the method comprises the steps: obtaining an image shot by a reference camera when an operation is not started, the shot image comprises an operation part layer, and taking the image of the operation part layer as a reference image; an image shot by the reference camera in the operation process of an operator is obtained and serves as a first reconstructed image; the first reconstructed image comprises an operator head layer; images shot by a plurality of acquisition cameras in the operation process of the operator are obtained and serve as second reconstructed images; the second reconstructed image comprises a hand layer or a surgical site layer of the operator; and based on the reference image, the operator head layer in the first reconstructed image, and the operator hand layer or the operation part layer in the second reconstructed image, performing three-dimensional reconstruction to obtain an operation video of the corresponding part. The whole operation process is effectively and completely recorded, so that effective operation demonstration teaching, postoperative backtracking and / or operation guidance and the like are realized.

Description

technical field [0001] The present application relates to the field of video processing, in particular to a method, device, equipment and storage medium for three-dimensional reconstruction of surgical video. Background technique [0002] There is a need to record video images during surgery for demonstration teaching, postoperative retrospective and / or remote surgical guidance, etc. In order to take pictures of the surgery, an independent surgical camera / camera arm is generally installed in the operating room, and the operation process can be recorded by controlling the mechanical components, or the nursing staff can hold the camera to take pictures. [0003] Existing camera devices can only take pictures from a single angle of view. During the operation, most of the time, only the head, hands or back of the surgeon can be photographed, and the patient's surgical site and the operation of the surgeon cannot be photographed. Effective surgical demonstration teaching, post-o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N13/268H04N13/243H04N5/247H04N5/265H04N5/76
CPCH04N13/268H04N13/243H04N5/265H04N5/76H04N23/90
Inventor 王小斐俞涛
Owner 桑瑞思医疗科技有限公司