Operating room communication method and communication system based on instant image
By adopting the separation acquisition and transmission of video and audio in the operating room communication system, combined with retained features and interval compression technology, the problem of communication instability is solved, and efficient information transmission is achieved in hospital scenarios.
Patent Information
- Application Number
- CN202411585674.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-08
- Publication Date
- 2024-12-13
- Estimated Expiration
- 2044-11-08
AI Technical Summary
In hospital use scenarios, unstable communication in the operating room communication system will lead to low information reach efficiency and even return to human-to-person communication. Further research is still needed to solve this problem.
The operating room communication method based on instant images is adopted to collect and transmit video and audio separately, and combine the retained feature compression and interval compression to dynamically compress data to ensure the stability of video communication. Specific measures include collecting video streams and audio streams on the communication side, testing information fluency, selecting compression methods based on fluency values, using retained feature compression to perform intermittent background data acquisition at the communication side where the video stream is generated, and using interval compression Virtually compensates the background data at the communication end pointed to by the video stream.
It ensures the stability and efficiency of video communication under unstable network conditions, avoids communication back to human-to-person communication, and improves the convenience and efficiency of information access.
Smart Images

Figure CN119135826A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and in particular to an operating room communication method and communication system based on real-time images. Background Art
[0002] The operating room communication system is centered on information integration, integrating various independent medical devices and medical information on a unified digital medical information platform through hospital information systems (such as HIS, PACS, etc.). The system not only supports real-time video communication and voice intercom inside and outside the operating room, but also has functions such as data sharing, recording, and remote surgical guidance, providing medical staff with a convenient, intuitive, and efficient way of communication. For example, you can communicate directly with the patient before the operation, and you can also communicate directly with the patient's family during the operation. This direct communication method can effectively reduce the difficulty of communication and make it easier to reach important information.
[0003] Currently, there are two ways to establish communication methods: relying on own services and using third-party services (such as using instant messaging software). Using third-party services is more convenient and does not require additional software installation.
[0004] However, in hospital scenarios, it is necessary to focus on practical factors such as the large number of service personnel and unstable network quality. If the communication is unstable, it will result in low efficiency of information delivery and even revert to person-to-person communication. How to solve this problem requires further research. Summary of the invention
[0005] The present application provides an operating room communication method and communication system based on real-time images, which realizes dynamic compression and stable display of data by using a method of separately collecting and transmitting video and audio, and combining feature-retaining compression and interval compression to ensure the stability of video communication.
[0006] The above-mentioned purpose of the present application is achieved through the following technical solutions: In a first aspect, the present application provides an operating room communication method based on real-time images, comprising: In response to the received link communication request or communication requirement, establishing a data communication relationship between at least two communication terminals; Collect the video stream and audio stream generated at the communication end; Compress the audio stream and send it to the communication end pointed by the audio stream; Test the information fluency of the video stream pointing to the communication end and obtain the value of the information fluency; Selecting a compression method for the video stream according to the value of the information fluency, the compression methods include feature-preserving compression and interval compression; Wherein, when feature-preserving compression is used, intermittent background data collection is performed at the communication end generating the video stream; When using interval compression, background data of the communication end where the video stream is generated is virtually compensated at the communication end to which the video stream is directed.
[0007] In a possible implementation manner of the first aspect, testing the information fluency of the video stream pointing to the communication terminal includes: Continuously acquiring the time intervals between a plurality of sent video stream data packets and / or audio stream data packets in a time sequence, and recording the time intervals as a first time parameter sequence; Continuously obtaining in a time sequence a time interval for displaying the video stream data packets and / or audio stream data packets on a communication terminal pointed to by a plurality of sent video stream data packets and / or audio stream data packets, and recording the time interval as a second time parameter sequence; Comparing the first time parameter sequence and the second time parameter sequence to obtain a total value of the lag time or an average value of the lag time; Information fluency is given based on the total value of lag time or the average value of lag time.
[0008] In a possible implementation manner of the first aspect, when testing the information fluency of the video stream pointing to the communication terminal, the test density is negatively correlated with the information fluency.
[0009] In a possible implementation manner of the first aspect, retaining feature compression includes: When establishing a data communication relationship, collecting background data at a communication end for generating a video stream; Extracting and compressing the portrait at the communication end of the generated video stream to obtain compressed portrait data; Send the compressed portrait data to the communication end pointed by the video stream; When a person at a communication end for generating a video stream moves and the amount of movement exceeds an allowable range, low-level collection of background data at the communication end for generating the video stream is performed.
[0010] In a possible implementation manner of the first aspect, performing low-density collection of background data at a communication end for generating a video stream includes: identifying individual subjects included in the background data; Collect edge features of individual objects and multiple points or areas in the area surrounded by edge features; When collecting edge features of individual objects, edge features are established based on gray value data. For areas where edge features cannot be established using gray value data, only the added portion is collected.
[0011] In a possible implementation manner of the first aspect, the interval compression includes: Select multiple time points in the time series; Collecting the video stream generated at the communication end at a time point, and collecting the action parameters of the object at a subsequent time of the time point; Wherein, when the background data of the communication end where the video stream is generated is virtually compensated at the communication end pointed by the video stream, the action parameters are used to perform the virtual compensation.
[0012] In a possible implementation manner of the first aspect, the intervals between the multiple time points selected in the time series are negatively correlated with the action parameters of the object.
[0013] In a second aspect, the present application provides an operating room communication device based on real-time images, comprising: A communication establishing unit, configured to establish a data communication relationship between at least two communication terminals in response to a received link communication request or communication requirement; A data acquisition unit, used for acquiring video streams and audio streams generated at the communication end; A compression and sending unit, used for compressing the audio stream and sending it to the communication end pointed by the audio stream; A test unit, used to test the information fluency of the video stream pointing to the communication end, and obtain the value of the information fluency; A compression mode adjustment unit, used for selecting a compression mode of the video stream according to the value of the information fluency, the compression modes including feature-preserving compression and interval compression; Wherein, when feature-preserving compression is used, intermittent background data collection is performed at the communication end generating the video stream; When using interval compression, background data of the communication end where the video stream is generated is virtually compensated at the communication end to which the video stream is directed.
[0014] In a third aspect, the present application provides an operating room communication system based on real-time images, the system comprising: one or more memories for storing instructions; and One or more processors, used to call and run the instructions from the memory to execute the method as described in the first aspect and any possible implementation of the first aspect.
[0015] In a fourth aspect, the present application provides a computer-readable storage medium, the computer-readable storage medium comprising: Program, when the program is executed by a processor, the method described in the first aspect and any possible implementation of the first aspect is executed.
[0016] In a fifth aspect, the present application provides a computer program product, comprising program instructions. When the program instructions are executed by a computing device, the method described in the first aspect and any possible implementation of the first aspect is executed.
[0017] In a sixth aspect, the present application provides a chip system, which includes a processor for implementing the functions involved in the above aspects, for example, generating, receiving, sending, or processing the data and / or information involved in the above methods.
[0018] The chip system may be composed of chips, or may include chips and other discrete devices.
[0019] In a possible design, the chip system also includes a memory, which is used to store necessary program instructions and data. The processor and the memory can be decoupled and respectively set on different devices, connected by wired or wireless means, or the processor and the memory can also be coupled on the same device. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 This is a schematic flowchart of the steps of an operating room communication method based on real-time images provided in this application.
[0021] Figure 2 It is a schematic diagram for comparing a first time parameter sequence and a second time parameter sequence provided by the present application.
[0022] Figure 3 It is another schematic diagram for comparing the first time parameter sequence and the second time parameter sequence provided by the present application.
[0023] Figure 4 It is a schematic diagram of a movement amount provided by this application.
[0024] Figure 5 This is a schematic diagram of the process of interval compression provided by the present application. DETAILED DESCRIPTION
[0025] The technical solution in this application is further described in detail below in conjunction with the accompanying drawings.
[0026] This application discloses an operating room communication method based on real-time images, please refer to Figure 1 In some examples, the present application discloses an operating room communication method based on real-time images, including the following steps: S101, establishing a data communication relationship between at least two communication terminals in response to a received link communication request or communication requirement; S102, collecting video streams and audio streams generated at the communication end; S103, compressing the audio stream and sending it to the communication end pointed to by the audio stream; S104, testing the information fluency of the video stream directed to the communication end, and obtaining the information fluency value; S105, selecting a compression method for the video stream according to the value of the information fluency, the compression method including feature-preserving compression and interval compression; Wherein, when feature-preserving compression is used, intermittent background data collection is performed at the communication end generating the video stream; When using interval compression, background data of the communication end where the video stream is generated is virtually compensated at the communication end to which the video stream is directed.
[0027] In some examples, the operating room communication method based on real-time images disclosed in the present application is based on the WeChat client. When using it, the user first scans the QR code and binds personal information, and then learns the operation instructions. Of course, this step can also be skipped directly.
[0028] The communication can be initiated by the doctor, and then the interface is displayed to the user. At this time, the user clicks the button to enter the preoperative communication process, or can choose to enter the preoperative communication process in other interfaces. The intraoperative communication process is also carried out according to the above content, which will not be repeated here.
[0029] In step S101, in response to a received link communication request or communication requirement, a data communication relationship is established between at least two communication ends. The communication end here generally refers to a mobile phone, and the initiator generally refers to a doctor. A communication request can be participated by two people or multiple people.
[0030] In step S102, the video stream and audio stream generated at the communication end are collected. From step S101 and step S102, it can be seen that the execution subject of the operating room communication method based on real-time images disclosed in this application is the communication end, and the communication end here is not limited to a fixed communication end in a call process. For example, if three communication ends are involved in a communication process, the execution subjects are these three communication ends.
[0031] The video stream and the audio stream are processed separately. The audio stream is processed in step S103, in which the audio stream is compressed and sent to the communication end pointed to by the audio stream. The video stream is processed in steps S104 and S105. The specific method is to first test the information fluency of the video stream pointing to the communication end, obtain the information fluency value, and then select the compression method of the video stream according to the information fluency value. There are two compression methods, namely feature-retaining compression and interval compression.
[0032] When using feature-preserving compression, intermittent background data collection is performed at the communication end that generates the video stream; When using interval compression, background data of the communication end where the video stream is generated is virtually compensated at the communication end to which the video stream is directed.
[0033] The method for testing the information fluency of the video stream pointing to the communication end is as follows: S201, continuously obtaining the time intervals between a plurality of sent video stream data packets and / or audio stream data packets in a time sequence, which is recorded as a first time parameter sequence; S202, continuously obtaining in a time sequence a time interval at which a communication terminal to which a plurality of sent video stream data packets and / or audio stream data packets point to display the video stream data packets and / or audio stream data packets, and recording the time interval as a second time parameter sequence; S203, comparing the first time parameter sequence and the second time parameter sequence to obtain a total value of the lag time or an average value of the lag time; S204: providing information fluency according to the total value of the lag time or the average value of the lag time.
[0034] See also Figure 2 and Figure 3 Specifically, in step S201 to step S204, the information fluency test is performed using a time interval method. The specific method is to continuously obtain the time interval between multiple sent video stream data packets and / or audio stream data packets in a time series, which is recorded as a first time parameter sequence, and then continuously obtain the time interval for displaying the video stream data packets and / or audio stream data packets on the communication end to which the multiple sent video stream data packets and / or audio stream data packets point in a time series, which is recorded as a second time parameter sequence.
[0035] The first time parameter sequence is generated at the communication end that sends the video stream data packet and / or the audio stream data packet, and the second time parameter sequence is generated at the communication end that receives the video stream data packet and / or the audio stream data packet.
[0036] Then, the first time parameter sequence and the second time parameter sequence are compared to obtain a total value of the lag time or an average value of the lag time. The total value of the lag time is the accumulated value of all the lag times, and the average value of the lag time is the average value of all the lag times.
[0037] Finally, the information fluency is given according to the total value of the lag time or the average value of the lag time. The relationship between the information fluency and the total value of the lag time or the average value of the lag time is negatively correlated.
[0038] In some possible implementations, when testing the information fluency of a video stream directed to a communication terminal, the test density is negatively correlated with the information fluency.
[0039] In some possible implementations, information fluency is a set parameter value.
[0040] The timeliness of data transmission between communication terminals can be determined by the fluency of information, and then the appropriate compression method can be selected for processing.
[0041] The specific method of preserving feature compression is as follows: S301, collecting background data at a communication end for generating a video stream when establishing a data communication relationship; S302, extracting a human portrait at the communication end of the generated video stream and compressing the human portrait to obtain compressed human portrait data; S303, sending the compressed portrait data to the communication end pointed to by the video stream; When a person at a communication end for generating a video stream moves and the amount of movement exceeds an allowable range, low-level collection of background data at the communication end for generating the video stream is performed.
[0042] Feature-preserving compression means first collecting background data at the communication end that generates the video stream, and then extracting the portrait at the communication end that generates the video stream and compressing the portrait to obtain compressed portrait data in a subsequent process. Alternatively, it can be interpreted as only collecting portrait data in the subsequent communication process and then compressing the portrait data.
[0043] Here, we also need to consider the impact of the movement of the portrait. The movement of the portrait means that the user at the communication end moves during the communication process. When the movement is within the allowable range, the adjacent copy compensation method is used for processing; when the movement exceeds the allowable range, the background data at the communication end that generates the video stream is collected at a low level.
[0044] The adjacent copy compensation method refers to copying the content at the adjacent position, but this method needs to limit the range, because copying in a larger range will make the picture appear unreal.
[0045] In some possible implementations, when near-copy compensation is used, it is necessary to appropriately reduce the clarity of the missing content area.
[0046] See also Figure 4 One way to determine the amount of movement is to compare the images before and after the movement to obtain the moving area, and then determine the maximum width of the moving area in the moving direction. The maximum width is the amount of movement.
[0047] The allowed range is also a set value and is not restricted here.
[0048] The specific method of low-density acquisition of background data at the communication end generating the video stream is: identifying individual subjects included in the background data; Collect edge features of individual objects and multiple points or areas in the area surrounded by edge features; When collecting edge features of individual objects, edge features are established based on gray value data. For areas where edge features cannot be established using gray value data, only the added portion is collected.
[0049] The specific process of the above method is to first identify the individual object included in the background data, then obtain the edge features of the individual object, and then obtain multiple points or regions in the area surrounded by the edge features. For the receiving end, the edge features of the individual object and the multiple points or regions obtained in the area surrounded by the edge features are directly used to reconstruct the individual object.
[0050] The reconstruction method is to use multiple points or areas in the area surrounded by edge features to reconstruct individual objects. One method is to divide the individual object into multiple independent areas, collect at least one point or area in each independent area, and use the collected points or areas to fill the independent areas during reconstruction. For the junction of independent areas, use blurring or reducing the clarity to make a transition.
[0051] When edge features cannot be established, only the increased portion of the individual object is collected.
[0052] The specific method of interval compression is: S401, selecting multiple time points in the time series; S402, collecting a video stream generated at the communication end at a time point, and collecting action parameters of the object at a subsequent time of the time point; Wherein, when the background data of the communication end where the video stream is generated is virtually compensated at the communication end pointed by the video stream, the action parameters are used to perform the virtual compensation.
[0053] For more details, see Figure 5 ,Interval compression is to collect the video stream at a time point, and then collect the action parameters of the object at the time part between two adjacent time points, and then use the action parameters to perform virtual compensation when the background data of the communication end where the video stream is generated is virtually compensated at the communication end pointed by the video stream.
[0054] In this way, the time between two adjacent time points can be converted into action parameters.
[0055] In some possible implementations, the motion parameters include head movement, eye movement, mouth movement, and hand movement, and the missing part between two motion parameters is supplemented by using a difference method.
[0056] In some possible implementations, the intervals between the multiple time points selected in the time series are negatively correlated with the motion parameters of the object.
[0057] The present application also provides an operating room communication device based on real-time images, comprising: A communication establishing unit, configured to establish a data communication relationship between at least two communication terminals in response to a received link communication request or communication requirement; A data acquisition unit, used for acquiring video streams and audio streams generated at the communication end; A compression and sending unit, used for compressing the audio stream and sending it to the communication end pointed by the audio stream; A test unit, used to test the information fluency of the video stream pointing to the communication end, and obtain the value of the information fluency; A compression mode adjustment unit, used for selecting a compression mode of the video stream according to the value of the information fluency, the compression modes including feature-preserving compression and interval compression; Wherein, when feature-preserving compression is used, intermittent background data collection is performed at the communication end generating the video stream; When using interval compression, background data of the communication end where the video stream is generated is virtually compensated at the communication end to which the video stream is directed.
[0058] Furthermore, it also includes: A first processing unit, configured to continuously obtain a time interval between a plurality of sent video stream data packets and / or audio stream data packets in a time sequence, recorded as a first time parameter sequence; A second processing unit is used to continuously obtain, in a time sequence, a time interval for displaying the video stream data packets and / or audio stream data packets on a communication terminal pointed to by a plurality of sent video stream data packets and / or audio stream data packets, recorded as a second time parameter sequence; A comparison processing unit, used for comparing the first time parameter sequence and the second time parameter sequence to obtain a total value of the lag time or an average value of the lag time; The result output unit is used to provide information fluency according to the total value of the lag time or the average value of the lag time.
[0059] Furthermore, when testing the information fluency of the video stream pointing to the communication end, the test density is negatively correlated with the information fluency.
[0060] Furthermore, it also includes: A first acquisition unit, used for acquiring background data at a communication end for generating a video stream when establishing a data communication relationship; A compression processing unit, used for extracting a human image at a communication end for generating a video stream and compressing the human image to obtain compressed human image data; A sending unit, used for sending the compressed portrait data to a communication end pointed to by the video stream; When a person at a communication end for generating a video stream moves and the amount of movement exceeds an allowable range, low-level collection of background data at the communication end for generating the video stream is performed.
[0061] Furthermore, it also includes: an identification unit for identifying individual objects included in the background data; A second acquisition unit is used to acquire edge features of individual objects and multiple points or regions in an area surrounded by edge features; When collecting edge features of individual objects, edge features are established based on gray value data. For areas where edge features cannot be established using gray value data, only the added portion is collected.
[0062] Furthermore, it also includes: A time point selection unit is used to select multiple time points in a time series; A third acquisition unit is used to acquire the video stream generated at the communication end at a time point, and to acquire the motion parameters of the object at a subsequent time of the time point; Wherein, when the background data of the communication end where the video stream is generated is virtually compensated at the communication end pointed by the video stream, the action parameters are used to perform the virtual compensation.
[0063] Furthermore, the intervals between the multiple time points selected in the time series are negatively correlated with the motion parameters of the object.
[0064] In one example, the unit in any of the above devices can be one or more integrated circuits configured to implement the above methods, such as: one or more application specific integrated circuits (ASICs), or, one or more digital signal processors (DSPs), or, one or more field programmable gate arrays (FPGAs), or a combination of at least two of these integrated circuit forms.
[0065] For another example, when the units in the device can be implemented in the form of a processing element scheduling program, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call a program. For another example, these units can be integrated together and implemented in the form of a system-on-a-chip (SOC).
[0066] Various objects such as various messages / information / equipment / network elements / systems / devices / actions / operations / processes / concepts that may appear in this application are named. It can be understood that these specific names do not constitute a limitation on the relevant objects. The names assigned may change with factors such as scenarios, contexts or usage habits. The understanding of the technical meaning of the technical terms in this application should be mainly determined from the functions and technical effects embodied / executed in the technical scheme.
[0067] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0068] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0069] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0070] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0071] It should also be understood that in various embodiments of the present application, the first, second, etc. are only used to indicate that multiple objects are different. For example, the first time window and the second time window are only used to indicate different time windows. They should not have any impact on the time window itself, and the first, second, etc. mentioned above should not impose any limitations on the embodiments of the present application.
[0072] It should also be understood that in the various embodiments of the present application, unless otherwise specified or there is a logical conflict, the terms and / or descriptions between different embodiments are consistent and can be referenced to each other, and the technical features in different embodiments can be combined to form new embodiments according to their internal logical relationships.
[0073] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a computer-readable storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned computer-readable storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0074] The present application also provides an operating room communication system based on real-time images, the system comprising: one or more memories for storing instructions; and One or more processors are used to call and run the instructions from the memory to execute the method as described above.
[0075] The present application also provides a computer program product, which includes instructions. When the instructions are executed, the terminal device and the network device perform operations of the terminal device and the network device corresponding to the above method.
[0076] The present application also provides a chip system, which includes a processor for implementing the functions involved in the above content, such as generating, receiving, sending, or processing the data and / or information involved in the above method.
[0077] The chip system may be composed of chips, or may include chips and other discrete devices.
[0078] The processor mentioned in any of the above places can be a CPU, a microprocessor, an ASIC, or one or more integrated circuits for executing programs for controlling the above-mentioned feedback information transmission method.
[0079] In a possible design, the chip system also includes a memory, which is used to store necessary program instructions and data. The processor and the memory can be decoupled and respectively set on different devices, connected by wire or wireless means to support the chip system to implement various functions in the above embodiments. Alternatively, the processor and the memory can also be coupled on the same device.
[0080] Optionally, the computer instructions are stored in a memory.
[0081] Optionally, the memory is a storage unit within the chip, such as a register, a cache, etc. The memory can also be a storage unit within the terminal located outside the chip, such as a ROM or other types of static storage devices that can store static information and instructions, RAM, etc.
[0082] It can be understood that the memory in the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories.
[0083] The non-volatile memory may be a ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), or a flash memory.
[0084] The volatile memory may be a RAM, which is used as an external cache. There are many different types of RAM, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct memory bus RAM.
[0085] The embodiments of this specific implementation method are all preferred embodiments of the present application, and are not intended to limit the protection scope of the present application. Therefore, all equivalent changes made based on the structure, shape, and principle of the present application should be included in the protection scope of the present application.
Claims
1. A communication method in an operating room based on real-time images, characterized in that: include: In response to the received link communication request or communication requirement, establishing a data communication relationship between at least two communication terminals; Collect the video stream and audio stream generated at the communication end; Compress the audio stream and send it to the communication end pointed by the audio stream; Test the information fluency of the video stream pointing to the communication end and obtain the value of the information fluency; Selecting a compression method for the video stream according to the value of the information fluency, the compression methods include feature-preserving compression and interval compression; Wherein, when feature-preserving compression is used, intermittent background data collection is performed at the communication end generating the video stream; When using interval compression, background data of the communication end where the video stream is generated is virtually compensated at the communication end to which the video stream is directed.
2. The operating room communication method based on real-time images according to claim 1, characterized in that: Testing the information fluency of the video stream to the communication end includes: Continuously acquiring the time intervals between a plurality of sent video stream data packets and / or audio stream data packets in a time sequence, and recording the time intervals as a first time parameter sequence; Continuously obtaining in a time sequence a time interval for displaying the video stream data packets and / or audio stream data packets on a communication terminal pointed to by a plurality of sent video stream data packets and / or audio stream data packets, and recording the time interval as a second time parameter sequence; Comparing the first time parameter sequence and the second time parameter sequence to obtain a total value of the lag time or an average value of the lag time; Information fluency is given based on the total value of lag time or the average value of lag time.
3. The operating room communication method based on real-time images according to claim 1 or 2, characterized in that: When testing the information fluency of the video stream pointing to the communication end, the test density is negatively correlated with the information fluency.
4. The operating room communication method based on real-time images according to claim 1, characterized in that: Feature-preserving compression includes: When establishing a data communication relationship, collecting background data at a communication end for generating a video stream; Extracting and compressing the portrait at the communication end of the generated video stream to obtain compressed portrait data; Send the compressed portrait data to the communication end pointed by the video stream; When a person at a communication end for generating a video stream moves and the amount of movement exceeds an allowable range, low-level collection of background data at the communication end for generating the video stream is performed.
5. The operating room communication method based on real-time images according to claim 4, characterized in that: The low-density acquisition of background data at the communication end generating the video stream includes: identifying individual subjects included in the background data; Collect edge features of individual objects and multiple points or areas in the area surrounded by edge features; When collecting edge features of individual objects, edge features are established based on gray value data. For areas where edge features cannot be established using gray value data, only the added portion is collected.
6. The operating room communication method based on real-time images according to claim 1, characterized in that: Interval compression includes: Select multiple time points in the time series; Collecting the video stream generated at the communication end at a time point, and collecting the action parameters of the object at a subsequent time of the time point; Wherein, when the background data of the communication end where the video stream is generated is virtually compensated at the communication end pointed by the video stream, the action parameters are used to perform the virtual compensation.
7. The operating room communication method based on real-time images according to claim 1, characterized in that: The intervals between multiple time points selected in the time series are negatively correlated with the motion parameters of the object.
8. An operating room communication device based on real-time images, characterized in that: include: A communication establishing unit, configured to establish a data communication relationship between at least two communication terminals in response to a received link communication request or communication requirement; A data acquisition unit, used for acquiring video streams and audio streams generated at the communication end; A compression and sending unit, used for compressing the audio stream and sending it to the communication end to which the audio stream points; A test unit, used to test the information fluency of the video stream pointing to the communication end, and obtain the value of the information fluency; A compression mode adjustment unit, used for selecting a compression mode of the video stream according to the value of the information fluency, the compression modes including feature-preserving compression and interval compression; Wherein, when feature-preserving compression is used, intermittent background data collection is performed at the communication end generating the video stream; When using interval compression, background data of the communication end where the video stream is generated is virtually compensated at the communication end to which the video stream is directed.
9. An operating room communication system based on real-time images, characterized in that: The system comprises: one or more memories for storing instructions; and One or more processors, configured to call and execute the instructions from the memory to perform the method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: The computer readable storage medium comprises: The program, when the program is executed by a processor, the method according to any one of claims 1 to 7 is executed.
Citation Information
Patent Citations
Operating room medical information reconstruction and interaction system
CN102164273A
Dynamic target recognition tracking image data optimization transmission method and system
CN108765354A
A low-delay operation demonstration live broadcast method and system
CN109874027A
Voice and video definition adjusting system and method based on a remote operation
CN111447415A
Wireless video monitoring method
CN114866743A
