An operating room communication method and communication system based on instant images

Abstract

The present application relates to an operating room communication method and communication system based on instant images. The method includes establishing a data communication relationship between at least two communication terminals; collecting video streams and audio streams generated at the communication terminals; compressing the audio stream and sending it to the communication terminal pointed to by the audio stream; testing the information fluency of the communication terminal pointed to by the video stream, obtaining an information fluency value, and selecting a compression method for the video stream according to the information fluency value. The compression methods include feature-preserving compression and interval compression. When using feature-preserving compression, intermittent background data collection is performed at the communication terminal where the video stream is generated. The operating room communication method and communication system based on instant images disclosed in the present application use the method of separately collecting and separately transmitting video and audio, and at the same time combine feature-preserving compression and interval compression to achieve dynamic compression and stable display of data, so as to ensure the stability of video communication.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to an operating room communication method and communication system based on real-time images. Background Art

[0002] The operating room communication system is centered on information integration, integrating various independent medical devices and medical information on a unified digital medical information platform through hospital information systems (such as HIS, PACS, etc.). The system not only supports real-time video communication and voice intercom inside and outside the operating room, but also has functions such as data sharing, recording, and remote surgical guidance, providing medical staff with a convenient, intuitive, and efficient way of communication. For example, you can communicate directly with the patient before the operation, and you can also communicate directly with the patient's family during the operation. This direct communication method can effectively reduce the difficulty of communication and make it easier to reach important information.

[0003] Currently, there are two ways to establish communication methods: relying on own services and using third-party services (such as using instant messaging software). Using third-party services is more convenient and does not require additional software installation.

[0004] However, in hospital scenarios, it is necessary to focus on practical factors such as the large number of service personnel and unstable network quality. If the communication is unstable, it will result in low efficiency of information delivery and even revert to person-to-person communication. How to solve this problem requires further research. Summary of the invention

[0005] The present application provides an operating room communication method and communication system based on real-time images, which realizes dynamic compression and stable display of data by using a method of separately collecting and transmitting video and audio, and combining feature-retaining compression and interval compression to ensure the stability of video communication.

[0006] The above-mentioned purpose of the present application is achieved through the following technical solutions:

[0007] In a first aspect, the present application provides an operating room communication method based on real-time images, comprising:

[0008] In response to the received link communication request or communication requirement, establishing a data communication relationship between at least two communication terminals;

[0009] Collect the video stream and audio stream generated at the communication end;

[0010] Compress the audio stream and send it to the communication end pointed by the audio stream;

[0011] Test the information fluency of the video stream pointing to the communication end and obtain the value of the information fluency;

[0012] Select the compression method of the video stream according to the information fluency value. The compression methods include feature-preserving compression and intermittent compression;

[0013] Among them, when using feature-preserving compression, intermittent background data collection is performed at the communication end where the video stream is generated;

[0014] When using intermittent compression, virtual compensation is performed on the background data of the communication end where the video stream is generated at the communication end pointed to by the video stream.

[0015] In a possible implementation manner of the first aspect, testing the information fluency of the video stream pointing to the communication end includes:

[0016] Continuously obtain the time intervals between multiple sent video stream data packets and / or audio stream data packets in the time series, and record them as the first time parameter sequence;

[0017] Continuously obtain the time intervals for displaying the video stream data packets and / or audio stream data packets on the communication end pointed to by multiple sent video stream data packets and / or audio stream data packets in the time series, and record them as the second time parameter sequence;

[0018] Compare the first time parameter sequence and the second time parameter sequence to obtain the total lag time or the average lag time;

[0019] Give the information fluency according to the total lag time or the average lag time.

[0020] In a possible implementation manner of the first aspect, when testing the information fluency of the video stream pointing to the communication end, the test density is negatively correlated with the information fluency.

[0021] In a possible implementation manner of the first aspect, the feature-preserving compression includes:

[0022] Collect the background data at the communication end where the video stream is generated when establishing the data communication relationship;

[0023] Extract the human portrait at the communication end where the video stream is generated and perform compression processing on the human portrait to obtain compressed human portrait data;

[0024] Send the compressed human portrait data to the communication end pointed to by the video stream;

[0025] Among them, when the human portrait at the communication end where the video stream is generated moves and the movement amount exceeds the allowable range, low-degree collection of the background data at the communication end where the video stream is generated at this time is performed.

[0026] In a possible implementation manner of the first aspect, performing low-density collection of the background data at the communication end where the video stream is generated includes:

[0027] Identify individual objects included in the background data;

[0028] Collect the edge features of the individual object and multiple points or regions in the area surrounded by the edge features;

[0029] Among them, when collecting the edge features of the individual object, the edge features are established according to the grayscale value data. For areas where the edge features cannot be established using the grayscale value data, only the added parts are collected.

[0030] In a possible implementation manner of the first aspect, the interval compression includes:

[0031] Select multiple time points in the time series;

[0032] Collect the video stream generated at the communication end at the time point, and at the same time collect the action parameters of the object at the subsequent time of the time point;

[0033] Among them, when virtual compensation is performed on the background data of the communication end where the video stream is generated at the communication end pointed to by the video stream, the action parameters are used for virtual compensation.

[0034] In a possible implementation manner of the first aspect, the interval between multiple time points selected in the time series is negatively correlated with the action parameters of the object.

[0035] In the second aspect, the present application provides an operating room communication device based on instant images, including:

[0036] A communication establishment unit, configured to establish a data communication relationship between at least two communication ends in response to a received link communication request or communication requirement;

[0037] A data acquisition unit, configured to acquire the video stream and audio stream generated at the communication end;

[0038] A compression and sending unit, configured to compress the audio stream and send it to the communication end pointed to by the audio stream;

[0039] A testing unit, configured to test the information fluency of the communication end pointed to by the video stream to obtain an information fluency value;

[0040] A compression method adjustment unit, configured to select a compression method for the video stream according to the information fluency value, and the compression methods include feature-preserving compression and interval compression;

[0041] Among them, when using feature-preserving compression, intermittent background data acquisition is performed at the communication end where the video stream is generated;

[0042] When using interval compression, virtual compensation is performed on the background data of the communication end where the video stream is generated at the communication end pointed to by the video stream.

[0043] In a third aspect, the present application provides an operating room communication system based on instant images, the system comprising:

[0044] one or more memories for storing instructions; and

[0045] one or more processors for calling and running the instructions from the memory to execute the method described in the first aspect and any possible implementation manner of the first aspect.

[0046] In a fourth aspect, the present application provides a computer-readable storage medium, the computer-readable storage medium comprising:

[0047] a program that, when run by a processor, executes the method described in the first aspect and any possible implementation manner of the first aspect.

[0048] In a fifth aspect, the present application provides a computer program product comprising program instructions that, when run by a computing device, execute the method described in the first aspect and any possible implementation manner of the first aspect.

[0049] In a sixth aspect, the present application provides a chip system, the chip system comprising a processor for implementing the functions involved in the above aspects, for example, generating, receiving, sending, or processing the data and / or information involved in the above method.

[0050] The chip system may be composed of chips or may include chips and other discrete devices.

[0051] In a possible design, the chip system further includes a memory for storing necessary program instructions and data. The processor and the memory may be decoupled and disposed on different devices and connected by wire or wirelessly, or the processor and the memory may also be coupled on the same device. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 is a schematic block diagram of the steps of an operating room communication method based on instant images provided by the present application.

[0053] Figure 2 is a schematic comparison diagram of a first time parameter sequence and a second time parameter sequence provided by the present application.

[0054] Figure 3 is another schematic comparison diagram of a first time parameter sequence and a second time parameter sequence provided by the present application.

[0055] Figure 4 is a schematic diagram of a movement amount provided by the present application.

[0056] Figure 5 This is a schematic diagram of the process of interval compression provided by this application. Specific implementation manners

[0057] The technical solutions in this application will be further described in detail below with reference to the accompanying drawings.

[0058] This application discloses a method for communication in the operating room based on instant images. Please refer to Figure 1 , in some examples, the method for communication in the operating room based on instant images disclosed in this application includes the following steps:

[0059] S101, in response to a received link communication request or communication requirement, establish a data communication relationship between at least two communication terminals;

[0060] S102, collect the video stream and audio stream generated at the communication terminal;

[0061] S103, compress the audio stream and send it to the communication terminal pointed to by the audio stream;

[0062] S104, test the information fluency of the communication terminal pointed to by the video stream to obtain an information fluency value;

[0063] S105, select a compression method for the video stream according to the information fluency value, and the compression methods include feature-preserving compression and interval compression;

[0064] Among them, when using feature-preserving compression, intermittent background data collection is performed at the communication terminal where the video stream is generated;

[0065] When using interval compression, virtual compensation is performed on the background data of the communication terminal where the video stream is generated at the communication terminal pointed to by the video stream.

[0066] In some examples, the method for communication in the operating room based on instant images disclosed in this application is based on the WeChat client. When used, the user first scans the QR code and binds personal information, and then learns the operation guide. Of course, this step can also be skipped directly.

[0067] For the initiation of communication, it can be initiated by the doctor, and then the interface is displayed at the user's end. At this time, after the user clicks the button, they enter the pre-operative communication process, or they can also select to enter the pre-operative communication process on other interfaces. The intra-operative communication process is also carried out according to the above content and will not be elaborated here.

[0068] In step S101, in response to a received link communication request or communication requirement, a data communication relationship is established between at least two communication terminals. Here, the communication terminals generally refer to mobile phones, and the initiator generally refers to the doctor. A communication request can involve two people or multiple people.

[0069] In step S102, the video stream and audio stream generated at the communication end are collected. From steps S101 and S102, it can be seen that the execution subject of the instant image-based operating room communication method disclosed in this application is the communication end, and the communication end here does not limit a fixed communication end for a call process. For example, in a communication process involving three communication ends, the execution subject is these three communication ends.

[0070] For the video stream and audio stream, a separate processing method is adopted. The processing of the audio stream is in step S103. In this step, the audio stream is compressed and then sent to the communication end pointed to by the audio stream. For the processing of the video stream, it is carried out in steps S104 and S105. The specific method is to first test the information fluency of the communication end pointed to by the video stream to obtain the information fluency value, and then select the compression method of the video stream according to the information fluency value. There are two compression methods, namely feature-preserving compression and intermittent compression.

[0071] When using feature-preserving compression, intermittent background data collection is performed at the communication end where the video stream is generated;

[0072] When using intermittent compression, virtual compensation is performed on the background data of the communication end where the video stream is generated at the communication end pointed to by the video stream.

[0073] The method for testing the information fluency of the communication end pointed to by the video stream is as follows:

[0074] S201, Continuously obtain the time intervals between multiple sent video stream data packets and / or audio stream data packets in the time series, and record them as the first time parameter sequence;

[0075] S202, Continuously obtain the time intervals for displaying the video stream data packets and / or audio stream data packets on the communication end pointed to by multiple sent video stream data packets and / or audio stream data packets in the time series, and record them as the second time parameter sequence;

[0076] S203, Compare the first time parameter sequence and the second time parameter sequence to obtain the total lag time or the average lag time;

[0077] S204, Give the information fluency according to the total lag time or the average lag time.

[0078] Please refer to Figure 2 and Figure 3, specifically, in steps S201 to S204, the time interval method is used to test the information fluency. Specifically, the time intervals between multiple consecutively acquired video stream data packets and / or audio stream data packets sent in the time series are recorded as the first time parameter sequence, and then the time intervals for presenting the video stream data packets and / or audio stream data packets on the communication end pointed to by the multiple consecutively acquired video stream data packets and / or audio stream data packets in the time series are recorded as the second time parameter sequence.

[0079] The first time parameter sequence is generated at the communication end that sends the video stream data packets and / or audio stream data packets, and the second time parameter sequence is generated at the communication end that receives the video stream data packets and / or audio stream data packets.

[0080] Then, the first time parameter sequence and the second time parameter sequence are compared to obtain the total lag time or the average lag time. The total lag time is the cumulative value of all lag times, and the average lag time is the average value of all lag times.

[0081] Finally, the information fluency is given based on the total lag time or the average lag time. The relationship between the information fluency and the total lag time or the average lag time is negatively correlated.

[0082] In some possible implementation manners, when testing the information fluency of the video stream pointing to the communication end, the test density is negatively correlated with the information fluency.

[0083] In some possible implementation manners, the information fluency is a set parameter value.

[0084] Through the information fluency, the timeliness of data transmission between communication ends can be judged, and then a suitable compression method can be selected for processing.

[0085] The specific manner of retaining feature compression is as follows:

[0086] S301, collect the background data at the communication end that generates the video stream when establishing the data communication relationship;

[0087] S302, extract the human figure at the communication end that generates the video stream and perform compression processing on the human figure to obtain compressed human figure data;

[0088] S303, send the compressed human figure data to the communication end pointed to by the video stream;

[0089] Wherein, when the human figure at the communication end that generates the video stream moves and the movement amount exceeds the allowable range, low-level acquisition is performed on the background data at the communication end that generates the video stream at this time.

[0090] Retention feature compression means that background data at the communication end where the video stream is generated is first collected, and then in subsequent processes, the human figure is extracted at the communication end where the video stream is generated and compressed to obtain compressed human figure data. Or it can be interpreted as that in subsequent communication processes, only human figure data is collected and then compressed.

[0091] Here, the impact caused by the movement of the human figure also needs to be considered. The movement of the human figure means that the user at the communication end moves during the communication process. When the movement amount is within the allowable range, it is processed by the adjacent copy compensation method; when the movement amount exceeds the allowable range, low-density acquisition is performed on the background data at the communication end where the video stream is generated at this time.

[0092] The adjacent copy compensation method means copying the content at adjacent positions, but this method needs to limit the range because copying in a large range will make the picture look unrealistic.

[0093] In some possible implementation manners, when using adjacent copy compensation, the clarity of the missing content area needs to be appropriately reduced.

[0094] Please refer to Figure 4 , one way to determine the movement amount is to compare the images before and after the movement to obtain the movement area, and then determine the maximum width of the movement area in the movement direction, and the maximum width is the movement amount.

[0095] The allowable range is also a set value and is not restricted here.

[0096] The specific method for performing low-density acquisition on the background data at the communication end where the video stream is generated is:

[0097] Identify the individual objects included in the background data;

[0098] Collect the edge features of the individual objects and multiple points or regions in the area surrounded by the edge features;

[0099] Among them, when collecting the edge features of the individual objects, the edge features are established according to the gray value data. For the areas where the edge features cannot be established using the gray value data, only the added parts are collected.

[0100] The specific process of the above method is to first identify the individual objects included in the background data, then obtain the edge features of the individual objects, and then obtain multiple points or regions in the area surrounded by the edge features. For the receiving end, the edge features of the individual objects and multiple points or regions obtained in the area surrounded by the edge features are directly used to reconstruct the individual objects.

[0101] The reconstruction method is to reconstruct an individual object using multiple points or regions in the area surrounded by edge features. One way is to divide the individual object into multiple independent regions, and at least one point or region is collected for each independent region. During reconstruction, the collected points or regions are used to fill the independent regions. For the junctions of the independent regions, a blurring process or a way of reducing clarity is used for transition.

[0102] When the edge features cannot be established, only the increased part of the collection of the individual object at this time is collected.

[0103] The specific method of intermittent compression is as follows:

[0104] S401, select multiple time points in the time series;

[0105] S402, collect the video stream generated at the communication end at the time point, and at the same time collect the action parameters of the object at the subsequent time of the time point;

[0106] Among them, when virtual compensation is performed on the background data of the communication end where the video stream is generated at the communication end pointed to by the video stream, the action parameters are used for virtual compensation.

[0107] Specifically, please refer to Figure 5 , intermittent compression is to collect the video stream at the time point, then collect the action parameters of the object in the time part between two adjacent time points, and then when virtual compensation is performed on the background data of the communication end where the video stream is generated at the communication end pointed to by the video stream, the action parameters are used for virtual compensation.

[0108] This method can convert the time between two adjacent time points into action parameters.

[0109] In some possible implementation manners, the action parameters include head movement, eye movement, mouth movement, and hand movement. For the missing part between two action parameters, the difference method is used for supplementation.

[0110] In some possible implementation manners, the interval between multiple time points selected in the time series is negatively correlated with the action parameters of the object.

[0111] This application also provides an operating room communication device based on instant images, including:

[0112] A communication establishment unit, configured to establish a data communication relationship between at least two communication ends in response to a received link communication request or communication requirement;

[0113] A data collection unit, configured to collect the video stream and audio stream generated at the communication end;

[0114] A compression and transmission unit, configured to compress an audio stream and then transmit it to a communication terminal pointed to by the audio stream;

[0115] A testing unit, configured to test the information fluency of the communication terminal pointed to by the video stream and obtain an information fluency value;

[0116] A compression mode adjustment unit, configured to select a compression mode for the video stream according to the information fluency value, and the compression modes include feature-preserving compression and interval compression;

[0117] Wherein, when using feature-preserving compression, intermittent background data acquisition is performed at the communication terminal where the video stream is generated;

[0118] When using interval compression, virtual compensation is performed on the background data of the communication terminal where the video stream is generated at the communication terminal pointed to by the video stream.

[0119] Furthermore, it further includes:

[0120] A first processing unit, configured to continuously obtain the time intervals between multiple transmitted video stream data packets and / or audio stream data packets in a time series, denoted as a first time parameter sequence;

[0121] A second processing unit, configured to continuously obtain the time intervals for displaying the video stream data packets and / or audio stream data packets on the communication terminal pointed to by multiple transmitted video stream data packets and / or audio stream data packets in a time series, denoted as a second time parameter sequence;

[0122] A comparison processing unit, configured to compare the first time parameter sequence and the second time parameter sequence to obtain a total lag time or an average lag time;

[0123] A result output unit, configured to give the information fluency according to the total lag time or the average lag time.

[0124] Furthermore, when testing the information fluency of the communication terminal pointed to by the video stream, the testing density is negatively correlated with the information fluency.

[0125] Furthermore, it further includes:

[0126] A first acquisition unit, configured to acquire background data at the communication terminal where the video stream is generated when establishing a data communication relationship;

[0127] A compression processing unit, configured to extract a portrait at the communication terminal where the video stream is generated and perform compression processing on the portrait to obtain compressed portrait data;

[0128] A transmission unit, configured to transmit the compressed portrait data to the communication terminal pointed to by the video stream;

[0129] Among them, when the portrait at the communication end that generates the video stream moves and the amount of movement exceeds the allowable range, the background data at the communication end that generates the video stream at this time is collected at a low level.

[0130] Furthermore, it also includes:

[0131] An identification unit, used to identify individual objects included in the background data;

[0132] A second acquisition unit, used to acquire the edge features of the individual object and multiple points or regions in the region surrounded by the edge features;

[0133] Among them, when acquiring the edge features of the individual object, the edge features are established according to the gray value data. For regions where the edge features cannot be established using the gray value data, only the added parts are collected.

[0134] Furthermore, it also includes:

[0135] A time point selection unit, used to select multiple time points in the time series;

[0136] A third acquisition unit, used to acquire the video stream generated at the communication end at the time point, and at the same time acquire the action parameters of the object at the subsequent time of the time point;

[0137] Among them, when performing virtual compensation on the background data of the communication end where the video stream is generated at the communication end pointed to by the video stream, the action parameters are used for virtual compensation.

[0138] Furthermore, the interval between multiple time points selected in the time series is negatively correlated with the action parameters of the object.

[0139] In an example, the units in any of the above devices can be one or more integrated circuits configured to implement the above methods. For example: one or more application specific integrated circuits (ASICs), or, one or more digital signal processors (DSPs), or, one or more field programmable gate arrays (FPGAs), or a combination of at least two of these integrated circuit forms.

[0140] Again, when the units in the device can be implemented in the form of a processing element scheduler, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processors that can call programs. Again, these units can be integrated together to be implemented in the form of a system-on-a-chip (SOC).

[0141] In this application, various objects such as various messages / information / devices / network elements / systems / devices / actions / operations / processes / concepts, etc. that may appear have been named. It can be understood that these specific names do not constitute a limitation on the relevant objects, and the assigned names can be changed according to factors such as the scenario, context, or usage habits. The understanding of the technical meaning of the technical terms in this application should be mainly determined from the functions and technical effects reflected / executed in the technical solution.

[0142] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments, and will not be elaborated herein.

[0143] In several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces, and the indirect couplings or communication connections of the devices or units can be in electrical, mechanical, or other forms.

[0144] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place, or can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0145] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in hardware or software depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but this implementation should not be considered to exceed the scope of this application.

[0146] It should also be understood that in the various embodiments of this application, the first, second, etc. are only used to indicate that multiple objects are different. For example, the first time window and the second time window are only used to indicate different time windows. And it should not have any impact on the time window itself. The above first, second, etc. should not impose any restrictions on the embodiments of this application.

[0147] It should also be understood that in various embodiments of the present application, if there is no special description and logical conflict, the terms and / or descriptions between different embodiments are consistent and can be referenced to each other, and the technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.

[0148] If the above-mentioned function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a computer-readable storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present application. The aforementioned computer-readable storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks, or optical discs that can store program codes.

[0149] The present application also provides an operating room communication system based on instant images, and the system includes:

[0150] One or more memories for storing instructions; and

[0151] One or more processors for calling and running the instructions from the memory and executing the methods described in the above content.

[0152] The present application also provides a computer program product, and the computer program product includes instructions. When the instructions are executed, the terminal device and the network device are caused to perform the operations of the terminal device and the network device corresponding to the above methods.

[0153] The present application also provides a chip system, and the chip system includes a processor for implementing the functions involved in the above content. For example, generating, receiving, sending, or processing the data and / or information involved in the above methods.

[0154] The chip system can be composed of chips or can include chips and other discrete devices.

[0155] The processor mentioned anywhere above can be a CPU, a microprocessor, an ASIC, or an integrated circuit for controlling the execution of the programs of the methods for transmitting the above feedback information.

[0156] In a possible design, the chip system further includes a memory for storing necessary program instructions and data. The processor and the memory can be decoupled and separately disposed on different devices and connected by wired or wireless means to support the chip system in implementing various functions in the above embodiments. Alternatively, the processor and the memory can also be coupled on the same device.

[0157] Optionally, the computer instructions are stored in the memory.

[0158] Optionally, the memory is a storage unit within the chip, such as a register, cache, etc. The memory can also be a storage unit outside the chip within the terminal, such as a ROM or other types of static storage devices that can store static information and instructions, a RAM, etc.

[0159] It can be understood that the memory in this application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories.

[0160] The non-volatile memory can be a ROM, a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.

[0161] The volatile memory can be a RAM, which is used as an external cache. There are various different types of RAM, such as a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synch link DRAM (SLDRAM), and a direct memory bus random access memory.

[0162] The embodiments of this specific implementation manner are all preferred embodiments of this application, and do not limit the protection scope of this application accordingly. Therefore, all equivalent changes made according to the structure, shape, and principle of this application should be covered within the protection scope of this application.

Claims

1. A communication method in an operating room based on real-time images, characterized in that: include: In response to the received link communication request or communication requirement, establishing a data communication relationship between at least two communication terminals; Collect the video stream and audio stream generated at the communication end; Compress the audio stream and send it to the communication end pointed by the audio stream; Test the information fluency of the video stream pointing to the communication end and obtain the value of the information fluency; Selecting a compression method for the video stream according to the value of the information fluency, the compression methods include feature-preserving compression and interval compression; Wherein, when feature-preserving compression is used, intermittent background data collection is performed at the communication end generating the video stream; When using interval compression, background data of the communication end where the video stream is generated is virtually compensated at the communication end to which the video stream is directed; Feature-preserving compression includes: When establishing a data communication relationship, collecting background data at a communication end for generating a video stream; Extracting and compressing the portrait at the communication end of the generated video stream to obtain compressed portrait data; Send the compressed portrait data to the communication end pointed by the video stream; When the person at the communication end generating the video stream moves and the amount of movement exceeds the allowed range, the background data at the communication end generating the video stream is collected at a low level; Low-level collection of background data at the communication end that generates the video stream includes: identifying individual subjects included in the background data; Collect edge features of individual objects and multiple points or areas in the area surrounded by edge features; Wherein, when collecting edge features of individual objects, edge features are established according to gray value data, and after obtaining edge features of individual objects, multiple points or regions are obtained in the area surrounded by edge features, and multiple points or regions are obtained in the edge features and the area surrounded by edge features to reconstruct the individual objects; For areas where edge features cannot be established using gray value data, only the increased portion is collected.

2. The operating room communication method based on real-time images according to claim 1, characterized in that: Testing the information fluency of the video stream to the communication end includes: Continuously acquiring the time intervals between a plurality of sent video stream data packets and / or audio stream data packets in a time sequence, and recording the time intervals as a first time parameter sequence; Continuously obtaining the time intervals for displaying the video stream data packets and / or audio stream data packets on the communication end pointed to by the multiple sent video stream data packets and / or audio stream data packets in a time sequence, recorded as a second time parameter sequence; Comparing the first time parameter sequence and the second time parameter sequence to obtain a total value of the lag time or an average value of the lag time; Information fluency is given based on the total value of lag time or the average value of lag time.

3. The operating room communication method based on real-time images according to claim 1 or 2, characterized in that: When testing the information fluency of the video stream pointing to the communication end, the test density is negatively correlated with the information fluency.

4. The operating room communication method based on real-time images according to claim 1, characterized in that: Interval compression includes: Select multiple time points in the time series; Collecting the video stream generated at the communication end at a time point, and collecting the action parameters of the object at a subsequent time of the time point; Wherein, when the background data of the communication end where the video stream is generated is virtually compensated at the communication end pointed by the video stream, the action parameters are used to perform the virtual compensation.

5. The operating room communication method based on real-time images according to claim 1, characterized in that: The intervals between multiple time points selected in the time series are negatively correlated with the motion parameters of the object.

6. An operating room communication device based on real-time images, characterized in that: include: A communication establishing unit, configured to establish a data communication relationship between at least two communication terminals in response to a received link communication request or communication requirement; A data acquisition unit, used for acquiring video streams and audio streams generated at the communication end; A compression and sending unit, used for compressing the audio stream and sending it to the communication end pointed by the audio stream; A test unit, used to test the information fluency of the video stream pointing to the communication end, and obtain the value of the information fluency; A compression mode adjustment unit, used for selecting a compression mode of the video stream according to the value of the information fluency, the compression modes including feature-preserving compression and interval compression; Wherein, when feature-preserving compression is used, intermittent background data collection is performed at the communication end generating the video stream; When using interval compression, background data of the communication end where the video stream is generated is virtually compensated at the communication end to which the video stream is directed; Feature-preserving compression includes: When establishing a data communication relationship, collecting background data at a communication end for generating a video stream; Extracting and compressing the portrait at the communication end of the generated video stream to obtain compressed portrait data; Send the compressed portrait data to the communication end pointed by the video stream; When the person at the communication end generating the video stream moves and the amount of movement exceeds the allowed range, the background data at the communication end generating the video stream is collected at a low level; Low-level collection of background data at the communication end that generates the video stream includes: identifying individual subjects included in the background data; Collect edge features of individual objects and multiple points or areas in the area surrounded by edge features; When collecting edge features of individual objects, edge features are established based on gray value data. For areas where edge features cannot be established using gray value data, only the added portion is collected.

7. An operating room communication system based on real-time images, characterized in that: The system comprises: one or more memories for storing instructions; and One or more processors, configured to call and execute the instructions from the memory to perform the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: The computer readable storage medium comprises: The program, when the program is executed by a processor, the method according to any one of claims 1 to 5 is executed.

Images