Method, apparatus and computer-readable storage medium for transmitting tissue slice video data
By scanning and transmitting video data of tissue sections using a medical coordinate measuring machine, the problem of difficult analysis for pathologists in small and medium-sized hospitals has been solved, enabling efficient and real-time remote collaborative analysis.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- VISIONVERA INFORMATION TECH CO LTD
- Filing Date
- 2020-07-10
- Publication Date
- 2026-05-26
AI Technical Summary
Small and medium-sized hospitals often lack experienced pathologists who struggle to accurately analyze tissue slides, necessitating assistance from higher-level hospitals. Furthermore, the large file transfer speed of electronic tissue slides is slow and susceptible to network fluctuations.
Tissue sections are scanned using a medical coordinate measuring machine (CMM). The scanning range is determined based on the physical magnification and the scanning reference point. Video data is generated and transmitted via a video network. The monitoring access server performs protocol conversion and displays the data.
It enables remote real-time viewing of tissue slices, reduces the amount of scanned data, avoids network congestion, and improves transmission efficiency and the real-time performance and accuracy of analysis.
Smart Images

Figure CN111951932B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of data processing technology, and in particular to a method, apparatus, and computer-readable storage medium for transmitting tissue slice video data. Background Technology
[0002] Due to the scarcity of pathologists, most small and medium-sized hospitals do not have dedicated pathology departments. Even in those hospitals that do, the professional skills of the pathologists vary greatly. Because pathologists in small and medium-sized hospitals often lack extensive experience, they are unable to accurately analyze tissue sections and produce accurate reports. Therefore, they typically request assistance from doctors at higher-level hospitals to analyze tissue sections.
[0003] In related technologies, when doctors in small and medium-sized hospitals request assistance from doctors in higher-level hospitals to analyze tissue slides, they do so by creating electronic tissue slides of the diseased tissue and then submitting them to the higher-level hospital for analysis. Electronic tissue slides are generated by a slide scanning lens, which scans layer by layer according to a set magnification, resulting in a large file. Ordinary electronic tissue slides can easily be several gigabytes or even tens of gigabytes in size, making network transmission slow and prone to failure due to network fluctuations. Therefore, they must be submitted to the higher-level hospital regularly by a designated person. Summary of the Invention
[0004] In view of the above problems, embodiments of the present invention are proposed to provide a method, apparatus and computer-readable storage medium for transmitting tissue slice video data to overcome or at least partially solve the above problems.
[0005] To address the aforementioned problems, this invention discloses a method for transmitting tissue slide video data, applied to a medical coordinate measuring machine (CMM) microscope. The method includes:
[0006] The first scanning range of the scanning lens is determined based on the first physical magnification of the scanning lens;
[0007] The first region is determined based on the first scanning reference point of the scanning lens and the first scanning range;
[0008] Control the scanning lens to scan the first area and obtain the first scan data;
[0009] The first scanned data is encoded according to a preset format to obtain the first video data;
[0010] The first video data is sent to the monitoring access server, and then the monitoring access server sends the first video data to the tissue slice display system through the video network, so that the tissue slice display system can display the first video data. The monitoring access server and the tissue slice display system are connected through the video network.
[0011] This invention discloses a method for transmitting video data from tissue sections, applied to a tissue section display system. The method includes:
[0012] The system receives first video data from a medical coordinate measuring machine (CMM) video microscope sent by a monitoring access server via a video network. The first video data is obtained by encoding the first scan data by the medical CMM video microscope according to a preset format encoding.
[0013] Display the first video data.
[0014] This invention also discloses a tissue section video data transmission device for use in a medical coordinate measuring machine (CMM), the device comprising:
[0015] The first determining module is used to determine the first scanning range of the scanning lens based on the first physical magnification of the scanning lens;
[0016] The second determining module is used to determine the first region based on the first scanning reference point of the scanning lens and the first scanning range;
[0017] The first acquisition module is used to control the scanning lens to scan the first area and acquire the first scan data;
[0018] The second acquisition module is used to encode the first scan data according to a preset format to obtain the first video data;
[0019] The first sending module is used to send the first video data to the monitoring access server, and then send the first video data to the tissue slice display system through the video network via the monitoring access server, so that the tissue slice display system can display the first video data.
[0020] This invention also discloses a tissue slide video data transmission device, applied to a tissue slide display system, the device comprising:
[0021] The second receiving module is used to receive first video data from a medical coordinate measuring machine (CMM) sent by a monitoring access server via a video network. The first video data is obtained by encoding the first scan data by the medical CMM according to a preset format encoding.
[0022] The second display module is used to display the first video data.
[0023] This invention also discloses a tissue slice video data transmission device, comprising:
[0024] One or more processors; and
[0025] One or more computer-readable media having instructions stored thereon, which, when executed by the one or more processors, cause the apparatus to perform the tissue slice video data transmission method as described in any embodiment of the present invention.
[0026] This invention also discloses a computer-readable storage medium storing a computer program that causes a processor to execute the tissue slice video data transmission method as described in this invention.
[0027] The embodiments of the present invention have the following advantages:
[0028] In the tissue slice video data transmission method provided in this embodiment of the invention, the scanning lens is controlled to collect the first scan data of the first region in real time, and after encoding to obtain the first video data, it is sent to the monitoring access server in the form of monitoring, and then sent by the monitoring access server to the tissue slice display system for display. Since this application only scans the first region, compared with the traditional layer-by-layer scanning of tissue slices, the amount of scanning data is greatly reduced. Furthermore, since the monitoring access server and the tissue slice display system use a video network, network congestion can be avoided and transmission efficiency can be guaranteed. Attached Figure Description
[0029] Figure 1 This is a schematic diagram of an implementation environment provided in one embodiment of this application;
[0030] Figure 2 This is a flowchart of a method for transmitting video data from tissue slices according to an embodiment of this application;
[0031] Figure 3 This is a flowchart of another method for transmitting tissue slice video data according to an embodiment of this application;
[0032] Figure 4 This is a structural block diagram of a tissue slice video data transmission device provided in one embodiment of this application;
[0033] Figure 5 This is a structural block diagram of another tissue slice video data transmission device provided in an embodiment of this application.
[0034] Figure 6 This is a network diagram of a video network according to the present invention;
[0035] Figure 7 This is a schematic diagram of the hardware structure of a node server according to the present invention;
[0036] Figure 8 This is a schematic diagram of the hardware structure of an access switch according to the present invention;
[0037] Figure 9 This is a schematic diagram of the hardware structure of an Ethernet protocol gateway according to the present invention. Detailed Implementation
[0038] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0039] Please refer to Figure 1 , Figure 1 This is a schematic diagram of an implementation environment provided in one embodiment of this application. For example... Figure 1 As shown, the implementation environment includes: a medical coordinate measuring machine (CMM) video microscope, a monitoring access server, and a tissue slide display system. The CMM video microscope has a built-in scanning lens that can scan tissue slides. The CMM video microscope and the monitoring access server are connected via the Internet, and the monitoring access server and the tissue slide display system are connected via a video network.
[0040] Continue to refer to Figure 1 In one specific implementation scenario, a medical coordinate measuring machine (CMM) video microscope can be deployed in the pathology department of a small to medium-sized hospital. Additionally, a monitoring access server is deployed within the hospital, enabling communication between the CMM and the monitoring access server via the hospital's intranet. A tissue slide display system is deployed in the pathology department of a higher-level hospital, located within a video network. Thus, the CMM and the monitoring access server can connect via the internet, and the monitoring access server and the tissue slide display system can connect via the video network. Furthermore, the CMM can be connected to an external computer device, providing a client interface for doctors in small to medium-sized hospitals to control the CMM and to receive and display data from the tissue slide display system. Similarly, the tissue slide display system can also include a computer device, providing a client interface for doctors or specialists in higher-level hospitals to control the CMM and to receive and display video data scanned by the CMM from the monitoring access server.
[0041] In some implementations, doctors at the tissue slide display system can also join video conferences with doctors in small and medium-sized hospitals via computer devices for audio and video communication.
[0042] It should be noted that the aforementioned medical coordinate measuring machine (CMM) video microscope and monitoring access server are not necessarily deployed in small and medium-sized hospitals, and the tissue slide display system is not necessarily deployed in higher-level hospitals. In practice, any hospital that needs the assistance of other hospitals for remote tissue slide analysis can deploy a medical CMM video microscope and monitoring access server, and any hospital that assists other hospitals in remote tissue slide analysis can deploy a tissue slide display system, thereby realizing the aforementioned remote tissue slide analysis function.
[0043] Please refer to Figure 2 , Figure 2 This is a flowchart illustrating a method for transmitting video data from tissue sections according to an embodiment of this application. This method can be applied to medical coordinate measuring machine (CMM) microscopy. Figure 2 As shown, the method may specifically include the following steps:
[0044] Step S201: Determine the first scanning range of the scanning lens based on the first physical magnification of the scanning lens.
[0045] In this embodiment, the physical magnification refers to the actual magnification of the scanning lens of the medical coordinate measuring machine (CMM). The actual magnification of the scanning lens of a medical CMM is typically a range, which can be adjusted according to the user's needs.
[0046] The first physical magnification can be either the initial physical magnification of the scanning lens or a magnification actively selected by the physician in a small or medium-sized hospital. Typically, the physical magnification of the scanning lens is initialized before or after each use of the medical coordinate measuring machine (CMM), for example, to 1x, or any other magnification within the actual magnification range. Therefore, if the medical CMM is being used immediately after startup, the first physical magnification is the initial magnification; if it's not being used immediately after startup, for example, after a physician in a small or medium-sized hospital has actively selected a physical magnification, the first physical magnification is the magnification actively selected by the physician at that moment.
[0047] In this embodiment, determining the first scanning range of the scanning lens based on the first physical magnification of the scanning lens is a prior art technique, and relevant existing methods can be referred to, so it will not be repeated here.
[0048] Step S202: Determine the first region based on the first scanning reference point of the scanning lens and the first scanning range.
[0049] Step S203: Control the scanning lens to scan the first area and obtain the first scan data.
[0050] In this embodiment, the scanning reference point refers to the point on which the scanning lens takes as the scanning reference, that is, the point corresponding to the center of the scanning lens.
[0051] The scanning area refers to the area corresponding to the scan data obtained by the scanning lens, which can be determined based on the scanning reference point and the scanning range.
[0052] The first scanning reference point can be the initial reference point of the scanning lens or a scanning reference point actively selected by the physician in a small or medium-sized hospital. Similarly, before or after each use of the medical coordinate measuring machine (CMM), the scanning reference point of the scanning lens is initialized, typically to the center point of the tissue slide stage. Therefore, if the medical CMM is being used immediately after startup, the first scanning reference point is the center of the tissue slide stage, i.e., the initial reference point. After loading the tissue slide onto the stage, the point on the tissue slide corresponding to the center of the tissue slide stage is used as the scanning reference point for scanning. If the medical CMM is not being used immediately after startup, for example, after a physician in a small or medium-sized hospital actively selects a scanning reference point, the first scanning reference point is the scanning reference point actively selected by the physician at that moment.
[0053] The scanning reference point and the first physical magnification can be adjusted by operating the mouse of the external microcomputer device of the medical coordinate measuring machine, or by directly operating the lens adjustment device built into the medical coordinate measuring machine.
[0054] After determining the first scanning reference point and the first scanning range of the scanning lens, the first region can be determined, thereby controlling the scanning lens to scan the first region. That is, the scanning lens can be controlled to scan the tissue slice with the point on the tissue slice corresponding to the first scanning reference point as the scanning center, combined with the first region, to obtain the first scanning data.
[0055] Step S204: Encode the first scan data according to a preset format to obtain the first video data.
[0056] In this embodiment, since the first scan data obtained by the scanning lens is not conducive to transmission and display, after obtaining the first scan data, the medical coordinate measuring machine can encode the first scan data according to a preset format to obtain the first video data. The preset format can be H264 or H265 format.
[0057] Step S205: The first video data is sent to the monitoring access server, and then the monitoring access server sends the first video data to the tissue slice display system through the video network, so that the tissue slice display system displays the first video data. The monitoring access server and the tissue slice display system are connected through the video network.
[0058] In this embodiment, the medical coordinate measuring machine can send the encoded first video data to the monitoring access server in the form of monitoring. Since the first video data received by the monitoring access server is based on the Internet protocol, the monitoring access server can first convert the first video data into a protocol based on the Internet protocol, that is, convert the first video data based on the Internet protocol into the first video data based on the video network protocol, and then send it to the tissue slide display system.
[0059] After receiving the first video data based on the video network protocol, the tissue slide display system can parse the first video data and then display the video corresponding to the parsed first video data on the client interface provided by the microcomputer device, so that doctors in higher-level hospitals can remotely view tissue slides in real time.
[0060] Using the embodiments of the present invention, the first scan data of the first region can be collected in real time by controlling the scanning lens, and after encoding the first video data, it is sent to the monitoring access server in the form of monitoring. Then, the monitoring access server sends it to the tissue slide display system for display, so that experts and doctors can view it remotely in real time. This avoids the need to scan tissue slides into electronic tissue slides and submit them to higher-level hospitals in related technologies, simplifying the process of experts and doctors assisting in the analysis of tissue slides. At the same time, since this application only scans the first region, compared with the traditional layer-by-layer scanning of tissue slides, the amount of scanning data is greatly reduced.
[0061] Furthermore, since the medical coordinate measuring machine and the monitoring access server use the hospital's internal LAN, which is equivalent to using a dedicated network, the problem of network congestion can be avoided to a certain extent, ensuring transmission efficiency. In addition, since the monitoring access server and the tissue slide display system use a video network, which is also a dedicated network, the problem of network congestion can be avoided, further ensuring transmission efficiency.
[0062] In one implementation, a video conferencing system can be deployed between small and medium-sized hospitals and higher-level hospitals. Doctors in small and medium-sized hospitals can send meeting invitations to expert doctors in higher-level hospitals through the video conferencing system, inviting the expert doctors in higher-level hospitals to participate in remote tissue slide analysis meetings. After receiving the invitation, the expert doctors can use the video conferencing system to inform the doctors in small and medium-sized hospitals to prepare for the meeting, and the meeting will start at the agreed time.
[0063] Furthermore, considering that after reviewing the video corresponding to the first video data, specialist doctors may need to view video images of other areas as needed, the specialist doctor needs to inform the doctors in small and medium-sized hospitals of their needs. The doctors in these hospitals then operate the medical coordinate measuring machine to obtain video images of the other areas that the specialist doctor needs to view. This method requires the doctors in small and medium-sized hospitals to accurately understand the specialist doctor's needs before controlling the scanning lens, which reduces the real-time nature of tissue section viewing. Moreover, if the specialist doctor's needs are not accurately understood, the video images cannot be accurately obtained, affecting the specialist doctor's analysis.
[0064] Therefore, in order to enable doctors in higher-level hospitals to directly operate the medical coordinate measuring machine and control the scanning lens, so that expert doctors can obtain the required video images in real time and accurately, in one embodiment, after step S205 above, the tissue slide video data transmission method of this embodiment of the invention may further perform the following steps:
[0065] Step S206: Receive control data from the tissue slice display system sent by the monitoring access server.
[0066] Step S207: Determine the current scanning area of the scanning lens based on the control data.
[0067] Step S208: Control the scanning lens to scan the current scanning area and obtain the current scanning data.
[0068] Step S209: Encode the current scan data according to the preset format to obtain the current video data.
[0069] Step S210: The current video data is sent to the monitoring access server, and then the monitoring access server sends the current video data to the tissue slice display system so that the tissue slice display system can display the current video data.
[0070] In this embodiment, after viewing the video image corresponding to the first video data from the medical coordinate measuring machine (CMM), the expert physician may need to operate the CMM. At this time, the expert physician can input control commands into the tissue slide display system according to their needs. The tissue slide display system can then automatically generate control data based on the control commands and send the control data to the monitoring access server, which in turn sends the control data to the medical CMM. Similarly, the monitoring access server also performs a process of converting control data based on the video network protocol into control data based on the Internet protocol.
[0071] In this way, the medical coordinate measuring machine (CMM) can receive control data from the tissue slide display system sent by the monitoring access server. Based on the control data, it first determines the current scanning area of the scanning lens, then controls the scanning lens to scan the current scanning area to obtain the current scanning data. Then, it encodes the current scanning data according to a preset format to obtain the current video data, and sends the current video data to the monitoring access server. The monitoring access server then sends the current video data to the tissue slide display system so that the tissue slide display system can display the video image corresponding to the current video data. At this time, the expert doctor can view the video image of the tissue slide he / she needs.
[0072] In this embodiment, expert doctors can send control data from the tissue slide display system to the medical coordinate measuring machine (CMM) as needed, thereby controlling the CMM and scanning lens to obtain the video images they require. This improves the real-time performance and accuracy of remotely viewing tissue slides in different locations and increases the efficiency of remote tissue slide analysis.
[0073] Specifically, the actual needs of expert doctors may include, but are not limited to, the following three: viewing video images corresponding to video data in other areas, or switching the size and reference point of the display area of the currently displayed video image, or zooming in or out on the video image corresponding to the currently displayed first video data.
[0074] Considering that specialists may further observe the pathological conditions of other areas on the tissue section, their need at this time is to view the video images corresponding to the video data of other areas. Since it is only necessary to view the video images corresponding to the video data of other areas, this can be achieved by controlling the scanning lens to move the scanning reference point. Therefore, in one embodiment, the control data may include a second scanning reference point. In this case, the above step S207 may specifically include:
[0075] Step A1: Determine the current scanning area of the scanning lens based on the second scanning reference point and the first scanning range.
[0076] In this embodiment, since the expert doctor only needs to view video images of other areas and has no other needs, it is only necessary to switch the scanning reference point. Specifically, the medical coordinate video microscope can redetermine the scanning area of the scanning lens, i.e. the current scanning area, based on the second scanning reference point and the first scanning range. Then, the scanning lens can be controlled to scan the redetermined current scanning area to obtain the current scanning data and perform subsequent operations.
[0077] In practice, when a specialist needs to further observe other areas on a tissue slide, they can input a first operation command, namely, a command to view video images of other areas. At this time, the tissue slide display system can detect the first operation command and obtain the second scanning reference point selected by the specialist. Then, the tissue slide display system sends the control data including the second scanning reference point to the monitoring access server, which then sends the second scanning reference point to the medical coordinate measuring machine via the monitoring access server.
[0078] In this embodiment, expert doctors can remotely control the second scanning reference point of the scanning lens, which facilitates direct remote control of the medical coordinate measuring machine to obtain current video data, improving the real-time performance and accuracy of remote real-time viewing of tissue slices in different locations.
[0079] The first operation command can be input by using the mouse on the microcomputer device connected to the tissue slide display system to locate the second scanning reference point, and then clicking the mouse to select the second scanning reference point.
[0080] Furthermore, considering that specialists might switch screen sizes—that is, the size of the video image display area—for example, if a specialist is currently displaying the video image in full-screen mode, and then needs to switch out of full-screen mode to perform other operations, such as writing a pathology report on a specific lesion in the video image, they might use a half-screen or non-full-screen mode. Clearly, the display area in half-screen or non-full-screen mode is smaller than in full-screen mode. In traditional video image display methods, a smaller display area is proportionally scaled to maintain the original video image content. This means that in half-screen mode, the lesion in the video image also appears smaller. Therefore, when writing an analysis report on this lesion, the specialist cannot display it at the previous screen size, potentially leading to incorrect assessments of the lesion. Therefore, in this embodiment, it is desirable to be able to display a certain lesion tissue at the same screen size even after the display area size changes, so that the lesion tissue can still be clearly observed. In addition, in order to display a certain content in the video image, such as a certain lesion tissue, at the same screen size when using half-screen or non-full-screen mode, it is necessary to reduce the content of the video image actually displayed. Therefore, in order to retain the content that the expert needs to display, the expert needs to select a display area reference point, that is, the center point of the actual content displayed when using half-screen or non-full-screen mode, for example, selecting a point on a certain lesion tissue of interest as the display area reference point.
[0081] Therefore, in another implementation, the expert physician may need to switch the size of the display area and the reference point of the currently displayed video image. Consequently, the control data may include the display area size and the reference point of the tissue slice display system. In this case, step S207 may specifically include:
[0082] Step B1: Determine the first region as the current scanning region of the scanning lens.
[0083] Accordingly, step S208 above may include the following steps:
[0084] Step S2081: Control the scanning lens to scan the first area to obtain first scan data.
[0085] Step S2082: Determine the encoding area based on the display area size and the display area reference point.
[0086] Step S2083: Obtain the current scan data corresponding to the encoded region in the first scan data.
[0087] In this embodiment, the encoding region refers to the region corresponding to the data actually used for encoding in the first scan data. That is to say, in this embodiment, after obtaining the first scan data, it is not necessarily necessary to obtain the entire first scan data for encoding, but it is possible to obtain only a portion of the first scan data for encoding. If a portion of the first scan data is obtained for encoding, the region corresponding to that portion of the first scan data is the encoding region. If the entire scan data is encoded, the region corresponding to the entire scan data is the encoding region.
[0088] Therefore, in this embodiment, there is a correspondence between the encoding region and the current scan data. The medical coordinate video microscope can determine the encoding region based on the display area size and the display area reference point. Then, it can obtain the current scan data corresponding to the encoding region in the first scan data, and then encode only the current scan data according to the preset format.
[0089] Specifically, the medical coordinate measuring machine (CMM) video microscope can pre-store the display area size of the tissue slide display system in full-screen mode. Then, based on the display area size included in the control data, the size ratio between the two can be calculated. Combined with the display area reference point, the coded area can be determined. For example, if the size ratio between the display area size in full-screen mode and the display area size included in the control data is 2:1, then the coded area is half of the first area centered on the display area reference point.
[0090] In practice, after viewing the displayed video image, the specialist doctor may switch the display area size. Therefore, the specialist doctor can input a second operation command, which is a command to switch the display area based on a certain point. For example, first select a point on a lesion tissue, and then switch the screen size. At this time, the tissue slide display system can detect the second operation command, thereby obtaining the display area size and the display area reference point. The display area size is the size of the display area after switching, and the display area reference point is the point on the lesion tissue that the specialist doctor first selected. Then, the tissue slide display system sends the control data including the display area size and the display area reference point to the monitoring access server, and then the monitoring access server sends the display area size and the display area reference point to the medical coordinate measuring machine.
[0091] When a medical coordinate measuring machine (CMM) receives control data from a specialist doctor to switch the display area size, the CMM can directly determine the first area as the current scanning area of the scanning lens, since the display area size and reference point do not change the physical magnification of the scanning lens or the first scanning reference point of the scanning lens. Then, the CMM controls the scanning lens to scan the first scanning area to obtain the first scanning data, and then obtains the current scanning data corresponding to the coded area from the first scanning data and encodes it according to a preset format.
[0092] In this embodiment, the medical coordinate measuring machine (CMM) video microscope only encodes the scan data corresponding to the coded region. The encoded current video data is then sent to the tissue slide display system for display via a monitoring access server. Since the current video data is obtained by encoding only the scan data corresponding to the coded region, it reduces the amount of encoded and uploaded data by the medical CMM video microscope, ensuring the efficiency and quality of the current video data upload. On the other hand, it allows only the scan data corresponding to the coded region, i.e., the video data selected by the expert doctor, to be displayed on the limited screen, and displays the video image corresponding to the video data at the previous screen size, avoiding video image distortion and thus avoiding incorrect judgments when writing analysis reports.
[0093] Furthermore, considering that specialists may need to magnify or reduce the video image corresponding to the first video data displayed, for example, if a lesion in the video image is small and needs to be appropriately magnified for clearer observation, and to enable specialists to precisely control the magnification or reduction when magnifying or reducing the video image, in one embodiment, the control data may include the current logical magnification of the tissue slide display system and the third scanning reference point. In this case, step S207 may specifically include the following steps:
[0094] Step C1: Determine the second physical magnification of the scanning lens based on the current logical magnification and the ratio of the maximum logical magnification to the maximum physical magnification of the scanning lens.
[0095] Step C2: Determine the second scanning range of the scanning lens based on the second physical magnification.
[0096] Step C3: Determine the current scanning area of the scanning lens based on the third scanning reference point and the second scanning range of the scanning lens.
[0097] In this embodiment, the logical magnification refers to the magnification associated with the tissue section display system. The current logical magnification refers to the magnification selected by the expert physician when performing magnification or reduction operations in the tissue section display system. The maximum logical magnification refers to the maximum magnification that the expert physician can select in the tissue section display system.
[0098] In practice, after viewing the displayed video image, the expert doctor may zoom in or out on a certain location within the image. Therefore, the expert doctor can input a third operation command, which is a command to select the magnification for a specific location. At this time, the tissue slide display system can detect the third operation command, thereby obtaining the current logical magnification and the third scanning reference point selected by the expert doctor. Then, the tissue slide display system sends the control data, including the current logical magnification and the third scanning reference point, to the monitoring access server, which in turn sends the current logical magnification and the third scanning reference point to the medical coordinate measuring machine.
[0099] The third operation command can be entered by selecting a multiple in the drop-down box or by scrolling the mouse wheel. This embodiment does not specify the input method for the third operation command.
[0100] The medical coordinate measuring machine (CMM) video microscope pre-stores the maximum physical magnification of the scanning lens (an inherent property of the scanning lens) and the maximum logical magnification of the tissue section display system. Therefore, when the medical CMM video microscope receives control data from an expert physician requesting magnification or reduction of a certain location in the video image (corresponding to the third scanning reference point), it can determine the second physical magnification of the scanning lens based on the current logical magnification and the ratio of the maximum logical magnification to the maximum physical magnification of the scanning lens. After determining the second physical magnification, the second scanning range of the scanning lens can be determined based on the second physical magnification. As mentioned earlier, determining the scanning range of the scanning lens based on the physical magnification is existing technology and will not be elaborated here. Next, the current scanning area of the scanning lens can be determined based on the third scanning reference point and the second scanning range. The medical CMM video microscope then controls the scanning lens to scan the current scanning area to obtain the current scanning data, and then encodes the current scanning data according to a preset format.
[0101] In one implementation, the maximum logical magnification can be determined based on the maximum physical magnification, the maximum scanning area size of the scanning lens, and the actual display area size. Specifically, the maximum logical magnification = maximum physical magnification * (maximum scanning area size of the scanning lens / actual display area size). Since both the maximum scanning area size and the maximum physical magnification are fixed values, the maximum logical magnification is only related to the actual display area size; that is, the maximum logical magnification differs for different actual display area sizes.
[0102] For example, suppose the maximum logical magnification calculated in full-screen mode is 25x, and the maximum physical magnification is 50x, a ratio of 1:2. If the specialist selects a logical magnification of 15x, the determined second physical magnification is 30x. This means the scanning lens is actually scanning at a much higher magnification of 30x compared to the specialist's choice of 15x. Conversely, suppose in non-full-screen mode, the maximum logical magnification calculated based on the actual display area is 50x, and the maximum physical magnification is also 50x, a ratio of 1:1. If the specialist selects a logical magnification of 30x, the determined second physical magnification is also 30x. This means the scanning lens is also scanning at a magnification of 30x compared to the specialist's choice of 30x. Let's assume another non-full-screen scenario where the maximum logical magnification calculated based on the actual display area is 100x, and the maximum physical magnification is 50x, with a ratio of 2:1. If the expert doctor selects a current logical magnification of 50x, then the determined second physical magnification is 25x. In other words, compared to the expert doctor's selection of 50x, the scanning lens is actually scanning with a smaller magnification of 25x.
[0103] In other words, this embodiment allows for greater scaling of the video image when the actual display area of the screen is large, enabling the video image to be quickly adjusted to a suitable size. Conversely, when the actual display area of the screen is small, it allows for less scaling of the video image, preventing the video image from being adjusted too quickly and causing the image at a certain position in the video image to be lost due to excessively rapid zooming in or out.
[0104] In this embodiment, after receiving the current logical magnification from the tissue section display system, the medical coordinate measuring machine (CMM) does not directly use the current logical magnification as the second physical magnification of the scanning lens. Instead, it combines the current logical magnification with the ratio of the maximum logical magnification to the maximum physical magnification of the scanning lens to determine the second physical magnification of the scanning lens. Since the maximum logical magnification is determined based on the actual display area size, different second physical magnifications can correspond to different actual display areas. This allows the medical CMM to automatically select a more suitable physical magnification for different display areas, thereby more accurately controlling the scanning lens to scan and improving the display effect of the video image.
[0105] In one embodiment, the tissue slice video data transmission method of this embodiment may further include the following steps:
[0106] Step S211: Receive and display the analysis data from the tissue slice display system sent by the monitoring access server.
[0107] In this embodiment, the medical coordinate measuring machine (CMM) video microscope can send first video data or current video data to a monitoring access server. The monitoring access server then sends the first video data or current video data to a tissue slide display system for display. In this way, experts and doctors can analyze the tissue slides based on the video images corresponding to the first video data or the current video data, and obtain the analysis results. The experts and doctors can then input the analysis results into the tissue slide display system. At this time, the tissue slide display system can obtain the analysis data input by the user and send the analysis data to the monitoring access server, which then sends it to the medical CMM video microscope. After receiving the analysis data, the medical CMM video microscope can display it on an external microcomputer device for doctors in small and medium-sized hospitals to view.
[0108] In this embodiment, expert doctors and doctors in small and medium-sized hospitals can directly transmit analysis data, making it more convenient and timely for doctors in small and medium-sized hospitals to obtain tissue slide analysis data.
[0109] Based on the same inventive concept, please refer to Figure 3 , Figure 3 This is a flowchart of another tissue slide video data transmission method provided in an embodiment of this application. In this embodiment, the tissue slide video data transmission method is described in detail from the perspective of the tissue slide display system. Figure 3 As shown, the specific steps may include the following:
[0110] Step S301: Receive the first video data from the medical coordinate measuring machine sent by the monitoring access server via the video network.
[0111] The first video data is obtained by encoding the first scan data using the medical coordinate measuring machine according to a preset format.
[0112] Step S302: Display the first video data.
[0113] For details of this embodiment, please refer to the content of steps S201-S205 above, which will not be repeated here.
[0114] In this embodiment of the invention, the tissue slide display system can receive first video data after the first scan data has been encoded by a medical coordinate measuring machine according to a preset format, and display the video image of the first video data to a specialist doctor for viewing. This allows specialist doctors to remotely view tissue slides in real time at a different location, avoiding the need to scan tissue slides into electronic tissue slides and then submit them to a higher-level hospital, as required in related technologies. This simplifies the process of specialist doctors assisting in the analysis of tissue slides. At the same time, since this application only receives the first video data, the amount of video data received is greatly reduced.
[0115] Furthermore, since the medical coordinate measuring machine and the monitoring access server use the hospital's internal LAN, which is equivalent to using a dedicated network, the problem of network congestion can be avoided to a certain extent, ensuring transmission efficiency. In addition, since the monitoring access server and the tissue slide display system use a video network, which is also a dedicated network, the problem of network congestion can be avoided, further ensuring transmission efficiency.
[0116] To enable doctors in higher-level hospitals to directly operate the medical coordinate measuring machine and control the scanning lens, so that specialists can obtain the required video images in real time and accurately, in one embodiment, after the tissue slide display system displays the first video data, the tissue slide video data transmission method of this embodiment can further perform the following steps:
[0117] Step S303: Obtain control data.
[0118] Step S304: The control data is sent to the monitoring access server via the video network, and then the control data is sent to the medical coordinate measuring machine via the monitoring access server, so that the medical coordinate measuring machine can determine the current scanning area of the scanning lens according to the control data and control the scanning lens to obtain the current video data.
[0119] Step S305: Receive current video data from the medical coordinate measuring machine sent by the monitoring access server via the video network.
[0120] Step S306: Display the current video data.
[0121] For details of this embodiment, please refer to the content of steps S206-S210 above, which will not be repeated here.
[0122] In this embodiment, expert doctors can send control data from the tissue slide display system to the medical coordinate measuring machine (CMM) as needed, thereby controlling the CMM and scanning lens to obtain the video images they require. This improves the real-time performance and accuracy of remotely viewing tissue slides in different locations and increases the efficiency of remotely assisting in the analysis of tissue slides.
[0123] In one implementation, the control data may include a second scan reference point. In this case, step S303 may specifically include the following steps:
[0124] Step D1: When a first operation command input by the user is detected, the second scanning reference is obtained according to the first operation command.
[0125] Accordingly, step S304 above may specifically include the following steps:
[0126] S3041, the second scanning reference point is sent to the monitoring access server via the video network, and then the second scanning reference point is sent to the medical coordinate measuring machine via the monitoring access server, so that the medical coordinate measuring machine determines the current scanning area of the scanning lens based on the second scanning reference point and the first scanning range, and obtains the current video data based on the current scanning area.
[0127] Similarly, the specific details of this embodiment can be found in step A1 above, and will not be repeated here.
[0128] In this embodiment, expert doctors can remotely control the second scanning reference point of the scanning lens, which facilitates direct remote control of the medical coordinate measuring machine to obtain current video data, improving the real-time performance and accuracy of remote real-time viewing of tissue slices in different locations.
[0129] In another embodiment, the control data may include the display area size and display area reference point of the tissue slice display system. In this case, step S303 may specifically include the following steps:
[0130] Step E1: When a second operation command input by the user is detected, the display area size and the display area reference point are obtained according to the second operation command.
[0131] Accordingly, step S304 above may specifically include the following steps:
[0132] S3042, the display area size and the display area reference point are sent to the monitoring access server via the video network, and then the display area size and the display area reference point are sent to the medical coordinate video microscope via the monitoring access server, so that the medical coordinate video microscope can obtain the first scan data, obtain the current scan data corresponding to the encoding area in the first scan data, and encode the current scan data according to a preset format to obtain the current video data.
[0133] The encoding area is determined based on the display area size and the display area reference point.
[0134] Similarly, the specific details of this embodiment can be found in steps B1 and S2081-S2083 above, and will not be repeated here.
[0135] In this embodiment, the medical coordinate measuring machine (CMM) video microscope only encodes the scan data corresponding to the coded region. The encoded current video data is then sent to the tissue slide display system for display via a monitoring access server. Since the current video data is obtained by encoding only the scan data corresponding to the coded region, it reduces the amount of encoded and uploaded data by the medical CMM video microscope, ensuring the efficiency and quality of the current video data upload. On the other hand, it allows only the scan data corresponding to the coded region, i.e., the video data selected by the expert doctor, to be displayed on the limited screen, and displays the video image corresponding to the video data at the previous screen size, avoiding video image distortion and thus avoiding incorrect judgments when writing analysis reports.
[0136] In another implementation, the control data may include the current logical magnification of the tissue slice display system and the third scan reference point. In this case, step S303 may specifically include the following steps:
[0137] Step F1: When a third operation instruction input by the user is detected, the current logical amplification factor and the third scan reference point are obtained according to the third operation instruction.
[0138] Accordingly, step S304 above may specifically include the following steps:
[0139] S3043, the current logical magnification and the third scanning reference point are sent to the monitoring access server via the video network. Then, the monitoring access server sends the current logical magnification and the third scanning reference point to the medical coordinate measuring machine (CMM). This allows the CMM to determine the second physical magnification of the scanning lens based on the current logical magnification and the ratio of the maximum logical magnification to the maximum physical magnification of the scanning lens. Based on the second physical magnification, the CMM determines the second scanning range of the scanning lens. Based on the third scanning reference point and the second scanning range, the CMM determines the current scanning area of the scanning lens and obtains the current video data based on the current scanning area.
[0140] Similarly, the specific details of this embodiment can be found in steps C1-C3 above, and will not be repeated here.
[0141] In this embodiment, after receiving the current logical magnification from the tissue section display system, the medical coordinate measuring machine (CMM) does not directly use the current logical magnification as the second physical magnification of the scanning lens. Instead, it combines the current logical magnification with the ratio of the maximum logical magnification to the maximum physical magnification of the scanning lens to determine the second physical magnification of the scanning lens. Since the maximum logical magnification is determined based on the actual display area size, different second physical magnifications can correspond to different actual display areas. This allows the CMM to automatically select a more suitable physical magnification for different display areas, thereby more accurately controlling the scanning lens and improving the display effect of the video image.
[0142] In one embodiment, the tissue slice video data transmission method of this embodiment may further include the following steps:
[0143] Step S307: Obtain the analysis data input by the user.
[0144] Step S308: The analysis data is sent to the monitoring access server via the video network, and then the analysis data is sent to the medical coordinate measuring machine via the monitoring access server.
[0145] Similarly, the specific details of this embodiment can be found in step S211 above, and will not be repeated here.
[0146] In this embodiment, expert doctors and doctors in small and medium-sized hospitals can directly transmit analysis data, making it more convenient and timely for doctors in small and medium-sized hospitals to obtain tissue slide analysis data.
[0147] It should be noted that, for the sake of simplicity, the method embodiments are all described as a series of actions. However, those skilled in the art should understand that the embodiments of the present invention are not limited to the described order of actions, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions involved are not necessarily essential to the embodiments of the present invention.
[0148] Based on the same technical concept, please refer to Figure 4 , Figure 4 This illustration shows a structural block diagram of a tissue slice video data transmission device 40 according to an embodiment of this application. Figure 4 As shown, this device is used in a medical coordinate measuring machine (CMM) and includes:
[0149] The first determining module 41 is used to determine the first scanning range of the scanning lens based on the first physical magnification of the scanning lens;
[0150] The second determining module 42 is used to determine the first region based on the first scanning reference point of the scanning lens and the first scanning range;
[0151] The first acquisition module 43 is used to control the scanning lens to scan the first area and obtain the first scan data;
[0152] The second acquisition module 44 is used to encode the first scan data according to a preset format to obtain the first video data;
[0153] The first sending module 45 is used to send the first video data to the monitoring access server, and then send the first video data to the tissue slice display system through the video network via the monitoring access server, so that the tissue slice display system can display the first video data. The monitoring access server and the tissue slice display system are connected through the video network.
[0154] Optionally, the device further includes:
[0155] The first receiving module is used to receive control data from the tissue slice display system sent by the monitoring access server;
[0156] The third determining module is used to determine the current scanning area of the scanning lens based on the control data;
[0157] The third acquisition module is used to control the scanning lens to scan the current scanning area and obtain the current scanning data;
[0158] The fourth acquisition module is used to encode the current scan data according to the preset format to obtain the current video data;
[0159] The second sending module is used to send the current video data to the monitoring access server, and then send the current video data to the tissue slice display system through the monitoring access server, so that the tissue slice display system can display the current video data.
[0160] Optionally, the control data includes a second scanning reference point, and the third determining module includes:
[0161] The first determining submodule is used to determine the current scanning area of the scanning lens based on the second scanning reference point and the first scanning range.
[0162] Optionally, the control data includes the display area size and display area reference point of the tissue slice display system, and the third determining module includes:
[0163] The second determining submodule is used to determine the first region as the current scanning region of the scanning lens;
[0164] The third obtaining module includes:
[0165] The first acquisition submodule is used to control the scanning lens to scan the first area and obtain the first scan data;
[0166] The third determining submodule is used to determine the encoding area based on the display area size and the display area reference point;
[0167] The second acquisition submodule is used to acquire the current scan data corresponding to the encoding region in the first scan data.
[0168] Optionally, the control data includes the current logical magnification of the tissue slice display system and the third scan reference point, and the third determination module includes:
[0169] The fourth determining submodule is used to determine the second physical magnification of the scanning lens based on the current logical magnification and the ratio of the maximum logical magnification to the maximum physical magnification of the scanning lens;
[0170] The fifth determining submodule is used to determine the second scanning range of the scanning lens based on the second physical magnification.
[0171] The sixth determining submodule is used to determine the current scanning area of the scanning lens based on the third scanning reference point of the scanning lens and the second scanning range.
[0172] Optionally, the device further includes:
[0173] The first display module is used to receive and display the analysis data sent by the monitoring access server from the tissue slice display system.
[0174] Based on the same technical concept, please refer to Figure 5 , Figure 5 This illustration shows a structural block diagram of a tissue slice video data transmission device 50 according to an embodiment of this application. Figure 5 As shown, this device is used in a tissue section display system, and the device includes:
[0175] The second receiving module 51 is used to receive first video data from a medical coordinate measuring machine (CMM) sent by a monitoring access server via a video network. The first video data is obtained by encoding the first scan data by the medical CMM according to a preset format encoding.
[0176] The second display module 52 is used to display the first video data.
[0177] Optionally, the device further includes:
[0178] The fifth acquisition module is used to acquire control data;
[0179] The third sending module is used to send the control data to the monitoring access server through the video network, and then send the control data to the medical coordinate measuring machine through the monitoring access server, so that the medical coordinate measuring machine can determine the current scanning area of the scanning lens according to the control data, and control the scanning lens to obtain the current video data.
[0180] The third receiving module is used to receive current video data from the medical coordinate video microscope sent by the monitoring access server via the video network;
[0181] The third display module is used to display the current video data.
[0182] Optionally, the control data includes a second scanning reference point, and the fifth acquisition module includes:
[0183] The third acquisition submodule is used to obtain the second scanning reference point according to the first operation instruction input by the user when the first operation instruction is detected;
[0184] The third sending module includes:
[0185] The first sending submodule is used to send the second scanning reference point to the monitoring access server via the video network, and then send the second scanning reference point to the medical coordinate measuring machine via the monitoring access server, so that the medical coordinate measuring machine can determine the current scanning area of the scanning lens based on the second scanning reference point and the first scanning range, and obtain the current video data based on the current scanning area.
[0186] Optionally, the control data includes the display area size and display area reference point of the tissue slice display system, and the fifth obtaining module includes:
[0187] The fourth submodule is used to obtain the display area size and the display area reference point according to the second operation instruction input by the user when the second operation instruction is detected.
[0188] The third sending module includes:
[0189] The second sending submodule is used to send the display area size and the display area reference point to the monitoring access server via the video network, and then send the display area size and the display area reference point to the medical coordinate measuring machine via the monitoring access server, so that the medical coordinate measuring machine can obtain the first scan data, obtain the current scan data corresponding to the encoding area in the first scan data, and encode the current scan data according to a preset format to obtain the current video data, wherein the encoding area is determined based on the display area size and the display area reference point.
[0190] Optionally, the control data includes the current logical magnification of the tissue slice display system and the third scan reference point, and the fifth acquisition module includes:
[0191] The fifth acquisition submodule is used to obtain the current logical amplification factor and the third scanning reference point according to the third operation instruction when the user input is detected;
[0192] The third sending module includes:
[0193] The third sending submodule is used to send the current logical magnification and the third scanning reference point to the monitoring access server via the video network, and then send the current logical magnification and the third scanning reference point to the medical coordinate measuring machine via the monitoring access server, so that the medical coordinate measuring machine can determine the second physical magnification of the scanning lens based on the current logical magnification and the ratio of the maximum logical magnification to the maximum physical magnification of the scanning lens, determine the second scanning range of the scanning lens based on the second physical magnification, determine the current scanning area of the scanning lens based on the third scanning reference point and the second scanning range, and obtain the current video data based on the current scanning area.
[0194] Optionally, the device further includes:
[0195] The sixth module is used to acquire the analysis data input by the user;
[0196] The fourth sending module is used to send the analysis data to the monitoring access server via the video network, and then send the analysis data to the medical coordinate measuring machine via the monitoring access server.
[0197] This invention also provides a tissue slice video data transmission device, comprising:
[0198] One or more processors; and
[0199] One or more computer-readable instructions are stored thereon, which, when executed by the one or more processors, cause the apparatus to perform the tissue slice video data transmission method as described in any embodiment of the present invention.
[0200] This invention also provides a computer-readable storage medium storing a computer program that causes a processor to execute the tissue slice video data transmission method as described in this invention.
[0201] As the embodiment of the tissue slice video data transmission device is basically similar to the embodiment of the tissue slice video data transmission method, the description is relatively simple. For relevant details, please refer to the description of the tissue slice video data transmission method embodiment.
[0202] The video network is a significant milestone in network development. It is a real-time network that enables real-time transmission of high-definition video, pushing many internet applications towards high-definition video and enabling high-definition face-to-face interaction.
[0203] The video network adopts real-time high-definition video switching technology, which can integrate dozens of services such as high-definition video conferencing, video surveillance, intelligent monitoring and analysis, emergency command, digital broadcasting, time-delayed television, online teaching, live broadcasting, VOD, TV mail, personalized recording (PVR), intranet (self-operated) channels, intelligent video broadcast control, information release, etc., into a single system platform, enabling high-definition video playback through televisions or computers.
[0204] To enable those skilled in the art to better understand the embodiments of the present invention, the following describes the video network:
[0205] Some of the technologies used in the video network are described below:
[0206] Network Technology
[0207] VideoNet technology innovates and improves upon traditional Ethernet to handle the potentially massive video traffic on the network. Unlike simple packet switching or circuit switching, VideoNet technology uses packet switching to meet streaming requirements. VideoNet technology combines the flexibility, simplicity, and low cost of packet switching with the quality and security guarantees of circuit switching, achieving a fully switched virtual circuit across the network and seamless data format connectivity.
[0208] Switching Technology
[0209] The video network leverages the asynchronous and packet-switching advantages of Ethernet, eliminating its shortcomings while maintaining full compatibility. It features seamless end-to-end connectivity across the entire network, directly connecting to user terminals and carrying IP data packets. User data requires no format conversion across the network. As a more advanced form of Ethernet, the video network is a real-time switching platform capable of large-scale, real-time high-definition video transmission across the entire network—a feat currently impossible with the internet—promoting high-definition and unification in numerous network video applications.
[0210] Server Technology
[0211] The server technology on the VideoNet and Unified Video Platform differs from traditional servers. Its streaming media transmission is based on connection-oriented principles, and its data processing capabilities are independent of traffic and communication time. A single network layer can handle both signaling and data transmission. For voice and video services, the complexity of streaming media processing on the VideoNet and Unified Video Platform is much simpler than that of data processing, and its efficiency is more than a hundred times higher than that of traditional servers.
[0212] Storage Technology
[0213] The unified video platform's ultra-high-speed storage technology employs a state-of-the-art real-time operating system to accommodate ultra-large capacity and high traffic media content. This maps program information from server instructions to specific hard drive spaces, eliminating the need for server intervention and delivering media content directly to the user terminal instantly. User waiting time is typically less than 0.2 seconds. Optimized sector distribution significantly reduces the mechanical movement of hard drive heads seeking data, consuming only 20% of the resources of a comparable IP internet connection, while generating more than three times the concurrent traffic of traditional hard drive arrays, resulting in an overall efficiency improvement of over 10 times.
[0214] Network Security Technology
[0215] The structural design of the video network completely eradicates the network security problems that plague the Internet by implementing a separate license system for each service and complete isolation between devices and user data. It generally does not require antivirus programs or firewalls, thus preventing attacks by hackers and viruses and providing users with a structurally worry-free secure network.
[0216] Service Innovation Technology
[0217] The unified video platform integrates services and transmission, resulting in a single, automatic connection for individual users, private network users, and the entire network. User terminals, set-top boxes, or PCs connect directly to the unified video platform to access a wide variety of multimedia video services. The unified video platform uses a "recipe-style" configuration model to replace traditional complex application programming, enabling complex applications to be implemented with minimal code and facilitating "unlimited" new business innovation.
[0218] The networking topology of the video network is as follows:
[0219] A video network is a centralized control network structure. The network can be a tree network, a star network, a ring network, etc., but it requires a centralized control node to control the entire network.
[0220] like Figure 6 As shown, the video network is divided into two parts: the access network and the metropolitan area network.
[0221] The equipment in the access network can be mainly divided into three categories: node servers, access switches, and terminals (including various set-top boxes, encoders, and storage devices). Node servers are connected to access switches, and access switches can be connected to multiple terminals and can also connect to Ethernet.
[0222] In this context, the node server is the node that performs centralized control functions in the access network, controlling the access switches and terminals. The node server can be directly connected to the access switch or directly connected to the terminal.
[0223] Similarly, the equipment in the metropolitan area network (MAN) can also be divided into three categories: metropolitan area servers, node switches, and node servers. Metropolitan area servers are connected to node switches, and node switches can be connected to multiple node servers.
[0224] Among them, the node server is the node server of the access network part, that is, the node server belongs to both the access network part and the metropolitan area network part.
[0225] A metropolitan area network (MAN) server is a node in a MAN that provides centralized control, controlling both node switches and node servers. A MAN server can be directly connected to either a node switch or a node server.
[0226] Therefore, the entire visual network is a hierarchical centralized control network structure, and the network controlled by the node server and the metropolitan area server can be various structures such as tree, star, and ring.
[0227] Figuratively speaking, the access network can form a unified video platform (the part within the dotted circle), and multiple unified video platforms can form a video network; each unified video platform can be interconnected through metropolitan area and wide area video networks.
[0228] Classification of video network devices
[0229] 1.1 The devices in the video network of this invention can be mainly divided into three categories: servers, switches (including Ethernet gateways), and terminals (including various set-top boxes, encoding boards, memory, etc.). The video network as a whole can be divided into metropolitan area networks (or national networks, global networks, etc.) and access networks.
[0230] 1.2 The equipment in the access network can be mainly divided into three categories: node servers, access switches (including Ethernet gateways), and terminals (including various set-top boxes, encoders, memory, etc.).
[0231] The specific hardware structure of each access network device is as follows:
[0232] Node server:
[0233] like Figure 7 As shown, it mainly includes a network interface module 701, a switching engine module 702, a CPU module 703, and a disk array module 704;
[0234] In this system, incoming packets from the network interface module 701, CPU module 703, and disk array module 704 all enter the switching engine module 702. The switching engine module 702 performs an address table lookup operation on the incoming packets in 705 to obtain packet routing information. Based on this information, it stores the packet in the queue of the corresponding packet buffer 706. If the queue of packet buffer 706 is nearly full, the packet is discarded. The switching engine module 702 polls all packet buffer queues and forwards packets if the following conditions are met: 1) the port's transmit buffer is not full; 2) the packet counter in the queue is greater than zero. The disk array module 704 primarily controls the hard disk, including initialization, read / write operations, etc. The CPU module 703 is mainly responsible for protocol processing with the access switch and terminals (not shown in the figure), configuring the address table 705 (including downlink protocol packet address table, uplink protocol packet address table, and data packet address table), and configuring the disk array module 704.
[0235] Access switch:
[0236] like Figure 8 As shown, it mainly includes a network interface module (downlink network interface module 801, uplink network interface module 802), a switching engine module 803, and a CPU module 804.
[0237] In this process, packets (uplink data) coming into the downlink network interface module 801 enter the packet inspection module 805. The packet inspection module 805 checks whether the destination address (DA), source address (SA), data packet type, and packet length of the packet meet the requirements. If they do, it assigns the corresponding stream identifier and sends the packet to the switching engine module 803; otherwise, it discards the packet. Packets (downlink data) coming into the uplink network interface module 802 enter the switching engine module 803. Data packets coming into the CPU module 804 enter the switching engine module 803. The switching engine module 803 processes the incoming packets... The system performs a lookup operation in address table 806 to obtain packet routing information. If the packet entering the switching engine module 803 is destined for an uplink network interface from a downlink network interface, it is stored in the queue of the corresponding packet buffer 807 based on the stream identifier (stream-id). If the queue of the packet buffer 807 is close to full, it is discarded. If the packet entering the switching engine module 803 is not destined for an uplink network interface from a downlink network interface, it is stored in the queue of the corresponding packet buffer 807 according to the packet routing information. If the queue of the packet buffer 807 is close to full, it is discarded.
[0238] The switching engine module 803 polls all packet buffer queues, which in this embodiment of the invention is divided into two scenarios:
[0239] If the queue is from a downlink network interface to an uplink network interface, forwarding will proceed if the following conditions are met: 1) the port's transmit buffer is not full; 2) the queue's packet counter is greater than zero; 3) a token generated by the rate control module is obtained.
[0240] If the queue is not from a downlink network interface to an uplink network interface, forwarding will be performed if the following conditions are met: 1) the port's transmit buffer is not full; 2) the queue's packet counter is greater than zero.
[0241] The rate control module 808 is configured by the CPU module 804. It generates tokens for the packet buffer queues from all downlink network interfaces to uplink network interfaces at programmable intervals to control the uplink forwarding rate.
[0242] CPU module 804 is mainly responsible for protocol processing with the node server, configuring the address table 806, and configuring the bit rate control module 808.
[0243] Ethernet protocol gateway:
[0244] like Figure 9 As shown, it mainly includes a network interface module (downlink network interface module 901, uplink network interface module 902), a switching engine module 903, a CPU module 904, a packet detection module 905, a bit rate control module 908, an address table 906, a packet buffer 907, a MAC addition module 909, and a MAC deletion module 910.
[0245] In this process, incoming data packets from the downlink network interface module 901 enter the packet inspection module 905. The packet inspection module 905 checks whether the Ethernet MAC DA, Ethernet MAC SA, Ethernet length or frame type, video network destination address DA, video network source address SA, video network data packet type, and packet length of the data packets meet the requirements. If they do, the corresponding stream identifier (stream-id) is assigned. Then, the MAC deletion module 910 subtracts the MAC DA, MAC SA, length or frame type (2 bytes) and puts the data into the corresponding receive buffer; otherwise, the data is discarded.
[0246] The downlink network interface module 901 detects the transmit buffer of this port. If there is a packet, it obtains the corresponding terminal's Ethernet MAC DA based on the packet's video network destination address DA, adds the terminal's Ethernet MAC DA, the Ethernet protocol gateway's MACSA, the Ethernet length or frame type, and then sends it.
[0247] The other modules in the Ethernet protocol gateway function similarly to those in the access switch.
[0248] terminal:
[0249] It mainly includes network interface modules, service processing modules, and CPU modules; for example, a set-top box mainly includes a network interface module, an audio / video encoding / decoding engine module, and a CPU module; an encoding board mainly includes a network interface module, an audio / video encoding engine module, and a CPU module; and a storage mainly includes a network interface module, a CPU module, and a disk array module.
[0250] 1.3 The equipment in the metropolitan area network (MAN) can be mainly divided into two categories: node servers, node switches, and MAN servers. Node switches mainly consist of network interface modules, switching engine modules, and CPU modules; MAN servers mainly consist of network interface modules, switching engine modules, and CPU modules.
[0251] 2. Definition of video network data packets
[0252] 2.1 Access Network Data Packet Definition
[0253] The data packets in the access network mainly include the following parts: destination address (DA), source address (SA), reserved bytes, payload (PDU), and CRC.
[0254] As shown in the table below, the data packets in the access network mainly include the following parts:
[0255] DA SA Reserved Payload CRC
[0256] in:
[0257] The destination address (DA) consists of 8 bytes. The first byte indicates the type of data packet (such as various protocol packets, multicast packets, unicast packets, etc.), with a maximum of 256 possibilities. The second to sixth bytes are the metropolitan area network address, and the seventh and eighth bytes are the access network address.
[0258] The source address (SA) also consists of 8 bytes and is defined in the same way as the destination address (DA);
[0259] Reserved bytes consist of 2 bytes;
[0260] The payload portion has different lengths depending on the type of datagram. For various protocol packets, it is 64 bytes, and for unicast and multicast data packets, it is 32 + 1024 = 1056 bytes. Of course, it is not limited to these two types.
[0261] CRC consists of 4 bytes, and its calculation method follows the standard Ethernet CRC algorithm.
[0262] 2.2 Metropolitan Area Network Packet Definition
[0263] The topology of a metropolitan area network (MAN) is graphical, and there may be two or more types of connections between two devices. Specifically, there may be more than two types of connections between a node switch and a node server, between node switches, or between node switches and node servers. However, the MAN address of a MAN device is unique. To accurately describe the connection relationships between MAN devices, this invention introduces a parameter: a label, to uniquely describe a MAN device.
[0264] The label definitions in this manual are similar to those in MPLS (Multi-Protocol Label Switching). Assuming there are two connections between device A and device B, a data packet traveling from device A to device B will have two labels, and vice versa. Labels are categorized as incoming and outgoing labels. For example, if the label (incoming label) of a data packet entering device A is 0x0000, the label (outgoing label) of the same data packet leaving device A might become 0x0001. The metropolitan area network (MAN) entry process is a centrally controlled process, meaning that address allocation and label allocation are primarily handled by the MAN server. Node switches and node servers passively execute these processes. This differs from MPLS label allocation, where label allocation is the result of negotiation between switches and servers.
[0265] As shown in the table below, data packets in a metropolitan area network mainly include the following components:
[0266] DA SA Reserved Label Payload CRC
[0267] These are the Destination Address (DA), Source Address (SA), Reserved Bytes, Tag, Payload (PDU), and CRC. The tag format can be defined as follows: the tag is 32 bits, with the high 16 bits reserved and only the low 16 bits used. It is positioned between the Reserved Bytes and the payload in the data packet.
[0268] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.
[0269] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, apparatus, or computer program products. Therefore, embodiments of the present invention can take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware aspects. Furthermore, embodiments of the present invention can take the form of computer program products embodied on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0270] In other words, the technical solution of the present invention, or the part that contributes to the prior art, or part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention.
[0271] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0272] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0273] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal equipment, causing a series of operational steps to be performed on the computer or other programmable terminal equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable terminal equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0274] Although preferred embodiments of the present invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of the embodiments of the present invention.
[0275] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes said element.
[0276] The foregoing has provided a detailed description of a tissue slice video data transmission method, a tissue slice video data transmission device, and a computer-readable storage medium provided by the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.
Claims
1. A method for transmitting tissue slice video data, the method comprising: The method, applied to a medical coordinate measuring machine (CMM) video microscope, includes: The first scanning range of the scanning lens is determined based on the first physical magnification of the scanning lens; The first region is determined based on the first scanning reference point of the scanning lens and the first scanning range; Control the scanning lens to scan the first area and obtain the first scan data; The first scanned data is encoded according to a preset format to obtain the first video data; The first video data is sent to the monitoring access server, and then the monitoring access server sends the first video data to the tissue slice display system through the video network, so that the tissue slice display system can display the first video data. The method further includes: Receive and display analysis data from the tissue slice display system sent by the monitoring access server; The control data includes the current logical magnification of the tissue slice display system and the third scanning reference point. Determining the current scanning area of the scanning lens based on the control data includes: The second physical magnification of the scanning lens is determined based on the current logical magnification and the ratio of the maximum logical magnification to the maximum physical magnification of the scanning lens. The maximum logical magnification is determined based on the maximum physical magnification, the maximum scanning area size of the scanning lens, and the actual display area size. The second scanning range of the scanning lens is determined based on the second physical magnification. The current scanning area of the scanning lens is determined based on the third scanning reference point of the scanning lens and the second scanning range.
2. The method according to claim 1, characterized in that, After transmitting the first video data to the tissue slice display system via the video network through the monitoring access server, the method further includes: Receive control data from the tissue slice display system sent by the monitoring access server; Based on the control data, the current scanning area of the scanning lens is determined; The scanning lens is controlled to scan the current scanning area to obtain the current scanning data; The current scanned data is encoded according to the preset format to obtain the current video data; The current video data is sent to the monitoring access server, and then the monitoring access server sends the current video data to the tissue slice display system so that the tissue slice display system can display the current video data.
3. The method according to claim 2, characterized in that, The control data includes a second scanning reference point, and determining the current scanning area of the scanning lens based on the control data includes: The current scanning area of the scanning lens is determined based on the second scanning reference point and the first scanning range.
4. The method according to claim 2, characterized in that, The control data includes the display area size and display area reference point of the tissue section display system. Determining the current scanning area of the scanning lens based on the control data includes: The first region is defined as the current scanning region of the scanning lens; Controlling the scanning lens to scan the current scanning area and obtain current scanning data includes: The scanning lens is controlled to scan the first area to obtain first scan data; The encoding area is determined based on the display area size and the display area reference point; Obtain the current scan data corresponding to the encoded region from the first scan data.
5. A method for transmitting video data from tissue slices, characterized in that, The method, applied to a tissue section display system, includes: The system receives first video data from a medical coordinate measuring machine (CMM) video microscope sent by a monitoring access server via a video network. The first video data is obtained by encoding the first scan data by the medical CMM video microscope according to a preset format encoding. Display the first video data; The method further includes: Obtain analytical data input by the user; The analysis data is sent to the monitoring access server via the video network, and then the analysis data is sent to the medical coordinate video microscope via the monitoring access server. The control data includes the current logical magnification of the tissue slice display system and the third scan reference point. The acquisition of the control data includes: When a third operation command input by the user is detected, the current logical amplification factor and the third scan reference point are obtained according to the third operation command; The control data is sent to the monitoring access server via a video network, and then the control data is sent to the medical coordinate measuring machine via the monitoring access server, including: The current logical magnification and the third scanning reference point are sent to the monitoring access server via the video network. The monitoring access server then sends the current logical magnification and the third scanning reference point to the medical coordinate measuring machine (CMM). This allows the CMM to determine the second physical magnification of the scanning lens based on the current logical magnification and the ratio of the maximum logical magnification to the maximum physical magnification of the scanning lens. Based on the second physical magnification, the CMM determines the second scanning range of the scanning lens. Furthermore, based on the third scanning reference point and the second scanning range, the CMM determines the current scanning area of the scanning lens and obtains the current video data based on the current scanning area. The maximum logical magnification is determined based on the maximum physical magnification, the maximum scanning area size of the scanning lens, and the actual display area size.
6. The method according to claim 5, characterized in that, After displaying the first video data, the method further includes: Obtain control data; The control data is sent to the monitoring access server via the video network, and then the monitoring access server sends the control data to the medical coordinate measuring machine (CMM) so that the medical CMM can determine the current scanning area of the scanning lens based on the control data and control the scanning lens to obtain the current video data. The system receives current video data from the medical coordinate measuring machine via the monitoring access server through the video network. Display the current video data.
7. The method according to claim 6, characterized in that, The control data includes a second scan reference point, and the acquisition of control data includes: Upon detecting a first operation command input by the user, the second scanning reference point is obtained based on the first operation command; The control data is sent to the monitoring access server via a video network, and then the control data is sent to the medical coordinate measuring machine via the monitoring access server, including: The second scanning reference point is sent to the monitoring access server via the video network, and then the second scanning reference point is sent to the medical coordinate measuring machine via the monitoring access server, so that the medical coordinate measuring machine can determine the current scanning area of the scanning lens based on the second scanning reference point and the first scanning range, and obtain the current video data based on the current scanning area.
8. The method according to claim 6, characterized in that, The control data includes the display area size and display area reference point of the tissue section display system. Obtaining the control data includes: Upon detecting a second operation command input by the user, the display area size and the display area reference point are obtained according to the second operation command; The control data is sent to the monitoring access server via a video network, and then the control data is sent to the medical coordinate measuring machine via the monitoring access server, including: The display area size and the display area reference point are sent to the monitoring access server via the video network. Then, the monitoring access server sends the display area size and the display area reference point to the medical coordinate measuring machine (CMM) so that the medical CMM can obtain the first scan data, acquire the current scan data corresponding to the encoding area in the first scan data, and encode the current scan data according to a preset format to obtain the current video data. The encoding area is determined based on the display area size and the display area reference point.
9. A tissue slice video data transmission device, characterized in that, The device, used in a medical coordinate measuring machine (CMM) video microscope, includes: The first determining module is used to determine the first scanning range of the scanning lens based on the first physical magnification of the scanning lens; The second determining module is used to determine the first region based on the first scanning reference point of the scanning lens and the first scanning range; The first acquisition module is used to control the scanning lens to scan the first area and acquire the first scan data; The second acquisition module is used to encode the first scan data according to a preset format to obtain the first video data; The first sending module is used to send the first video data to the monitoring access server, and then send the first video data to the tissue slice display system through the video network via the monitoring access server, so that the tissue slice display system can display the first video data. The monitoring access server and the tissue slice display system are connected through the video network. The first display module is used to receive and display analysis data from the tissue slice display system sent by the monitoring access server; The control data includes the current logical magnification of the tissue slice display system and the third scan reference point. The third determination module includes: The fourth determining submodule is used to determine the second physical magnification of the scanning lens based on the current logical magnification and the ratio of the maximum logical magnification to the maximum physical magnification of the scanning lens. The maximum logical magnification is determined based on the maximum physical magnification, the maximum scanning area size of the scanning lens, and the actual display area size. The fifth determining submodule is used to determine the second scanning range of the scanning lens based on the second physical magnification. The sixth determining submodule is used to determine the current scanning area of the scanning lens based on the third scanning reference point of the scanning lens and the second scanning range.
10. A tissue slice video data transmission device, characterized in that, The device is used in a tissue section display system and includes: The second receiving module is used to receive first video data from a medical coordinate measuring machine (CMM) sent by a monitoring access server via a video network. The first video data is obtained by encoding the first scan data by the medical CMM according to a preset format encoding. The second display module is used to display the first video data; The sixth module is used to acquire the analysis data input by the user; The fourth sending module is used to send the analysis data to the monitoring access server via the video network, and then send the analysis data to the medical coordinate video microscope via the monitoring access server; The control data includes the current logical magnification of the tissue slice display system and the third scan reference point. The fifth acquisition module includes: The fifth acquisition submodule is used to obtain the current logical amplification factor and the third scanning reference point according to the third operation instruction when the user input is detected; The third sending module includes: The third sending submodule is used to send the current logical magnification and the third scanning reference point to the monitoring access server via the video network, and then send the current logical magnification and the third scanning reference point to the medical coordinate measuring machine via the monitoring access server. This allows the medical coordinate measuring machine to determine the second physical magnification of the scanning lens based on the current logical magnification and the ratio of the maximum logical magnification to the maximum physical magnification of the scanning lens. Based on the second physical magnification, it determines the second scanning range of the scanning lens. Based on the third scanning reference point and the second scanning range, it determines the current scanning area of the scanning lens and obtains the current video data based on the current scanning area. The maximum logical magnification is determined based on the maximum physical magnification, the maximum scanning area size of the scanning lens, and the actual display area size.
11. A tissue slice video data transmission device, characterized in that, include: One or more processors; and The device has one or more computer-readable instructions stored thereon, which, when executed by the one or more processors, cause the device to perform the tissue slice video data transmission method as described in any one of claims 1 to 4, or to perform the tissue slice video data transmission method as described in any one of claims 5 to 8.
12. A computer-readable storage medium, characterized in that, The stored computer program causes the processor to execute the tissue slice video data transmission method as described in any one of claims 1 to 4, or to execute the tissue slice video data transmission method as described in any one of claims 5 to 8.