Remote ultrasonic data processing method and device, equipment, medium and product

Abstract

The invention discloses a remote ultrasonic data processing method and device, equipment, a medium and a product, and the method comprises the steps that mobile ultrasonic equipment obtains an ultrasonic image of a target biological object and audio data of a near-end operation party of the mobile ultrasonic equipment, and sends the ultrasonic image and the audio data of the near-end operation party to at least one far-end device; the far-end device receives and displays the ultrasonic image and audio data of the near-end operation party, and receives annotation information of a far-end auditing party on the ultrasonic image and audio data of the far-end auditing party within a preset time period; and the mobile ultrasonic equipment receives the annotation information sent by the remote equipment and the audio data of the remote auditing party within a preset time period, and updates the ultrasonic image based on at least one piece of annotation information and the audio data of the remote auditing party. Based on the annotation information from the far-end device and the audio data of the far-end auditing party in the preset time period, the analysis result of the ultrasonic image is quickly generated so as to update the ultrasonic image.

Description

Technical Field

[0001] The present disclosure generally relates to the field of data processing technology, and in particular to a method, device, equipment, medium and product for processing remote ultrasound data. Background Art

[0002] With the rapid and high-quality development of medical imaging technology, ultrasound imaging, a medical imaging technology that uses high-frequency sound waves to create images, has been widely used. At present, the target biological object can be determined based on the analysis results of ultrasound images.

[0003] Specifically, in the process of determining the analysis result of the ultrasound image, it is necessary to first obtain the ultrasound image using the ultrasound device, and then receive and analyze the ultrasound image by different processing objects, so as to generate the analysis result of the ultrasound image according to the analysis opinions of the different processing objects on the ultrasound image. However, since the time when the different processing objects generate the analysis opinions is inconsistent, the efficiency of generating the analysis result of the ultrasound image is low.

[0004] Therefore, the low efficiency of generating analysis results of ultrasound images in the prior art has become a problem that needs to be solved. Summary of the invention

[0005] In view of the above-mentioned defects or deficiencies in the prior art, it is desired to provide a method, apparatus, device, medium and product for processing remote ultrasound data. The method can be used by a remote auditor to form annotation information for the ultrasound image and audio data related to the annotation information based on the ultrasound image obtained by a mobile ultrasound device and the audio data of a proximal operator, and the mobile ultrasound device can receive and respond to the annotation information and related audio data for the ultrasound image within a preset time period, thereby quickly generating analysis results of the ultrasound image to update the ultrasound image, thereby improving the efficiency of generating ultrasound image analysis results.

[0006] In a first aspect, the present invention provides a remote ultrasound data processing method, which is applied to an ultrasound data review system, wherein the ultrasound data review system includes a mobile ultrasound device and at least one remote device, and the method includes: The mobile ultrasound device acquires an ultrasound image of a target biological object and audio data of a proximal operator of the mobile ultrasound device, and transmits the ultrasound image and the audio data of the proximal operator to at least one remote device; the audio data of the proximal operator includes at least feature information of the target biological object obtained based on the ultrasound image; The remote device receives and displays the ultrasound image and the audio data of the near-end operator, and receives the annotation information of the ultrasound image and the audio data of the remote auditor within a preset time period; the annotation information is used to identify the key features of the ultrasound image, and the key features are related to the feature information of the target biological object in the audio data of the near-end operator; the audio data of the remote auditor includes at least the parsed content of the annotation information; The mobile ultrasound device receives the annotation information sent by the remote device and the audio data of the remote auditor within a preset time period, and updates the ultrasound image based on at least one of the annotation information and the audio data of the remote auditor.

[0007] In a second aspect, a remote ultrasound data processing device is provided, characterized in that it is applied to an ultrasound data review system, the ultrasound data review system includes a mobile ultrasound device and at least one remote device, and the device includes: A first processing unit is configured to enable the mobile ultrasound device to obtain an ultrasound image of a target biological object and audio data of a proximal operator of the mobile ultrasound device, and to send the ultrasound image and the audio data of the proximal operator to at least one remote device; the audio data of the proximal operator at least includes feature information of the target biological object obtained based on the ultrasound image; The second processing unit is used to enable the remote device to receive and display the ultrasound image and the audio data of the near-end operator, and receive the annotation information of the ultrasound image by the remote auditor and the audio data of the remote auditor within a preset time period; the annotation information is used to identify the key features of the ultrasound image, and the key features are related to the feature information of the target biological object in the audio data of the near-end operator; the audio data of the remote auditor at least includes the parsed content of the annotation information; The updating unit is used to enable the mobile ultrasound device to receive the annotation information sent by the remote device and the audio data of the remote auditor within a preset time period, and update the ultrasound image based on at least one of the annotation information and the audio data of the remote auditor.

[0008] In a third aspect, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method described in any one of the first aspects is implemented.

[0009] In a fourth aspect, a computer program product is provided. The computer program product includes instructions. When the instructions are executed, any method described in the first aspect is executed.

[0010] In a fifth aspect, a computer-readable storage medium is provided, on which a computer program is stored, characterized in that when the program is executed by a processor, the method described in any one of the first aspects is implemented.

[0011] Compared with the prior art, which easily leads to low efficiency in generating analysis results of ultrasonic images by integrating analysis opinions of different processing objects, the remote ultrasonic data processing method, device, equipment, medium and product provided in the embodiments of the present application can, on the one hand, receive annotation information of ultrasonic images sent from different remote devices within a preset time period, so as to determine the analysis results of key features in ultrasonic images by different remote reviewers based on the annotation information (wherein the key features of the ultrasonic images can correspond to the key features of the target biological objects), thereby solving the problem of inconsistent time for generating analysis opinions of different processing objects in the prior analysis technology by limiting the receiving time; on the other hand, the mobile ultrasonic device can receive audio data from the proximal operator, and send the audio data of the proximal operator to different remote devices, so that the remote reviewers corresponding to each remote device can form annotation information and audio data related to the annotation information based on the audio data of the proximal operator, so that the proximal operator corresponding to the mobile ultrasonic device and the remote reviewer corresponding to the remote device can analyze and process the ultrasonic image through audio data. Compared with the existing text-based analysis and processing, the transmission of audio data shortens the analysis time of the ultrasonic image and improves the efficiency of generating analysis results of the ultrasonic image. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings: Figure 1 A schematic diagram of the architecture of an ultrasound data review system 10 provided in an embodiment of the present application; Figure 2 A schematic diagram of a process flow of a remote ultrasound data processing method provided in an embodiment of the present application; Figure 3 A block diagram of a remote ultrasound data processing device provided in an embodiment of the present application; Figure 4 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0013] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant inventions, rather than to limit the inventions. It should also be noted that, for ease of description, only the parts related to the invention are shown in the accompanying drawings.

[0014] It should be noted that, in the absence of conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments. In addition, the term "and / or" herein is merely a description of the association relationship of associated objects, indicating that three relationships may exist, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order of objects.

[0015] First, the terms involved in this application are explained as follows: (1) Target biological object: It is the scanning object of the ultrasound device, which can be a biological object suspected of having abnormal conditions, such as a lesion in the human body.

[0016] Currently, after an ultrasound image is obtained using an ultrasound device, the ultrasound image is usually received and analyzed by different processing objects, so as to determine the analysis result of the target biological object in the ultrasound image by combining the analysis data of the ultrasound image by the different processing objects.

[0017] However, different processing objects generate analysis data at inconsistent times, which results in low efficiency in generating analysis results of ultrasound images, and there is no interactive data transmission between the operating object of the mobile device and the processing object of the ultrasound image, which makes it impossible for the remote processing object of the ultrasound image to review and guide the operation of the proximal operating object of the ultrasound device in real time.

[0018] Therefore, the low efficiency of generating analysis results of ultrasound images in the prior art has become a problem that needs to be solved.

[0019] Based on this, an embodiment of the present application provides a remote ultrasound data processing method, apparatus, device, medium and product. The method is applied to an ultrasound data review system including a mobile ultrasound device and at least one remote device. Specifically, the remote reviewer can form annotation information for the ultrasound image and audio data related to the annotation information based on the ultrasound image obtained by the mobile ultrasound device and the audio data of the proximal operator, and the mobile ultrasound device can receive and respond to the annotation information and related audio data of the ultrasound image within a preset time period, thereby quickly generating analysis results of the ultrasound image to update the ultrasound image, thereby improving the efficiency of generating ultrasound image analysis results.

[0020] Figure 1 1 is a schematic diagram of the architecture of an ultrasound data review system 10 provided in an embodiment of the present application. The ultrasound data review system 10 is used to execute the remote ultrasound data processing method of the present application, such as Figure 1As shown, the ultrasound data review system 10 includes a mobile ultrasound device 101 and at least one remote device 102 .

[0021] Exemplarily, the mobile ultrasound device 101 may include an ultrasound instrument and a display terminal, so as to obtain an ultrasound image of a scanned object by using the ultrasound instrument, and display the obtained ultrasound image on the display terminal.

[0022] Specifically, when the mobile ultrasound device 101 moves to a target location, it can be used to acquire and display an ultrasound image of a scanned object at the target location.

[0023] Exemplarily, the remote device 102 may be a terminal device that is communicatively connected to the mobile ultrasound device 101 , and the terminal device may be, for example, a smart TV, a smart phone, a tablet computer, a TV, a laptop computer, a desktop computer, etc.

[0024] In a specific implementation, the proximal operator of the mobile ultrasound device 101 can use an ultrasound instrument to obtain an ultrasound image of the scanned object, and the mobile ultrasound device 101 can collect audio data of the proximal operator; then the mobile ultrasound device 101 sends the ultrasound image and the audio data of the proximal operator to the remote device 102, so that the remote reviewer corresponding to the remote device 102 can generate annotation information for the ultrasound image and audio data related to the annotation information based on the ultrasound image and the audio data of the proximal operator.

[0025] Exemplarily, the mobile ultrasound device 101 can use physical interfaces such as a serial digital interface (SDI interface for short) and a high-definition multimedia interface (HDMI interface for short) to obtain ultrasound images obtained by an ultrasound instrument, and use its own sound receiving device to obtain audio data of its own proximal operator, wherein the sound receiving device can be a microphone set on itself.

[0026] Exemplarily, when the target position of the mobile ultrasound device 101 is the bedside where the abnormal biological object is located, the mobile ultrasound device 101 can be called a bedside ultrasound terminal; and the remote device 102 can be a medical video terminal that is communicatively connected to the bedside ultrasound terminal.

[0027] Correspondingly, when the abnormal biological object is a patient (i.e., the area where the abnormal biological object is located is a patient's ward), the proximal operator of the mobile ultrasound device 101 may be at least one attending physician of the patient, and the remote reviewer of the remote device 102 may be at least one remote expert who guides the attending physician. That is, one mobile ultrasound device 101 may correspond to one or more proximal operators, and one remote device 102 may also correspond to one or more remote reviewers.

[0028] Exemplary, reference Figure 1 The ultrasound data audit system 10 may further include a control device 103, which may be used to monitor the transmission data between the mobile ultrasound device 101 and at least one remote device 102, and in the event of a data transmission failure between the mobile ultrasound device 101 and a certain remote device 102, send indication information to the mobile ultrasound device 101, so that the proximal control party of the control device 103 may instruct the proximal operator of the mobile ultrasound device 101 to perform an operation.

[0029] Correspondingly, when the abnormal biological object is a patient (ie, the area where the abnormal biological object is located is a patient ward), the proximal control party of the control device 103 may be at least one remote expert instructing the attending physician in the quality control room.

[0030] For example, Figure 2 FIG. 1 is a flow chart of a method for processing remote ultrasound data provided by an embodiment of the present application. Figure 2 As shown, the method may include the following steps: In step S201, the mobile ultrasound device 101 acquires an ultrasound image of a target biological object and audio data of a proximal operator of the mobile ultrasound device 101, and sends the ultrasound image and the audio data of the proximal operator to at least one remote device 102; the audio data of the proximal operator includes at least feature information of the target biological object obtained based on the ultrasound image.

[0031] Exemplarily, the characteristic information of the target biological object may include the position, size, shape, growth direction, edge, echo, rear echo, calcification description, lymph node description, blood flow, and abnormality level of the target biological object, etc., which are not specifically limited here.

[0032] In one possible implementation, the mobile ultrasound device 101 can obtain the grouping results of the display resolutions corresponding to each remote device 102 based on the display resolution sent by at least one remote device 102, and send the corresponding ultrasound image and the audio data of the proximal operator to the remote device 102 based on each grouping result.

[0033] In the embodiment of the present application, by grouping the display resolutions corresponding to the remote devices 102 , the ultrasound images and audio data sent by the mobile ultrasound device 101 to the remote devices 102 can better adapt to the display resolutions of the remote devices 102 .

[0034] Exemplarily, for each remote device 102 , the mobile ultrasound device 101 can encode the ultrasound image obtained by itself and the audio data of the proximal operator based on the grouping result corresponding to the display resolution using the encoding data corresponding to the grouping result to send the encoding processing result to the remote device 102 .

[0035] Specifically, each set of display resolutions may correspond to a set of encoding data; for example, the encoding data may include a resolution, a bit rate, a frame rate, etc. applied during the encoding process.

[0036] In step S202, the remote device 102 receives and displays the ultrasound image and the audio data of the proximal operator, and receives the annotation information of the ultrasound image and the audio data of the remote auditor within a preset time period; the annotation information is used to identify the key features of the ultrasound image, and the key features are related to the feature information of the target biological object in the audio data of the proximal operator; the audio data of the remote auditor includes at least the parsed content of the annotation information.

[0037] In an embodiment of the present application, after the remote device 102 receives the ultrasound image from the mobile ultrasound device 101 and the audio data from the proximal operator, by limiting the receiving time, the remote device 102 can receive the annotation information of the ultrasound image and the related audio data from the remote reviewer within a preset time period, thereby shortening the time spent by each remote reviewer in analyzing the ultrasound image and improving the efficiency of generating ultrasound image analysis results.

[0038] Exemplarily, the remote device 102 can display the ultrasound image from the mobile ultrasound device 101 on its own display device, and play the audio data from the proximal operator corresponding to the mobile ultrasound device 101 through its own playback device; wherein the display device of the remote device 102 can be a display screen of the device, and the playback device of the remote device 102 can be a speaker or earphone of the device, etc.

[0039] In one possible implementation, after the remote device 102 displays the ultrasound image and the audio data of the proximal operator, the remote reviewer corresponding to the remote device 102 can generate annotation information for the ultrasound image and audio data related to the annotation information based on the ultrasound image and the audio data of the proximal operator, and send the annotation information and audio data to the remote device 102 within a preset time period.

[0040] Exemplarily, the audio data related to the annotation information generated by the remote reviewer may include at least one of the following: analysis content of the annotation information, analysis content of the audio data of the proximal operator, instruction content to the proximal operator, and analysis content of the characteristic information of the target biological object based on its own annotation information.

[0041] Exemplarily, the preset time period is a limit on the time taken by the remote auditor to generate the annotation information and the audio data, so as to shorten the time taken by the remote auditor to analyze the ultrasound image by limiting the time taken.

[0042] Therefore, in order to improve the efficiency of generating ultrasonic image analysis results, the time spent by the remote auditor in generating annotation information and audio data can be limited to a shorter time, that is, the preset time period can be set to a shorter time period.

[0043] Preferably, the remote device 102 can send prompt information to the remote auditor while displaying the ultrasound image and the audio data of the proximal operator, so as to prompt the remote auditor to analyze the ultrasound image in time.

[0044] Step S203: the mobile ultrasound device 101 receives the annotation information and the audio data of the remote auditor sent by the remote device 102 within a preset time period, and updates the ultrasound image based on at least one of the annotation information and the audio data of the remote auditor.

[0045] Exemplarily, the mobile ultrasound device 101 can determine the key features of the ultrasound image based on the annotation information sent by at least one remote device 102 and the audio data of the corresponding remote reviewer, and adjust the proportion of the key features in the ultrasound image, thereby completing the update of the ultrasound image.

[0046] Compared with the prior art in which the analysis opinions of different processing objects are combined, which easily leads to low efficiency in generating analysis results of ultrasound images, the remote ultrasound data processing method provided in the embodiment of the present application can, on the one hand, receive annotation information of ultrasound images sent from different remote devices 102 within a preset time period, so as to determine the analysis results of key features in the ultrasound images by different remote review parties based on the annotation information (wherein the key features of the ultrasound images can correspond to the key features of the target biological objects), thereby solving the problem of inconsistent time for generating analysis opinions of different processing objects in the prior analysis technology by limiting the receiving time; on the other hand, The mobile ultrasound device 101 is capable of receiving audio data from a proximal operator, and sending the audio data of the proximal operator to different remote devices 102, so that the remote auditors corresponding to each remote device 102 can form annotation information and audio data related to the annotation information based on the audio data of the proximal operator, thereby enabling the proximal operator corresponding to the mobile ultrasound device 101 and the remote auditor corresponding to the remote device 102 to analyze and process the ultrasound image through the audio data. Compared with the existing text-based analysis and processing, the transmission of audio data shortens the analysis time of the ultrasound image and improves the efficiency of generating the analysis results of the ultrasound image.

[0047] In another embodiment of the present application, a specific implementation method of the mobile ultrasound device 101 sending ultrasound images and audio data of the near-end operator to the remote device 102 is also provided. Exemplarily, the aforementioned "sending ultrasound images and audio data of the near-end operator to at least one remote device 102" includes: the mobile ultrasound device 101 receives the display resolution sent by at least one remote device 102, and sorts at least one display resolution in descending order; based on the encoding level of the mobile ultrasound device 101, the sorted display resolutions are grouped to obtain a grouping result of the display resolutions, wherein each group of display resolutions corresponds to encoding data of an encoding level, and each group of display resolutions is greater than or equal to the minimum encoding resolution of the corresponding encoding level and less than the maximum encoding resolution of the corresponding encoding level; for each remote device 102, based on the encoding data corresponding to the grouping result of the display resolution, the ultrasound image and the audio data of the near-end operator are encoded, and the encoded ultrasound image and the audio data of the near-end operator are sent to the remote device 102.

[0048] In one possible implementation, for each remote device 102, the display resolution can be determined based on its own window resolution and decoding resolution, and the determined display resolution can be sent to the mobile ultrasound device 101; wherein the window resolution is the window resolution used by the remote device 102 to render the ultrasound image, and the decoding resolution is the decoding resolution of the ultrasound image supported by the performance specifications of the remote device 102 itself.

[0049] Exemplarily, the remote device 102 may determine the display resolution according to a comparison result between a corresponding value of the window resolution and a maximum value of the decoding resolution.

[0050] For example, the remote device 102 may determine the resolution with the smallest resolution value between the window resolution corresponding value and the maximum decoding resolution as its own display resolution.

[0051] Exemplarily, the mobile ultrasound device 101 may form its own encoding level by configuring different video encoding publishing specifications, so as to encode the ultrasound image and the audio data of the near-end operator based on the encoding data corresponding to each encoding level.

[0052] Correspondingly, the coding data corresponding to each coding level may include the resolution, bit rate, frame rate, etc. applied in the video coding process.

[0053] In a possible implementation, the mobile ultrasound device 101 may sort the display resolutions corresponding to the remote device 102 to encode the ultrasound image and the audio data of the near-end operator based on the encoding data corresponding to the sorting results of the display resolutions.

[0054] Exemplarily, the display resolutions corresponding to two coding levels may be determined as a group of display resolutions in descending order, that is, each group of display resolutions is greater than or equal to the minimum coding resolution of the corresponding coding level and less than the maximum coding resolution of the corresponding coding level.

[0055] Preferably, for each set of display resolutions, the maximum encoding resolution of the corresponding encoding level may be determined as the encoding data when encoding the ultrasound image and the audio data of the proximal operator.

[0056] In one possible implementation, after sending the ultrasound image and the audio data of the proximal operator to the remote device 102, the mobile ultrasound device 101 can also receive a receipt message sent from the remote device 102, so as to update the grouping result of the corresponding display resolution of the remote device 102 when the receipt message indicates that the ultrasound image and the audio data of the proximal operator have not been received.

[0057] Exemplarily, the remote device 102 may generate a receipt message to be sent to the mobile ultrasound device 101 according to the audio bit rate and / or video bit rate received by the remote device 102 .

[0058] For example, when the audio bit rate and the video bit rate are both 0, it means that the remote device 102 has not received any encoded data from the mobile ultrasound device 101. At this time, a receipt message indicating that the ultrasound image and the audio data of the proximal operator have not been received can be sent to the mobile ultrasound device 101, that is, the receipt information is actually data stream loss information.

[0059] Correspondingly, when the mobile ultrasound device 101 receives the above-mentioned data stream loss information, it can send the encoded data to the corresponding remote device 102 again.

[0060] Exemplarily, when the mobile ultrasound device 101 can still receive data stream loss information after sending the encoded data again, and the threshold of the data stream loss information received from a certain remote device 102 within a preset time period exceeds the preset threshold, the grouping result of the corresponding display resolution of the remote device 102 can be updated to encode the ultrasound image and the audio data of the proximal operator based on the new encoded data, and then send it to the remote device 102 again after the encoding is completed.

[0061] For example, the encoding level of the remote device 102 corresponding to the display resolution can be reduced so that the mobile ultrasound device 101 can encode the ultrasound image and the audio data of the near-end operator using new encoding data that is smaller than the current encoding data, and resend the encoded data to the remote device 102.

[0062] In another embodiment of the present application, a specific implementation of updating the ultrasound image by the mobile ultrasound device 101 is also provided. Exemplarily, the "updating the ultrasound image" mentioned above includes: determining the key features of the ultrasound image based on at least one annotation information; and adjusting the content and clarity of the key features in the ultrasound image based on the key features of the ultrasound image and the audio data of the remote reviewer.

[0063] In one possible implementation, for each remote device 102, the annotation information sent by the remote device 102 can be displayed on a transparent layer located on the upper layer of the ultrasound image to determine the overlapping area between the annotation information on the transparent layer and the ultrasound image, and the image features in the overlapping area are determined as key features of the ultrasound image.

[0064] Exemplarily, the remote reviewer may first generate annotation behavior based on the ultrasound image and the audio data of the proximal operator, and present the annotation behavior in the form of annotation information on a transparent layer above the ultrasound image displayed by the remote device 102. The remote device 102 then packages the generated annotation information into a data packet.

[0065] Correspondingly, when the mobile ultrasound device 101 receives a data packet sent by the remote device 102, it can parse the data packet and display the annotation information corresponding to the data packet in a transparent layer located on the upper layer of the ultrasound image to restore the annotation behavior of the remote reviewer.

[0066] Exemplarily, the annotation information can be expressed in text form, graphic form, and line form. Specifically, when the annotation information is expressed in text form, the annotation information may include the annotation text content, text font size, and text font size; when the annotation information is expressed in graphic form, the annotation information may include the relative coordinates of the annotation starting point relative to the upper left corner of the ultrasound image screen, the rotation angle of the annotation content, the scaling ratio of the annotation content, the moving coordinates of the annotation content relative to the current coordinates, the color of the annotation content, the thickness of the annotation content, and the coordinates of the annotation end point of the annotation graphic relative to the annotation starting point; when the annotation information is expressed in line form, the annotation information may include the relative coordinates of the annotation starting point relative to the upper left corner of the ultrasound image screen, the rotation angle of the annotation content, the scaling ratio of the annotation content, the moving coordinates of the annotation content relative to the current coordinates, the color of the annotation content, the thickness of the annotation content, and the coordinate points of the annotation line trajectory.

[0067] In one possible implementation, based on the above-mentioned annotation information, the key features already existing in the ultrasound image can be first determined, and then the ultrasound image can be updated based on the determined key features in the ultrasound image and the instructions to the proximal operator in the audio data of the remote reviewer.

[0068] Exemplarily, the remote auditor may determine standard key features of the target biological object corresponding to the ultrasound image based on the ultrasound image, and generate instructions to the proximal operator based on the comparison results of the standard key features with the key features already existing in the ultrasound image.

[0069] Based on this, the instructions to the proximal operator in the audio data of the remote auditor may include adjustments to the content of key features in the ultrasound image and the clarity of the key features.

[0070] For example, the ultrasound image 1 acquired by the mobile ultrasound device is a scanned image of the target biological object A. The remote auditor can determine that the standard key features corresponding to the target biological object A are A1, A2 and A3 based on the ultrasound image 1, and the existing features of the ultrasound image 1 only include A1 and A2. At this time, the instruction content generated by the remote auditor to the proximal operator can be to obtain an ultrasound image 2 including the key features A1, A2 and A3 of the target biological object A, so as to complete the update of the ultrasound image.

[0071] Exemplarily, when the mobile ultrasonic device 101 receives the annotation information sent by the remote device 102 and the audio data of the remote auditor, it can also receive the identity of the annotation information.

[0072] For example, the identity identifier of the annotation information may include the device identifier of the remote device 102, the device name of the remote device 102, the unique identifier of the annotation information, and the name identifier of the remote auditor, etc., which are not specifically limited here.

[0073] In a possible implementation, the mobile ultrasound device 101 may also receive indication information sent by the remote device 102 , where the indication information is used to indicate the retention of the annotation information of the ultrasound image by the remote auditor.

[0074] Exemplarily, when the instruction information sent by the remote device 102 indicates deleting the annotation information of the ultrasound image, the mobile ultrasound device 101 may delete the annotation information of the remote auditor corresponding to the remote device 102 based on the identifier of the remote device.

[0075] It should be noted that the remote device 102 may also send the above-mentioned marking information and indication information to other terminal devices 102 so that the other terminal devices 102 can clearly identify the marking information and the retention status of the marking information.

[0076] In another embodiment of the present application, other data transmission between the mobile ultrasound device 101 and the remote device 102 is also provided.

[0077] In the embodiment of the present application, the mobile ultrasonic device 101 may send a conference identifier to at least one remote device 102 by broadcasting, so that each remote device 102 may join the conference initiated by the mobile ultrasonic device 101 based on the conference identifier.

[0078] In a possible implementation, the mobile ultrasound device 101 may broadcast a conference identifier to one or more corresponding devices according to the pre-recorded device identifier and / or device name of the remote device 102 , and the conference identifier may be a conference number.

[0079] Exemplarily, the mobile ultrasonic device 101 may record the device identification of at least one remote device 102 in the form of a local address book.

[0080] Exemplarily, when the remote device 102 receives the conference identifier broadcast from the mobile ultrasonic device 101, it can display a conference prompt interface through its own display device to prompt the corresponding remote reviewer to determine whether to join the conference initiated by the mobile ultrasonic device 101; wherein, the conference prompt interface can be a prompt pop-up window.

[0081] Correspondingly, when the remote device 102 receives a confirmation receipt from the remote reviewer confirming joining the above conference, it can automatically send the display resolution to the mobile ultrasonic device 101.

[0082] In a possible implementation, while the mobile ultrasound device 101 receives audio data from the remote auditor, it can also receive images from the remote auditor to achieve audio and video communication between the near-end operator and the remote auditor.

[0083] Exemplarily, the image of the remote auditor may be acquired by the camera of the remote device 102 , so as to send the image of the remote auditor to the mobile ultrasound device 101 .

[0084] In a possible implementation, the mobile ultrasound device 101 may also receive and display text information from the remote device 102 , so that the near-end operator can perform corresponding operations based on the text information.

[0085] Correspondingly, the remote device 102 can also receive and display text information from the mobile ultrasound device 101, so that the remote auditor can determine the analysis content of the ultrasound image by the proximal operator based on the text information.

[0086] Exemplarily, the mobile ultrasonic device 101 and the remote device 102 may respectively display the received text information in a text display area of ​​a display device, wherein the text display area may also be referred to as a text discussion area.

[0087] Exemplarily, the text information may include a sending terminal identification, a sender name, a receiving terminal identification, a receiver name, etc., wherein the sender name and the receiver name may be the name of a near-end operator or a far-end auditor.

[0088] Exemplarily, after the mobile ultrasonic device 101 or the remote device 102 sends a text message, it can receive a confirmation message sent by the opposite device, so as to resend the text message to the opposite device if the confirmation message is not received within a preset time period; wherein the confirmation message is used to indicate that the device has successfully received the text message.

[0089] It should be noted that the mobile ultrasonic device 101 or the remote device 102 can send text information to a specific terminal device, that is, the mobile ultrasonic device 101 or the remote device 102 can selectively send text information to one or more terminal devices.

[0090] In another embodiment of the present application, a remote ultrasound data processing device is provided. Figure 3 FIG. 1 is a block diagram of a remote ultrasound data processing device according to an embodiment of the present application. Figure 3 The device includes a first processing unit 301, a second processing unit 302 and an updating unit 303.

[0091] The first processing unit 301 is configured to enable the mobile ultrasound device 101 to obtain an ultrasound image of a target biological object and audio data of a proximal operator of the mobile ultrasound device 101, and send the ultrasound image and the audio data of the proximal operator to at least one remote device 102; the audio data of the proximal operator at least includes feature information of the target biological object obtained based on the ultrasound image; The second processing unit 302 is used to enable the remote device 102 to receive and display the ultrasound image and the audio data of the near-end operator, and receive the annotation information of the ultrasound image by the remote auditor and the audio data of the remote auditor within a preset time period; the annotation information is used to identify the key features of the ultrasound image, and the key features are related to the feature information of the target biological object in the audio data of the near-end operator; the audio data of the remote auditor at least includes the parsed content of the annotation information; The updating unit 303 is used to enable the mobile ultrasound device 101 to receive the annotation information and the audio data of the remote auditor sent by the remote device 102 within a preset time period, and update the ultrasound image based on at least one of the annotation information and the audio data of the remote auditor.

[0092] Compared with the prior art in which the analysis opinions of different processing objects are combined, which easily leads to low efficiency in generating analysis results of ultrasound images, the remote ultrasound data processing device provided in the embodiment of the present application can, on the one hand, receive annotation information of ultrasound images sent from different remote devices 102 within a preset time period, so as to determine the analysis results of key features in the ultrasound images by different remote review parties based on the annotation information (wherein the key features of the ultrasound images can correspond to the key features of the target biological objects), thereby solving the problem of inconsistent time for generating analysis opinions of different processing objects in the prior analysis technology by limiting the receiving time; on the other hand, The mobile ultrasound device 101 is capable of receiving audio data from a proximal operator, and sending the audio data of the proximal operator to different remote devices 102, so that the remote auditors corresponding to each remote device 102 can form annotation information and audio data related to the annotation information based on the audio data of the proximal operator, thereby enabling the proximal operator corresponding to the mobile ultrasound device 101 and the remote auditor corresponding to the remote device 102 to analyze and process the ultrasound image through the audio data. Compared with the existing text-based analysis and processing, the transmission of audio data shortens the analysis time of the ultrasound image and improves the efficiency of generating the analysis results of the ultrasound image.

[0093] Reference below Figure 4 , Figure 4 A schematic diagram of the structure of a computer device suitable for implementing the embodiments of the present application is shown. Figure 4 As shown, the computer system 400 includes a central processing unit (CPU) 401, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage part 409 into a random access memory (RAM) 403. Various programs and data required for the operation instructions of the system are also stored in the RAM 403. The CPU 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0094] The following components are connected to the I / O interface 405: an input section 406 including a keyboard, a mouse, etc.; an output section 407 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 408 including a hard disk, etc.; and a communication section 409 including a network interface card such as a LAN card, a modem, etc. The communication section 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to the I / O interface 405 as needed. A removable medium 411, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 410 as needed so that a computer program read therefrom is installed into the storage section 408 as needed.

[0095] In particular, according to an embodiment of the present application, the above reference flow chart Figure 2 The described process can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication part 409, and / or installed from a removable medium 411. When the computer program is executed by the central processing unit (CPU) 401, the above-mentioned functions defined in the system of the present application are executed.

[0096] It should be noted that the computer-readable medium shown in the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium such as a computer-readable storage medium that can send, propagate or transmit a program for use by or in conjunction with an instruction execution system, device or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0097] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operating instructions of the system, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the aforementioned module, program segment or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, the boxes represented by two connections can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operating instruction, or can be implemented with a combination of dedicated hardware and computer instructions.

[0098] The units or modules involved in the embodiments described in the present application may be implemented by software or by hardware. The described units or modules may also be provided in a processor, for example, may be described as: a processor including a semantic extraction unit, a weight allocation unit, and a determination unit. The names of these units or modules do not, in some cases, constitute limitations on the units or modules themselves.

[0099] As another aspect, the present application further provides a computer-readable storage medium, which may be included in the computer device described in the above embodiment, or may exist independently without being installed in the computer device. The above computer-readable storage medium stores one or more programs, and when the above programs are used by one or more processors to execute the method described in the present application. For example, it can be executed Figure 2 The individual steps of the method are shown.

[0100] The present application embodiment provides a computer program product, which includes instructions. When the instructions are executed, the method described in the present application embodiment is executed. For example, Figure 2 The individual steps of the method are shown.

[0101] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the aforementioned disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present application (but not limited to) by each other to form a technical solution.

Claims

1. A method for processing remote ultrasound data, characterized in that: Applied to an ultrasound data review system, the ultrasound data review system includes a mobile ultrasound device and at least one remote device, the method includes: The mobile ultrasound device acquires an ultrasound image of a target biological object and audio data of a proximal operator of the mobile ultrasound device, and transmits the ultrasound image and the audio data of the proximal operator to at least one remote device; the audio data of the proximal operator at least includes feature information of the target biological object obtained based on the ultrasound image; The remote device receives and displays the ultrasound image and the audio data of the proximal operator, and receives the annotation information of the ultrasound image and the audio data of the remote auditor within a preset time period; the annotation information is used to identify the key features of the ultrasound image, and the key features are related to the feature information of the target biological object in the audio data of the proximal operator; the audio data of the remote auditor at least includes the parsed content of the annotation information; The mobile ultrasound device receives the annotation information and the audio data of the remote auditor sent by the remote device within a preset time period, and updates the ultrasound image based on at least one of the annotation information and the audio data of the remote auditor.

2. The method for processing remote ultrasonic data according to claim 1, characterized in that: The sending of the ultrasound image and the audio data of the proximal operator to at least one remote device includes: The mobile ultrasound device receives at least one display resolution sent by the remote device, and sorts the at least one display resolution in descending order; Based on the coding level of the mobile ultrasonic device, the sorted display resolutions are grouped to obtain a grouping result of the display resolutions, wherein each group of display resolutions corresponds to coding data of a coding level, and each group of display resolutions is greater than or equal to a minimum coding resolution of the corresponding coding level and less than a maximum coding resolution of the corresponding coding level; For each of the remote devices, the ultrasound image and the audio data of the near-end operator are encoded based on the encoding data corresponding to the grouping result of the display resolution, and the encoded ultrasound image and the audio data of the near-end operator are sent to the remote device.

3. The method for processing remote ultrasonic data according to claim 2, characterized in that: After sending the ultrasound image and the audio data of the proximal operator to the remote device, the method further includes: The mobile ultrasound device receives a receipt message sent from the remote device, and when the receipt message indicates that the ultrasound image and the audio data of the near-end operator are not received, updates the grouping result of the remote device corresponding to the display resolution.

4. The method for processing remote ultrasonic data according to claim 1, characterized in that: The updating of the ultrasound image comprises: Determining key features of the ultrasound image based on at least one of the annotation information; Based on the key features of the ultrasound image and the audio data of the remote auditor, the content and clarity of the key features in the ultrasound image are adjusted.

5. The method for processing remote ultrasonic data according to claim 4, characterized in that: Determining the key features of the ultrasound image includes: For each of the remote devices, displaying the annotation information sent by the remote device on a transparent layer located on an upper layer of the ultrasound image; An overlapping area between the annotation information on the transparent layer and the ultrasound image is determined, and image features in the overlapping area are determined as key features of the ultrasound image.

6. The method for processing remote ultrasonic data according to claim 1, characterized in that: The method further comprises: The mobile ultrasound device receives the indication information sent by the remote device, where the indication information is used to indicate the retention of the annotation information of the ultrasound image by the remote auditor; When the indication information indicates deleting the annotation information of the ultrasound image, based on the identifier of the remote device, the annotation information of the remote auditor corresponding to the remote device is deleted.

7. A remote ultrasonic data processing device, characterized in that: Applied to an ultrasound data review system, the ultrasound data review system includes a mobile ultrasound device and at least one remote device, the device includes: a first processing unit, configured to enable the mobile ultrasound device to acquire an ultrasound image of a target biological object and audio data of a proximal operator of the mobile ultrasound device, and to send the ultrasound image and the audio data of the proximal operator to at least one remote device; the audio data of the proximal operator at least includes feature information of the target biological object obtained based on the ultrasound image; a second processing unit, configured to enable the remote device to receive and display the ultrasound image and the audio data of the proximal operator, and receive the annotation information of the ultrasound image and the audio data of the remote auditor within a preset time period; the annotation information is used to identify key features of the ultrasound image, and the key features are related to the feature information of the target biological object in the audio data of the proximal operator; the audio data of the remote auditor at least includes the parsed content of the annotation information; An updating unit is used to enable the mobile ultrasound device to receive the annotation information and the audio data of the remote auditor sent by the remote device within a preset time period, and update the ultrasound image based on at least one of the annotation information and the audio data of the remote auditor.

8. A computer device, comprising a memory and a processor, wherein the memory stores instructions, and the processor is configured to execute the instructions to implement the method according to any one of claims 1 to 6.

9. A computer program product, characterized in that The computer program product comprises instructions, and when the instructions are executed, the method according to any one of claims 1 to 6 is implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images