Ultrasonic equipment, animation display method and device for ultrasonic scanning and medium

By embedding position sensors in the ultrasound device and generating and sending ultrasound scanning animations, the problem of fixing the view angle of the manual camera in the prior art cannot track the ultrasound probe technique, and efficient animation display in remote ultrasound consultation is achieved, which improves the consultation effect.

CN119908748AActive Publication Date: 2025-05-02QINGDAO HISENSE MEDICAL EQUIP
View PDF 14 Cites 0 Cited by

Patent Information

Application Number
CN202311414626.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-10-30
Publication Date
2025-05-02
Estimated Expiration
2043-10-30

AI Technical Summary

Technical Problem

In the existing remote ultrasound consultation technology, the perspective angle of the manual camera is fixed, and the ultrasound examination doctor's techniques cannot be tracked, especially when the whole body is scanned, which cannot clearly display the far-distance parts, which affects the consultation effect.

Method used

Design an ultrasonic device. The ultrasonic probe is equipped with a position sensor embedded in the ultrasonic probe to collect the position data of the ultrasonic probe during the scanning process, generate an ultrasonic scan animation through the processor, and send the target ultrasonic data and scan animation to the remote consultation terminal to realize the real-time display of the ultrasonic probe scanning animation.

Benefits of technology

In remote ultrasound consultation, the scanning animation of the ultrasound probe is presented intuitively and in real time, improving the fluency and effect of the consultation, especially when the whole body is scanned, the switching between the parts can be clearly displayed.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119908748A_ABST
    Figure CN119908748A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of image processing, in particular to ultrasonic equipment, an animation display method and device for ultrasonic scanning and a medium, and aims to solve the problem of poor consultation effect during traditional remote ultrasonic consultation. The equipment comprises an ultrasonic probe and a processor, the ultrasonic probe is used for collecting target ultrasonic data of a target object, and the ultrasonic probe comprises a pose sensor which is used for collecting pose data of the ultrasonic probe in the ultrasonic scanning process of the target object; the processor is used for determining a scanning position, corresponding to the target ultrasonic data, on the target object according to the target ultrasonic data and the candidate ultrasonic image data set; according to the pose data and the scanning position, generating a scanning animation for performing ultrasonic scanning on the target object, and sending the target ultrasonic data and the scanning animation to the target consultation terminal; the scanning animation is used for indicating the object part associated with the ultrasonic image corresponding to the target ultrasonic data and the posture of the ultrasonic probe on the object part, so that the consultation effect is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to an ultrasonic device, an animation display method, a device and a medium for ultrasonic scanning. Background Art

[0002] At present, there are obvious regional differences in medical levels. Compared with grassroots hospitals, provincial and municipal hospitals have richer clinical experience and can better make accurate diagnosis and treatment judgments, thereby reducing the misdiagnosis rate of grassroots hospitals. Therefore, telemedicine is a major development trend in medical diagnosis.

[0003] Under relevant technologies, remote ultrasound consultation is usually conducted based on two-channel videos, one of which is a high-definition ultrasound image video, used to present various ultrasound images; the other is a technique camera video, used to present the scanning angle and technique of the ultrasound probe.

[0004] However, under the relevant technology, the technique camera is usually installed in a fixed manner. Since the viewing angle and orientation of the technique camera are fixed, it cannot track the technique of the ultrasound doctor. Therefore, the consulting expert cannot always view the scanning technique from a good perspective, especially when performing a whole-body scan, such as scanning the head / legs in turn. The technique camera cannot clearly display the scan of a distant part, which affects the consultation effect of the remote ultrasound consultation. Summary of the invention

[0005] The purpose of this application is to provide an ultrasound device, an animation display method, a device and a medium for ultrasound scanning, which are used to intuitively and real-timely present the scanning animation demonstration of the ultrasound probe during remote ultrasound consultation, so as to make the consultation smoother and improve the consultation effect.

[0006] In a first aspect, the present application provides an ultrasound device, the ultrasound device comprising an ultrasound probe and a processor;

[0007] The ultrasonic probe is used to collect target ultrasonic data of the target object;

[0008] The ultrasonic probe comprises a posture sensor for collecting posture data of the ultrasonic probe during ultrasonic scanning of the target object;

[0009] The processor is used to determine a scanning position on the target object corresponding to the target ultrasound data according to the target ultrasound data and the candidate ultrasound image data set, wherein the ultrasound image data set includes ultrasound data and image description data of multiple different sections corresponding to various parts of the object;

[0010] According to the posture data and the scanning position, a scanning animation of an ultrasonic scan of the target object is generated, and the target ultrasonic data and the scanning animation are sent to a target consultation terminal; wherein the screen of the target consultation terminal displays an ultrasonic image and the scanning animation corresponding to the target ultrasonic data, and the scanning animation is used to indicate the object part associated with the ultrasonic image, and the posture of the ultrasonic probe on the object part. Optionally, the processor is specifically used to:

[0011] Extracting features from the target ultrasonic data to obtain a target feature vector;

[0012] According to the target feature vector, selecting reference ultrasound data from ultrasound data of multiple different sections corresponding to each part, wherein the reference ultrasound data is ultrasound data having a similarity with the target ultrasound data greater than a similarity threshold;

[0013] The scanning position corresponding to the target ultrasound data is determined according to the image description data corresponding to the reference ultrasound data.

[0014] Optionally, the processor is specifically configured to:

[0015] Determine the similarity between the target feature vector and the candidate feature vector according to the target feature vector and the candidate feature vector corresponding to the candidate ultrasound data, wherein the candidate ultrasound data is any one of the ultrasound data of the multiple different sections corresponding to the parts;

[0016] The candidate ultrasound data corresponding to the target similarity among the similarities is used as the reference ultrasound data, wherein the target similarity is the maximum value among the candidate similarities that are greater than the similarity threshold.

[0017] Optionally, the scanning position includes a part name of the scanning part and scanning point positioning data; then the processor is specifically used to:

[0018] The part name corresponding to the target ultrasound data is determined according to the part name in the image description data corresponding to the reference ultrasound data; and the scanning point positioning data corresponding to the target ultrasound data is determined according to the image probe positioning data corresponding to the reference ultrasound data.

[0019] Optionally, the processor is specifically configured to:

[0020] According to the part name, determining the sub-model to be displayed in the preset object digital model;

[0021] According to the scanning point positioning data, determining the coordinates of the scanning point to be displayed corresponding to the scanning point positioning data in the sub-model to be displayed;

[0022] The scanning animation is generated according to the posture data, the sub-model to be displayed and the coordinates of the scanning points to be displayed.

[0023] Optionally, the posture data includes at least one spatial coordinate and angle data associated with the at least one spatial coordinate; then the processor is specifically configured to:

[0024] Drawing an initial screen including the sub-model to be displayed according to the sub-model to be displayed and in combination with the object digital model;

[0025] According to the coordinates of the scanned points to be displayed, the scanned points to be displayed are drawn in the initial picture to obtain an intermediate picture;

[0026] The ultrasound probe is drawn in the intermediate picture according to at least one spatial coordinate of the posture data and a preset shape of the ultrasound probe; and the posture of the ultrasound probe drawn in the intermediate picture is adjusted according to the angle data associated with the at least one spatial coordinate to obtain the scanning animation.

[0027] Optionally, the posture sensor is specifically used for:

[0028] Collecting at least one spatial coordinate of the ultrasonic probe during ultrasonic scanning of the target object, and angle data associated with the at least one spatial coordinate;

[0029] The at least one spatial coordinate and angle data associated with the at least one spatial coordinate are used as the posture data, and the posture data is transmitted to the processor.

[0030] In a second aspect, the present application provides an animation display method of ultrasound scanning, which is applied to an ultrasound device, wherein the ultrasound device includes an ultrasound probe, and the method includes:

[0031] Collecting target ultrasound data of the target object, and collecting posture data of the ultrasound probe during ultrasound scanning of the target object through a posture sensor included in the ultrasound probe;

[0032] Determine, according to the target ultrasound data and the candidate ultrasound image data set, a scanning position on the target object corresponding to the target ultrasound data, wherein the ultrasound image data set includes ultrasound data and image description data of multiple different sections corresponding to various parts of the object;

[0033] According to the posture data and the scanning position, a scanning animation of an ultrasonic scan performed on the target object is generated, and the target ultrasonic data and the scanning animation are sent to a target consultation terminal; wherein the screen of the target consultation terminal displays an ultrasonic image and the scanning animation corresponding to the target ultrasonic data, and the scanning animation is used to indicate the object part associated with the ultrasonic image, and the posture of the ultrasonic probe on the object part. Optionally, determining the scanning position on the target object corresponding to the target ultrasonic data according to the target ultrasonic data and the candidate ultrasonic image data set includes:

[0034] Extracting features from the target ultrasonic data to obtain a target feature vector;

[0035] According to the target feature vector, selecting reference ultrasound data from ultrasound data of multiple different sections corresponding to each part, wherein the reference ultrasound data is ultrasound data having a similarity with the target ultrasound data greater than a similarity threshold;

[0036] The scanning position corresponding to the target ultrasound data is determined according to the image description data corresponding to the reference ultrasound data.

[0037] Optionally, the step of selecting reference ultrasound data from ultrasound data of a plurality of different sections corresponding to each part according to the target feature vector includes:

[0038] Determine the similarity between the target feature vector and the candidate feature vector according to the target feature vector and the candidate feature vector corresponding to the candidate ultrasound data, wherein the candidate ultrasound data is any one of the ultrasound data of the multiple different sections corresponding to the parts;

[0039] The candidate ultrasound data corresponding to the target similarity among the similarities is used as the reference ultrasound data, wherein the target similarity is the maximum value among the candidate similarities that are greater than the similarity threshold.

[0040] Optionally, the scanning position includes a part name of the scanning part and scanning point positioning data; then determining the scanning position corresponding to the target ultrasound data according to the image description data corresponding to the reference ultrasound data includes:

[0041] The part name corresponding to the target ultrasound data is determined according to the part name in the image description data corresponding to the reference ultrasound data; and the scanning point positioning data corresponding to the target ultrasound data is determined according to the image probe positioning data corresponding to the reference ultrasound data.

[0042] Optionally, generating a scanning animation of an ultrasonic scan performed on the target object according to the posture data and the scanning position includes:

[0043] According to the part name, determining the sub-model to be displayed in the preset object digital model;

[0044] According to the scanning point positioning data, determining the coordinates of the scanning point to be displayed corresponding to the scanning point positioning data in the sub-model to be displayed;

[0045] The scanning animation is generated according to the posture data, the sub-model to be displayed and the coordinates of the scanning points to be displayed.

[0046] Optionally, the posture data includes at least one spatial coordinate and angle data associated with the at least one spatial coordinate; then the processor is specifically configured to:

[0047] Drawing an initial screen including the sub-model to be displayed according to the sub-model to be displayed and in combination with the object digital model;

[0048] According to the coordinates of the scanned points to be displayed, the scanned points to be displayed are drawn in the initial picture to obtain an intermediate picture;

[0049] The ultrasound probe is drawn in the intermediate picture according to at least one spatial coordinate of the posture data and a preset shape of the ultrasound probe; and the posture of the ultrasound probe drawn in the intermediate picture is adjusted according to the angle data associated with the at least one spatial coordinate to obtain the scanning animation.

[0050] Optionally, collecting the posture data of the ultrasonic probe during ultrasonic scanning of the target object by a posture sensor included in the ultrasonic probe includes:

[0051] Collecting, by means of the posture sensor, at least one spatial coordinate of the ultrasonic probe during ultrasonic scanning of the target object, and angle data associated with the at least one spatial coordinate;

[0052] The at least one spatial coordinate and angle data associated with the at least one spatial coordinate are used as the posture data.

[0053] In a third aspect, the present application provides an animation display device for ultrasonic scanning, which is applied to an ultrasonic device, wherein the ultrasonic device includes an ultrasonic probe, and the device includes:

[0054] An acquisition module, used to acquire target ultrasonic data of a target object through the ultrasonic probe, and to acquire posture data of the ultrasonic probe during ultrasonic scanning of the target object through a posture sensor included in the ultrasonic probe;

[0055] a determination module, configured to determine a scanning position on the target object corresponding to the target ultrasound data according to the target ultrasound data and a candidate ultrasound image data set, wherein the ultrasound image data set includes ultrasound data and image description data of a plurality of different sections corresponding to various parts of the object;

[0056] An animation generation module is used to generate a scanning animation of an ultrasonic scan performed on the target object based on the posture data and the scanning position, and send the target ultrasonic data and the scanning animation to a target consultation terminal; wherein the ultrasonic image and the scanning animation corresponding to the target ultrasonic data are displayed on the screen of the target consultation terminal, and the scanning animation is used to indicate the object part associated with the ultrasonic image, and the posture of the ultrasonic probe on the object part.

[0057] In a fourth aspect, the present application provides a computer-readable storage medium. When the instructions in the computer-readable storage medium are executed by an ultrasound device, the ultrasound device can perform the animation display method of ultrasound scanning as described in the second aspect above.

[0058] In a fifth aspect, the present application provides a computer program product, including a computer program:

[0059] When the computer program is executed by the processor, the animation display method of ultrasonic scanning as described in the second aspect above is implemented.

[0060] The technical solution provided by the embodiments of the present application brings at least the following beneficial effects:

[0061] Since the ultrasound probe included in the ultrasound device in the embodiment of the present application has an embedded posture sensor, the posture data of the ultrasound probe during the ultrasound scanning of the target object can be collected, so that the ultrasound device can obtain the spatial coordinates of the ultrasound probe in space, and the angle data associated with the spatial coordinates, that is, the rotation and tilt, direction and angular velocity and other motion data in the spatial coordinate system associated with the posture sensor of the ultrasound probe, to prepare for the subsequent generation of a scanning animation for the ultrasound scanning of the target object; at the same time, based on the target ultrasound data of the target object collected by the ultrasound probe and the candidate ultrasound image data set, the position / location analysis of the target ultrasound data can be realized, so as to determine the current scanning position. The obtained target ultrasound data belongs to the part name and the scanning point positioning data of the cross-section image; then, according to the posture data and the part name and scanning point positioning data corresponding to the target ultrasound data, a scanning animation of the ultrasound scan performed on the target object is drawn and generated, and the scanning animation demonstration of the ultrasound probe can be presented intuitively and in real time in the remote ultrasound consultation, thereby improving the consultation effect during the remote ultrasound consultation; especially when the ultrasound device is used to perform a whole-body scan of the target object, the scanning animation picture of the corresponding sub-model can be generated in time by performing part / position analysis on the collected target ultrasound data, and the switching between the parts scanned by the ultrasound probe can be presented intuitively and in real time, thereby further improving the consultation effect during the remote ultrasound consultation. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. Obviously, the drawings introduced below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0063] Figure 1 This is an application scenario of an optional animation display method for ultrasonic scanning in an embodiment of the present application;

[0064] Figure 2 is a schematic diagram of the structure of an optional ultrasound probe in an embodiment of the present application;

[0065] Figure 3 It is a flow chart of an animation display method of ultrasonic scanning in an embodiment of the present application;

[0066] Figure 4 This is a schematic diagram of an example of image description data in an embodiment of the present application;

[0067] Figure 5 A schematic diagram of a logic for determining a scanning position of an ultrasound probe through target ultrasound data in an embodiment of the present application;

[0068] Figure 6 A flowchart of a specific method for determining a scanning position in an embodiment of the present application;

[0069] Figure 7 A flowchart of a specific method for generating a scanning animation in an embodiment of the present application;

[0070] Figure 8 A schematic diagram of a flow chart of a method for obtaining a scanning animation in an embodiment of the present application;

[0071] Fig.9A A schematic diagram of an initial screen obtained in one embodiment of the present application;

[0072] Fig. 9B This is a schematic diagram of an intermediate picture obtained in an embodiment of the present application;

[0073] Fig. 9C A schematic diagram of a scanning animation frame of a scanning animation in an embodiment of the present application;

[0074] Fig.9D A schematic diagram of a multi-frame scanning animation frame screen of a scanning animation in an embodiment of the present application;

[0075] Fig.10 This is a schematic diagram of an application interface in remote ultrasound consultation in an embodiment of the present application;

[0076] Fig.11 It is a flow chart of another animation display method of ultrasonic scanning in an embodiment of the present application;

[0077] Fig.12 This is another schematic diagram of an application interface in remote ultrasound consultation in an embodiment of the present application;

[0078] Fig.13 A flowchart showing a scanning animation on an ultrasound device in an embodiment of the present application;

[0079] Fig.14 A schematic diagram of a display interface of a scanning animation of an ultrasound device in an embodiment of the present application;

[0080] Fig.15 This is a schematic diagram of the specific implementation logic in remote ultrasound consultation in an embodiment of the present application;

[0081] Fig.16 It is a structural schematic diagram of an animation display device for ultrasonic scanning in an embodiment of the present application. DETAILED DESCRIPTION

[0082] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Among them, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0083] Furthermore, in the description of the embodiments of the present application, unless otherwise specified, “ / ” means or. For example, A / B can mean A or B. The “and / or” in the text is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, “multiple” refers to two or more than two.

[0084] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, "multiple" means two or more.

[0085] The following describes an application scenario of an optional animation display method for ultrasonic scanning provided by an embodiment of the present application in conjunction with the accompanying drawings. Figure 1 As shown in Figure , this application scenario corresponds to the remote ultrasound consultation scenario in actual applications. Figure 1 As shown, the application scenario includes an ultrasound device 10 used by a primary care doctor and a target consultation terminal 20 on a consulting expert side. The ultrasound device 10 and the target consultation terminal 20 establish a connection through a remote ultrasound cloud service to transmit data during ultrasound scanning, such as target ultrasound data for a target object collected by the ultrasound device 10; wherein,

[0086] The ultrasound device 10 includes an ultrasound probe 101 and a processor 102, wherein Figure 2 As shown in FIG. 1 , a schematic diagram of the structure of an optional ultrasound probe in an embodiment of the present application is shown. Figure 2 As shown, a posture sensor is embedded in the top of the ultrasonic probe 101, which is used to collect posture data of the ultrasonic probe during ultrasonic scanning of the target object, wherein the posture data includes at least one spatial coordinate and angle data corresponding to at least one spatial coordinate, such as the angular velocity, angular displacement, angular acceleration and other parameter values ​​of the ultrasonic probe on the coordinate axis corresponding to a certain spatial coordinate.

[0087] In practice, the above-mentioned posture sensor can be a microchip based on micro-electromechanical systems (MEMS) technology, wherein MEMS can use the Coriolis force principle to sense the rotation angle and angular velocity, and realize the measurement of the object (i.e., the ultrasonic probe 101) in the three axes of x, y, and z, angular velocity, angular displacement, angular acceleration and other parameters. In the embodiment of the present application, the installation position diagram of the above-mentioned microchip 1011 based on MEMS technology in the ultrasonic probe 101 is as follows Figure 2 See Figure 2 As shown, the microchip is embedded in the rear portion of the handheld portion of the ultrasound probe 101 .

[0088] It should be noted that in the embodiments of the present application, the microchip based on MEMS technology and its installation position in the ultrasonic probe are only examples. The present application does not specifically limit the sensor type of the specific posture sensor for obtaining the posture data of the ultrasonic probe, nor the installation position of the posture sensor.

[0089] Still reading Figure 1 As shown in the figure, the ultrasonic probe 101 is used to collect target ultrasonic data of the target object and transmit the collected target ultrasonic data to the processor 102;

[0090] A posture sensor is used to collect posture data of the ultrasound probe 101 during the ultrasound scanning of the target object; and transmit the collected posture data to the processor 102;

[0091] The processor 102 is configured to determine a scanning position on a target object corresponding to the target ultrasound data according to the target ultrasound data and the candidate ultrasound image data set, wherein the ultrasound image data set includes ultrasound data and image description data of multiple different sections corresponding to various parts of the object; generate a scanning animation of an ultrasound scan performed on the target object according to the posture data and the scanning position, and send the target ultrasound data and the scanning animation to the remote ultrasound cloud service, so that the remote ultrasound cloud service sends the received target ultrasound data and the scanning animation to the associated target consultation terminal 20;

[0092] The target consultation terminal 20 is used to display the ultrasound image and scanning animation corresponding to the received target ultrasound data on the screen, wherein the scanning animation is used to indicate the object part associated with the ultrasound image and the posture of the ultrasound probe on the object part.

[0093] It should be noted that Figure 1 The position of the processor 102 shown is only an example, and the installation position of the processor 102 is not specifically limited in the embodiment of the present application.

[0094] In some optional embodiments, Figure 1 As shown, the ultrasound device 10 also includes a display screen 103 for displaying the target ultrasound data and scanning animation in a display interface. The scanning animation is used to add a special display function to the existing display interface of the ultrasound device to meet the user's needs for displaying the corresponding scanning animation on the ultrasound device.

[0095] Of course, the method provided in the embodiment of the present application is not limited to Figure 1 The application scenario shown can also be used in other possible application scenarios, which are not limited in the embodiments of the present application. After introducing an optional application scenario and an optional structure of an ultrasonic probe in the embodiments of the present application, the following describes in detail an animation display method of ultrasonic scanning in the embodiments of the present application in conjunction with the accompanying drawings.

[0096] like Figure 3 As shown, a flowchart of an animation display method of ultrasonic scanning in an embodiment of the present application, the specific steps of the method are as follows:

[0097] Step S301: collect target ultrasound data of the target object, and collect the posture data of the ultrasound probe during the ultrasound scanning of the target object through the posture sensor included in the ultrasound probe.

[0098] Still refer to Figure 1 In the application scenario shown, during implementation, a primary care doctor performs an ultrasonic scan on a target object using an ultrasonic probe included in an ultrasonic device, executes step S301, collects target ultrasonic data of the target object, and, through a posture sensor in the ultrasonic probe, collects posture data of the ultrasonic probe during the ultrasonic scanning of the target object, wherein the posture data includes at least one spatial coordinate and angle data associated with the at least one spatial coordinate.

[0099] Under the related technology, ultrasonic data of the target object is collected by an ultrasonic device to obtain an ultrasonic video within a preset time period of a preset area including the target object, and the ultrasonic video collected by the ultrasonic device is subjected to frame extraction processing at a preset frame extraction interval to obtain target ultrasonic data corresponding to each frame, wherein the frame extraction interval can be determined by the device hardware performance and the internal parameter settings of the software system. If the frame extraction interval is small and the algorithm has a large amount of computation, more details of the part contour changes in the ultrasonic image corresponding to each frame of target ultrasonic data obtained will be obtained; if the frame extraction interval is large, the algorithm has a small amount of computation, the processing speed is faster, and the part contour changes between the ultrasonic images corresponding to each frame of target ultrasonic data obtained will be smoother. The above-mentioned frame extraction interval is not specifically limited in the embodiment of the present application, and can be specifically set according to actual needs during implementation.

[0100] In a specific implementation, when executing step S301, the posture data of the ultrasonic probe during ultrasonic scanning of the target object is collected by the posture sensor included in the ultrasonic probe, specifically at least one spatial coordinate of the ultrasonic probe during ultrasonic scanning of the target object and angle data associated with at least one spatial coordinate are collected; the at least one spatial coordinate and the angle data associated with at least one spatial coordinate are used as posture data.

[0101] Step S302: determining a scanning position on the target object corresponding to the target ultrasound data according to the target ultrasound data and the candidate ultrasound image data set, wherein the ultrasound image data set includes ultrasound data and image description data of multiple different sections corresponding to various parts of the object.

[0102] In an embodiment of the present application, the above-mentioned ultrasound image data set is pre-constructed, and the ultrasound image data set includes ultrasound data and image description data of multiple different sections corresponding to various parts of the object, wherein the image description data includes basic data corresponding to the ultrasound data, associated part data, associated section data, image probe information and associated human body model data.

[0103] For example, taking the target object as a human body, it is assumed that, based on the target ultrasound data and the ultrasound image data set, it is determined that the reference ultrasound data corresponding to the target ultrasound data is ultrasound data of a thyroid image with an ID of 540045896.

[0104] In the embodiment of the present application, the image description data corresponding to the ultrasound data of the thyroid image ID 540045896 is as follows: Figure 4 As shown. Figure 4As shown, the image description data includes basic data, associated part data, associated section data, image probe information and associated human body model data corresponding to the ultrasound image with the thyroid image ID of 540045896, wherein the basic data includes but is not limited to: image ID (540045896), image number (11249), image classification (thyroid cross section), storage location of ultrasound data (S3: / 10102 / 540045896.jpg), image size (11458), image dimension (1920*1080), filing date (2023-04-28), image clarity score (0.97545), etc.; the associated part data includes but is not limited to: first-level part (head), first-level part ID (101), second-level part (neck), second-level part ID (10102), part I D, organ / part name (thyroid), organ ID (10102004), etc.; associated section data include but are not limited to: left / right / side (0, such as representing left), section (cross section), section ID (501); image probe information includes but is not limited to: image probe positioning data (in the embodiment of the present application, the image probe positioning data is the scanning position point anchor data combined with the preset object digital model) (0.002451, 0.085614, 0.958123), default probe shape storage location (S3: / probe / gpxz20.obj), etc.; associated human body model data include but are not limited to: associated human body model orientation / side, associated organ 3D model storage location (S3: / module / 10102004.obj), associated organ 3D model three-dimensional size (56*60*20), etc.

[0105] In the embodiment of the present application, the scanning position determined in step S302 includes the part name of the scanning part and the scanning point positioning data. Figure 5 FIG. 1 is a schematic diagram of a logic for determining the scanning position of the ultrasound probe corresponding to the target ultrasound data by using the target ultrasound data in an embodiment of the present application. Figure 5 As shown, the target ultrasound data is acquired by an ultrasound probe, and then, through an image feature quantization model, based on the target ultrasound data and an ultrasound image data set, an image feature matching method is adopted to determine the scanning position on the target object corresponding to the target ultrasound data, that is, the scanning part and scanning point positioning data.

[0106] In the embodiment of the present application, Figure 5The image feature vector quantization model shown is used to extract features from target ultrasound data, and to perform feature matching on the extracted target feature vectors with candidate feature vectors corresponding to ultrasound data of each section of each part of the object included in the ultrasound image data set, thereby matching reference ultrasound data from the ultrasound image data set whose similarity with the target ultrasound data is greater than a preset similarity threshold.

[0107] In the implementation, when executing step S302, refer to Figure 6 As shown, specifically by performing the following steps:

[0108] Step S3021: extract features from the target ultrasound data to obtain a target feature vector.

[0109] In the embodiment of the present application, in order to facilitate comparison, after obtaining the target ultrasound data, step S3021 is executed to perform feature vectorization on the target ultrasound data to obtain the target feature vector.

[0110] In some possible embodiments, when executing step S3021, the target ultrasound data can be input into a pre-trained deep learning model, such as the above-mentioned image feature vectorization model, and the features of the target ultrasound data can be extracted based on the convolutional neural network structure (CNN) in the image feature vectorization model to obtain the above-mentioned target feature vector corresponding to the target ultrasound data.

[0111] Step S3022: Filter out reference ultrasound data from ultrasound data of multiple different slices corresponding to each part according to the target feature vector, wherein the reference ultrasound data is ultrasound data whose similarity with the target ultrasound data is greater than a similarity threshold.

[0112] During implementation, when executing step S3022, the similarity between the target feature vector and the candidate feature vector is determined specifically based on the target feature vector and the candidate feature vector corresponding to the candidate ultrasound data, wherein the candidate ultrasound data is any one of the ultrasound data of multiple different sections corresponding to each part; the candidate ultrasound data corresponding to the target similarity in each similarity is used as the reference ultrasound data, wherein the target similarity is the maximum value of each candidate similarity that is greater than the similarity threshold.

[0113] In some feasible embodiments, the above-mentioned image feature vectorization model may be a text image residual gating (TIRG) model. Then, when executing steps S3021 to S3022, the target ultrasound data is input into the TIRG model, and the features of the target ultrasound data are extracted through the TIRG model to obtain a target feature vector. Then, based on the target feature vector corresponding to the target ultrasound data, a search and comparison is performed with candidate feature vectors corresponding to the ultrasound data of each section corresponding to each part in the ultrasound image data set to screen out the reference ultrasound data. The present application does not specifically limit the model structure of the TIRG model, and the existing model structure may be used to implement the search and comparison process of the present application.

[0114] Step S3023: Determine the scanning position corresponding to the target ultrasound data according to the image description data corresponding to the reference ultrasound data.

[0115] In the embodiment of the present application, since the scanning position includes the part name of the scanned part and the scanning point positioning data; therefore, in the implementation, when executing step S3023, the part name corresponding to the target ultrasound data is determined according to the part name in the image description data corresponding to the reference ultrasound data; and the scanning point positioning data corresponding to the target ultrasound data is determined according to the image probe positioning data corresponding to the reference ultrasound data.

[0116] In some possible embodiments, when executing step S3023, the part name in the image description corresponding to the reference ultrasound data is specifically determined as the part name corresponding to the target ultrasound data; and the image probe positioning data corresponding to the reference ultrasound data is determined as the scanning point positioning data corresponding to the target ultrasound data.

[0117] Step S303: Generate a scanning animation of the ultrasonic scanning of the target object according to the posture data and the scanning position.

[0118] In the implementation, when executing step S303, refer to Figure 7 As shown, specifically by performing the following steps:

[0119] Step S3031: Determine the sub-model to be displayed in the preset object digital model according to the part name.

[0120] Still reading Figure 4As shown, in an embodiment of the present application, the associated human body model data included in the image description data also includes data such as an associated human body part model sub-model code, an associated human body model organ code, an associated organ 3D model storage location, and an associated organ 3D model three-dimensional size; then, after obtaining the part name corresponding to the target ultrasound data, execute step S3031 to determine the sub-model to be displayed in the subsequent scanning animation, that is, the associated human body model sub-model in the image description data corresponding to the reference ultrasound data, and the associated human body model organ and other information. It should be noted that when determining the sub-module to be displayed, the present application selects the first-level part in the image description data corresponding to the reference ultrasound data. Referring to the aforementioned example, combined with Figure 4 As shown, when the part name in the scanning position is the thyroid gland, the sub-model to be displayed may be the sub-model corresponding to the head.

[0121] Step S3032: Determine the coordinates of the scan point to be displayed corresponding to the scan point positioning data in the sub-model to be displayed according to the scan point positioning data.

[0122] For example, still taking the target object as a human body, it is assumed that the object digital model corresponding to the target object is a 3D human body model, and the three-dimensional size of the associated organ 3D model in the image description data corresponding to the reference ultrasound data is 56*60*20 (unit: mm), which represents the outer size of a rectangular parallelepiped of the organ, wherein the middle point (x0, y0, z0) of the rectangular parallelepiped three-dimensional space is taken as the origin, and its coordinates are represented by (0, 0, 0).

[0123] Then, according to the scanning point positioning data, still refer to Figure 4 As shown, with reference to the image probe positioning data (0.002451, 0.085614, 0.958123) corresponding to the ultrasound data (represented by the unit percentage, a positive value indicates a positive direction offset of the corresponding axis toward the origin, and a negative value indicates a negative direction offset toward the origin), the specific position of the ultrasound probe scanning point, that is, the specific coordinates on the 3D model of the associated organ, can be determined.

[0124] In the implementation, the coordinates of the scan point to be displayed in the 3D model of the scan point positioning data obtained are (0.002451*56, 0.085614*60, 0.958123*20).

[0125] Step S3033: Generate a scanning animation according to the posture data, the sub-model to be displayed and the coordinates of the scanning points to be displayed.

[0126] In the embodiment of the present application, the object digital model is a model composed of multiple sub-models, wherein each sub-model has two display forms, one is displayed in the whole body model, and the other is displayed in close-up. In implementation, if the scanning position corresponding to the target ultrasound data is determined based on the collected target ultrasound data and the candidate ultrasound image data set, the close-up picture of the sub-model corresponding to the scanning position is displayed in the scanning animation, so that the details and minor changes of the ultrasound scanning technique in the scanning can be displayed more clearly; if the target ultrasound data is not obtained within the preset time length, and only the posture data of the ultrasound probe is obtained within the time length, such as before and after the ultrasound scanning, and some characteristic conditions in the ultrasound scanning cause the ultrasound scanning to be interrupted, etc., then the whole body model picture of the object can be displayed in the scanning animation at this time, so that the consulting experts in the remote ultrasound consultation can promptly know the real-time situation of the grassroots doctors in the remote ultrasound consultation.

[0127] For example, still taking the target object as a human body, assuming that the corresponding scanning position is determined to be the thyroid gland according to the target ultrasound data, then when displaying the scanning animation of the thyroid gland, the generated scanning animation is constructed in combination with the posture data obtained by the posture sensor embedded in the ultrasound probe.

[0128] In the implementation, when executing step S3033, refer to Figure 8 As shown, the specific steps are as follows:

[0129] Step S801: Based on the sub-model to be displayed and in combination with the object digital model, an initial screen including the sub-model to be displayed is drawn.

[0130] In practice, when executing step S800, the sub-model to be displayed is drawn in combination with the object digital model, thereby obtaining the initial screen.

[0131] For example, see Fig.9A As shown, the target object is still a human body as an example. Assuming that the part name of the scanned position is determined to be the thyroid gland according to the image description data of the reference ultrasound data corresponding to the target ultrasound data, then the associated human body model sub-model corresponding to the sub-model to be displayed obtained according to the image description data is the sub-model corresponding to the first-level part (head), then step S801 is executed, and the initial screen including the sub-model to be displayed is drawn according to the sub-model to be displayed in combination with the human body 3D model, as shown in FIG. Fig.9A The initial screen shown includes a 3D model of a human head.

[0132] Step S802: Draw the scan points to be displayed in the initial picture according to the coordinates of the scan points to be displayed, and obtain an intermediate picture.

[0133] For example, still taking the target object as a human body. According to the coordinates of the scan point to be displayed, i.e. (0.002451*56, 0.085614*60, 0.958123*20), the scan point to be displayed is drawn in the initial screen. Fig. 9B As shown by the black dot A in the figure, the middle picture is obtained.

[0134] Step S803: draw an ultrasonic probe in the middle picture according to at least one spatial coordinate of the posture data and a preset shape of the ultrasonic probe; and adjust the posture of the ultrasonic probe drawn in the middle picture according to angle data associated with at least one spatial coordinate to obtain a scanning animation.

[0135] In the embodiment of the present application, the posture data of the ultrasound probe can be collected in real time through the posture sensor. Then, the scanning animation frame can be generated according to the collection period of the posture data, or a fixed collection period (such as consistent with the frame extraction period of the target ultrasound data) can be used to generate the scanning animation frame. The frequency of generating the scanning animation frame can also be determined according to the specific situation of the acquired posture data. The above are all determined by the hardware performance of the device and the internal parameter settings of the software system, and this application does not make specific limitations.

[0136] In the implementation, when executing step S803, first, based on the acquisition time of the target ultrasound data, the posture data collected by the posture sensor aligned with the acquisition time is determined, and then, according to the spatial coordinates included in the posture data aligned with the acquisition time and the preset shape of the ultrasound probe, the ultrasound probe is drawn in the middle screen, and, according to the angle data associated with the spatial coordinates, the posture of the ultrasound probe is adjusted, so as to obtain the following: Fig. 9C A frame of the scanning animation is shown.

[0137] In some preferred embodiments, the acquisition period of the posture sensor is inconsistent with the aforementioned frame extraction period. Usually, the acquisition period is shorter than the frame extraction period. Then, after acquiring the target ultrasound data, multiple sets of posture data will be obtained. For each posture data obtained subsequently, the spatial position of the ultrasound probe in the middle picture is adjusted according to the spatial coordinates of the posture data, and the posture of the ultrasound probe is adjusted according to the angle data associated with the spatial coordinates of the posture data. In this way, multiple scanning animation frames are obtained. The obtained multiple scanning animation frames are as follows: Fig.9D shown.

[0138] Step S304, sending the target ultrasound data and the scanning animation to the target consultation terminal; wherein the screen of the target consultation terminal displays the ultrasound image and the scanning animation corresponding to the target ultrasound data, and the scanning animation is used to indicate the object part associated with the ultrasound image, and the posture of the ultrasound probe on the object part.

[0139] An optional application interface schematic diagram in remote ultrasound consultation in the embodiment of the present application is as follows: Fig.10 As shown. Fig.10 As shown, the application interface is an interface of a remote ultrasound consultation cloud clinic; the middle part of the interface is an ultrasound image display area (used to display the ultrasound image corresponding to the target ultrasound data), the middle part of the right side is a scanning animation display area (used to display the scanning animation), and the lower part is a function display area. The function display area includes functions such as creating medical records, microphone, camera, sharing, brush, laser pen, recording, screenshot, timer, settings, and ending the meeting to meet the various usage needs of remote ultrasound consultation scenarios.

[0140] In actual applications, remote ultrasound consultation opportunities are rare, and usually multiple target subjects are arranged to participate in the remote ultrasound consultation. Then, there will be a period of time between two target subjects without ultrasound scanning. At this time, in order to make the scanning animation intuitively and in real time present this idle time, in the embodiment of the present application, refer to Fig.11 As shown, another animation method for ultrasound scanning is provided, the method comprising the following steps:

[0141] Step S1101: If the ultrasound probe fails to acquire target ultrasound data within a preset time period, a scanning animation is generated according to the posture data and a preset object digital model.

[0142] Step S1102: Send the scan animation to the target consultation terminal.

[0143] In the embodiment of the present application, for steps S1101 to S1102, if the target ultrasound data is not obtained within the preset time period, then Fig.12 As shown, in the schematic diagram of the application interface in the remote ultrasound consultation, the scanning animation corresponding to the whole body model can be displayed in the scanning animation display area, so that the consulting experts in the remote ultrasound consultation can intuitively know that there is no ultrasound image at this time. More importantly, the real-time situation of the ultrasound scanning site can be conveyed to the consulting experts in the remote ultrasound consultation intuitively and in real time.

[0144] In the embodiment of the present application, the posture data of the ultrasound probe is collected by the posture sensor included in the ultrasound probe, and the spatial coordinates of the ultrasound probe in space and the angle data associated with the spatial coordinates, that is, the rotation and tilt, direction and angular velocity and other motion data in the spatial coordinate system associated with the posture sensor of the ultrasound probe can be obtained, so as to prepare for the subsequent generation of a scanning animation for the ultrasound scanning of the target object; at the same time, according to the target ultrasound data of the target object collected by the ultrasound probe and the candidate ultrasound image data set, the part / position analysis of the target ultrasound data can be realized, so as to determine the object part to which the target ultrasound data currently scanned belongs and the scanning point positioning data where the cross-section image is located; then, according to the object part and scanning point positioning data corresponding to the posture data and the target ultrasound data, the scanning animation for the ultrasound scanning of the target object is drawn and generated. In particular, when the whole body of the target object is scanned, the scanning animation screen of the corresponding sub-model can be generated in time by performing part / position analysis on the collected target ultrasound data, so as to intuitively and real-timely present the scanning animation demonstration of the ultrasound probe, so as to perform auxiliary diagnosis on the target object and improve the consultation effect during remote ultrasound consultation.

[0145] Furthermore, under the relevant technology, the technique camera video mostly adopts true color technique video, which usually occupies a large bandwidth, basically around 2M. Therefore, in remote ultrasound consultation with poor network performance, such as non-5G network or slightly less than ideal 4G network, the technique camera video will occupy the transmission bandwidth of the ultrasound image video during the remote ultrasound consultation, and even when the network bandwidth is poor, the video will be stuck, further affecting the consultation effect of the remote ultrasound consultation. By adopting an animation display method for ultrasound scanning provided in an embodiment of the present application, the data volume of the obtained animation video can be relatively small, and to some extent, part of the transmission bandwidth can be saved, so that the consultation is smooth, and the consultation effect can be improved to a certain extent, while also reducing the hardware configuration requirements of the remote ultrasound consultation.

[0146] In some feasible embodiments, still refer to Figure 1 As shown, the ultrasound device also includes a display screen; after executing step S303 to generate a scanning animation of the ultrasound scan performed on the target object, refer to Fig.13 As shown, you can also perform the following steps:

[0147] Step S1301, transmitting the scanning animation to a display screen.

[0148] Step S1302: display the scanning animation in the display interface of the display screen.

[0149] In progress, please refer to Figure 1As shown, by executing steps S1301 to S1302, the scanning animation can also be displayed on the display screen of the ultrasound device at the grassroots doctor side. The schematic diagram of the scanning animation displayed in the ultrasound device is as follows: Fig.14 As shown, the scanning animation displayed in the ultrasound device is used to add a special display function to the existing display interface of the ultrasound device to meet the user's demand for displaying the corresponding scanning animation on the ultrasound device.

[0150] After a detailed introduction to the process of an animation display method for ultrasound scanning in an embodiment of the present application, the specific implementation logic of the above method in remote ultrasound consultation is briefly summarized as follows: Fig.15 As shown, Figure 1 The application scenarios shown correspond to Figure 1 The application scenario shown briefly summarizes the specific implementation logic of the solution of this application:

[0151] When the primary care doctor uses the ultrasound probe to perform ultrasound scanning on the target object, the ultrasound device collects target ultrasound data of the target object through the ultrasound probe, and the target ultrasound data is transmitted to the remote software ultrasound terminal in the ultrasound device through the data line 1 between the ultrasound probe and the processor; at the same time, the posture data of the ultrasound probe is obtained through the posture sensor included in the ultrasound probe, that is, the data such as the movement and rotation of the ultrasound probe during the primary care doctor's ultrasound scanning of the target object, and then, the posture data is transmitted to the remote software ultrasound terminal through the corresponding data line 2.

[0152] Then, the remote software ultrasound end performs a position / location analysis on the target ultrasound data to obtain the scanning position on the target object corresponding to the target ultrasound data. The remote software ultrasound end performs a probe orientation / angle analysis on the posture data to obtain the motion data and posture data of the ultrasound probe, and combines it with the preset object digital model to generate a scanning animation, and transmits the scanning animation to the remote ultrasound cloud service. Accordingly, the target ultrasound data will also be transmitted to the remote ultrasound cloud service.

[0153] The remote ultrasound cloud service sends the target ultrasound data and scanning animation to the corresponding remote software expert terminal, i.e., the target consultation terminal, so that the scanning animation and the ultrasound image corresponding to the target ultrasound data are displayed in the corresponding display area of ​​the screen of the target consultation terminal. The consulting expert performs auxiliary diagnosis on the target object through the displayed ultrasound image and scanning animation, wherein the ultrasound image corresponding to the target ultrasound data is determined by the target consultation terminal based on the target ultrasound data; the scanning animation is used to indicate the object part associated with the ultrasound image, and the posture of the ultrasound probe on the object part.

[0154] Optionally, the above-mentioned remote ultrasound cloud service can also update the specific algorithm data used for part / position analysis, and can also update the specific algorithm data used for probe orientation / angle analysis, so as to meet the consultation needs in remote ultrasound consultation in real time.

[0155] like Fig.16 As shown, an embodiment of the present application provides an animation display device 1600 for ultrasonic scanning, which can be specifically applied to the ultrasonic device in the above embodiment, wherein the ultrasonic device includes an ultrasonic probe, and the device includes:

[0156] The acquisition module 1601 is used to acquire target ultrasonic data of the target object through the ultrasonic probe, and acquire the posture data of the ultrasonic probe during the ultrasonic scanning of the target object through the posture sensor included in the ultrasonic probe;

[0157] A determination module 1602 is used to determine a scanning position on the target object corresponding to the target ultrasound data according to the target ultrasound data and the candidate ultrasound image data set, wherein the ultrasound image data set includes ultrasound data and image description data of multiple different sections corresponding to various parts of the object;

[0158] The animation generation module 1603 is used to generate a scanning animation of the ultrasound scan performed on the target object according to the posture data and the scanning position, and send the target ultrasound data and the scanning animation to the target consultation terminal; wherein the screen of the target consultation terminal displays the ultrasound image and the scanning animation corresponding to the target ultrasound data, and the scanning animation is used to indicate the object part associated with the ultrasound image, and the posture of the ultrasound probe on the object part. Optionally, the determination module 1602 is specifically used to:

[0159] Extracting features from the target ultrasonic data to obtain a target feature vector;

[0160] According to the target feature vector, selecting reference ultrasound data from ultrasound data of multiple different sections corresponding to each part, wherein the reference ultrasound data is ultrasound data having a similarity with the target ultrasound data greater than a similarity threshold;

[0161] The scanning position corresponding to the target ultrasound data is determined according to the image description data corresponding to the reference ultrasound data.

[0162] Optionally, the determining module 1602 is specifically configured to:

[0163] Determine the similarity between the target feature vector and the candidate feature vector according to the target feature vector and the candidate feature vector corresponding to the candidate ultrasound data, wherein the candidate ultrasound data is any one of the ultrasound data of the multiple different sections corresponding to the parts;

[0164] The candidate ultrasound data corresponding to the target similarity among the similarities is used as the reference ultrasound data, wherein the target similarity is the maximum value among the candidate similarities that are greater than the similarity threshold.

[0165] Optionally, the scanning position includes the name of the scanning part and the scanning point positioning data; then the determination module 1602 is specifically used for:

[0166] The part name corresponding to the target ultrasound data is determined according to the part name in the image description data corresponding to the reference ultrasound data; and the scanning point positioning data corresponding to the target ultrasound data is determined according to the image probe positioning data corresponding to the reference ultrasound data.

[0167] Optionally, the animation generation module 1603 is specifically used for:

[0168] According to the part name, determining the sub-model to be displayed in the preset object digital model;

[0169] According to the scanning point positioning data, determining the coordinates of the scanning point to be displayed corresponding to the scanning point positioning data in the sub-model to be displayed;

[0170] The scanning animation is generated according to the posture data, the sub-model to be displayed and the coordinates of the scanning points to be displayed.

[0171] Optionally, the posture data includes at least one spatial coordinate and angle data associated with the at least one spatial coordinate; then the animation generation module 1603 is specifically used for:

[0172] Based on the sub-model to be displayed and in combination with the object digital model, an initial picture including the sub-model to be displayed is drawn;

[0173] According to the coordinates of the scanned points to be displayed, the scanned points to be displayed are drawn in the initial picture to obtain an intermediate picture;

[0174] The ultrasound probe is drawn in the intermediate picture according to at least one spatial coordinate of the posture data and a preset shape of the ultrasound probe; and the posture of the ultrasound probe drawn in the intermediate picture is adjusted according to the angle data associated with the at least one spatial coordinate to obtain the scanning animation.

[0175] Optionally, the acquisition module 1601 is specifically used for:

[0176] Collecting, by means of the posture sensor, at least one spatial coordinate of the ultrasonic probe during ultrasonic scanning of the target object, and angle data associated with the at least one spatial coordinate;

[0177] The at least one spatial coordinate and the angle data associated with the at least one spatial coordinate are used as the posture data, and the posture data is transmitted to the determination module 1602.

[0178] Based on the same inventive concept, an embodiment of the present application provides a computer-readable storage medium. When the instructions in the computer-readable storage medium are executed by an ultrasound device, the ultrasound device can execute the animation display method of ultrasound scanning as described in the above embodiment. Since the principle of solving the problem by the above computer-readable storage medium is similar to that of the animation display method of ultrasound scanning, the implementation of the above computer-readable storage medium can refer to the implementation of the method, and the repeated parts will not be repeated.

[0179] Based on the same inventive concept, an embodiment of the present application provides a computer program product, including a computer program: when the computer program is executed by a processor, the animation display method of ultrasound scanning as described in the above embodiment is implemented.

[0180] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0181] The present application is described with reference to the flowchart and / or block diagram of the method, device (system), and computer program product according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the process and / or box in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.

[0182] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0183] These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0184] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. An ultrasonic device, characterized in that: The ultrasonic device includes an ultrasonic probe and a processor; The ultrasonic probe is used to collect target ultrasonic data of the target object; The ultrasonic probe comprises a posture sensor for collecting posture data of the ultrasonic probe during ultrasonic scanning of the target object; The processor is used to determine a scanning position on the target object corresponding to the target ultrasound data according to the target ultrasound data and the candidate ultrasound image data set, wherein the ultrasound image data set includes ultrasound data and image description data of multiple different sections corresponding to various parts of the object; Based on the posture data and the scanning position, a scanning animation of an ultrasonic scan performed on the target object is generated, and the target ultrasonic data and the scanning animation are sent to a target consultation terminal; wherein the screen of the target consultation terminal displays an ultrasonic image and the scanning animation corresponding to the target ultrasonic data, and the scanning animation is used to indicate the object part associated with the ultrasonic image, and the posture of the ultrasonic probe on the object part.

2. The ultrasonic device according to claim 1, characterized in that The processor is specifically used for: Extracting features from the target ultrasonic data to obtain a target feature vector; According to the target feature vector, selecting reference ultrasound data from ultrasound data of multiple different sections corresponding to each part, wherein the reference ultrasound data is ultrasound data having a similarity with the target ultrasound data greater than a similarity threshold; The scanning position corresponding to the target ultrasound data is determined according to the image description data corresponding to the reference ultrasound data.

3. The ultrasonic device according to claim 2, characterized in that The processor is specifically used for: Determine the similarity between the target feature vector and the candidate feature vector according to the target feature vector and the candidate feature vector corresponding to the candidate ultrasound data, wherein the candidate ultrasound data is any one of the ultrasound data of the multiple different sections corresponding to the parts; The candidate ultrasound data corresponding to the target similarity among the similarities is used as the reference ultrasound data, wherein the target similarity is the maximum value among the candidate similarities that are greater than the similarity threshold.

4. The ultrasonic device according to claim 3, characterized in that The scanning position includes the name of the scanning part and the scanning point positioning data; the processor is specifically used for: The part name corresponding to the target ultrasound data is determined according to the part name in the image description data corresponding to the reference ultrasound data; and the scanning point positioning data corresponding to the target ultrasound data is determined according to the image probe positioning data corresponding to the reference ultrasound data.

5. The ultrasonic device according to claim 4, characterized in that The processor is specifically used for: According to the part name, determining the sub-model to be displayed in the preset object digital model; According to the scanning point positioning data, determining the coordinates of the scanning point to be displayed corresponding to the scanning point positioning data in the sub-model to be displayed; The scanning animation is generated according to the posture data, the sub-model to be displayed and the coordinates of the scanning points to be displayed.

6. The ultrasonic device according to claim 5, characterized in that The posture data includes at least one spatial coordinate and angle data associated with the at least one spatial coordinate; the processor is specifically configured to: Drawing an initial screen including the sub-model to be displayed according to the sub-model to be displayed and in combination with the object digital model; According to the coordinates of the scanned points to be displayed, the scanned points to be displayed are drawn in the initial picture to obtain an intermediate picture; The ultrasound probe is drawn in the intermediate picture according to at least one spatial coordinate of the posture data and a preset shape of the ultrasound probe; and the posture of the ultrasound probe drawn in the intermediate picture is adjusted according to the angle data associated with the at least one spatial coordinate to obtain the scanning animation.

7. The ultrasonic device according to any one of claims 1 to 6, characterized in that: The posture sensor is specifically used for: Collecting at least one spatial coordinate of the ultrasonic probe during ultrasonic scanning of the target object, and angle data associated with the at least one spatial coordinate; The at least one spatial coordinate and angle data associated with the at least one spatial coordinate are used as the posture data, and the posture data is transmitted to the processor.

8. An animation display method for ultrasonic scanning, characterized in that: Applied to an ultrasound device, the ultrasound device includes an ultrasound probe, and the method includes: Collecting target ultrasound data of the target object, and collecting posture data of the ultrasound probe during ultrasound scanning of the target object through a posture sensor included in the ultrasound probe; Determine, according to the target ultrasound data and the candidate ultrasound image data set, a scanning position on the target object corresponding to the target ultrasound data, wherein the ultrasound image data set includes ultrasound data and image description data of a plurality of different sections corresponding to various parts of the object; Based on the posture data and the scanning position, a scanning animation of an ultrasonic scan performed on the target object is generated, and the target ultrasonic data and the scanning animation are sent to a target consultation terminal; wherein the ultrasonic image and the scanning animation corresponding to the target ultrasonic data are displayed on the screen of the target consultation terminal, and the scanning animation is used to indicate the object part associated with the ultrasonic image, and the posture of the ultrasonic probe on the object part.

9. An animation display device for ultrasonic scanning, characterized in that: Applied to ultrasound equipment, the ultrasound equipment includes an ultrasound probe, and the device includes: An acquisition module, used to acquire target ultrasonic data of a target object through the ultrasonic probe, and to acquire posture data of the ultrasonic probe during ultrasonic scanning of the target object through a posture sensor included in the ultrasonic probe; a determination module, configured to determine a scanning position on the target object corresponding to the target ultrasound data according to the target ultrasound data and a candidate ultrasound image data set, wherein the ultrasound image data set includes ultrasound data and image description data of a plurality of different sections corresponding to various parts of the object; An animation generation module is used to generate a scanning animation of an ultrasonic scan performed on the target object based on the posture data and the scanning position, and send the target ultrasonic data and the scanning animation to a target consultation terminal; wherein the screen of the target consultation terminal displays an ultrasonic image corresponding to the target ultrasonic data and the scanning animation, and the scanning animation is used to indicate the object part associated with the ultrasonic image, and the posture of the ultrasonic probe on the object part.

10. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by an ultrasound device, the ultrasound device is enabled to perform the animation display method of ultrasound scanning as described in claim 8.

Citation Information

Patent Citations

  • Ultrasound exploration auxiliary positioning system

    CN105030275A

  • Ultrasonic imaging system and method

    CN107708571A

  • Ultrasonic echo imaging method and system, and ultrasound equipment

    CN110680398A

  • Automatic measurement method of prenatal ultrasonic image, storage medium and ultrasonic equipment

    CN110680399A

  • Ultrasonic imaging method and system

    CN111368586A