A method of processing ultrasound data and a mobile terminal

Abstract

A method for processing ultrasonic data and a mobile terminal, wherein: an ultrasonic image is displayed on a first interface, a first touch operation for the first interface is received, and a scan section of a target object is determined; based on the scan section, a corresponding scan instruction is obtained; the scan instruction includes at least one of an anatomical structure diagram of the scan section, a scan method diagram of the scan section, and a standard ultrasonic image of the scan section; a first window independent of the first interface is superimposed and displayed on the first interface, and an initial size of the first window is smaller than that of the first interface; and the scan instruction is displayed in the first window to assist a user in scanning an ultrasonic image corresponding to the scan section. According to the application, the user can simultaneously view the ultrasonic image and the scan instruction on the interface of the mobile terminal, and the scanning and imaging efficiency is improved.

Description

Technical Field

[0001] This invention relates to the field of ultrasound imaging, and more specifically to a method for processing ultrasound data and a mobile terminal. Background Technology

[0002] Ultrasound imaging technology has been widely used in the field of medical testing. Ultrasound equipment radiates ultrasound signals generated by the transducer of the probe onto the object being tested and receives the ultrasound echo signals reflected from the object, thereby obtaining an internal image of the object.

[0003] With the widespread application of ultrasound imaging in the medical field, ultrasound devices adapted to various medical scenarios have emerged. Handheld ultrasound devices are a new type of portable ultrasound diagnostic device that fits a variety of application scenarios, such as bedside diagnosis in hospitals, emergency medical care in ambulances, home and outdoor medical care, emergency medical care in adventure settings, and field hospital settings. Generally, to accommodate these usage scenarios, handheld ultrasound devices can establish wired or wireless communication connections with mobile terminals (such as smartphones), allowing users to view ultrasound images through their mobile devices.

[0004] Traditional ultrasound equipment typically uses a computer screen to view ultrasound images and interact with the interface. In the case of handheld ultrasound equipment, users view ultrasound images and interact with the interface through a small screen on a mobile device. Therefore, directly transferring the original interface interaction logic and layout to a mobile device would cause significant inconvenience for users. Summary of the Invention

[0005] In view of the above problems, the present invention provides a method for processing ultrasound data and a mobile terminal, which are described in detail below.

[0006] According to a first aspect, one embodiment provides a method for processing ultrasound data, applied to a mobile terminal and a handheld ultrasound device, wherein a communication connection is established between the mobile terminal and the handheld ultrasound device; the handheld ultrasound device is used to transmit ultrasound waves to a target object, receive ultrasound echoes returned by the target object, and obtain ultrasound echo signals; the mobile terminal receives the ultrasound echo signals transmitted by the handheld ultrasound device or receives ultrasound image data obtained by processing the ultrasound echo signals by the handheld ultrasound device through the communication connection; the mobile terminal has an application program installed, the application program being used to provide a first interface through which human-computer interaction can be performed; the ultrasound data processing method includes:

[0007] After the mobile terminal runs the application, it displays the first interface;

[0008] An ultrasound image obtained based on the ultrasound echo signal or the ultrasound image data is displayed in the first interface.

[0009] Receive a first touch operation on the first interface and determine the scanning section of the target object;

[0010] Based on the scanning section, a corresponding scanning instruction is obtained; the scanning instruction includes at least one of the following: a schematic diagram of the anatomical structure of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section;

[0011] A first window, independent of the first interface, is overlaid and displayed on the first interface. The initial size of the first window is smaller than that of the first interface.

[0012] The scanning instructions are displayed in the first window to assist the user in scanning and obtaining the ultrasound image corresponding to the scanning section.

[0013] According to a second aspect, one embodiment provides a method for processing ultrasound data, applied to a mobile terminal and a handheld ultrasound device, wherein a communication connection is established between the mobile terminal and the handheld ultrasound device; the handheld ultrasound device is used to transmit ultrasound waves to a target object, receive ultrasound echoes returned by the target object, and obtain ultrasound echo signals; the mobile terminal receives the ultrasound echo signals transmitted by the handheld ultrasound device or receives ultrasound image data obtained by processing the ultrasound echo signals by the handheld ultrasound device through the communication connection; the mobile terminal has an application program installed, the application program being used to provide a first interface through which human-computer interaction can be performed; the ultrasound data processing method includes:

[0014] After the mobile terminal runs the application, it displays the first interface, which has a first area of ​​a third size.

[0015] Display an ultrasound image based on the ultrasound echo signal or the ultrasound image data within the first region;

[0016] Receive a ninth touch operation on the first interface and determine the scanning section of the target object;

[0017] Based on the scanning section, a corresponding scanning instruction is obtained; the scanning instruction includes at least one of the following: a schematic diagram of the anatomical structure of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section;

[0018] Within the first interface, the size of the first region is reduced from the third size to the first size, and a second region with a second size is displayed; wherein the second size is less than or equal to the first size;

[0019] The scanning instruction is displayed in the second area to assist the user in scanning and obtaining the ultrasound image corresponding to the scanning section.

[0020] According to a third aspect, one embodiment provides a mobile terminal, including a communication port, a memory, a display component, and a processor;

[0021] The communication port is used to establish communication with the handheld ultrasound device and transmit data.

[0022] The memory is used to store application and ultrasound image data;

[0023] The display component is used to display content;

[0024] The processor is used to execute the ultrasound data processing method described in any embodiment of this document.

[0025] According to a fourth aspect, one embodiment is a computer program product that, when run on a computer, causes the computer to execute a method for processing ultrasound data as described in any embodiment herein.

[0026] According to a fifth aspect, one embodiment provides a computer-readable storage medium storing a program that can be executed by a processor to implement the ultrasonic data processing method described in any embodiment herein.

[0027] The ultrasound data processing method, mobile terminal, computer program product, and computer-readable storage medium according to the above embodiments enable users to simultaneously view ultrasound images and scanning instructions on the interface of the mobile terminal, thereby improving scanning and mapping efficiency. Attached Figure Description

[0028] Figure 1 A schematic diagram of a mobile terminal and a handheld ultrasound device according to one embodiment;

[0029] Figure 2(a) shows a schematic diagram of an example of data rearrangement; Figure 2(b) shows a schematic diagram of another example of data rearrangement; Figure 2(c) shows a schematic diagram of yet another example of data rearrangement.

[0030] Figure 3 A flowchart illustrating an embodiment of a method for processing ultrasound data;

[0031] Figures 4(a), 4(b), and 4(c) are three schematic diagrams showing the first window superimposed on the first interface;

[0032] Figure 5This is a flowchart of a process for determining a scanning section of a target object by receiving a first touch operation on a first interface, as described in one embodiment.

[0033] Figures 6(a) and 6(b) are two schematic diagrams illustrating how the scanning section of the target object is determined;

[0034] Figure 7(a) is a flowchart of obtaining the corresponding scanning instruction based on the scanning section in one embodiment;

[0035] Figure 7(b) is a flowchart of obtaining the corresponding scanning instructions based on the scanning section in one embodiment;

[0036] Figures 8(a), 8(b), 8(c), 8(d), and 8(e) are five schematic diagrams of the first interface;

[0037] Figure 9 A flowchart illustrating an embodiment of a method for processing ultrasound data;

[0038] Figures 10(a), 10(b), and 10(c) are three schematic diagrams of the first interface;

[0039] Figure 11 This is a flowchart of a process for determining a scanning section of a target object by receiving a ninth touch operation on a first interface, as described in one embodiment.

[0040] Figure 12(a) is a flowchart of obtaining the corresponding scanning instruction based on the scanning section in one embodiment;

[0041] Figure 12(b) is a flowchart of obtaining the corresponding scanning instruction based on the scanning section in one embodiment;

[0042] Figure 13 This is a schematic diagram of the structure of a mobile terminal according to one embodiment. Detailed Implementation

[0043] The present invention will now be described in further detail with reference to specific embodiments and accompanying drawings. Similar elements in different embodiments are referred to by associated similar element reference numerals. In the following embodiments, many details are described to facilitate a better understanding of this application. However, those skilled in the art will readily recognize that some features may be omitted in different situations, or may be replaced by other elements, materials, or methods. In some cases, certain operations related to this application are not shown or described in the specification. This is to avoid obscuring the core parts of this application with excessive description. For those skilled in the art, detailed description of these related operations is not necessary; they can fully understand the related operations based on the description in the specification and general technical knowledge in the art.

[0044] Furthermore, the features, operations, or characteristics described in the specification can be combined in any suitable manner to form various embodiments. At the same time, the steps or actions in the method description can be rearranged or adjusted in a manner obvious to those skilled in the art. Therefore, the various orders in the specification and drawings are only for the clear description of a particular embodiment and do not imply a necessary order, unless otherwise stated that a particular order must be followed.

[0045] The serial numbers assigned to components in this document, such as "first" and "second," are used only to distinguish the described objects and have no sequential or technical meaning. The terms "connection" and "linkage" used in this application, unless otherwise specified, include both direct and indirect connections (linkages).

[0046] When users, such as doctors, use ultrasound equipment to observe the internal structures of the human body, they place the probe on the skin surface corresponding to the body part to obtain an ultrasound image of that part. Typically, doctors also need to observe the same area from different angles using the ultrasound equipment, obtaining different cross-sectional images of the same area for a more comprehensive and clear observation. However, this requires considerable experience from the user, and a very clear understanding of the spatial structure of various organs and tissues in order to obtain standard cross-sections of each organ and tissue. One solution is to provide prompts through an interactive interface to assist users in ultrasound imaging. However, this would actually cause greater inconvenience in scenarios where handheld ultrasound devices are used on mobile terminals, as users would need to repeatedly switch between the real-time ultrasound image viewing interface and the ultrasound imaging information interface.

[0047] Considering the above issues, this application proposes a new arrangement, display, and interaction method for scanning information and ultrasound viewing interface based on the scenario of handheld ultrasound devices interacting with mobile terminals, taking into account the small screen characteristics of mobile terminals.

[0048] Please refer to Figure 1 The ultrasound data processing methods proposed in some embodiments are applied to the mobile terminal 10 and the handheld ultrasound device 20. In some embodiments, a communication connection is established between the mobile terminal 10 and the handheld ultrasound device 20—for example, a wired communication connection or a wireless communication connection.

[0049] The handheld ultrasound device 20 is used to emit ultrasonic waves towards a target object, receive the ultrasonic echoes returned by the target object, and obtain ultrasonic echo signals. In some embodiments, the ultrasonic echo signals are processed into displayable ultrasonic images through one or more processing stages; in some embodiments, the handheld ultrasound device 20 can directly send the ultrasonic echo signals to the mobile terminal 10, for example, the ultrasonic echo signals can be channel echo data where the ultrasonic echoes are converted into electrical signals by array elements in the handheld ultrasound device 20; in some embodiments, the handheld ultrasound device 20 can also process the ultrasonic echoes to obtain ultrasonic image data, and then transmit the ultrasonic image data to the mobile terminal 10—for example, the handheld ultrasound device 20 can perform several stages (e.g., some or all stages) of processing on the ultrasonic echo signals to obtain ultrasonic image data. The ultrasound image data is then transmitted to the mobile terminal 10. Understandably, if the handheld ultrasound device 20 processes the ultrasound echo signal partially but not entirely before outputting ultrasound image data to the mobile terminal 10, then the mobile terminal 10 can continue processing the received ultrasound image data to obtain a displayable ultrasound image. If the handheld ultrasound device 20 processes the ultrasound echo signal completely before outputting ultrasound image data to the mobile terminal 10, then the ultrasound image data can actually be directly displayed as an ultrasound image. Therefore, the mobile terminal 10 can directly display the received ultrasound image data as an ultrasound image.

[0050] by Figure 1 For example, Figure 1 The illustration shows an example where a wireless communication connection is established between a handheld ultrasound device 20 and a mobile terminal 10, and the mobile terminal 10 is a smartphone. The dashed arrow below the handheld ultrasound device 20 in the figure represents the ultrasonic waves it emits. This is only for illustration and is not used to limit the direction and magnitude of the ultrasonic wave emission. The cone-shaped graphic displayed on the screen of the mobile terminal 10 in the figure is used to schematically represent the ultrasound image.

[0051] The processing of ultrasonic echo signals may include the following steps: analog-to-digital conversion, signal demodulation, amplification, filtering, downsampling, beamforming, modulus extraction, logarithmic compression, and grayscale transformation. The following is an explanation of each data processing step.

[0052] The ultrasound echo signal received by the array element of the handheld ultrasound device 20 is an analog signal, which is converted into digital ultrasound image data after analog-to-digital conversion. The signal demodulation stage refers to demodulating the input ultrasound image data, which can be a digital signal obtained after analog-to-digital conversion. Demodulation methods can include: simple demodulation, orthogonal demodulation, Hilbert transform demodulation, double sampling demodulation, multiple sampling demodulation, or baseband sampling demodulation, etc. The commonly used demodulation method is orthogonal demodulation. That is, the received echo signal is split into two paths and multiplied by cos(ωnT) respectively. s ) and sin(ωnT s The amplification process includes: amplifying the ultrasound image data using different magnification factors depending on the time of reception to compensate for signal attenuation; or, applying different magnification factors depending on the location of the ultrasound image data to compensate for signal attenuation; the amplification process can be performed after the signal demodulation process.

[0053] Filtering is typically performed after signal demodulation, using, for example, a low-pass filter to improve signal quality. Downsampling reduces the signal sampling rate, decreasing computational complexity. Data normalization, including scaling normalization or standard normalization, confines data within a certain range, thus eliminating the adverse effects of outlier (sample) data.

[0054] Principal component analysis includes: centering the features of ultrasound image data to obtain features, solving the covariance matrix of the features, solving the eigenvalues ​​of the covariance matrix, selecting the largest eigenvalue to form the eigenvector, and projecting the ultrasound image data onto the eigenvector; principal component analysis mainly serves to reduce the dimensionality of the data features.

[0055] Data augmentation involves translating and / or adding noise to ultrasound image data, which improves the accuracy of neural networks in processing data. For example, when training a neural network, operations such as translating and adding noise to the limited training data can expand the dataset size, thereby enhancing the accuracy of the neural network.

[0056] Data rearrangement includes rearranging the ultrasound image data in at least one of the following ways: Demodulating the ultrasound image data received by each element of the handheld ultrasound device 20 and arranging it into two columns (one column for I data and one column for Q data; assuming an element receives (Npoint*1) data, it is arranged into two columns as shown in Figure 2(a) I1Q1) or arranging it into one column before demodulation; arranging the ultrasound image data (Npoint*2n) received by all effective elements of the handheld ultrasound device 20 after the same ultrasonic wave transmission into a matrix (as shown in Figure 2(b) I1Q1……I n Q nThe N*2n matrix, where n is the number of effective array elements; the ultrasound image data (Npoint*1) received by each array element of the handheld ultrasound device 20 is divided into multiple (e.g., m) and arranged into a matrix (Npoint / m, 2m, as shown in Figure 2(c)). 1-1 Q 1-1 I 1-2 Q 1-2 The data (Figure 2(c) shows an example where m is 2). It should be noted that if the data is before demodulation, it will not be set to two columns, i.e. Figures 2(a) to 2(c) The number of columns is reduced by half. Furthermore, in other examples, Figures 2(a) to 2(c) These data can also be combined to form three-dimensional or even higher-dimensional data inputs. The rearranged data, when used as input to the neural network, can improve the network's accuracy.

[0057] Beamforming refers to the process of reconstructing ultrasound image data (which can be either the radio frequency signal before demodulation or the baseband signal after demodulation) from the channel domain (e.g., data dimensions are: time direction * number of channels * number of transmissions) into beam domain data (i.e., beamformed data, e.g., data dimensions are: number of vertical points * number of horizontal points, which are points in actual physical space). Beamforming can employ various beamforming methods, including but not limited to the Delay Apodization Summation (DAS) method, adaptive beamforming method, coherence factor beamforming method and / or incoherent beamforming method or frequency domain beamforming method, etc.

[0058] Modulus extraction, logarithmic compression, and grayscale transformation are processing steps performed on ultrasound image data in the image domain. These three steps can also be collectively referred to as scan transformation, thereby obtaining an ultrasound image for display.

[0059] The above is a description of the mobile terminal 10, the handheld ultrasound device 20, and the ultrasound data processing stage.

[0060] In some embodiments, the mobile terminal 10 is equipped with an application that allows the user to view ultrasound images and interact with them; for example, the application may provide an interface for human-computer interaction, such as a first interface and / or a second interface, etc.

[0061] Please refer to Figure 3 Some embodiments of ultrasound data processing methods include the following steps:

[0062] Step 100: After the mobile terminal 10 runs the above application, it displays the first interface.

[0063] Step 110: Display an ultrasound image obtained based on ultrasound echo signals or ultrasound image data within the first interface. In some embodiments, the first interface has an image display area for displaying the ultrasound image, that is, the first interface displays the ultrasound image within the image display area.

[0064] As described above, the mobile terminal 10 receives an ultrasound echo signal sent by the handheld ultrasound device 20 or receives ultrasound image data obtained by processing the ultrasound echo signal by the handheld ultrasound device 20. The mobile terminal then displays the ultrasound image obtained based on the ultrasound echo signal or ultrasound image data in the first interface.

[0065] Understandably, the mobile terminal 10 can receive data (ultrasound echo signals or ultrasound image data) from the handheld ultrasound device 20 in real time and display the corresponding ultrasound image on the first interface; that is, the first interface displays a real-time ultrasound image. Alternatively, the mobile terminal 10 can receive data (ultrasound echo signals or ultrasound image data) from the handheld ultrasound device 20 and store it, then retrieve and display the data on the first interface when the user needs to view it. Furthermore, the mobile terminal 10 can receive data (ultrasound echo signals or ultrasound image data) from the handheld ultrasound device 20 either before or after opening (starting) the aforementioned application.

[0066] Step 120: Receive the first touch operation on the first interface and determine the scanning section of the target object.

[0067] Step 130: Based on the scanning section, obtain the corresponding scanning instructions. In some embodiments, the scanning instructions include at least one of the following: a schematic diagram of the anatomical structure of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section. In some embodiments, the scanning instructions also include explanatory text to explain and describe the content of the scanning instructions. In some embodiments, the schematic diagram of the anatomical structure of the scanning section also includes textual annotations to explain each anatomical structure; in some embodiments, the scanning technique diagram of the scanning section also includes textual annotations to illustrate the scanning technique.

[0068] Step 140: Overlay a first window independent of the first interface onto the first interface. The initial size of the first window is smaller than that of the first interface.

[0069] Step 150: Display scanning instructions in the first window to assist the user in scanning and obtaining the ultrasound image corresponding to the scanning section.

[0070] By overlaying a first window independent of the first interface onto the first interface, with the ultrasound image displayed in the first interface and the scanning instructions displayed in the first window, users can view both the ultrasound image and the scanning instructions on their mobile devices, thus improving scanning and image processing efficiency.

[0071] In order to maximize the use of the mobile terminal's screen and distinguish the primary and secondary content, in some embodiments, the initial size of the first window is smaller than the size of the image display area or the ultrasound image.

[0072] In order to ensure that the first window does not obscure the displayed ultrasound image as much as possible, in some embodiments, the initial position of the first window is located in the upper left, lower left, upper right, or lower right of the image display area or the ultrasound image and does not overlap; or, the initial position of the first window is located in the upper left, lower left, upper right, or lower right of the image display area or the ultrasound image and at least partially overlaps.

[0073] To minimize the obstruction of the displayed ultrasound image by the first window, in some embodiments, the initial position of the first window is located at a first position on the first interface. This first position ensures that the first window does not overlap with the image display area or the ultrasound image, or minimizes the overlap area. The first position can be a pre-set position or calculated based on the actual position occupied by the current ultrasound image.

[0074] In some embodiments, the first window can be moved and scaled independently of the first interface, which makes it convenient for users to continue to adjust the position and size of the first window according to the actual situation.

[0075] In some embodiments, the first window can be moved independently of the first interface based on a second touch operation. In some embodiments, the second touch operation includes pressing and dragging a preset position of the first window. For example, a user moves the first window to a corresponding position by pressing and dragging the border of the first window.

[0076] In some embodiments, the first window can be scaled independently of the first interface based on a third touch operation. In some embodiments, the third touch operation includes: pinching two fingers together within the area of ​​the first window to shrink, spreading two fingers apart within the area of ​​the first window to enlarge, pressing and holding the edge of the first window and dragging it within the area of ​​the first window to shrink, or pressing and holding the edge of the first window and dragging it outside the area of ​​the first window to enlarge.

[0077] In some embodiments, when the first window is enlarged, it displays more content; when the first window is shrunk, it displays less content.

[0078] In some embodiments, when the first window is enlarged, the image displayed thereon is also adaptively enlarged; when the first window is shrunk, the image displayed thereon is also adaptively shrunk.

[0079] Figure 4(a) shows an example of a first window superimposed on a first interface, where the first window is at its initial size and in its initial or first position; Figure 4(b) shows an example of a user moving the first window to the right using a second touch operation; Figure 4(c) shows an example of a user enlarging the first window.

[0080] In some embodiments, the first window can switch the displayed scanning instructions within the first window based on a fourth touch operation. In some embodiments, the fourth touch operation includes a sliding operation in a preset direction within the first window. In some embodiments, switching the displayed scanning instructions includes switching between at least two of an anatomical diagram of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section. For example, the first window displays the scanning instructions corresponding to scanning section A of the identified target object, but the scanning instructions may contain a lot of content that cannot be fully displayed within the current size of the first window. Therefore, the user can switch the content of the currently displayed scanning instructions in the first window based on a fourth touch operation. For example, if the currently displayed scan is an anatomical diagram of the scanning instructions corresponding to scanning section A, the user can switch the first window to display the scanning technique diagram or the standard ultrasound image of scanning section A by sliding left or right.

[0081] In some embodiments, the first window can be exited based on a fifth touch operation. In some embodiments, the fifth touch operation includes: dragging the first window to a preset position or clicking an exit control for the first window. For example, a user exits the first window by dragging it to the edge (top edge, bottom edge, left edge, or right edge) of the first interface. Another example is that a user long-presses the first window to trigger the display of an exit control, and then clicks the exit control to exit the first window.

[0082] The above steps also involve determining the scanning aspect of the target object, which can be achieved in several ways, as explained below.

[0083] In some embodiments, please refer to Figure 5 Step 120 receives the first touch operation on the first interface and determines the scanning section of the target object, including the following steps:

[0084] Step 121: Receive the first touch operation on the first interface and display several cross-section options for scanning areas; each cross-section option corresponds to a scanning cross-section.

[0085] Step 122: Receive the user's sixth touch operation on the facet option and determine the facet option selected by the user.

[0086] Step 123: Determine the scanning section of the target object based on the section options selected by the user.

[0087] For example, referring to Figures 6(a) and 6(b), the first interface has a menu control C. After the user clicks the menu control C, one or more scanning parts and the cross-section options under the scanning parts are displayed on the first interface by means of such as calling up a page or a tab. The figure schematically shows 7 scanning parts, and the current display shows 6 cross-section options under scanning part 2.

[0088] In some embodiments, when displaying the cross-section options in step 121, the corresponding scanning area can be selected by default based on the current scanning mode to display the various cross-section options under that scanning area for the user to choose from. Understandably, scanning modes are usually divided based on the location, such as abdominal scanning mode, liver scanning mode, thyroid scanning mode, and heart scanning mode, etc.

[0089] In some implementation examples, referring to Figure 7(a), step 130, based on the scanning section, to obtain the corresponding scanning indication includes the following steps:

[0090] Step 131: After determining the scanning section of the target object, display the second interface and show the scanning instructions corresponding to the scanning section on the second interface.

[0091] Step 132: Receive the seventh touch operation for the second interface, and select the scan instruction displayed in the first window according to the seventh touch operation;

[0092] Step 133: Receive the eighth touch operation for calling the window, exit the second interface, display the first interface, and overlay the first window, which is independent of the first interface, on the first interface.

[0093] In some implementation examples, referring to Figure 7(b), step 130, based on the scanning section, to obtain the corresponding scanning indication, further includes the following steps:

[0094] Step 134: After determining the scanning section of the target object, display the second interface and show the scanning instructions corresponding to the scanning section on the second interface;

[0095] Step 135: Receive the seventh touch operation for the second interface, select the scan instruction displayed in the first window according to the seventh touch operation, exit the second interface, display the first interface, and overlay the first window, which is independent of the first interface, on the first interface.

[0096] By displaying the scanning instructions for the scanning cross-section on a second interface, users can fully view the scanning instructions through a second interface that is larger than the first window.

[0097] Figures 8(a) to 8(e)As an example, Figure 8(a) shows the ultrasound image displayed on the first interface. Below the ultrasound image is a snowflake-shaped circular control, which is the freeze control. Clicking it freezes the currently displayed ultrasound image, and clicking it again unfreezes it. Figure 8(b) shows multiple scanning sites displayed on the first interface after the user performs a first touch operation—liver, gallbladder and bile ducts, pancreas, spleen, and kidneys—along with cross-sectional options below the scanning sites. The current figure shows multiple scanning cross-sections below the liver. Figure 8(c) shows the scanning instructions corresponding to the scanning cross-section selected by the user on the second interface. The upper half of the second interface displays, from left to right and top to bottom, a scanning technique diagram, a standard ultrasound image of the scanning cross-section, and a schematic diagram of the anatomical structure of the scanning cross-section; the lower half of the second interface displays some textual explanations. Users can also select the scanning technique diagram, standard ultrasound image, and anatomical structure diagram of the scanning section shown in Figure 8(c) via touch operation. The second interface can then further enlarge the selected image and add text descriptions. For example, if a user selects the anatomical structure diagram of the scanning section shown in Figure 8(c) via touch operation, a larger anatomical structure diagram of the scanning section with relevant text descriptions will be displayed in the second interface, as shown in Figure 8(d). Both Figure 8(c) and Figure 8(d) can lead to Figure 8(e), i.e., exiting the second interface and redisplaying the first interface, which displays the first window. The small window in the upper left corner of the first interface is the first window, which displays the standard ultrasound image of the scanning section. Figures 8(a) to 8(e) There is some English in it, which can also be Chinese or other languages.

[0098] The above is an example of displaying a first window overlaid on a first interface, and displaying ultrasound images and scanning instructions on the first interface and the first window respectively.

[0099] Please refer to Figure 9 Some embodiments of ultrasound data processing methods include the following steps:

[0100] Step 200: After the mobile terminal 10 runs the above application, it displays the first interface.

[0101] In some embodiments, the first interface has a first region of a third size. In some embodiments, the first region of the third size occupies more than 60% of the area of ​​the first interface; in some embodiments, the first region of the third size occupies more than 70% of the area of ​​the first interface; in some embodiments, the first region of the third size occupies more than 80% of the area of ​​the first interface; and in some embodiments, the first region of the third size occupies more than 90% of the area of ​​the first interface.

[0102] Step 210: Display an ultrasound image based on ultrasound echo signals or ultrasound image data within the first region. In some embodiments, the first region has an image display area for displaying the ultrasound image, that is, the first interface displays the ultrasound image within the image display area.

[0103] As described above, the mobile terminal 10 receives an ultrasound echo signal sent by the handheld ultrasound device 20 or receives ultrasound image data obtained by processing the ultrasound echo signal by the handheld ultrasound device 20. The mobile terminal then displays the ultrasound image obtained based on the ultrasound echo signal or ultrasound image data in the first interface.

[0104] Understandably, the mobile terminal 10 can receive data (ultrasound echo signals or ultrasound image data) from the handheld ultrasound device 20 in real time and display the corresponding ultrasound image on the first interface; that is, the first interface displays a real-time ultrasound image. Alternatively, the mobile terminal 10 can receive data (ultrasound echo signals or ultrasound image data) from the handheld ultrasound device 20 and store it, then retrieve and display the data on the first interface when the user needs to view it. Furthermore, the mobile terminal 10 can receive data (ultrasound echo signals or ultrasound image data) from the handheld ultrasound device 20 either before or after opening (starting) the aforementioned application.

[0105] Step 220: Receive the ninth touch operation for the first interface and determine the scanning section of the target object.

[0106] Step 230: Based on the scanning section, obtain the corresponding scanning instructions. In some embodiments, the scanning instructions include at least one of a schematic diagram of the anatomical structure of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section. In some embodiments, the scanning instructions also include explanatory text to explain and describe the content of the scanning instructions. In some embodiments, the schematic diagram of the anatomical structure of the scanning section also includes textual annotations to explain each anatomical structure; in some embodiments, the scanning technique diagram of the scanning section also includes textual annotations to illustrate the scanning technique.

[0107] Step 240: Within the first interface, reduce the size of the first region from the third size to the first size, and display a second region with a second size; wherein the second size is less than or equal to the first size; in some embodiments, the second size is less than the size of the ultrasound image or the size of the image display area.

[0108] In some embodiments, the first region and the second region do not overlap.

[0109] Step 250: Display scanning instructions in the second area to assist the user in scanning and obtaining the ultrasound image corresponding to the scanning section.

[0110] By displaying a first area within a first interface, and shrinking the first area to display a second area when a scanning instruction is needed, the user can view the ultrasound image in the first area and the scanning instruction in the second area. This allows the user to view both the ultrasound image and the scanning instruction on the mobile terminal, improving scanning and image processing efficiency.

[0111] In some embodiments where a first region and a second region are displayed on a first interface, the first region can be scaled, allowing the user to adjust its size as needed; similarly, the second region can be scaled, allowing the user to adjust its size as needed.

[0112] In some embodiments, the first region can be scaled based on a tenth touch operation; after the scaling of the first region is detected, the second region is adaptively scaled. For example, if the first region is zoomed in by the user, the second region is adaptively zoomed out, and if the first region is zoomed out by the user, the second region is adaptively zoomed in. In some embodiments, the first and second regions are kept from overlapping during this process.

[0113] In some embodiments, the tenth touch operation includes: pinching two fingers together in the first area to shrink, spreading two fingers apart in the first area to enlarge, pressing and holding the edge of the first area and dragging it into the first area to shrink, or pressing and holding the edge of the first area and dragging it out of the first area to enlarge.

[0114] In some embodiments, the second region can be scaled based on an eleventh touch operation; upon detecting that the second region has been scaled, the first region is adaptively scaled. For example, if the second region is zoomed in by the user, the first region is adaptively zoomed out, and if the second region is zoomed out by the user, the first region is adaptively zoomed in. In some embodiments, the first and second regions are kept from overlapping during this process.

[0115] In some embodiments, the eleventh touch operation includes: pinching two fingers together in the second area to shrink, spreading two fingers apart in the second area to enlarge, pressing and holding the edge of the second area and dragging it into the second area to shrink, or pressing and holding the edge of the second area and dragging it out of the first area to enlarge.

[0116] In some embodiments, the second region can be exited based on a thirteenth touch operation, and after the second region exits, the first region is adaptively enlarged, for example, the first region is restored to its original third size. In some embodiments, the thirteenth touch operation includes: clicking an exit control for the second region. For example, the user triggers the display of an exit control by long-pressing the second region, and the user then clicks the exit control to exit the second region.

[0117] Figure 10(a) shows a first interface with a first region D1 (the area defined by the dashed line in the figure). The size of the first region D1 is the third dimension; an ultrasound image is displayed within the first region D1. Figure 10(b) shows an example where the size of the first region D1 is reduced from the third dimension to the first dimension within the first interface, and a second region D2 with a second dimension is displayed. Figure 10(c) shows an example where the first region D1 is enlarged based on Figure 10(b), and the second region D2 is adaptively reduced.

[0118] In some embodiments, when the first region is magnified or reduced, the displayed ultrasound image is also adaptively magnified or reduced.

[0119] In some embodiments, the second region can switch the displayed scanning instructions based on a twelfth touch operation. In some embodiments, the twelfth touch operation includes a sliding operation in a preset direction within the second region. In some embodiments, switching the displayed scanning instructions includes switching between at least two of a schematic diagram of the anatomical structure of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section. For example, the second region displays the scanning instructions corresponding to scanning section A of the identified target object. However, the scanning instructions may contain a lot of information that cannot be fully displayed within the current size of the second region. Therefore, the user can switch the content of the currently displayed scanning instructions in the second region based on the twelfth touch operation. For example, if the currently displayed section is a schematic diagram of the anatomical structure of the scanning instructions corresponding to scanning section A, the user can switch the second region to display the scanning technique diagram or the standard ultrasound image of scanning section A by sliding left or right.

[0120] The above steps also involve determining the scanning aspect of the target object, which can be achieved in several ways, as explained below.

[0121] In some embodiments, please refer to Figure 11 Step 220 receives the ninth touch operation on the first interface and determines the scanning section of the target object, including the following steps:

[0122] Step 221: Receive the ninth touch operation for the first interface and display several cross-section options for scanning areas; each cross-section option corresponds to a scanning cross-section.

[0123] Step 222: Receive the user's fourteenth touch operation on the facet option and determine the facet option selected by the user.

[0124] Step 223: Determine the scanning section of the target object based on the section options selected by the user.

[0125] For example, the first interface has a menu control. After the user clicks the menu control, one or more scanning sites and cross-sectional options under the scanning sites are displayed on the first interface through methods such as pop-up pages or tabs. In some embodiments, when displaying cross-sectional options in step 221, the corresponding scanning site can be selected by default based on the current scanning mode to display the various cross-sectional options under that scanning site for the user to choose from. Understandably, scanning modes are usually divided based on the location, such as abdominal scanning mode, liver scanning mode, thyroid scanning mode, and heart scanning mode, etc.

[0126] In some implementation examples, please refer to Figure 12(a). Step 230, based on the scanning section, to obtain the corresponding scanning indication includes the following steps:

[0127] Step 231: After determining the scanning section of the target object, display the second interface and show the scanning instructions corresponding to the scanning section on the second interface.

[0128] Step 232: Receive the fifteenth touch operation for the second interface, and select the scan instruction displayed in the second area according to the fifteenth touch operation.

[0129] Step 233: Receive the sixteenth touch operation for allocating the second area, exit the second interface, display the first interface, and display a first area with a first size and a second area with a second size within the first interface.

[0130] In some implementation examples, please refer to Figure 12(b). Step 230, based on the scanning section, to obtain the corresponding scanning indication includes the following steps:

[0131] Step 234: After determining the scanning section of the target object, display the second interface and show the scanning instructions corresponding to the scanning section on the second interface.

[0132] Step 235: Receive the seventeenth touch operation for the second interface, select the scanning instruction displayed in the second area according to the seventeenth touch operation, exit the second interface, display the first interface, and display a first area with a first size and a second area with a second size in the first interface.

[0133] By displaying the scanning instructions for the scanning cross-section on the second interface, users can fully view the scanning instructions through the second interface, which is larger than the second area.

[0134] Please refer to Figure 13In some embodiments, the mobile terminal 10 includes a communication port 11, a memory 12, a display component 13, and a processor 14. The communication port 11 is used to establish communication with the handheld ultrasound device 20 and to transmit data; the memory 12 is used to store applications and ultrasound image data; the display component 13 is used to display content, and the display component 13 may include a touch screen; the processor 14 is used to execute applications, and the processor 14 is used to execute the ultrasound data processing method involved in any embodiment of this document.

[0135] For example, after the processor 14 runs the application, it controls the display component 13 to display a first interface and displays an ultrasound image obtained based on ultrasound echo signals or ultrasound image data within the first interface; the processor 14 receives a first touch operation on the first interface to determine the scanning section of the target object; the processor 14 obtains the corresponding scanning instruction based on the scanning section; the processor 14 controls the display component 13 to overlay a first window independent of the first interface on the first interface and displays the scanning instruction within the first window to assist the user in scanning to obtain the ultrasound image corresponding to the scanning section.

[0136] For example, after the processor 14 runs the application, it controls the display component 13 to display a first interface, the first interface having a first area of ​​a third size; the processor 14 controls the display component 13 to display an ultrasound image obtained based on ultrasound echo signals or ultrasound image data within the first area; the processor 14 receives a ninth touch operation on the first interface to determine the scanning section of the target object; the processor 14 obtains the corresponding scanning instruction based on the scanning section; the processor 14 controls the display component 13 to reduce the size of the first area from the third size to the first size within the first interface, and displays a second area of ​​a second size, and displays the scanning instruction within the second area to assist the user in scanning to obtain the ultrasound image corresponding to the scanning section.

[0137] This document describes various exemplary embodiments with reference to them. However, those skilled in the art will recognize that changes and modifications can be made to the exemplary embodiments without departing from the scope of this document. For example, various operational steps and components for performing operational steps can be implemented in different ways depending on the specific application or considering any number of cost functions associated with the operation of the system (e.g., one or more steps can be deleted, modified, or combined with other steps).

[0138] In the above embodiments, implementation can be achieved, in whole or in part, by software, hardware, firmware, or any combination thereof. Furthermore, as those skilled in the art will understand, the principles herein can be reflected in a computer program product on a computer-readable storage medium pre-loaded with computer-readable program code. Any tangible, non-transitory computer-readable storage medium may be used, including magnetic storage devices (hard disks, floppy disks, etc.), optical storage devices (CD-ROMs, DVDs, Blu-ray discs, etc.), flash memory, and / or the like. These computer program instructions can be loaded onto a general-purpose computer, special-purpose computer, or other programmable data processing apparatus to form a machine, such that instructions executing on the computer or other programmable data processing apparatus can generate means for implementing a specified function. These computer program instructions can also be stored in a computer-readable storage medium that can instruct the computer or other programmable data processing apparatus to operate in a particular manner, such that instructions stored in the computer-readable storage medium can form an article of manufacture including means for implementing the specified function. The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to perform a series of operational steps on the computer or other programmable apparatus to produce a computer-implemented process, such that instructions executing on the computer or other programmable apparatus can provide steps for implementing the specified function.

[0139] While the principles herein have been illustrated in various embodiments, numerous modifications to the structure, arrangement, proportions, elements, materials, and components, particularly suited to specific environmental and operational requirements, may be used without departing from the principles and scope of this disclosure. These modifications and other alterations or alterations will be included within the scope of this document.

[0140] The foregoing specific descriptions have been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes can be made without departing from the scope of this disclosure. Therefore, considerations for this disclosure are to be illustrative rather than restrictive, and all such modifications are to be included within its scope. Similarly, advantages, other advantages, and solutions to problems with respect to various embodiments have been described above. However, benefits, advantages, solutions to problems, and any elements that produce these, or make them more explicit, should not be construed as critical, essential, or necessary. The term “comprising” and any other variations thereof as used herein are non-exclusive inclusion, meaning that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not expressly listed or not part of the process, method, system, article, or apparatus. Furthermore, the term “coupled” and any other variations thereof as used herein refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections, and / or any other connections.

Claims

1. A method for processing ultrasound data, applied to mobile terminals and handheld ultrasound devices, characterized in that, A communication connection is established between the mobile terminal and the handheld ultrasound device; the handheld ultrasound device is used to emit ultrasound waves toward a target object, receive the ultrasound echo returned by the target object, and obtain an ultrasound echo signal; the mobile terminal receives the ultrasound echo signal sent by the handheld ultrasound device or receives ultrasound image data obtained by processing the ultrasound echo signal by the handheld ultrasound device through the communication connection; the mobile terminal has an application installed, which provides a first interface through which human-computer interaction can be performed. The method for processing the ultrasound data includes: After the mobile terminal runs the application, it displays the first interface; An ultrasound image obtained based on the ultrasound echo signal or the ultrasound image data is displayed in the first interface. Receive a first touch operation on the first interface and determine the scanning section of the target object; Based on the scanning section, a corresponding scanning instruction is obtained; the scanning instruction includes at least two of the following: a schematic diagram of the anatomical structure of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section; A first window, independent of the first interface, is overlaid and displayed on the first interface. The initial size of the first window is smaller than that of the first interface. The scanning instructions are displayed in the first window to assist the user in scanning to obtain the ultrasound image corresponding to the scanning section; the first window can switch the displayed scanning instructions within the first window based on a fourth touch operation; the switching of the displayed scanning instructions includes switching between at least two of the anatomical structure diagram of the scanning section, the scanning technique diagram of the scanning section, and the standard ultrasound image of the scanning section.

2. The processing method as described in claim 1, characterized in that, The first window can be moved independently of the first interface based on a second touch operation; and / or, the first window can be scaled independently of the first interface based on a third touch operation; and / or, the first window can be exited based on a fifth touch operation.

3. The processing method as described in claim 2, characterized in that, The second touch operation includes: pressing and dragging a preset position on the first window; And / or, the third touch operation includes: pinching two fingers together in the area of ​​the first window to shrink, spreading two fingers apart in the area of ​​the first window to enlarge, pressing and holding the edge of the first window and dragging it in the area of ​​the first window to shrink, or pressing and holding the edge of the first window and dragging it out of the area of ​​the first window to enlarge. And / or, the fourth touch operation includes: a sliding operation in a preset direction within the first window; And / or, the fifth touch operation includes: dragging the first window to a preset position or clicking the exit control for the first window.

4. The processing method as described in claim 1, characterized in that, Receiving a first touch operation on the first interface and determining the scanning section of the target object includes: The system receives a first touch operation on the first interface and displays several cross-section options for scanning areas; each cross-section option corresponds to a scanning cross-section. Receive the user's sixth touch operation on the facet option and determine the facet option selected by the user; Based on the cross-section option selected by the user, the scanning cross-section of the target object is determined.

5. The processing method as described in claim 1 or 4, characterized in that, The application is also used to provide a second interface; obtaining the corresponding scanning instruction based on the scanning section includes: After determining the scanning section of the target object, the second interface is displayed and the scanning instruction corresponding to the scanning section is displayed on the second interface; Receive a seventh touch operation for the second interface, select the scan instruction displayed in the first window according to the seventh touch operation; receive an eighth touch operation for calling the window, exit the second interface, display the first interface, and overlay the first window, which is independent of the first interface, on the first interface; or, After determining the scanning section of the target object, the second interface is displayed and the scanning instruction corresponding to the scanning section is displayed on the second interface; The system receives a seventh touch operation on the second interface, selects the scan instruction displayed in the first window according to the seventh touch operation, exits the second interface, displays the first interface, and overlays the first window, which is independent of the first interface, on the first interface.

6. The processing method as described in claim 1, characterized in that, The first interface has an image display area for displaying the ultrasound image; the initial size of the first window is smaller than the size of the ultrasound image or the size of the image display area.

7. The processing method as described in claim 1, characterized in that, The first interface has an image display area for displaying the ultrasound image; The initial position of the first window is located in the upper left, lower left, upper right, or lower right of the image display area or the ultrasound image, and does not overlap or at least partially overlaps. And / or, The initial position of the first window is located at a first position on the first interface, and the first position ensures that the first window does not overlap with the image display area or the ultrasound image, or minimizes the overlap area.

8. The processing method as described in claim 1, characterized in that, The scanning instructions include two of the following: an anatomical diagram of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section; the fourth touch operation includes a sliding operation in a preset direction within the first window, and the first window can switch between the two based on the sliding operation to display either one. or, The scanning instructions include three of the following: an anatomical diagram of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section. The fourth touch operation includes a sliding operation in a preset direction within the first window. The first window can switch between the three based on the sliding operation to display any one of them.

9. A method for processing ultrasound data, applied to mobile terminals and handheld ultrasound devices, characterized in that, A communication connection is established between the mobile terminal and the handheld ultrasound device; the handheld ultrasound device is used to emit ultrasound waves toward a target object, receive the ultrasound echo returned by the target object, and obtain an ultrasound echo signal; the mobile terminal receives the ultrasound echo signal sent by the handheld ultrasound device or receives ultrasound image data obtained by processing the ultrasound echo signal by the handheld ultrasound device through the communication connection; the mobile terminal has an application installed, which provides a first interface through which human-computer interaction can be performed. The method for processing the ultrasound data includes: After the mobile terminal runs the application, it displays the first interface, which has a first area of ​​a third size. Display an ultrasound image based on the ultrasound echo signal or the ultrasound image data within the first region; Receive a ninth touch operation on the first interface and determine the scanning section of the target object; Based on the scanning section, a corresponding scanning instruction is obtained; the scanning instruction includes at least two of the following: a schematic diagram of the anatomical structure of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section; Within the first interface, the size of the first region is reduced from the third size to the first size, and a second region with a second size is displayed; wherein the second size is less than or equal to the first size; The scanning instructions are displayed in the second area to assist the user in scanning to obtain the ultrasound image corresponding to the scanning section; the second area can switch the displayed scanning instructions based on the twelfth touch operation; the switching of the displayed scanning instructions includes switching between at least two of the anatomical structure diagram of the scanning section, the scanning technique diagram of the scanning section, and the standard ultrasound image of the scanning section.

10. The processing method as described in claim 9, characterized in that, The first area can be scaled based on a tenth touch operation; after detecting that the first area has been scaled, the second area is adaptively scaled. And / or, The second area can be scaled based on the eleventh touch operation; After detecting that the second region has been scaled, the first region is adaptively scaled while keeping the first region and the second region from overlapping.

11. The processing method as described in claim 9, characterized in that, The second area can be exited based on a thirteenth touch operation, and after the second area is exited, the first area is adaptively enlarged.

12. The processing method of claim 9, wherein receiving a ninth touch operation on the first interface and determining the scanning section of the target object includes: The system receives a ninth touch operation on the first interface and displays several cross-section options for scanning areas; each cross-section option corresponds to a scanning cross-section. Receive the user's fourteenth touch operation on the facet option and determine the facet option selected by the user; Based on the cross-section option selected by the user, the scanning cross-section of the target object is determined.

13. The processing method as described in claim 9 or 12, characterized in that, The application is also used to provide a second interface; obtaining the corresponding scanning instruction based on the scanning section includes: After determining the scanning section of the target object, the second interface is displayed and the scanning instruction corresponding to the scanning section is displayed on the second interface; Receive a fifteenth touch operation for the second interface, select the scan instruction displayed in the second area according to the fifteenth touch operation; receive a sixteenth touch operation for allocating the second area, exit the second interface, display the first interface and display a first area with the first size and a second area with the second size in the first interface; or, After determining the scanning section of the target object, the second interface is displayed and the scanning instruction corresponding to the scanning section is displayed on the second interface; The system receives a seventeenth touch operation on the second interface, selects the scan instruction displayed in the second area according to the seventeenth touch operation, exits the second interface, displays the first interface, and displays a first area with the first size and a second area with the second size within the first interface.

14. The processing method as described in claim 9, characterized in that, The first region and the second region do not overlap.

15. The processing method as described in claim 9, characterized in that, The first region has an image display area for displaying the ultrasound image; the second size is smaller than the size of the ultrasound image or the size of the image display area.

16. The processing method as described in claim 9, characterized in that, The scanning instructions include two of the following: an anatomical diagram of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section; the twelfth touch operation includes a sliding operation in a preset direction within the second area, and the second area can switch between the two based on the sliding operation to display either one; or, The scanning indication includes three elements: an anatomical diagram of the scanning section, a scanning technique diagram of the scanning section, and a standard ultrasound image of the scanning section. The twelfth touch operation includes a sliding operation in a preset direction within the second area. The second area can switch between the three elements based on the sliding operation to display any one of them.

17. A mobile terminal, characterized in that, Includes communication ports, memory, display components, and processor; The communication port is used to establish communication with the handheld ultrasound device and transmit data. The memory is used to store application and ultrasound image data; The display component is used to display content; The processor is used to execute the method for processing ultrasound data as described in any one of claims 1 to 16.

18. A computer program product, characterized in that, When the computer program product is run on a computer, the computer is caused to execute a method for processing ultrasound data as described in any one of claims 1 to 16.

19. A computer-readable storage medium, characterized in that, The medium stores a program that can be executed by a processor to implement the method for processing ultrasound data as described in any one of claims 1 to 16.

Images