Ultrasound imaging apparatus, control method thereof, ultrasound imaging system, and storage medium

Abstract

The embodiment of the invention provides an ultrasonic imaging device, a control method thereof, an ultrasonic imaging system and a storage medium. The control method comprises the following steps: establishing communication connection with external equipment; transmitting ultrasonic data to the external equipment through the communication connection; receiving user interface information about the ultrasonic data generated on a display interface of the external equipment through the communication connection; and in response to the generation of the switching instruction, switching the input equipment of the ultrasonic imaging device to control the user interface of the external equipment. Therefore, the control object of the input equipment of the ultrasonic imaging device is switched through the switching instruction, so that the input equipment of the ultrasonic imaging device not only can perform ultrasonic scanning operation, but also can control the external equipment, thereby being capable of simultaneously performing the operation of the external equipment and the ultrasonic scanning operation, and improving the working efficiency.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of medical equipment technology, and in particular, to an ultrasonic imaging device and a control method thereof, an ultrasonic imaging system, and a storage medium. Background Art

[0002] With the development of ultrasound imaging technology, ultrasound imaging has been widely used in the medical field. Doctors use ultrasound imaging equipment to examine the object to be tested, obtain ultrasound data, and make medical diagnosis of the object based on the ultrasound data.

[0003] In recent years, with the development of network technology, telemedicine has also been rapidly promoted. For example, doctors can interact remotely with other personnel through external devices when performing ultrasound scans, thereby achieving efficient sharing of medical resources.

[0004] It should be noted that the above introduction to the technical background is only intended to provide a clear and complete description of the technical solution of the present application and to facilitate understanding by those skilled in the art. Summary of the invention

[0005] The inventors have discovered that when doctors are performing telemedicine, they need to operate external devices to interact with remote personnel, but the operating components of the external devices are generally not provided on the ultrasonic imaging device. In addition, the doctors generally also have to operate the ultrasonic imaging device, including operating the scanning probe, various buttons and keys on the ultrasonic imaging device, etc. Therefore, when doctors operate the ultrasonic imaging device, it is difficult for them to directly operate the external device due to the distance, causing inconvenience.

[0006] In response to at least one of the above technical problems, an embodiment of the present application provides an ultrasonic imaging device and a control method thereof, an ultrasonic imaging system and a storage medium.

[0007] According to a first aspect of an embodiment of the present application, a control method for an ultrasonic imaging device is provided, the method comprising:

[0008] Establishing communication connection with external devices;

[0009] transmitting ultrasound data to the external device via the communication connection;

[0010] receiving, through the communication connection, user interface information about the ultrasound data generated on a display interface of the external device; and

[0011] In response to the generation of the switching instruction, the input device of the ultrasonic imaging apparatus is switched to control the user interface of the external device.

[0012] In one or more embodiments, the generation of the switching instruction is based on at least one of the following methods:

[0013] The cursor of the input device on the display device of the ultrasonic imaging device moves out of the edge of the display device toward the external device;

[0014] A switch button in the input device is operated; and

[0015] A camera device is used to determine whether the user's sight line is directed toward the external device.

[0016] In one or more embodiments, using a camera to determine that the user's line of sight is directed toward the external device includes:

[0017] Using the camera device to capture the user's sight line,

[0018] When it is determined that the line of sight is directed toward the external device, the input device is enabled to control the external device.

[0019] In one or more embodiments, using a camera device to determine that the user's line of sight is directed toward the external device further includes:

[0020] In a case where it is determined that the line of sight is not directed toward the external device, the input device is caused to control the ultrasonic imaging apparatus.

[0021] In one or more embodiments, the input device includes at least one of a trackball, a keyboard, a touchpad, and a touch screen.

[0022] In one or more embodiments, the input device includes at least one of a trackball and a touchpad, and the input device controls the user interface of the external device including:

[0023] A controllable area of ​​the user interface of the external device is determined, and a cursor corresponding to the trackball or the touchpad is limited within the controllable area.

[0024] In one or more embodiments, the input device includes a touch screen, and the touch screen controls the user interface of the external device including:

[0025] The interface information of the external device is projected onto the touch screen.

[0026] In one or more embodiments, the display interface of the external device is configured to be touch-operable.

[0027] In one or more embodiments, the external device includes a camera.

[0028] According to a second aspect of an embodiment of the present application, an ultrasonic imaging apparatus is provided, comprising an input device and a processor, wherein the processor is configured to execute the method as described in the embodiment of the first aspect.

[0029] According to a third aspect of the embodiments of the present application, an ultrasound imaging system is provided, the ultrasound imaging system comprising the ultrasound imaging device as described in the embodiments of the second aspect and an external device connected to the ultrasound imaging device.

[0030] According to a fourth aspect of an embodiment of the present application, a non-transitory computer-readable storage medium is provided, which is used to store a computer program. When the computer program is executed by a computer, the computer executes the method as described in the embodiment of the first aspect.

[0031] One of the beneficial effects of the embodiments of the present application is that the control object of the input device of the ultrasonic imaging device is switched through a switching instruction, so that the input device of the ultrasonic imaging device can control an external device, thereby improving convenience and work efficiency.

[0032] With reference to the following description and accompanying drawings, the specific implementation of the embodiment of the present application is disclosed in detail, indicating the way in which the principle of the embodiment of the present application can be adopted. It should be understood that the implementation of the present application is not limited in scope. Within the scope of the spirit and clauses of the attached claims, the implementation of the present application includes many changes, modifications and equivalents. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The included drawings are used to provide a further understanding of the embodiments of the present application, which constitute a part of the specification, are used to illustrate the implementation methods of the present application, and together with the text description, explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other implementation methods can be obtained based on these drawings without creative work. In the drawings:

[0034] Figure 1 is a schematic diagram of an ultrasound imaging system according to an embodiment of the present application;

[0035] Figure 2 is a schematic diagram of a control method of an ultrasonic imaging device according to an embodiment of the present application;

[0036] Figure 3 is another schematic diagram of a control method of an ultrasonic imaging device according to an embodiment of the present application;

[0037] Figure 4 is another schematic diagram of an ultrasound imaging system according to an embodiment of the present application;

[0038] Figure 5It is a schematic diagram of an ultrasonic imaging device according to an embodiment of the present application. DETAILED DESCRIPTION

[0039] With reference to the accompanying drawings, the foregoing and other features of the embodiments of the present application will become apparent through the following description. In the description and the accompanying drawings, specific embodiments of the present application are specifically disclosed, which show some embodiments in which the principles of the embodiments of the present application can be adopted. It should be understood that the present application is not limited to the described embodiments. On the contrary, the embodiments of the present application include all modifications, variations and equivalents that fall within the scope of the attached claims.

[0040] In the embodiments of the present application, the terms "first", "second", etc. are used to distinguish different elements in terms of title, but do not indicate the spatial arrangement or temporal order of these elements, etc., and these elements should not be limited by these terms. The term "and / or" includes any one and all combinations of one or more of the associated listed terms. The terms "comprising", "including", "having", etc. refer to the presence of the stated features, elements, components or components, but do not exclude the presence or addition of one or more other features, elements, components or components.

[0041] In the embodiments of the present application, the singular forms "a", "the", etc. include plural forms and should be broadly understood as "a kind" or "a type" rather than being limited to the meaning of "one"; in addition, the term "said" should be understood to include both singular and plural forms, unless the context clearly indicates otherwise. In addition, the term "according to" should be understood as "at least in part according to...", and the term "based on" should be understood as "at least in part based on...", unless the context clearly indicates otherwise.

[0042] Features described and / or shown for one embodiment may be used in one or more other embodiments in the same or similar manner, combined with features in other embodiments, or replace features in other embodiments. The term "includes / comprising" when used herein refers to the presence of a feature, an entirety, a step, or a component, but does not exclude the presence or addition of one or more other features, entireties, steps, or components.

[0043] An embodiment of the present application provides an ultrasound imaging system. Figure 1 is a schematic diagram of an ultrasound imaging system according to an embodiment of the present application.

[0044] like Figure 1As shown, the ultrasound imaging system 100 includes an ultrasound imaging device 110 and an external device 120, and the ultrasound imaging device 110 and the external device 120 realize information exchange through a communication connection 130. The ultrasound imaging device 110 may include a controller circuit 102 and an input device 142. In addition, the ultrasound imaging device 110 may also include an ultrasound probe 103, a communication circuit 104, a display device 138, an input device 142 and a memory 106.

[0045] The ultrasound probe 103 may include, for example, a transducer, a transmitter, a transmit beamformer, and a detector / SAP electronic component (not shown). The detector / SAP electronic component may be used to control the switching of the transducer element. The detector / SAP electronic component may also be used to group the transducer element into one or more sub-holes. The ultrasound probe 103 may communicate with the controller circuit 102 by wire or wirelessly, and send the collected data to the controller circuit 102, and the controller circuit 102 may process the data collected by the ultrasound probe 103 to obtain ultrasound data such as an ultrasound image. The implementation of the ultrasound probe 103 may refer to the relevant technology, and the embodiments of the present application are not limited thereto.

[0046] The controller circuit 102 is configured to control the operation of the ultrasound imaging device 110. The controller circuit 102 may include one or more processors. Optionally, the controller circuit 102 may include a central processing unit (CPU), one or more microprocessors, a graphics processing unit (GPU), or any other electronic component capable of processing input data according to specific logic instructions. Optionally, the controller circuit 102 may include and / or represent one or more hardware circuits or circuit systems, which include, connect, or include and connect one or more processors, controllers, and / or other hardware-based logic devices. In addition or alternatively, the controller circuit 102 may execute instructions stored on a tangible and non-temporary computer-readable medium (e.g., memory 106).

[0047] The controller circuit 102 may be connected to and / or control the communication circuit 104. The communication circuit 104 is configured to receive and / or transmit information along a bidirectional communication link with one or more optional external devices 120, etc. The external device 120 may include patient information, machine learning algorithms, remotely stored medical images from previous scans and / or treatments of the patient, etc. The communication circuit 104 may represent hardware for transmitting and / or receiving data along a bidirectional communication link. The communication circuit 104 may include a transceiver, a receiver, a transceiver, etc. and associated circuit systems (e.g., antennas) for communicating (e.g., transmitting and / or receiving) in a wired and / or wireless manner with the one or more optional external devices 120. For example, protocol firmware for transmitting and / or receiving data along a bidirectional communication link may be stored in a memory 106 accessed by the controller circuit 102. The protocol firmware provides the controller circuit 102 with network protocol syntax to assemble data packets, build and / or segment data received along a bidirectional communication link, etc.

[0048] The bidirectional communication link may be a wired (e.g., via physical conductors) and / or wireless communication (e.g., using radio frequency (RF)) link for exchanging data (e.g., data packets) between the one or more selected external devices 120. The bidirectional communication link may be based on a standard communication protocol, such as Ethernet, TCP / IP, WiFi, 802.11, a custom communication protocol, Bluetooth, etc.

[0049] The controller circuit 102 is operably connected to a display device 138 and an input device 142. The display device 138 may include one or more liquid crystal display devices (e.g., light emitting diode (LED) backlights), organic light emitting diode (OLED) display devices, plasma display devices, CRT display devices, etc. The display device 138 may display patient information, one or more medical images and / or videos, a graphical user interface or component, one or more 2D, 3D, or 4D ultrasound image data sets from ultrasound data stored in the memory 106, or currently acquired anatomical measurements, diagnoses, processing information, etc., received by the display device 138 from the controller circuit 102.

[0050] The controller circuit 102 may be configured to process the acquired ultrasound data (e.g., RF signal data or IQ data pairs) and prepare and / or generate ultrasound image data frames representing anatomical structures of interest for display on the display device 138. The acquired ultrasound data may be processed by the controller circuit 102 in real time as echo signals are received during a scanning or treatment procedure for an ultrasound examination. Additionally or alternatively, the ultrasound data may be temporarily stored in the memory 106 during the scanning procedure and processed in a less real-time manner in an on-the-go or off-line operation.

[0051] The memory 106 may be used to store processed frames of acquired ultrasound data that are not intended for immediate display, or to store post-processed images (e.g., shear wave images, strain images), firmware or software corresponding to, for example, a graphical user interface, one or more default image display settings, programmed instructions, and the like. The memory 106 may store medical images such as 3D ultrasound image data sets of ultrasound data, where such 3D ultrasound image data sets are accessed to present 2D and 3D images. For example, the 3D ultrasound image data sets may be mapped into the corresponding memory 106 and one or more reference planes. The processing of ultrasound data including the ultrasound image data sets may be based in part on user input, such as a user selection received at the input device 142.

[0052] The memory 106 includes parameters, algorithms, one or more ultrasound examination protocols, data values, etc. used by the controller circuit 102 to perform one or more operations described in the present application. The memory 106 can be a tangible and non-transitory computer-readable medium, such as a flash memory, RAM, ROM, EEPROM, etc. The memory 106 may include a set of learning algorithms (such as a convolutional neural network algorithm, a deep learning algorithm, a decision tree learning algorithm, etc.) configured to define an image analysis algorithm. When executing the image analysis algorithm, the controller circuit 102 is configured to identify a section (or view, anatomical plane) of an anatomical structure of interest in the medical image. Optionally, the image analysis algorithm can be received by the communication circuit 104 along one of the two-way communication links and stored in the memory 106. It can be understood that the anatomical structure of interest can be a specific anatomical feature in the part to be scanned, for example, it can be a muscle, a blood vessel, a tissue to be intervened (such as a tumor), etc.

[0053] The input device 142 controls the operation of the controller circuit 102 and the external device 120. The input device 142 is configured to receive input from a clinician and / or an operator of the ultrasound imaging system 100. The input device 142 may include a keyboard, a mouse, a trackball, a touchpad, one or more physical buttons, and the like. Optionally, the display device 138 may be a touch screen display device that includes at least a portion of the input device 142. For example, a portion of the input device 142 may correspond to a graphical user interface (GUI) generated by the controller circuit 102 and displayed on the display device 138. The touch screen display device may detect the presence of a touch from an operator on the display device 138, and may also identify the location of the touch relative to the surface area of ​​the display device 138. For example, a user may select one or more user interface components of the user interface (GUI) displayed on the display device by touching or contacting the display device 138. The user interface components may correspond to icons, text boxes, menu bars, and the like displayed on the display device 138. The user interface components may be selected, manipulated, utilized, interacted with, and the like by a clinician to instruct the controller circuit 102 to perform one or more operations as described herein. For example, the touch may be applied by at least one of a person's hand, a glove, a stylus, and the like.

[0054] The external device 120 can be used to receive ultrasound data, perform remote ultrasound, etc. The external device 120 includes a communication module for communicating with the ultrasound imaging device 110, such as a 4G / 5G module, a ZigBee wireless communication module, a wireless Bluetooth module, a Star Flash communication module, a wifi communication module, a CPE (Customer Premises Equipment) communication module, etc. The external device 120 can interact with the ultrasound imaging device 110 through the communication module for ultrasound data and ultrasound data related information. The ultrasound data related information can be, for example, user interface information about ultrasound data generated on the display interface of each display component based on ultrasound data, such as the coordinates and size of the user interface. The external device 120 can also include one or more camera devices, which can be built into the external device 120. For example, the camera device can be the front camera and / or rear camera of the external device 120; the camera device can also be external to the external device 120. The camera device can perform the remote ultrasound function of the external device and can also perform line of sight judgment. Remote ultrasound and line of sight judgment can be achieved by one camera device or by different camera devices. Remote ultrasound and line of sight judgment will be described in detail below.

[0055] The scanning operator of the ultrasound imaging system 100 may exchange information with a remote person through the external device 120 .

[0056] The above exemplarily describes the functions of the various components of the ultrasound imaging system 100 and the manner in which they cooperate with each other. It can be understood that those skilled in the art can also adjust the configuration of the ultrasound imaging system 100 based on the above teachings of the present disclosure.

[0057] The inventors have discovered that, during ultrasonic scanning, the scanning operator needs to hold the ultrasonic probe with one hand and operate various keys and buttons on the ultrasonic imaging device with the other hand. When remote communication is performed through an external device, it is difficult for the scanning operator to directly operate the external device while operating the ultrasonic imaging device due to the distance. The scanning operator often has to put down the ultrasonic probe to operate the external device. After operating the external device, the scanning operator needs to pick up the ultrasonic probe again to perform ultrasonic scanning. The scanning operator cannot efficiently operate the external device and the ultrasonic scanning.

[0058] An embodiment of the present application provides a control method for an ultrasonic imaging device, wherein the control method controls an input device of the ultrasonic imaging device to be able to perform input operations on an external device.

[0059] Figure 2 It is a schematic diagram of a control method of an ultrasonic imaging device according to an embodiment of the present application.

[0060] like Figure 2 As shown, the method includes:

[0061] 201: Establishing a communication connection with an external device;

[0062] 202: Transmitting ultrasound data to the external device through the communication connection;

[0063] 203: receiving user interface information about the ultrasound data generated on a display interface of the external device through the communication connection;

[0064] 204: In response to the generation of the switching instruction, switch the input device of the ultrasonic imaging apparatus to control the user interface of the external device.

[0065] Therefore, the control object of the input device of the ultrasonic imaging device is switched through the switching instruction, so that the input device of the ultrasonic imaging device can control the external device. That is to say, the input device of the ultrasonic imaging device can be used to perform ultrasonic scanning operations and operate external devices, which improves convenience and can improve work efficiency.

[0066] In an embodiment of the present application, the user interface information about the ultrasound data generated on the display interface of the external device may be, for example, the coordinates, size, etc. of the user interface about the ultrasound data on the display interface of the external device, thereby enabling accurate control of the user interface of the external device.

[0067] One application scenario of the embodiment of the present application may be remote ultrasound, that is, a doctor at a remote end may communicate with a scanning operator of an ultrasound imaging device through remote communication to instruct the scanning operator to perform ultrasound scanning, or the scanning operator and the doctor at the remote end may share ultrasound data. Figure 1 In the ultrasonic imaging system 100 shown, the scanning operator can operate the input device of the ultrasonic imaging device 110 to obtain the ultrasonic image, and the ultrasonic imaging device 110 transmits the ultrasonic data such as the ultrasonic image to the external device 120. The external device 120 can share the ultrasonic data with the doctor at the remote end through, for example, a 5G module. The doctor and the scanning operator interact through the external device 120, and the scanning operator can obtain the guidance of the remote doctor by operating the external device 120, while performing an ultrasonic scan on the patient in real time under the guidance of the doctor. Thus, for example, the remote doctor can determine the required ultrasonic data in real time according to the patient's scanning situation, and the scanning operator can quickly and accurately obtain the data required for diagnosing the disease under the guidance of the doctor, thereby improving the diagnostic efficiency; on the other hand, even if the scanning operator of the ultrasonic imaging device does not have the medical knowledge to diagnose the disease, the ultrasonic data required for diagnosing the disease can be obtained efficiently, thereby avoiding the waste of medical resources caused by the scanning operator obtaining useless data.

[0068] Another application scenario of the embodiment of the present application may be that a scanning operator communicates with a remote trainee through an external device to provide remote training on ultrasound scanning related knowledge to the trainee. Figure 1 In the ultrasound imaging system 100 shown, the input device of the ultrasound imaging apparatus 110 is operated to acquire an ultrasound image, and the ultrasound imaging apparatus 110 transmits ultrasound data such as the ultrasound image to the external device 120. The external device 120 can send or share the ultrasound data to a remote trainee. In addition, when the external device 120 is equipped with a camera, the camera of the external device 120 can also be used to capture the operation video of the scanning operator, and transmit it to the remote trainee in real time. The scanning operator can perform the ultrasound scanning operation while explaining the knowledge related to the previous ultrasound scanning operation to the remote trainee by operating the external device 120.

[0069] Those skilled in the art should understand that the above description of the application scenarios is to make the implementation methods of the embodiments of the present application clearer and should not be interpreted as limiting the embodiments of the present application. The embodiments of the present application can also be applied to other scenarios, and the embodiments of the present application do not limit the application scenarios.

[0070] In some embodiments, the generation of the switching instruction may be based on at least one of the following methods:

[0071] The cursor of the input device on the display device of the ultrasonic imaging device moves out of the edge of the display device toward the external device;

[0072] A switch button in the input device is operated; and

[0073] A camera device is used to determine whether the user's sight line is directed toward the external device.

[0074] Thus, the user can flexibly and quickly switch between the operation of the ultrasonic imaging device and the operation of the external device through simple operations.

[0075] For example, in Figure 1 In the ultrasound imaging system 100 shown, the input device 142 may include at least one of a trackball, a keyboard, a touch pad, and a touch screen.

[0076] In some embodiments, the input device 142 includes a trackball and / or a touchpad. When the cursor of the input device 142 moves on the display device 138 toward the external device 120 to the edge of the display device 138, it indicates that the operator's operation of the current device (i.e., the ultrasound imaging device 110) is temporarily terminated and needs to be transferred to the display interface of the external device 120 for operation, and therefore, a switching instruction is generated.

[0077] In the above example, operation 204 may include: determining a controllable area of ​​the user interface of the external device 120, and limiting the cursor corresponding to the trackball or touchpad within the controllable area. For example, if the size of the user interface of the external device 120 is different from the size of the display interface of the display device 138 of the ultrasound imaging device, an area similar to the size of the display interface of the display device 138 may be specified on the user interface of the external device 120, and an interface related to ultrasound data is displayed in the area, and the cursor corresponding to the trackball or touchpad is limited to the area, which is conducive to the conversion of ultrasound image and other data on the two display interfaces.

[0078] Alternatively, the user interface of the external device 120 displays some information that cannot be changed or is not allowed to be changed, such as information related to the patient's privacy information, or information related to the external device 120. By defining areas on the user interface other than areas related to this information as controllable areas, the user is prevented from making accidental operations on this information on the external device 120.

[0079] In some embodiments, the input device 142 includes a touch screen, and operation 204 may include: projecting interface information of the external device onto the touch screen. Thus, the interface of the external device is controlled by controlling the touch screen.

[0080] For example, in Figure 1In the ultrasound imaging system 100 shown, the input device 142 may also be provided with a switching button for triggering a switching instruction. The switching button may be a hardware button or a software button. When the user needs to switch the control object, the button is triggered. In response to the trigger operation, a switching instruction is generated to switch to controlling the user interface of the external device or controlling the ultrasound imaging device.

[0081] For example, in Figure 1 The ultrasonic imaging system 100 shown may also include a camera device, which detects that the operator's line of sight is directed toward the external device 120, indicating that the operator is interested in the external device 120, and thus generates a switching instruction. In addition, optionally, the external device 120 may include the camera device for detecting the direction of the operator's line of sight, and the camera device may also be provided in the ultrasonic imaging device.

[0082] Figure 3 is another schematic diagram of the control method of the ultrasonic imaging device according to an embodiment of the present application, Figure 3 The steps of switching the control object of the input device based on the line of sight direction are shown.

[0083] like Figure 3 As shown, the method includes:

[0084] 301: using the camera device to capture the user's sight line,

[0085] 302: When it is determined that the line of sight is directed toward the external device, enable the input device to control the external device.

[0086] In the embodiment of the present application, for example, the camera device collects the user's face image, and the collected face image is analyzed based on the neural network model to obtain the user's line of sight. Other methods can also be used to collect the user's line of sight, and specific reference can be made to related technologies. The embodiment of the present application does not limit the implementation method of how to collect the user's line of sight.

[0087] In the embodiments of the present application, for example, the user's facial image can be analyzed based on a deep learning model to obtain the head posture, and the user's line of sight can be calculated based on parameters such as the head posture, the line of sight angle, and the distance between the user and the external device. If the user's line of sight is in a predetermined area where the external device is located, it is determined that the user's line of sight is directed toward the external device. Other methods can also be used to determine the line of sight direction, and specific reference can be made to related technologies. The embodiments of the present application do not limit the implementation method of how to determine the line of sight direction.

[0088] In addition, if Figure 3 As shown, the method may also include,

[0089] 303: When it is determined that the line of sight is not directed toward the external device, enable the input device to control the ultrasonic imaging apparatus.

[0090] Thus, the user can switch the control object of the input device only by switching the line of sight, which further facilitates the switching of the operation of the ultrasonic imaging apparatus and the operation of the external device.

[0091] However, the present application is not limited to this. For example, the camera device can also obtain the posture and / or movement of other parts of the scanning operator to generate a switching instruction. For example, when the camera device obtains the movement or posture of the scanning operator raising his hand, a switching instruction is generated. In addition, the body information about the operator obtained by the camera device can also be combined to generate a switching instruction. For example, when the camera device successively obtains the information that the scanning operator's line of sight is directed toward an external device and the scanning operator raises his hand, a switching instruction is generated. This can improve the operational reliability.

[0092] In some embodiments, the display interface of the external device is configured to be touch-operable. Figure 1 In the ultrasonic imaging system 100 shown in the figure, the external device 120 may be a portable computer capable of touch screen operation, such as a tablet computer, etc.

[0093] It can be seen from the above embodiments that the control object of the input device of the ultrasonic imaging apparatus is switched by switching instructions, so that the input device of the ultrasonic imaging apparatus can control the external device, thereby improving convenience and work efficiency.

[0094] To further illustrate the embodiments of the present application, please refer to Figure 4 , showing a schematic diagram of an ultrasound imaging system 400 in some embodiments of the present application.

[0095] The ultrasound imaging system 400 includes an ultrasound imaging device 410 and an external device 420. There is a communication connection 130 between the two. The communication connection 130 enables data exchange and transmission of control instructions between the ultrasound imaging device 410 and the external device 420. The communication connection 130 can be configured with multiple functions. In one example, it can allow data from the ultrasound imaging device 410 to be transmitted to the external device 420. Figure 4 As shown, the ultrasound image 411 of the ultrasound imaging device 410 is transmitted to the external device 420 via the communication connection 130, and the external device 420 can display the same image 421 on its user interface 423. In the use scenario of remote ultrasound, the screen of the external device 420 can be shared to the remote end through the remote communication technology, and the remote user can understand the status of the current ultrasound scan through the image 421, so as to learn or guide.

[0096] Furthermore, in some examples, the external device 420 includes a camera 422. The camera 422 can collect the required image information. The types of image information can be various, for example, it can be the user's line of sight and / or facial information. In a typical usage scenario, when the user operates the ultrasonic imaging device 410, it is difficult to operate the external device 420 due to the distance. Through the method described in the above embodiment of the present application, the user's line of sight information collected by the camera 422 can be received by the processor of the ultrasonic imaging device 410 through the communication connection 130, so as to determine whether the user's current attention is focused on the external device 420. If so, the input instruction of the input device 412 can be configured to be sent to the external device 420 to achieve control of the external device 420. In this configuration, the user does not need to adjust the position or perform too many additional operations during the ultrasonic scanning process, and can freely control the ultrasonic imaging device 410 and the external device 420 through the input device 412 of the ultrasonic imaging device 410.

[0097] The control of the external device 420 can be performed by keys, trackball, touch pad ( Figure 4 In one example, for a controllable area 424 (represented by a dotted box) of a user interface 423 of an external device 420, a cursor 413 corresponding to a trackball (or touchpad) in an input device 412 may be confined within the controllable area 424. In this way, the operation of the cursor 413 will be faster, especially when the user interface is large in size and complex in composition, the cursor 413 will not be too difficult to control to the required position. The above-mentioned embodiment can ensure that even if the input device 412 of the ultrasonic imaging device 410 is used to control the external device 420, the accuracy and efficiency of the control can be guaranteed. The meaning of a controllable area is a functional area on the user interface that can be operated by user input. Figure 4 A complete controllable area 424 is shown, but it is understood that under the teachings of the embodiments of the present application, the controllable area 424 can be a plurality of discrete areas on the user interface. In addition, the controllable area 424 can include a plurality of controllable components (such as Figure 4 However, it should also be allowed that there is a small area in the controllable area that cannot be operated (such as Figure 4 the gap between the virtual keys).

[0098] It is understandable that the camera device 422 can also be integrated into the ultrasonic imaging device 410, or exist independently of the ultrasonic imaging device 410 and the external device 420. In addition, the camera device 422 can also perform other functions at the same time. For example, in the application scenario of remote ultrasound, the camera device 422 can also be used to obtain the user's facial image and display it in the user video window 425. Similarly, the user interface 423 also includes a remote video window 426. The user and the remote user can communicate via video in real time through these two windows. In another embodiment, the camera device 422 can be used to collect the user's scanning information, such as the probe operation method in ultrasonic scanning. It is understandable that the probe operation method will be displayed in the user video window 425. This is conducive to remote user observation, so as to make scanning suggestions or conduct scanning learning.

[0099] Please note that Figure 4 The ultrasonic imaging device 410 is shown in the form of a portable ultrasonic imaging device, which can also be any other type in the art, such as a flat-panel ultrasonic imaging device, a desktop ultrasonic imaging device, etc. In addition, Figure 4 The internal structure, program, circuit, etc. of the ultrasonic imaging device 410 not shown can refer to the description of any of the above embodiments of the present application.

[0100] The present application also provides an ultrasonic imaging device, Figure 5 Schematic diagram of an ultrasonic imaging device according to an embodiment of the present application. Figure 5 As shown, the ultrasound imaging device 500 includes a processor 501 and an input device 502. The input device 502 may include at least one of a trackball, a keyboard, a touchpad, and a touch screen. The implementation of the input device 142 in the aforementioned embodiment may refer to the implementation of the input device 142, which will not be repeated here.

[0101] The processor 501 executes the steps of the control method described in any of the above embodiments, thereby controlling the input device 502, etc., for example, Figure 5 As shown, the ultrasonic imaging device 500 may further include a memory 503 coupled to the processor 501, and a computer-readable program 504 is stored in the memory 503. The processor 501 may be configured to execute the program 504 to implement the control method described in the above embodiment, and the content thereof is incorporated herein and will not be repeated here. In addition, the implementation of the processor 501 may also refer to the implementation of the controller circuit 102 in the above embodiment, and will not be repeated here.

[0102] In addition, the implementation of the ultrasonic imaging device 500 may also refer to the implementation of the ultrasonic imaging devices 110 and 410 in the aforementioned embodiments, which will not be described in detail here.

[0103] An embodiment of the present application also provides a computer-readable program, wherein when the program is executed, the program enables the computer to execute the control method described in the above embodiment in the ultrasonic imaging device.

[0104] An embodiment of the present application also provides a non-transitory computer-readable storage medium, which is used to store a computer program. When the computer program is executed by a computer, the computer executes the control method described in the above embodiment.

[0105] The above embodiments are merely exemplary of the embodiments of the present application, but the present application is not limited thereto, and appropriate modifications may be made based on the above embodiments. For example, the above embodiments may be used alone, or one or more of the above embodiments may be combined.

[0106] The present application is described above in conjunction with specific implementation methods, but it should be clear to those skilled in the art that these descriptions are exemplary and are not intended to limit the scope of protection of the present application. Those skilled in the art can make various modifications and variations to the present application based on the spirit and principles of the present application, and these modifications and variations are also within the scope of the present application.

[0107] The preferred embodiments of the present application are described above with reference to the accompanying drawings. Many features and advantages of these embodiments are clear from this detailed description, and therefore the appended claims are intended to cover all such features and advantages of these embodiments that fall within their true spirit and scope. In addition, since many modifications and variations are easily conceivable to those skilled in the art, the embodiments of the present application are not intended to be limited to the precise structures and operations illustrated and described, but all suitable modifications, variations, and equivalents that fall within their scope may be covered.

Claims

1. A control method for an ultrasonic imaging device, characterized in that: The method comprises: Establishing communication connection with external devices; transmitting ultrasound data to the external device via the communication connection; receiving, through the communication connection, user interface information about the ultrasound data generated on a display interface of the external device; and In response to the generation of the switching instruction, the input device of the ultrasonic imaging apparatus is switched to control the user interface of the external device.

2. The method according to claim 1, characterized in that The generation of the switching instruction is based on at least one of the following methods: The cursor of the input device on the display device of the ultrasonic imaging device moves out of the edge of the display device toward the external device; The switch button in the input device is operated; as well as A camera device is used to determine whether the user's sight line is directed toward the external device.

3. The method according to claim 2, characterized in that Determining by using a camera device that the user's line of sight is directed toward the external device includes: Using the camera device to capture the user's sight line, When it is determined that the line of sight is directed toward the external device, the input device is enabled to control the external device.

4. The method according to claim 3, characterized in that Determining by using a camera device that the user's line of sight is directed toward the external device further includes: In a case where it is determined that the line of sight is not directed toward the external device, the input device is caused to control the ultrasonic imaging apparatus.

5. The method according to claim 1, characterized in that The input device includes at least one of a trackball, a keyboard, a touch pad and a touch screen.

6. The method according to claim 5, characterized in that The input device includes at least one of a trackball and a touch pad, and the input device controls the user interface of the external device including: A controllable area of ​​the user interface of the external device is determined, and a cursor corresponding to the trackball or the touchpad is limited within the controllable area.

7. The method according to claim 5, characterized in that The input device includes a touch screen, and the touch screen controls the user interface of the external device including: The interface information of the external device is projected onto the touch screen.

8. The method according to claim 1, characterized in that The display interface of the external device is configured to be touch-operable.

9. The method according to claim 8, characterized in that The external device includes a camera.

10. An ultrasonic imaging device, characterized in that: The apparatus comprises an input device and a processor, wherein the processor is configured to perform the method of any one of claims 1 to 9.

11. A non-transitory computer-readable storage medium for storing a computer program, characterized in that: When the computer program is executed by a computer, the computer is caused to execute the method according to any one of claims 1 to 9.

12. An ultrasonic imaging system, characterized in that: The ultrasonic imaging system comprises the ultrasonic imaging apparatus as claimed in claim 10 and an external device connected to the ultrasonic imaging apparatus.

Images