User authentication using an ultrasound probe
Patent Information
- Application Number
- PCT/US2024/035117
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-07-17
- Filing Date
- 2024-06-21
- Publication Date
- 2025-04-03
AI Technical Summary
There is a need for improved methods and systems to automatically authenticate authorized users of portable, handheld ultrasound imaging devices to prevent unauthorized use and device theft.
The use of ultrasound transducers on an ultrasound imaging system to acquire biometric data, such as handprints or fingerprints, for user authentication, allowing authorized users to access device settings and ensuring the correct patient data is used for medical diagnosis.
This solution provides a secure and efficient method for user authentication, ensuring that only authorized personnel can operate the ultrasound device and reducing the risk of human error by verifying patient identity through paired biometric and diagnostic data.
Smart Images

Figure US2024035117_03042025_PF_FP_ABST
Abstract
Description
User Authentication Using an Ultrasound ProbeTECHNICAL FIELD
[0001] The disclosed implementations relate generally to systems, methods, and devices for utilizing an ultrasound probe to authentic users.BACKGROUND
[0002] Ultrasound imaging is an imaging method that uses sound waves to produce images of structures or features within a region probed by the sound waves. In biological or medical applications, ultrasound images can be captured in real-time to show movement of internal organs as well as blood flowing through the blood vessels. The images can provide valuable information for diagnosing and directing treatment for a variety of diseases and conditions.
[0003] Recent technological advancements in ultrasound technology have led to the growth of portable, handheld ultrasound imaging devices. To increase the security of the ultrasound imaging device, and to prevent unauthorized users from using the device, there is a need for improved methods and systems of automatically authenticating authorized users of these devices.SUMMARY
[0004] Medical ultrasound is an imaging modality that is based on the reflection of propagating sound waves at the interface between different tissues. Advantages of ultrasound imaging with respect to other imaging modalities may include one or more of: (1) its non- invasive and non-ionizing nature, (2) its reduced costs, (3) its portability, and (4) its ability to provide a good temporal resolution, for example on the order of millisecond or better. Point- of-care ultrasound (POCUS) may be used at bedside by healthcare providers as a real-time tool for answering clinical questions (e.g., whether a patient has developmental hip dysplasia). A trained clinician may perform both the task of acquiring and the task of interpreting ultrasound images, without the need for a radiologist to analyze ultrasound images acquired by a highly trained technician. Depending on specifics of the ultrasound examination, there may still behighly specialized training to learn different protocols for acquiring medically relevant images that are high quality images.
[0005] Recent technological advancements in ultrasound technology have led to the increasing viability of portable, handheld ultrasound imaging devices. Trained clinicians or clinical trainees can have their own ultrasound imaging devices that they carry around and use to acquire ultrasound images. To prevent their devices from being stolen, or switched with somebody else’s device, it is beneficial to be able to associate an ultrasound imaging device with its corresponding authorized users.
[0006] In some embodiments, the methods, systems, and devices described herein utilize transducers (e.g., piezoelectric micromachined ultrasound transducers, or PMUT) on an ultrasound imaging system and / or device to acquire first ultrasound data of a first subject. The first ultrasound data is used to verify whether the first subject is an authorized subject of the ultrasound imaging system and / or device. When it is determined that the first subject is an authorized subject, the ultrasound imaging system and / or device utilizes the same transducers to acquire second ultrasound data that is used for medical diagnosis
[0007] In some embodiments, the first ultrasound data of the first subject corresponds to ultrasound data (e.g., of a handprint or fingerprint) of an operator (e.g., a provider or clinician) of the ultrasound imaging device. In some instances, when it is determined that the first subject is authorized to operate the ultrasound imaging device, the ultrasound imaging device automatically retrieves and loads, on the device, settings corresponding to a user profile of the first subject (e.g., a level of training of the user for operating the ultrasound device), thereby improving device efficiency, saving time, and minimizing human error.
[0008] In some embodiments, the first ultrasound data and the second ultrasound data correspond to ultrasound data of the same patient. For example, prior to acquiring the second ultrasound data using the ultrasound device for medical diagnosis, some embodiments of the present disclosure utilize the same ultrasound device to acquire the first ultrasound scan (e.g., of biometric scan data) that would verify the identity of the patient. Advantageously, the pairing of biometric data (from the first ultrasound scan) and diagnostic data (from the second ultrasound scan) of the same patient provides an extra layer of safety / identification for the diagnostic data that is obtained, thereby leading to reduced human error. In some embodiments, after verifying the identity of the patient via the first ultrasound scan, the ultrasound imagingdevice automatically retrieves information regarding a scan type for the patient visit and loads, on the device, imaging control parameters corresponding to the scan type, thereby improving device efficiency and minimizing human error.
[0009] The systems, methods, and devices of this disclosure have several innovative aspects, the desirable attributes disclosed herein may be derived from one or more of the innovative aspects individually or as a combination, in accordance with some embodiments.
[0010] In accordance with some embodiments, a method is performed at an imaging system that includes an ultrasound probe having a plurality of transducers, one or more processors and memory. The method includes acquiring a first scan of a portion of a first subject via the ultrasound probe in accordance with a first set of imaging control parameters, including activating at least a first subset of the plurality of transducers of the ultrasound probe. The method includes transmitting, to a computing device that is communicatively connected with the ultrasound probe, the first scan of the portion of the first subject. The computing device includes a database of biometric information of users associated with the ultrasound probe. The method includes, in accordance with receiving, from the computing device, information that the first scan of the portion of the first subject matches a first record in the database: authorizing acquisition of ultrasound imaging data via the ultrasound probe.
[0011] In some embodiments, the method includes, in accordance with the authorization of the acquisition of the ultrasound imaging data via the ultrasound probe, acquiring the ultrasound imaging data via the ultrasound probe with a second set of imaging control parameters, including activating at least a second subset of the plurality of transducers of the ultrasound probe.
[0012] In some embodiments, the portion of the first subject comprises an external surface of the first subject. For example, in some embodiments, the portion of the first subject comprises one or more of: at least a portion of a palm of the first subject; at least a portion of a finger of the first subject; and a shape and / or a contour of at least a finger of the first subject. In some embodiments, the portion of the first subject comprises an external surface of the first subject with distinguishing features, such as the creases of skin inside an elbow of the first subject, creases of skin on the neck of the first subject, or foot creases of the first subject, or any external surfaces with skin creases. In some embodiments, the portion of the first subject comprises or extends to subsurface features of the first subject, such as organ(s), bone(s), orvessels of the first subject. In some embodiments, the first portion of the first subject is (consists of) subsurface features. In other words, an internal anatomy of the subject may be used as a biometric marker through which to authenticate the subject via ultrasound.
[0013] In some embodiments, the first scan of the portion of the first subject comprises a scan of an acoustic barcode physically coupled to the first subject.
[0014] In some embodiments, the method includes, prior to acquiring the first scan of the portion of the first subject, detecting whether the ultrasound probe is in use. The acquiring the first scan is in response to a determination that the ultrasound probe is in use.
[0015] In some embodiments, detecting whether the ultrasound probe is in use includes detecting presence of a communicative connection between the ultrasound probe and an electronic device.
[0016] In some embodiments, the electronic device includes a display. The method includes, in accordance with detecting the presence of a communicative connection between the ultrasound probe and an electronic device, generating and displaying, via the display, a notification to acquire the first scan of the portion of the first subject via the ultrasound probe.
[0017] In some embodiments, the imaging system includes a display. The method includes generating and displaying a visual indicator representing the portion of the first subject. The method includes, while acquiring the first scan of the portion of the first subject, updating an appearance of the visual indicator according to a status of the first scan.
[0018] In some embodiments, the method includes, after acquiring the first scan of the portion of the first subject, determining whether the first scan of the portion of the first subject meets a set of one or more conditions associated with one or more quality requirements for the first scan.
[0019] In some embodiments, the transmitting the first scan of the portion of the first subject to the computing device is in accordance with a determination that the first scan of the portion of the first subject meets the set of conditions associated with one or more quality requirements for the first scan.
[0020] In some embodiments, the method includes, in accordance with a determination that the first scan of the portion of the first subject does not meet the set of conditions associatedwith one or more quality requirements for the first scan: providing guidance for one or more recommended actions to be executed via the ultrasound probe.
[0021] In some embodiments, the first set of imaging control parameters requires sequentially activating one transducer, of the first subset of the plurality of transducers, at a time, while acquiring the first scan of the portion of the first subject.
[0022] In some embodiments, the first set of imaging control parameters requires sequentially activating at least two transducers, of the first subset of the plurality of transducers, at a time, while acquiring the first scan of the portion of the first subject.
[0023] In some embodiments, acquiring the first scan of the portion of a first subject via the ultrasound probe includes: during a first portion of the first scan, sequentially activating a first count of transducers, of the first subset of the plurality of transducers, at a time, while acquiring the first portion of the first scan; and during a second portion of the first scan, subsequent to the first portion of the first scan, sequentially activating a second count of transducers, smaller than the first count of transducers, of the first subset of the plurality of transducers, at a time, while acquiring the second portion of the first scan.
[0024] In some embodiments, the ultrasound imaging data comprises ultrasound imaging data of a user that is distinct from the first subject.
[0025] In some embodiments, the ultrasound imaging data comprises ultrasound imaging data of the first subject.
[0026] In some embodiments, the method includes, in accordance with receiving, from the computing device, the information that the first scan of the portion of the first subject matches the first record in the database: retrieving, from the computing device, first device settings corresponding to a user profile corresponding the first record; and loading the first device settings on the ultrasound probe. The ultrasound imaging data is acquired using the first device settings.
[0027] In some embodiments, the method includes, in accordance with receiving, from the computing device, the information that the first scan of the portion of the first subject matches the first record in the database: retrieving, from the computing device, a scan type corresponding to the ultrasound imaging data; and loading, on the ultrasound probe, a third setof imaging control parameters corresponding to the retrieved scan type. The ultrasound imaging data is acquired using the third set of imaging control parameters.
[0028] In some embodiments, the computing device is configured to apply a trained machine learning model to determine whether the first scan of the portion of the first subject matches a record in the database.
[0029] In accordance with some embodiments, a method of unlocking an ultrasound probe is performed at a computing device that includes one or more processors and memory. The method includes receiving a first scan of a portion of a first subject acquired via an ultrasound probe in accordance with a first set of imaging control parameters, including activating at least a first subset of a plurality of transducers of the ultrasound probe. The method includes performing a comparison of the first scan of the portion of the first subject with a database of biometric information of users associated with the ultrasound probe. The method includes, in accordance with the comparing, determining, by the computing device, that information the first scan of the portion of the first subject matches a first record in the database: authorizing acquisition of ultrasound imaging data via the ultrasound probe.
[0030] In some embodiments, the method includes, in accordance with a determination that the first subject has been authorized, causing the ultrasound probe to acquire ultrasound imaging data in accordance with a second set of imaging control parameters, including activating at least a second subset of the plurality of transducers of the ultrasound probe.
[0031] In some embodiments, the portion of the first subject comprises one or more of: at least a portion of a palm of the first subject; at least a portion of a finger of the first subject; and a shape and / or a contour of at least a finger of the first subject.
[0032] In some embodiments, the first scan of the portion of the first subject comprises a scan of an acoustic barcode physically coupled to the first subject.
[0033] In some embodiments, the method includes, after receiving the first scan of the portion of the first subject, determining whether the first scan of the portion of the first subject meets a set of one or more conditions associated with one or more quality requirements for the first scan.
[0034] In some embodiments, the performing the comparison is in accordance with a determination that the first scan of the portion of the first subject meets the set of conditions associated with one or more quality requirements for the first scan.
[0035] In some embodiments, the method includes, in accordance with a determination that the first scan of the portion of the first subject does not meet the set of conditions associated with one or more quality requirements for the first scan: causing the ultrasound probe to provide guidance for one or more recommended actions to be executed via the ultrasound probe.
[0036] In accordance with some embodiments, an imaging system comprises an ultrasound probe having a plurality of transducers, one or more processors, and memory. The memory stores instructions that, when executed by the one or more processors, cause the imaging system to perform any of the methods disclosed herein /
[0037] In accordance with some embodiments, a computer device (e.g., computer system) comprises one or more processors and memory. The memory stores memory storing instructions that, when executed by the one or more processors, cause the computer system to perform any of the methods disclosed herein.
[0038] In accordance with some embodiments of the present disclosure, a non- transitory computer readable storage medium stores computer-executable instructions. The computer-executable instructions, when executed by one or more processors of a computer device (e.g., computer system), cause the computer device to perform any of the methods disclosed herein.
[0039] Note that the various embodiments described above can be combined with any other embodiments described herein. The features and advantages described in the specification are not all inclusive and, in particular, many additional features and advantages will be apparent to one of ordinary skill in the art in view of the drawings, specification, and claims. Moreover, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes and may not have been selected to delineate or circumscribe the inventive subject matter.BRIEF DESCRIPTION OF THE DRAWINGS
[0040] The disclosed aspects will hereinafter be described in conjunction with the appended drawings, provided to illustrate and not to limit the disclosed aspects, wherein like designations denote like elements.
[0041] Figure 1 illustrates an exemplary operating environment, in accordance with some embodiments.
[0042] Figure 2 illustrates a block diagram of an ultrasound device in accordance with some embodiments.
[0043] Figures 3A and 3B illustrates a block diagram of a computing device in accordance with some embodiments.
[0044] Figures 4A and 4B are exemplary images that illustrate using an ultrasound device to authenticate a user, in accordance with some embodiments.
[0045] Figures 5 A and 5B illustrate an exemplary process for associating a subj ect with an ultrasound device, in accordance with some embodiments.
[0046] Figures 6A to 6C illustrate an exemplary process for providing guidance for actions to be executed via the ultrasound device, in accordance with some embodiments.
[0047] Figures 7A to 7D illustrate a flowchart diagram for a method of authenticating a user an ultrasound probe, in accordance with some embodiments.
[0048] Figures 8A and 8B illustrates a flowchart diagram for a method of authenticating a user an ultrasound probe, in accordance with some embodiments.
[0049] Reference will now be made to implementations, examples of which are illustrated in the accompanying drawings. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one of ordinary skill in the art that the present invention may be practiced without requiring some of these specific details.DESCRIPTION OF IMPLEMENTATIONS
[0050] Figure 1 illustrates an exemplary operating environment 100, in accordance with some embodiments.
[0051] In some embodiments, the operating environment 100 includes one or more ultrasound devices 200 (e.g., ultrasound device 200-1 and ultrasound device 200-2). According to some embodiments of the present disclosure, the ultrasound device 200 is also referred to as an ultrasound imaging device or an ultrasound imaging system. In some embodiments, the ultrasound device 200 is a portable handheld device. In some embodiments, the ultrasound device 200 includes a probe portion that includes transducers (e.g., transducers 220, Figure 2). In some embodiments, the transducers are arranged in an array. In some embodiments, the ultrasound device 200 includes an integrated control unit and user interface. In some embodiments, the ultrasound device 200 includes a probe that communicates with a control unit and user interface that is external to the housing of the probe itself. During operation, the ultrasound device 200 (e.g., via the transducers) produces sound waves 120 that are transmitted toward an organ, such as a heart or a lung, of a respective patient 110 (e.g., patient 110-1 or patient 110-2). The internal organ, or other object(s) to be imaged, may reflect a portion of the sound waves toward the probe portion of the ultrasound device 200, which are received by the transducers 220.
[0052] In some embodiments, the ultrasound device 200 uses the received signals to generate an ultrasound image that is displayed on a display (e.g., display 218, Figure 2) of the ultrasound device. In some embodiments, the ultrasound device 200 uses the received signals to generate an ultrasound image that is displayed on a display 162 of an electronic device 0 (e.g., a computing device) that is communicatively connected (e.g., wirelessly or via a wired connection, such as cable 158) to the ultrasound device.
[0053] In some embodiments, the ultrasound device 200 is communicatively coupled through communication network(s) 106 to a computer system 130 (e.g., a computer device). For example, the ultrasound device 200 transmits the received signals to computer system 130, which uses the received signals to create an image 150 that is also known as a sonogram. In some embodiments, the computing device 130 includes a display 140 (e.g., a display device) for displaying ultrasound images, and other input and output devices (e.g., keyboard, touch screenjoystick, touchpad, and / or speakers).
[0054] In some embodiments, the computer system 130 and the ultrasound device 200 are co-located at the same location (e.g., in the same room where the ultrasound device 200 is deployed, such as ultrasound device 200-1 and computer system 130-1 in Figure 1). In someembodiments, the ultrasound device 200 and the computer system 130 are located at different locations (e.g., such as computer system 130-2 in Figure 1).
[0055] In some embodiments, the computer system 130 includes a data receiving module 354 that is configured to receive data from one or more ultrasound devices 200, such as ultrasound medical imaging data and / or ultrasound data for user authentication. The computer system 130 includes a data processing module 358 that is configured to process the received data. In some embodiments, the computer system 130 includes a database 380. Further details of the data receiving module 354, data processing module 358, and database 380 are discussed with respect to Figure 3 A.
[0056] Figure 2 illustrates a block diagram of an exemplary ultrasound device 200 in accordance with some embodiments.
[0057] The ultrasound device 200 may be used to perform different types of imaging. For example, the ultrasound device 200 may be used to perform one-dimensional imaging, also known as A-Scan, two-dimensional imaging, also known as B scan, three-dimensional imaging, also known as C scan, and Doppler imaging. The ultrasound device 200 may be switched to different imaging modes, including without limitation linear mode and sector mode, and electronically configured under program control.
[0058] In some embodiments, the ultrasound device 200 includes one or more processors 202, one or more communication interfaces 204 (e.g., network interface(s)), memory 206, and one or more communication buses 208 for interconnecting these components (sometimes called a chipset).
[0059] In some embodiments, the ultrasound device 200 includes one or more input interfaces 210 that facilitate user input. For example, in some embodiments, the input interfaces 210 include port(s) 212 and button(s) 214. In some embodiments, the port(s) can be used for receiving a cable (e.g., cable 158) for powering or charging the ultrasound device 200, or for facilitating communication between the ultrasound device and other devices (e.g., computing device 130, electronic device 160, display device 140, printing device, and / or other input output devices and accessories).
[0060] In some embodiments, the ultrasound device 200 includes a power supply 216. For example, in some embodiments, the ultrasound device 200 is battery-powered. In some embodiments, the ultrasound device is powered by a continuous AC power supply.
[0061] In some embodiments, the ultrasound device 200 includes a display 218 for displaying ultrasound imaging data and / or other notifications generated by the ultrasound device 200.
[0062] In some embodiments, the ultrasound device 200 includes a probe portion that includes transducers 220, which may also be referred to as transceivers or imagers. Examples of transducers 220 include, without limitation, piezoelectric micromachined ultrasonic transducers (PMUT) and capacitive micromachined ultrasonic transducers (CMUT). In some embodiments, the transducers 220 are based on photo-acoustic or ultrasonic effects. For ultrasound imaging, the transducers 220 generate and transmit ultrasonic waves towards a target (e.g., a target organ, blood vessels, etc.) to be imaged. The transducers 220 receive reflected sound waves (e.g., echoes) that bounce off body tissues. The reflected waves are then converted to electrical signals and / or ultrasound images. In some embodiments, the probe portion of the ultrasound device 200 is separately housed from the computing and control portion of the ultrasound device. In some embodiments, the probe portion of the ultrasound device 200 is integrated in the same housing as the computing and control portion of the ultrasound device 200. In some embodiments, part of the computing and control portion of the ultrasound device is integrated in the same housing as the probe portion, and part of the computing and control portion of the ultrasound device is implemented in a separate housing that is coupled communicatively with the part integrated with the probe portion of the ultrasound device. In some embodiments, the probe portion of the ultrasound device has a respective transducer array that is tailored to a respective scanner type (e.g., linear, convex, endocavitary, phased array, transesophageal, 3D, and / or 4D). In the present disclosure, “ultrasound probe” may refer to the probe portion of an ultrasound device, or an ultrasound device that includes a probe portion.
[0063] In some embodiments as used herein, a transducer 220 is also known as a “pixel.” In some embodiments, multiple pixels / transducers (e.g., 4, 8, 16, or 64) are grouped together to form a transducer element 221. For example, in some embodiments, the ultrasound device 200 is configured to control transmit (Tx) firings (the transmissions of ultrasonicwaveforms from a transducer pixel or a transducer element) by sequentially activating one transducer 220 at a time. In some embodiments, the ultrasound device 200 is configured to control Tx firings by sequentially activating two or more transducers (e.g., a transducer element 221) at a time.
[0064] In some embodiments, the ultrasound device 200 includes a control circuitry 291 that is configured to control transducers 220 and / or transducer elements 221 to send ultrasound waves toward the target object being imaged while other transducers 220 and / or transducer elements 221, at the same time, receive the ultrasound waves / ultrasonic energy reflected from the target object, and generate electrical charges based on the same in response to the received ultrasound waves / ultrasonic energy. To generate the pressure waves, the ultrasound device 200 may include a number of transmit (Tx) channels 292 and a number of receive (Rx) channels 293. The transmit channels 292 may include a number of components that drive the transducers 220 (e.g., transducer elements 221) with a voltage pulse at a frequency that they are responsive to. This causes an ultrasonic waveform to be emitted from the transducers 220 towards an object to be imaged.
[0065] In some embodiments, the ultrasound device 200 includes radios 230. The radios 230 enable one or more communication networks, and allow the ultrasound device 200 to communicate with other devices, such as the computing device 130 in Figures 1 and 3, the display device 140 in Figure 1, and / or the electronic device 160 in Figure 1. In some implementations, the radios 230 are capable of data communications using any of a variety of custom or standard wireless protocols (e.g., IEEE 802.15.4, Wi-Fi, ZigBee, 6L0WPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.5A, WirelessHART, MiWi, Ultrawide Band (UWB), software defined radio (SDR) etc.) custom or standard wired protocols (e.g., Ethernet, HomePlug, etc.), and / or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.
[0066] The memory 206 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; and, optionally, includes non-volatile memory, such as one or more magnetic disk storage devices, one or more optical disk storage devices, one or more flash memory devices, or one or more other nonvolatile solid state storage devices. The memory 206, optionally, includes one or more storage devices remotely located from one or more processor(s) 202. The memory 206, or alternativelythe non-volatile memory within the memory 206, includes a non-transitory computer-readable storage medium. In some implementations, the memory 206, or the non-transitory computer- readable storage medium of the memory 206, stores the following programs, modules, and data structures, or a subset or superset thereof:• operating logic 240 including procedures for handling various basic system services and for performing hardware dependent tasks;• a communication module 242 (e.g., a radio communication module) for connecting to and communicating with other network devices (e.g., a local network, such as a router that provides Internet connectivity, networked storage devices, network routing devices, server systems, computer device 130, electronic device 160, and / or other connected devices etc.) coupled to one or more communication networks via the communication interface(s) 204 (e.g., wired or wireless);• application 250 for acquiring ultrasound data (e.g., imaging data) of a patient, and / or for controlling one or more components of the ultrasound device 200 and / or other connected devices (e.g., in accordance with a determination that the ultrasound data meets, or does not meet, certain conditions). In some embodiments, the application 250 includes: o an acquisition module 252 for acquiring ultrasound data (e.g., via control circuitry 291 and transmit channels 292). In some embodiments, the ultrasound data includes imaging data. In some embodiments, the acquisition module 252 activates the transducers 220 (e.g., less than all of the transducers 220, different subset(s) of the transducers 220, all the transducers 220, transducer elements 221, etc.) according to whether the ultrasound data meets one or more conditions associated with one or more quality requirements; o a receiving module 254 for receiving ultrasound data (e.g., via control circuitry 291 and receive channels 293); o a transmitting module 256 for transmitting ultrasound data to other device(s) (e.g., a server system, computer device 130, display device 140, electronic device 160, and / or other connected devices etc.);o a transducer control module 260 for adjusting imaging control parameters (e.g., between an authentication scan and a diagnostic scan, or between diagnostic scans of different anatomies); o an authentication module 262 for authenticating a user of the ultrasound device 200 (e.g., by transmitting the device to a computer system 130 for authentication). In some embodiments, the authentication module 262 is used to provision the ultrasound device 200 (e.g., during initial setup) and / or to associate additional users with the ultrasound device 200. For example, in some embodiments, prior to acquiring ultrasound medical imaging data, the authentication module 292 provisions (e.g., sets up) the ultrasound device 200 to associate the ultrasound device 200 with one or more authorized subjects (e.g., clinicians and / or patients). In some embodiments, during device provisioning, the authentication module 292 acquires biometric data (e.g., fingerprints, thumbprints, handprints, etc.) of the subjects and transmits the information to a computer system (e.g., computer system 130), where the biometric information is added to a database of authorized (e.g., registered) users (e.g., as biometric information 394, Figure 3); device data 280 for the ultrasound device 200, including but not limited to: o device settings 282 for the ultrasound device 200, such as default options and preferred user settings. In some embodiments, the device settings 282 include imaging control parameters. For example, in some embodiments, the imaging control parameters include one or more of: a number of transducers that are activated, a power consumption threshold of the probe, an imaging frame rate, a scan speed, a depth of penetration, and other scan parameters that control the power consumption, heat generation rate, and / or processing load of the probe; o user settings 284, such as a preferred gain, depth, zoom, and / or focus settings. In some embodiments, user settings are loaded automatically (e.g., without user intervention) after the user authenticates using an ultrasound scan as described herein; o ultrasound scan data 286 (e.g., imaging data) that are acquired (e.g., detected, measured) by the ultrasound device 200 (e.g., via transducers 220);o an atlas 290. In some embodiments, the atlas 290 includes anatomical structures of interest. In some embodiments, the atlas 290 includes three-dimensional representations of the anatomical structure of interest (e.g., hip, heart, lung, and / or other anatomical structures);
[0067] Each of the above identified executable modules, applications, or sets of procedures may be stored in one or more of the previously mentioned memory devices, and corresponds to a set of instructions for performing a function described above. The above identified modules or programs (i.e., sets of instructions) need not be implemented as separate software programs, procedures, or modules, and thus various subsets of these modules may be combined or otherwise re-arranged in various implementations. In some implementations, the memory 206 stores a subset of the modules and data structures identified above. Furthermore, the memory 206 may store additional modules or data structures not described above. In some embodiments, a subset of the programs, modules, and / or data stored in the memory 206 are stored on and / or executed by a server system, and / or by an external device (e.g., computing device 130, display device 140, or electronic device 160).
[0068] Figures 3A and 3B illustrate a block diagram of a computer system 130 in accordance with some embodiments.
[0069] In some embodiments, the computer system 300 is a server or control console that is in communication with the ultrasound device 200 (e.g., ultrasound probe). In some embodiments, the computer system 300 is integrated into the same housing as the ultrasound device 200. In some embodiments, the computer system 300 is a smartphone, tablet device, a gaming console, or other portable computing devices. In some embodiments, the computer system 300 may be provided by a combination of components integrated into the same housing as the ultrasound device 200, and a smartphone, tablet device, a gaming console, or other portable computing devices.
[0070] The computer system 300 includes one or more processors 302 (e.g., processing units of CPU(s)), one or more network interfaces 304, memory 306, and one or more communication buses 308 for interconnecting these components (sometimes called a chipset), in accordance with some implementations.
[0071] In some embodiments, the computer system 300 includes one or more input devices 310 that facilitate user input, such as a keyboard, a mouse, a voice-command input unitor microphone, a touch screen display, a touch-sensitive input pad, a gesture capturing camera, or other input buttons or controls. In some embodiments, the computer system 300 uses a microphone and voice recognition or a camera and gesture recognition to supplement or replace the keyboard. In some embodiments, the computer system 300 includes one or more output devices 312 that enable presentation of user interfaces and display content, such as one or more speakers and / or one or more visual displays (e.g., display device 140).
[0072] The memory 306 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; and, optionally, includes non-volatile memory, such as one or more magnetic disk storage devices, one or more optical disk storage devices, one or more flash memory devices, or one or more other nonvolatile solid state storage devices. The memory 306, optionally, includes one or more storage devices remotely located from the one or more processors 302. The memory 306, or alternatively the non-volatile memory within the memory 306, includes a non-transitory computer-readable storage medium. In some implementations, the memory 306, or the non- transitory computer-readable storage medium of the memory 306, stores the following programs, modules, and data structures, or a subset or superset thereof:• an operating system 322 including procedures for handling various basic system services and for performing hardware dependent tasks;• a communication module 323 (e.g., a radio communication module) for connecting to and communicating with other network devices (e.g., a local network, such as a router that provides Internet connectivity, networked storage devices, network routing devices, server systems, computer device 130, ultrasound device 200, and / or other connected devices etc.) coupled to one or more communication networks via the network interface 304 (e.g., wired or wireless);• a user interface module 324 for enabling presentation of information (e.g., a graphical user interface for presenting application(s), widgets, websites and web pages thereof, games, audio and / or video content, text, etc.) either at the computer system 300 or another device;• application 350 for acquiring ultrasound data (e.g., imaging data) from a patient. In some embodiments, the application 350 is used for receiving data (e.g., ultrasound data, imaging data, etc.) acquired via an ultrasound device 200. In some embodiments, theapplication 350 is used for controlling one or more components of an ultrasound device 200 (e.g., the probe portion, and / or the transducers) and / or other connected devices (e.g., in accordance with a determination that the data meets, or does not meet, certain conditions). In some embodiments, the application 350 includes: o an acquisition module 352 for acquiring ultrasound data. In some embodiments, the ultrasound data includes imaging data acquired by an ultrasound probe.; o a receiving module 354 for receiving ultrasound scan data. In some embodiments, the ultrasound scan data includes imaging data acquired by an ultrasound probe; o a transmitting module 356 for transmitting ultrasound data (e.g., imaging data) to other device(s) (e.g., a server system, computer device 130, display device 140, ultrasound device 200, and / or other connected devices etc.); o a processing module 358 for processing ultrasound data and / or other data. ; and o a transducer control module 360 for adjusting imaging control parameters (e.g., between an authentication scan and a diagnostic scan, or between diagnostic scans of different anatomies); and a database 380, including: o ultrasound scan data 382 (e.g., imaging data) that are acquired (e.g., detected, measured) by one or more ultrasound devices 200; o user settings 284, such as a preferred gain, depth, zoom, and / or focus settings. In some embodiments, user settings are loaded automatically (e.g., without user intervention) after the user authenticates using an ultrasound scan as described herein; o an atlas 386. In some embodiments, the atlas 386 includes anatomical structures of interest. In some embodiments, the atlas 386 includes three-dimensional representations of the anatomical structure of interest (e.g., hip, heart, or lung); o imaging control parameters 388. For example, in some embodiments, the imaging control parameters include one or more of: a number of transducers that are activated, a power consumption threshold of the probe, an imagingframe rate, a scan speed, a depth of penetration, and other scan parameters that control the power consumption, heat generation rate, and / or processing load of the probe; ultrasound scan data processing models 390 for processing ultrasound data. For example, in some embodiments, the ultrasound scan data processing models 390 are trained neural network models that are trained to determine whether an ultrasound image meets quality requirements corresponding to a scan type, or trained to output an anatomic plane corresponding to an anatomical structure of an ultrasound image, or trained to predict, based on a sequence of ultrasound images and their quality scores, whether a subsequent frame to be acquired by an ultrasound probe will contain certain anatomical structures and / or landmarks of interest; labeled images 392 (e.g., a databank of images), including images for training the models that are used for processing new ultrasound data, and / or new images that have been or need to be processed. In some embodiments, the labeled images 392 are images of anatomical structures that have been labeled with their respective identifiers and relative positions; and authorized users data 394. Figure 3B illustrates an exemplary data structure for the authorized users data 394, in accordance with some embodiments. In some embodiments, the authorized users data 394 are categorized according to respective identifiers 396 corresponding to respective ultrasound devices (e.g., identifier 396-1 corresponding to ultrasound device 1 200-1 and identifier 396- 2 corresponding to ultrasound device 2 200-2). A respective identifier 396 is associated with one or more authorized subjects 397, a respective authorized subject having corresponding biometric data 398. For example, Figure 3B illustrates that identifier 396-1 is associated with authorized subject 397-1-1 having biometric data 398-1-1 and associated with authorized subject 397-1-2 having biometric data 398-1-2; identifier 396-2 is associated with authorized subject 397-2-1 having biometric data 398-2-1. In some embodiments, the respective biometric data 398 comprises at least a portion of a fingerprint, at least a portion of a thumbprint, or at least a portion of a handprint of therespective authorized subject. In some embodiments, the respective biometric data 398 comprises a scan of a barcode (e.g., an acoustic barcode, such as acoustic barcode 512) that is associated with a subject (e.g., printed on a wristband that is physically coupled to the subject);
[0073] Each of the above identified elements may be stored in one or more of the memory devices described herein, and corresponds to a set of instructions for performing the functions described above. The above identified modules or programs need not be implemented as separate software programs, procedures, modules or data structures, and thus various subsets of these modules may be combined or otherwise re-arranged in various embodiments. In some embodiments, the memory 306, optionally, stores a subset of the modules and data structures identified above. Furthermore, the memory 306 optionally stores additional modules and data structures not described above. In some embodiments, a subset of the programs, modules, and / or data stored in the memory 306 are stored on and / or executed by the ultrasound device 200. In some embodiments, a subset of the programs, modules, and / or data stored in the memory 306 are stored on and / or executed by the electronic device 160.
[0074] Figures 4A and 4B are exemplary images that illustrate using an ultrasound device to authenticate a subject, in accordance with some embodiments.
[0075] Figure 4A shows, on the left, an image 402 illustrating a portion of a subject’s palm 404 that includes ridges 406-1, 406-2, and 406-3. The right of Figure 4A shows an ultrasound scan image 410 of a portion of the subject’s palm 404, in which details 412-1, 412- 2, and 412-3 (e.g., lines and their corresponding lengths, angles, and / or contours), corresponding to the ridges 406-1, 406-2, and 406-3, are visible in the ultrasound scan image 410.
[0076] Figure 4B shows, on the left, an image 420 illustrating a subject pressing their palm 422 on a probe head 430 of an ultrasound device 200. Figure 4B shows, on the right, a corresponding ultrasound image 440 acquired by the transducers (e.g., transducers 220) of the ultrasound device 200, in which details 442 corresponding to the palm lines are visible in the ultrasound image 440.
[0077] Although Figures 4A and 4B show portions of a subject’s palm, it will be apparent to one of ordinary skill in the art that ultrasound scan data of other portions of asubject, such as lines, ridges, shapes, or contours of a subject’s finger or thumb (or a portion thereof) can also be acquired using the ultrasound device 200.
[0078] Figures 5 A and 5B illustrate an exemplary process 500 for associating a subject(e.g., an operator or a patient) with an ultrasound device 200, in accordance with some embodiments. In some embodiments, the ultrasound device 200 is paired with an external electronic device 160 (e.g., a cellphone, tablet, laptop), which is used for displaying ultrasound scan data and / or other feedback (e.g., instructions or guidance) generated by the ultrasound device 200. During setup, a subject may be provided with instructions to connect the ultrasound device 200 to the electronic device 160 (e.g., via cable 158 or wirelessly). After the ultrasound device 200 is connected to the electronic device 160, the electronic device 160 can display, via display 162, text instructions 502 or visual instructions 504 to guide a subject to acquire a scan to acquire their biometric data (e.g., biometric data 398) using the probe head 430 of the ultrasound device 200. In some embodiments, the biometric data comprises a subject’s handprint, thumbprint, or fingerprint. In some embodiments, the biometric data 398 comprises a scan of a barcode that is associated with the subject, such as an acoustic barcode 512 that is printed on a wristband 510 that is physically coupled to the subject, as illustrated in Figure 5B. In some embodiments, after the ultrasound device 200 has acquired the biometric data of the user, the ultrasound device transmits the biometric data to a computer system (e.g., computer system 130), which associates the ultrasound device identification information with the user identification and the biometric data of the user.
[0079] Figures 6A to 6C illustrate an exemplary process 600 for providing guidance for actions to be executed via the ultrasound device 200 (e.g., for a registered subject of the ultrasound device), in accordance with some embodiments.
[0080] Figure 6A shows that in some embodiments, after the ultrasound device 200 detects the presence of a communicative connection between the ultrasound device 200 and an electronic device 160 (e.g., via detecting a wired connection 158 between a port of the ultrasound probe and the electronic device 160 or detecting a wireless connection between a wireless transceiver of the ultrasound device 200 and the electronic device 160), the ultrasound device 200 causes the electronic device 160 to display, via the display 162, guidance 604 to a user of the ultrasound probe to unlock the ultrasound device 200. For example, the user may be asked to roll their palm or finger on the probe head 430, or use the probe head to scan anacoustic barcode 512. In some embodiments, the ultrasound device 200 causes the electronic device 160 to display a visual representation 606 that includes visual indicators 608 (e.g., palm lines, ridges of a finger, barcode indicator) of the object (e.g., a palm, finger, or barcode) to be scanned using the probe head 430. In some embodiments, while acquiring the scan of the object, the ultrasound device 200 causes the electronic device 160 to update an appearance of the visual indicator 608 according to a status of the first scan. For example, the transition from Figure 6A to Figure 6B illustrates that as the palm of the subject is scanned, the electronic device 160 updates the visual indicators 608 representing the palm lines (e.g., from dashed lines to solid lines) to indicate which region(s) of the palm have been scanned and which region(s) are still missing information. In some embodiments, the electronic device 160 displays visual cues to guide the subject on how the thumb, or finger, or palm, should be moved to acquire the required biometric data to unlock the ultrasound device 200. In some embodiments, after the ultrasound device 200 acquires the biometric data, the ultrasound device 200 transmits the acquired data to computer system 130, which compares the acquired data to stored biometric information of registered users (e.g., authorized users data 394). Figure 6C illustrates that when the computer system 130 determines that the acquired data matches a first record, the computer system 130 causes the ultrasound device 200 to display an indication 610 that a match has been found. In some embodiments, when the computer system 130 determines that the biometric data does not match an entry in the database of biometric information of authorized users, the computer system 130 sends an alert to a system administrator (e.g., to notify the system administrator that an unauthorized user is trying to access / use an ultrasound device with a corresponding device ID or to alert the system administrator of the possibility of a stolen ultrasound device). In some embodiments, the computer system 130 is configured to send the alert to a system administrator after a predetermined number of unsuccessful access attempts, such as 3, 4, or 5 unsuccessful attempts by a user to gain access to an ultrasound device 200.
[0081] Figures 7A to 7D illustrate a flowchart diagram for a method 700 of unlocking an ultrasound probe and / or authenticating a user of an ultrasound probe, in accordance with some embodiments. In some embodiments, the method 700 is performed at an imaging system. The imaging system includes an ultrasound probe (e.g., ultrasound device 200, a portable device, and / or a handheld device) having a plurality of transducers (e.g., transducers 220, transducer elements 221), one or more processors (e.g., processor(s) 202, control circuitry 291,or ASIC chip for controlling the transducers) and memory. In some embodiments, the plurality of transducers are arranged in an array. In some embodiments, the imaging system includes a display that is integrated with the ultrasound probe, such as display 218. In some embodiments, the imaging system includes a display (e.g., display device 140 or display 162) that is part of another electronic device that is communicatively connected with the ultrasound probe. Referring to Figure 7A, in some embodiments, prior to acquiring the first scan of the portion of the first subject, the imaging system detects (702) whether the ultrasound probe is in use.
[0082] In some embodiments, the imaging system acquires (704) the first scan is in response to a determination that the ultrasound probe is in use.
[0083] In some embodiments, detecting whether the ultrasound probe is in use includes detecting (706) presence of a communicative connection between the ultrasound probe and an electronic device (e.g., electronic device 160, or an external device that is distinct from the ultrasound device 200). For example, in some embodiments, the communicative connection comprises a wired connection (e.g., cable 158 in Figures 1, 5, and 6A to 6C) between a port of the ultrasound probe (e.g., port(s) 212, Figure 2) and the electronic device. In some embodiments, the communicative connection comprises a wireless connection between a wireless transceiver of the first ultrasound probe and the electronic device.
[0084] In some embodiments, the electronic device (e.g., electronic device 160) includes a display (e.g., display 162). The method includes, in accordance with detecting (708) the presence of a communicative connection between the ultrasound probe and an electronic device (e.g., electronic device), generating and displaying, via the display, a notification to acquire the first scan of the portion of the first subject via the ultrasound probe.
[0085] For example, in some embodiments, when the imaging system detects the presence of a communicative coupling between the ultrasound probe and the cell phone, and detects that a subject is trying to use the ultrasound probe without prior authentication, the imaging system causes the electronic device the cell phone to display one or more visual prompts such as “Please scan palm to unlock probe” or “Please scan finger to unlock probe” (e.g., to explain to the subject why the ultrasound probe is not working as intended and what needs to be done to get the ultrasound probe to work).
[0086] Referring to Figure 7B, the imaging system acquires (710) a first scan of a portion of a first subject (e.g., a patient or a provider) via the ultrasound probe in accordancewith a first set of imaging control parameters, including activating at least a first subset of the plurality of transducers (e.g., pixels) of the ultrasound probe.
[0087] In some embodiments, the portion of the first subject comprises (711) an external surface of the first subject. In some embodiments, the portion of the first subject comprises (712) one or more of at least a portion of a palm (e.g., handprint or a palm print) of the first subject; at least a portion of a finger (e.g., a fingerprint or a thumbprint) of the first subject; and a shape and / or a contour of at least a finger of the first subject. In some embodiments, the portion of the first subject comprises an external surface of the first subject with distinguishing features, such as the creases of skin inside an elbow of the first subject, creases of skin on the neck of the first subject, or foot creases of the first subject, or any external surfaces with skin creases. In some embodiments, the portion of the first subject comprises(713) (e.g., extends to) subsurface features of the first subject, such as organ(s), bone(s), or vessels of the first subject.
[0088] In some embodiments, the first scan of the portion of the first subject comprises(714) a scan of an acoustic barcode (e.g., acoustic barcode 512, Figure 5B) physically coupled to (e.g., worn by or attached to) the first subject. For example, in some embodiments, the first subject is a patient whose ultrasound imaging data is being acquired. In some embodiments, the acoustic barcode comprises a pattern (e.g., notches, embossing or cuts, or a printed pattern that is printed with an ink that provides different acoustic properties) with different acoustic properties on the patient’s wristband (e.g., wristband 510, Figure 5B).
[0089] In some embodiments, the imaging system (716) includes a display. In some embodiments, the display is integrated with the ultrasound device (e.g., display 218, Figure 2). In some embodiments, the imaging system includes an external device having a display (e.g., display device 140 or electronic device 160 having display 162). The method 700 further comprises generating and displaying a visual indicator (e.g., visual indicators 608) representing the portion of the first subject. The method includes, while acquiring the first scan of the portion of the first subject, updating an appearance of the visual indicator according to a status of the first scan. This is illustrated in, for example, Figures 6A, 6B, and 6C.
[0090] For example, in some embodiments, the visual indicator is a progress bar, or an image representing the portion of the first subject. For example, in some embodiments, the image can include an outline of a thumb, a finger, a portion of a palm, etc., that represents theportion of the first subject. As the ultrasound probe acquires the first scan of the portion of the user, the imaging system updates a visual appearance of the outline to indicate which area(s) of the portion of the first subject have been scanned and which area(s) are still missing information. In some embodiments, the appearance of the visual indicator provides a visual cue on how the thumb, or finger, or palm, should be moved.
[0091] In some embodiments, the first set of imaging control parameters requires (718) sequentially activating (e.g., firing) one transducer (e.g., transducers 220, Figure 2), of the first subset of the plurality of transducers, at a time, while acquiring the first scan of the portion of the first subject.
[0092] In some embodiments, the first set of imaging control parameters requires sequentially activating (e.g., firing) at least two transducers (e.g., transducers 220, Figure 2), of the first subset of the plurality of transducers, at a time, while acquiring the first scan of the portion of the first subject. For example, in some cases, sequential activation of one transducer at a time leads to higher-resolution scans (e.g., obtaining features at a more granular level of detail) being obtained compared to sequential activation of two or more transducers at a time. In some cases, sequential activation of multiple (e.g., two or more) transducers at a time leads to reduced scan times (e.g., albeit at lower accuracy).
[0093] In some embodiments, during a first portion of the first scan, the imaging system sequentially activates (722) a first count of transducers (e.g., at least two transducers), of the first subset of the plurality of transducers, at a time, while acquiring the first portion of the first scan. During a second portion of the first scan, subsequent to the first portion of the first scan, the imaging system sequentially activates a second count of transducers (e.g., at least one transducers), smaller than the first count of transducers, of the first subset of the plurality of transducers, at a time, while acquiring the second portion of the first scan.
[0094] In an exemplary use case scenario, during the start of a first scan, the ultrasound probe can fire a larger number of transducers so as to acquire the first scan at higher speed / reduced time. In accordance with a determination (e.g., by the imaging system or ultrasound probe) that the higher speed (e.g., lower resolution) scan does not resolve features at a sufficient level of detail to define uniqueness for the first subject, the ultrasound probe performs a second portion of the first scan by firing a smaller number of transducers than that at start of the first scan, to acquire the second portion of the first scan at higher resolution. In some embodiments,the ultrasound probe performs successive scans by gradually reducing the number of transducers fired in a current scan compared to the prior scan, to determine the optimum number of transducers to activate at a given time so as to be able to resolve features of the first subject to authenticate the first subject.
[0095] With continued reference to Figure 7C, in some embodiments, after acquiring the first scan of the portion of the first subject (e.g., and prior to transmitting to the computing device the first scan of the portion of the first subject), the imaging system determines (724) whether the first scan of the portion of the first subject meets a set of one or more conditions associated with one or more quality requirements for the first scan.
[0096] For example, in some embodiments, the one or more conditions can include: a condition that the imaging data of the first scan include one or more visible features; a condition that the imaging data of the first scan of the portion of the subject meets a threshold quality score; a condition that the imaging data of the first scan includes one or more landmarks / features (or a combination of landmarks / features), such as a number of lines, angle between two respective line(s) (e.g., ridges), a slope of a respective line, or an intersection of two or more respective lines.
[0097] In some embodiments, the imaging system, in accordance with a determination that the first scan of the portion of the first subject does not meet the set of conditions associated with one or more quality requirements for the first scan, provides (726) guidance for one or more recommended actions to be executed via (e.g., using) the ultrasound probe (e.g., to meet the one or more quality requirements for the first scan).
[0098] In some embodiments, guidance can be provided via speech, sound, images, animations, and / or other audio, visual, and / or haptic feedback mechanisms. For example, in some embodiments, the imaging system includes a display (or is communicatively connected to a display device) that providing guidance for one or more recommended actions includes providing visual prompts / guidance, via the electronic device, to the first subject (e.g., prompts such as “Scan palm”, “scan finger,” “Please try again,” “Please apply greater pressure,” “Please place your hand this way” etc.).
[0099] The imaging system transmits (728), to a computing device that is communicatively connected with the ultrasound probe, the first scan of the portion of the firstsubject, the computing device including a (e.g., secured) database of biometric information of users associated with the ultrasound probe.
[0100] In some embodiments, the imaging system transmits the first scan of the portion of the first subject to the computing device in accordance with (730) a determination that the first scan of the portion of the first subject meets the set of conditions associated with one or more quality requirements for the first scan.
[0101] Referring to Figure 7D, the imaging system, in accordance with receiving (732), from the computing device, information that the first scan of the portion of the first subject matches a first record (e.g., for the first subject) in the database (thus verifying that the first subject is an authorized subject of the first ultrasound imaging device): authorizes acquisition of ultrasound imaging data via the ultrasound probe.
[0102] In some embodiments, the method includes, prior to acquiring the first scan of a portion of the first subject, provisioning (e.g., setting up) the imaging system for use by the first subject. This is illustrated in Figures 5 A and 5B. In some embodiments, provisioning the imaging system for use by the first subject includes adding the first subject as a registered user by adding biometric information of the first subject to the database. In some embodiments, the imaging system causes the first subject to upload an image of the portion of the first subject (e.g., an image of a palmprint, an image of fingerprint(s), and providing guidance (e.g., requirements) to the first subject on how to acquire the image.)
[0103] In some embodiments, the ultrasound imaging data comprises (734) ultrasound imaging data of a user that is distinct from the first subject. For example, the user is an operator of the ultrasound probe and the ultrasound imaging data is ultrasound imaging data of a patient.
[0104] In some embodiments, the ultrasound imaging data comprises (736) ultrasound imaging data of the first subject. For example, the first subject is a patient whose ultrasound imaging data is being acquired. Before acquiring the ultrasound imaging data of the patient, the ultrasound probe is used (e.g., by an operator who is not the subject) to scan a handprint or fingerprint of the patient (the first subject) to verify the identity of the patient. Advantageously, the pairing of the handprint / fingerprint data with ultrasound imaging data of the same patient provides an extra layer of safety / identification for the ultrasound imaging data that is obtained and reduces (e.g., avoids) human error. In some embodiments, after receiving, from the computing device, the information that the first scan of the portion of the first subject matchesthe first record in the database, the operator of the ultrasound probe is automatically provided with access to electronic health records (EHR) of the patient (e.g., the first subject).
[0105] In some embodiments, in accordance with receiving, from the computing device, the information that the first scan of the portion of the first subject matches the first record in the database: the imaging system retrieves (738), from the computing device, first device settings corresponding to a user profile corresponding the first record, and loads (740) the first device settings on the ultrasound probe. The imaging system acquires the ultrasound imaging data using the first device settings.
[0106] For example, in some embodiments, the first device settings corresponding to the user profile can include imaging control parameters, an imaging frame rate, a scan speed, a depth of penetration, and other scan parameters that control the power consumption, heat generation rate, and / or processing load of the ultrasound probe. In some embodiments, the first device settings corresponding to the user profile can include user-predefined settings such as a preferred gain, depth, zoom, and / or focus settings.
[0107] In some embodiments, the first device settings corresponding to the user profile can reflect a level of training of the user (operator) that will be operating the ultrasound probe to acquire the ultrasound imaging data. For example, in some embodiments, the first device settings corresponding to the user profile can include settings that are activated or deactivated in accordance with a proficiency level associated with the user profile (e.g., whether the user profile indicates that the user is a novice or an expert (e.g., a radiologist or a paramedic).)
[0108] In some embodiments, in accordance with receiving, from the computing device, the information that the first scan of the portion of the first subject matches the first record in the database, the imaging system retrieves (742), from the computing device, a scan type corresponding to the ultrasound imaging data. The imaging system loads (744), on the ultrasound probe, a third set of imaging control parameters corresponding to the retrieved scan type. The ultrasound imaging data is acquired using the third set of imaging control parameters. As an exemplary scenario, the first subject is a patient at a hospital and the hospital maintains records that indicate an objective of the patient visit (e.g., the patient is scheduled for a hip ultrasound scan). In this example, in accordance with receiving, from the computing device, the information that the first scan of the portion of the first subject matches the first record in the database, the imaging system automatically loads on the ultrasound probe, a set of imagingcontrol parameters that would be used in an ultrasound scan of the hip (e.g., and not the heart, lung, etc.), and acquires ultrasound imaging data of the patient’s hip using the set of imaging control parameters (e.g., a number of transducers that are activated, a power consumption threshold of the probe, an imaging frame rate, a scan speed, a depth of penetration, and other scan parameters that control the power consumption, heat generation rate, and / or processing load of the probe).
[0109] In some embodiments, the computing device is configured (746) to apply a trained machine learning model to determine whether the first scan of the portion of the first subject matches a record in the database.
[0110] In some embodiments, the trained machine learning model is obtained by training, using machine learning, a segmentation model using labeled training images with labels for the portion of interest (e.g., a portion of a palm, a finger, or two or more fingers, etc.). In some embodiments, the segmentation model is trained to categorize each pixel (or a group of pixels) in an image into a “line” or “no line” class. In some embodiments, the trained machine learning model is trained to determine form factors (e.g., shape, size, aspect ratio(s), length / angle of lines, contour of lines, number of lines, depth of grooves, or spacing between lines, etc.) for the portion of interest and determine whether the first scan of the portion of the first subject matches a record in the database based on form factors.
[0111] In some embodiments, the imaging system, in accordance with the authorization of the acquisition of the ultrasound imaging data via the ultrasound probe, acquires (748) the ultrasound imaging data via the ultrasound probe with a second set of imaging control parameters, including activating at least a second subset of the plurality of transducers of the ultrasound probe. In some embodiments, the second set of imaging control parameters (e.g., used to scan an internal anatomy of the patient and thus acquire diagnostic-quality data) is different from the first set of imaging control parameters (e.g., used to scan a surface or external portion of first subject). That is, in some embodiments and / or circumstances, it is beneficial to modify the imaging parameters so that the imaging parameters are different for the authentication scan as compared to the diagnostic scan. Such imaging parameters include an imaging frame rate, a scan speed, a depth of penetration, and other scan parameters.
[0112] Figures 8 A and 8B illustrate a flowchart diagram for a method 800 of unlocking an ultrasound probe and / or authenticating a user of an ultrasound probe, in accordance withsome embodiments. In some embodiments, the method 800 is performed at a computing device (e.g., computer system 130) that includes one or more processors (e.g., CPU(s) 302) and memory (e.g., memory 306). For example, in some embodiments, the computing device is a server or control console (e.g., a server, a standalone computer, a workstation, a smart phone, a tablet device, a medical system) that is in communication with a handheld ultrasound probe or ultrasound scanning system. In some embodiments, the computing device is a control unit integrated into a handheld ultrasound probe or ultrasound scanning system. Additional details of the method 800 can be found in Figures 1 to 7D and the accompanying descriptions, and are not repeated for the sake of brevity.
[0113] The computing device receives (802) a first scan of a portion of a first subject acquired via an ultrasound probe in accordance with a first set of imaging control parameters, including activating at least a first subset of a plurality of transducers (e.g., pixels, transducers 220, ot transducer elements 221) of the ultrasound probe.
[0114] In some embodiments, the portion of the first subject comprises (804) one or more of at least a portion of a palm of the first subject; at least a portion of a finger of the first subject; and a shape and / or a contour of at least a finger of the first subject.
[0115] In some embodiments, the first scan of the portion of the first subject comprises (806) a scan of an acoustic barcode physically coupled to the first subject.
[0116] In some embodiments, after receiving the first scan of the portion of the first subject, the computing device determines (808) whether the first scan of the portion of the first subject meets a set of one or more conditions associated with one or more quality requirements for the first scan.
[0117] The computing device performs (812) a comparison of the first scan of the portion of the first subject with a (e.g., secured) database of biometric information of users associated with the ultrasound probe.
[0118] In some embodiments, the computing device performs the comparison is in accordance with a determination (814) that the first scan of the portion of the first subject meets the set of conditions associated with one or more quality requirements for the first scan.
[0119] In some embodiments, the computing device, in accordance with a determination (810) that the first scan of the portion of the first subject does not meet the setof conditions associated with one or more quality requirements for the first scan: causes the ultrasound probe to provide guidance for one or more recommended actions to be executed via the ultrasound probe.
[0120] Referring to Figure 8B, the computing device, in accordance with the comparing, determines (816) that information that the first scan of the portion of the first subject matches a first record (e.g., for the first subject) in the database (e.g., thus verifying that the first user is an authorized user of the first ultrasound imaging device), and authorizes acquisition of ultrasound imaging data via the ultrasound probe. In some embodiments, the computing device, in accordance with the comparing, determines that information that the first scan of the portion of the first subject matches a first record in the database, and authorizes an alternate operation different from acquisition of ultrasound imaging data via the ultrasound probe. For example, in some embodiments, the subject is a patient and the alternate operation comprises accessing the patient’s records (e.g., loading, without further user intervention, the patient’s records into an electronic health record (EHR) system running on a computing device proximal to the patient, such as device 130-1). In this manner, a healthcare provider can quickly perform an ultrasound scan on the patient, which results in loading the correct patient’s information into the healthcare provider’s EHR. The healthcare provider can then perform other aspects of an assessment and / or examination (unrelated to ultrasound) and enter that information into the EHR.
[0121] In some embodiments, the computing device, in accordance with a determination (818) that the first subject has been authorized, causing the ultrasound probe to acquire ultrasound imaging data in accordance with a second set of imaging control parameters, including activating at least a second subset of the plurality of transducers of the ultrasound probe. For example, the computing device causes the ultrasound probe to acquire ultrasound imaging data in accordance with the second set of imaging control parameters includes causing the ultrasound probe to activate at least the second subset of the plurality of ultrasonic transducers of the ultrasound probe to transmit a signal into a target anatomical structure and receive a reflected signal from the target anatomical structure.
[0122] Although some of various drawings illustrate a number of logical stages in a particular order, stages that are not order dependent may be reordered and other stages may be combined or broken out. While some reordering or other groupings are specifically mentioned,others will be obvious to those of ordinary skill in the art, so the ordering and groupings presented herein are not an exhaustive list of alternatives. Moreover, it should be recognized that the stages could be implemented in hardware, firmware, software or any combination thereof.
[0123] It will also be understood that, although the terms first, second, etc. are, in some instances, used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first segmentation value could be termed a second segmentation value, and, similarly, a second segmentation value could be termed a first segmentation value, without departing from the scope of the various described implementations. The first segmentation value and the second segmentation value are both segmentation values, but they are not the same type of segmentation value.
[0124] The terminology used in the description of the various described implementations herein is for the purpose of describing particular implementations only and is not intended to be limiting. As used in the description of the various described implementations and the appended claims, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises,” and / or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0125] As used herein, the term “if’ is, optionally, construed to mean “when” or “upon” or “in response to determining” or “in response to detecting” or “in accordance with a determination that,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” is, optionally, construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event]” or “in accordance with a determination that [a stated condition or event] is detected,” depending on the context.
[0126] The foregoing description, for purpose of explanation, has been described with reference to specific implementations. However, the illustrative discussions above are not intended to be exhaustive or to limit the scope of the claims to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The implementations were chosen in order to best explain the principles underlying the claims and their practical applications, to thereby enable others skilled in the art to best use the implementations with various modifications as are suited to the particular uses contemplated.
Claims
What is claimed is:
1. A method, comprising: at an imaging system that includes an ultrasound probe having a plurality of transducers, one or more processors and memory: acquiring a first scan of a portion of a first subject via the ultrasound probe in accordance with a first set of imaging control parameters, including activating at least a first subset of the plurality of transducers of the ultrasound probe; transmitting, to a computing device that is communicatively connected with the ultrasound probe, the first scan of the portion of the first subject, the computing device including a database of biometric information of users associated with the ultrasound probe; and in accordance with receiving, from the computing device, information that the first scan of the portion of the first subject matches a first record in the database: authorizing acquisition of ultrasound imaging data via the ultrasound probe.
2. The method of claim 1, further comprising: in accordance with the authorization of the acquisition of the ultrasound imaging data via the ultrasound probe, acquiring the ultrasound imaging data via the ultrasound probe with a second set of imaging control parameters, including activating at least a second subset of the plurality of transducers of the ultrasound probe.
3. The method of claim 1, wherein the portion of the first subject comprises one or more of: at least a portion of a palm of the first subject; at least a portion of a finger of the first subject; and a shape and / or a contour of at least a finger of the first subject.
4. The method of claim 1, wherein the first scan of the portion of the first subject comprises a scan of an acoustic barcode physically coupled to the first subject.
5. The method of claim 1, further comprising: prior to acquiring the first scan of the portion of the first subject, detecting whether the ultrasound probe is in use,wherein the acquiring the first scan is in response to a determination that the ultrasound probe is in use.
6. The method of claim 5, wherein: detecting whether the ultrasound probe is in use includes detecting presence of a communicative connection between the ultrasound probe and an electronic device.
7. The method of claim 6, wherein: the electronic device includes a display; and the method further comprises: in accordance with detecting the presence of a communicative connection between the ultrasound probe and an electronic device, generating and displaying, via the display, a notification to acquire the first scan of the portion of the first subject via the ultrasound probe.
8. The method of claim 1, wherein: the imaging system includes a display; and the method further comprises: generating and displaying a visual indicator representing the portion of the first subject; and while acquiring the first scan of the portion of the first subject, updating an appearance of the visual indicator according to a status of the first scan.
9. The method of claim 1, further comprising: after acquiring the first scan of the portion of the first subject, determining whether the first scan of the portion of the first subject meets a set of one or more conditions associated with one or more quality requirements for the first scan.
10. The method of claim 9, wherein the transmitting the first scan of the portion of the first subject to the computing device is in accordance with a determination that the first scan of the portion of the first subject meets the set of conditions associated with one or more quality requirements for the first scan.
11. The method of claim 9, further comprising:in accordance with a determination that the first scan of the portion of the first subject does not meet the set of conditions associated with one or more quality requirements for the first scan: providing guidance for one or more recommended actions to be executed via the ultrasound probe.
12. The method of claim 1, wherein the first set of imaging control parameters requires sequentially activating one transducer, of the first subset of the plurality of transducers, at a time, while acquiring the first scan of the portion of the first subject.
13. The method of claim 1, wherein the first set of imaging control parameters requires sequentially activating at least two transducers, of the first subset of the plurality of transducers, at a time, while acquiring the first scan of the portion of the first subject.
14. The method of claim 1, wherein acquiring the first scan of the portion of a first subject via the ultrasound probe includes: during a first portion of the first scan, sequentially activating a first count of transducers, of the first subset of the plurality of transducers, at a time, while acquiring the first portion of the first scan; and during a second portion of the first scan, subsequent to the first portion of the first scan, sequentially activating a second count of transducers, smaller than the first count of transducers, of the first subset of the plurality of transducers, at a time, while acquiring the second portion of the first scan.
15. The method of claim 1, wherein the ultrasound imaging data comprises ultrasound imaging data of a user that is distinct from the first subject.
16. The method of claim 1, wherein the ultrasound imaging data comprises ultrasound imaging data of the first subject.
17. The method of claim 1, further comprising: in accordance with receiving, from the computing device, the information that the first scan of the portion of the first subject matches the first record in the database: retrieving, from the computing device, first device settings corresponding to a user profile corresponding the first record; andloading the first device settings on the ultrasound probe, wherein the ultrasound imaging data is acquired using the first device settings.
18. The method of claim 1, further comprising: in accordance with receiving, from the computing device, the information that the first scan of the portion of the first subject matches the first record in the database: retrieving, from the computing device, a scan type corresponding to the ultrasound imaging data; and loading, on the ultrasound probe, a third set of imaging control parameters corresponding to the retrieved scan type, wherein the ultrasound imaging data is acquired using the third set of imaging control parameters.
19. The method of claim 1, wherein the computing device is configured to apply a trained machine learning model to determine whether the first scan of the portion of the first subject matches a record in the database.
20. A method of unlocking an ultrasound probe, comprising: at a computing device that includes one or more processors and memory: receiving a first scan of a portion of a first subject acquired via an ultrasound probe in accordance with a first set of imaging control parameters, including activating at least a first subset of a plurality of transducers of the ultrasound probe; performing a comparison of the first scan of the portion of the first subject with a database of biometric information of users associated with the ultrasound probe; and in accordance with the comparing, determining, by the computing device, that information that the first scan of the portion of the first subject matches a first record in the database: authorizing acquisition of ultrasound imaging data via the ultrasound probe.
21. The method of claim 20, further comprising: in accordance with a determination that the first subject has been authorized, causing the ultrasound probe to acquire ultrasound imaging data in accordance with a second set of imaging control parameters, including activating at least a second subset of the plurality of transducers of the ultrasound probe.
22. The method of claim 20, wherein the portion of the first subject comprises one or more of: at least a portion of a palm of the first subject; at least a portion of a finger of the first subject; and a shape and / or a contour of at least a finger of the first subject.
23. The method of claim 20, wherein the first scan of the portion of the first subject comprises a scan of an acoustic barcode physically coupled to the first subject.
24. The method of claim 20, further comprising: after receiving the first scan of the portion of the first subject, determining whether the first scan of the portion of the first subject meets a set of one or more conditions associated with one or more quality requirements for the first scan.
25. The method of claim 24, wherein: the performing the comparison is in accordance with a determination that the first scan of the portion of the first subject meets the set of conditions associated with one or more quality requirements for the first scan.
26. The method of claim 24, further comprising: in accordance with a determination that the first scan of the portion of the first subject does not meet the set of conditions associated with one or more quality requirements for the first scan: causing the ultrasound probe to provide guidance for one or more recommended actions to be executed via the ultrasound probe.
27. An imaging system, comprising: an ultrasound probe having a plurality of transducers; one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the imaging system to perform the method of any of claims 1-19.
28. A non-transitory computer-readable storage medium having stored thereon program code instructions that, when executed by a processor, cause the processor to perform the method of any of claims 1-19.
29. A computer system, comprising: one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the computer system to perform the method of any of claims 20-26.
30. A non-transitory computer-readable storage medium having stored thereon program code instructions that, when executed by a processor, cause the processor to perform the method of any of claims 20-26.
Citation Information
Patent Citations
Ultrasound diagnostic apparatus and control method thereof
US20170071573A1
Imaging and reporting combination in medical imaging
US20190326007A1
CUSTOMIZATIONS IN STANDARD APPLICATION PROGRAMMING INTERFACES (APIs) PROVIDED BY A CLOUD COMPUTING PLATFORM
US20230030187A1