Internal and external proximity scanning

Abstract

Aspects of the present disclosure relate to internal and external scanning. In some embodiments, a method includes receiving a first set of data from an ingestible scanning device inside the body, identifying a first point of interest within the body based on the data, determining a location of the first point of interest within the body, and scanning the point of interest with an external scanning device.

Description

[Technical field]

[0001] Aspects of the present disclosure relate to internal and external proximity scanning, and more particularly, aspects relate to medical device scanning. [Background technology]

[0002] Medical scanning is a technique and process of collecting data on the interior of the body for clinical analysis and medical intervention, as well as visual representation of the functioning (physiology) of some organs or tissues. Medical scanning may reveal internal structures hidden by skin and bones to diagnose and treat diseases. Medical scanning also establishes a database of normal tissue and physiology to make it possible to identify abnormalities or anomalies. In the case of medical ultrasound, a probe emits ultrasonic pressure waves and echoes that travel inside the tissue to reveal the internal structures. In the case of projection radiography, the probe uses X-ray radiation, which is absorbed at different rates by different tissue types such as bone, muscle, and fat.

[0003] Medical scanning includes, among others, radiology procedures using X-ray radiography, magnetic resonance imaging, ultrasound, endoscopy, elastography, tactile imaging, thermography, medical photography imaging techniques, and nuclear medicine functional imaging techniques such as positron emission tomography (PET) and single photon emission computed tomography (SPECT).

[0004] Medical scanning also includes measurement and recording techniques that are not primarily designed to produce images, such as electroencephalography (EEG), magnetoencephalography (MEG), and electrocardiography (ECG). Summary of the Invention

[0005] The present disclosure provides methods, computer program products, and systems for internal and external proximity scanning. In some embodiments, the method includes receiving a first set of data from an ingestible scanning device inside the body, identifying a first point of interest within the body based on the first set of data, determining a location of the first point of interest within the body, and scanning the point of interest with an external scanning device.

[0006] In some embodiments, a computer program product includes a computer readable storage medium having program instructions executable by a computer to cause the computer to receive a first set of data from an ingestible scanning device inside a patient's body, identify a point of interest within the body based on the first set of data, determine a location of the point of interest within the body, and scan the point of interest with an external scanning device.

[0007] In some embodiments, the system includes a processor and a memory in communication with the processor, the memory including program instructions that, when executed by the processor, are configured to cause the processor to perform a method, the method including receiving a first set of data from an ingestible scanning device inside the patient's body, identifying a point of interest within the body based on the first set of data, determining a location of the point of interest within the body, and scanning the point of interest with an external scanning device. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 illustrates a flowchart of an exemplary method for internal and external proximity scanning, according to various embodiments of the present disclosure. [Diagram 2] FIG. 1 illustrates a flowchart of an exemplary method for configuring an external scan based on internal scan and historical data, according to various embodiments of the present disclosure. [Diagram 3] FIG. 1 is a block diagram illustrating an exemplary networking environment in accordance with various embodiments of the present disclosure. [Figure 4] FIG. 1 illustrates a computer system according to various embodiments of the present disclosure. [Diagram 5] FIG. 1 illustrates a cloud computing environment according to one embodiment of the present disclosure. [Figure 6] FIG. 2 illustrates an abstraction model layer according to one embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Medical scans such as X-rays, ultrasound, CT scans, and MRI scans provide valuable information, but may not individually give the whole picture. For example, X-rays in medical diagnosis are typically used to obtain a visual image of the object being X-rayed. The image results from the differential attenuation of radiation, which depends in part on the thickness, density, and orientation of the organ being irradiated, and in part on the proportion and nature of the various elements present. The nature of biological material is such that the contrast difference between each organ or each part of an organ is often insufficient, and despite methods to improve the contrast, this remains one of the main limitations. When living subjects are examined, additional limitations are imposed, since the object is rarely free of motion, and motion can distort the image. Furthermore, imaging radiation can be harmful to living subjects, so it is preferable to keep the radiation dose as low as reasonably practical. Further limitations are imposed by the high cost of some equipment, and the lack of qualified personnel to operate the equipment and interpret the findings. It is important to provide the radiologist with only the most important, informative images possible. Furthermore, in very sick patients, the number and type of tests performed must be limited as the limits of the patient's tolerance are reached. Thus, practically every procedure has certain advantages and limitations. However, with internal and external proximity scanning, some of the limitations can be alleviated and a more complete understanding of the scanned target can be achieved.

[0010] The medical community continues to make advances in medical scanning technology. However, sometimes a lack of information can lead to overuse, inaccuracies, and incorrect diagnosis. For example, without knowing the exact location of interest (e.g., growth), a full area X-ray or CT scan can be used instead of a localized precision scan. This can result in excessive exposure to harmful elements such as radiation, extra costs, and wasted time for doctors to view the images and results.

[0011] In some embodiments, a system is proposed for using internal scanning technology (e.g., an ingestible scanning device) with external scanning technology. By combining internal scanning technology (e.g., an ingestible ultrasonic pill) with external scanning (e.g., X-ray), a more focused and efficient process can be achieved. By combining scans, the shortcomings of one or both of the individual scans can be mitigated. For example, where a wide-range X-ray would normally be used, an ingestible scanning device can be used to tell the medical technician exactly which X-ray needs to be taken. With that information, the medical technician can use a narrow-range X-ray for that location, thereby limiting the area of ​​exposure. Similarly, a more complete picture of an area of ​​interest can be obtained by using two different scanning methods and correlating the results. In some embodiments, a first internal scanning device can provide information so that a second external scan can be selected or set. For example, some points of interest can be more accurately analyzed by MRI and some points of interest can be more accurately analyzed by X-ray.

[0012] 1 illustrates an exemplary method 100 for internal and external proximity scanning. The exemplary method 100 illustrates a model for performing a proximity scan of a living body.

[0013] At block 110, scan data from an ingestible scanning device is received. In some embodiments, the ingestible scanning device may be a wireless device that may take internal body scans (e.g., ultrasound scans / images, video, images, temperature, etc.), send signals, receive signals, and / or record. In some embodiments, the ingestible scanning device takes scans continuously. In some embodiments, the ingestible scanning device takes scans after a specific trigger. For example, the ingestible scanning device may be configured to take scans after passing through the stomach, at set time intervals, or only after receiving an external signal.

[0014] In some embodiments, an ingestible scanning device is used to describe one scanning instrument that may be swallowed. In some embodiments, the ingestible scanning device may be an ultrasound capsule. Ultrasound capsule endoscopy (USCE) overcomes the limitations of surface-only imaging and provides a transmural scan of the gastrointestinal tract. Integrating high-frequency micro-ultrasound (μUS) into capsule endoscopy allows for high-resolution transmural images, providing a means of both qualitative and quantitative assessment of the intestinal wall.

[0015] In some embodiments, the ingestible scanning device can be any other capsule with scanning capabilities. For example, capsule endoscopy is a procedure that uses a small wireless camera to take pictures of the digestive tract. The capsule endoscopy camera is inside a vitamin-sized capsule that is swallowed. As the capsule travels through the digestive tract, the camera takes thousands of pictures, which are then transmitted to a recorder.

[0016] At block 120, data from the ingestible scanning device is analyzed to find points of interest. In some embodiments, the points of interest may be specific areas of interest that are pre-determined. For example, the points of interest may be ulcers reported by the patient, tumors that were previously found, or masses found by the ingestible scanning device. In some embodiments, the points of interest may be any area that exhibits abnormal characteristics. In some embodiments, the location and characteristics (e.g., size, shape, density, etc.) of the points of interest may be used to determine what different scans / tests should be used and how the scans / tests should be configured. In some embodiments, the data may be analyzed for information indicative of points of interest (e.g., anomalies). For example, the system may have a read threshold that may be indicative of one or more target features. Some examples of read thresholds may be shape, density, signal transmission, opacity, or signal reflection, or a combination thereof. For example, kidney stones and tumors refract ultrasound images more strongly than soft tissue. For example, a mass of a certain shape in the intestine may indicate a cancerous mass. In some embodiments, the data may be analyzed by an artificial neural network.

[0017] An artificial neural network (ANN) can be a computing system modeled after biological neural networks found in animal brains. Such systems generally learn to perform a task (i.e., progressively improve performance) by considering examples, without task-specific programming. For example, in image recognition, an ANN can learn to identify images that contain tumors by analyzing example images that have been manually labeled as "tumor" or "non-tumor" and using the analysis to identify tumors in other images.

[0018] In some embodiments of the present disclosure, a neural network may be used to identify points of interest in a data scan. The neural network may be trained to recognize patterns in the input data by an iterative process of propagating training data through the network, identifying output errors, and modifying the network to address the output errors. Training data may be propagated through the neural network, and the neural network recognizes patterns in the training data. Such patterns may be compared to patterns identified in the training data by a human annotator to assess the accuracy of the neural network. In some embodiments, a mismatch between a pattern identified by the neural network and a pattern identified by a human annotator may trigger an examination of the neural network architecture to determine the specific neurons of the network that contribute to the mismatch. Such specific neurons may then be updated (e.g., by updating weights applied to functions at such neurons) in an attempt to reduce their contribution to the mismatch. In some embodiments, random changes are made to update the neurons. This process may be repeated until the number of neurons contributing to the pattern mismatch slowly decreases, eventually resulting in a change in the output of the neural network. If the new output matches the expected output based on review by human annotators, the neural network is said to be trained on that data.

[0019] In some embodiments, once a neural network has been fully trained on a training data set for a particular subject, the neural network may be used to detect patterns in a set of similar live data (i.e., non-training data on the same subject as the training data that has not been previously reviewed by a human annotator). The pattern recognition capabilities of the neural network may then be used for a variety of applications. For example, a neural network trained on a particular subject may be configured to review live data on that subject and predict the probability of a potential future event occurring that is related to that subject.

[0020] In some embodiments, a multi-layer perceptron (MLP) is a class of feed-forward artificial neural networks. An MLP consists of at least three layers of nodes: an input layer, a hidden layer, and an output layer. Except for the input nodes, each node is a neuron that uses a nonlinear activation function. MLPs utilize a supervised learning technique called backpropagation for training. Its multiple layers and nonlinear activations distinguish MLPs from linear perceptrons. Its multiple layers and nonlinear activations can distinguish data that is not linearly separable. Additionally, MLPs can be applied to perform regression operations.

[0021] Accurate identification of points of interest in a data scan (such as an ultrasound image) relies on processing live data sets that contain large amounts of data. For example, a live data set may include biological data from various sources (ultrasound images, images, x-ray images, temperature, acidity, etc.). Furthermore, achieving accurate predictions on a subject is difficult due to the amount of data that may be relevant to the prediction. For example, an ultrasound pill may take thousands of scans as it passes through the digestive system. In some embodiments, for example, a neural network according to the present disclosure may be configured to generate a prediction of the probability of a point of interest (i.e., an event whose probability is sought in the target prediction) for a particular set of conditions on the line asset. For example, in some embodiments, a predictive neural network may be utilized to predict the numerical probability that a particular section of the intestine, which is the basis for an external scan by an external scanning device, contains an anomaly (e.g., the predictive neural network will identify the anomaly as a point of interest).

[0022] At block 130, the location and / or orientation of the ingestible scanning device may be determined. In some embodiments, the scan data may be used to determine the location. For example, a tissue scan performed by an ultrasound ingestible scanning device may identify its surrounding environment as the stomach, small intestine, or large intestine. This identification may then be used to determine the location of the scanning device. For example, in some embodiments, the ingestible device may determine its location using a tissue scan. In some embodiments, the ingestible scanning device may send images to an external computer system, which may determine where the ingestible device is based on the received images. In some embodiments, the location of points of interest may also be determined.

[0023] Various methods may be implemented to determine the location of the pill. In some embodiments, the location determination may be performed by a technique selected from the group consisting of x-ray detection, ultrasound detection, echolocation, Doppler location, triangulation, or some combination thereof.

[0024] In some embodiments, an x-ray may be used to determine the location. This may be a dedicated x-ray specifically designed to identify the location of the pill. For example, if the pill is made at least in part from metal, the pill may stand out clearly even in a low power x-ray.

[0025] Pulse Doppler radar is a radar system that uses pulse timing techniques to determine the range to a target and the Doppler effect of the return signal to determine the object's velocity. Pulse Doppler radar combines features of pulsed and continuous wave radar, which were previously separate due to the complexity of the electronics.

[0026] An ultrasound scanner consists of a computer console, a video display screen, and an attached transducer. The transducer is a small handheld device similar to a microphone. In some tests, different transducers (with different functions) may be used during a single test. The transducer sends inaudible high frequency sound waves into the body and then listens for the returning echoes. The principle is similar to sonar used on boats and submarines.

[0027] Triangulation is a process by which the location of a radio transmitter may be determined by measuring either the radial distance or the direction of a received signal from two or three different points. Triangulation is sometimes used in cellular communications to determine the geographic location of a user.

[0028] At block 140, settings for the external scan may be determined based on the information received from the ingestible scanning device, or the location of the ingestible scanning device, or both. In some embodiments, the external scanning device may be positioned to produce a better image. For example, if the ingestible scanning device identifies low blood flow in an area of ​​the intestine, it may be determined that a particular orientation for X-ray exposure may provide the most important data. Similarly, the settings may include one or more settings for the external scan, such as orientation, intensity, exposure area, exposure duration, etc. For example, an image received from an ultrasound pill may identify an area of ​​the intestine that requires an external scan. Similarly, the location and orientation of the pill may help determine the settings for the external scan. The exact location where the ingestible scanning device took the image and the orientation of the ingestible scanning device may be used to point the external device to the exact location in the body to scan. For example, the human intestinal tract is approximately 25 feet long, and by identifying the exact location and orientation of the ingestible scanning device when it detects a point of interest (e.g., anomaly), it may be possible to perform a much narrower external scan.

[0029] In some embodiments, the external scan settings may include the type of scan to perform. In some embodiments, the location and characteristics of the point of interest (e.g., low blood flow, calcification, etc.) may be used to determine what kind of external scan may be used. For example, in a point of interest with high calcification, an X-ray may be a better option than an MRI.

[0030] At block 150, an external scan may be performed. In some embodiments, the scan may be synchronous, where the ingestible scanning device may scan the point of interest and the external scanning device may scan the point of interest at approximately the same time. Synchronous scanning may be performed when the point of interest is identified in advance. For example, when the point of interest is known, the external scanning device may be on standby until the ingestible scanning device is in position, and then both may take images at approximately the same time. In some embodiments, the external device may be on standby waiting for the ingestible scanning device to detect the point of interest. For example, the external device may be following the advancement of the ingestible scanning device in the body while the ingestible scanning device is moving through the digestive track. If the ingestible scanning device detects the point of interest, the external scanning device may scan the area of ​​interest at approximately the same time. In some embodiments, the ingestible scanning device may detect the point of interest, after which the external scan may be performed. For example, if the ingestible scanning device detects a point of interest at a location, the location may be identified and a subsequent external scan of the area may be performed based on the location and data received from the ingestible scanning device.

[0031] In some embodiments, data from the ingestible scanning device and the external scan may be compared. The scans may be compared and correlated to obtain more detailed information about the point of interest. For example, shape and blood flow may be obtained from the ingestible scanning device and density may be obtained from the external scanning device.

[0032] FIG. 2 illustrates a flow chart of an example method 200 for configuring an external scan based on internal scan and historical data, according to an embodiment of the present disclosure.

[0033] In some embodiments, the historical data includes previous scans and their results. In some embodiments, the historical data may indicate what features identified may be important at the point of interest and / or how the point of interest may be scanned in the external scan to improve results. In a first example, if a cancerous polyp is identified, comparing the shape of the cancerous polyp in a historical (previous) colonoscopy scan with the polyp in the current scan may help identify the cancerous polyp in the current scan. Here, colonoscopy may be used to describe a scan that looks for abnormalities in the colon, and may be performed by an ingestible ultrasound capsule, an ingestible camera, or otherwise. The system may also look for any abnormal readings identified in previous scans (such as low blood flow) and may indicate other issues not specifically looked for.

[0034] In a second example, if a patient has known diverticulitis, the system may compare inflammation surrounding previously identified pouches with the current scan data to identify pouches in the patient. Diverticulitis is an infection or inflammation of pouches that can form in the intestine. These pouches are called diverticula.

[0035] In some embodiments, method 200 may represent block 140 of method 100 (shown in FIG. 1). Method 200 may begin at 205 where current scan data is received from an ingestible scanning device. As discussed herein, the current scan data may be an image (e.g., an ultrasound image), medical data, signal data, etc.

[0036] At 210, a point of interest category is identified based on the current scan data or historical data. The point of interest category may be a primary focus of the current scan data. Continuing with the first example above, for an asymptomatic patient undergoing a general colonoscopy with an ingestible scanning device, the system may look for anomalies, identify the anomalies (such as polyps) as points of interest, give the points of interest one or more categories (e.g., low blood flow or asymmetric shape), and find historical data with the one or more categories for comparison. Continuing with the second example above, for a patient complaining of bowel pain and a previous diagnosis of diverticulitis, inflammation (which may surround the pouch) may be a primary category based on the previous diagnosis. The system may proactively find historical data with the identified category for comparison during the scan (e.g., comparing the characteristics of the inflamed pouch).

[0037] In some embodiments, multiple categories may be identified for a single point of interest, for example, a single point of interest (e.g., a discolored area of ​​the intestine) may be tagged with a category of low blood flow and a category of calcification.

[0038] Techniques for identifying interest point categories may include user selection, but may also include automated techniques such as image recognition analysis (e.g., to identify objects in an image / video), anomaly recognition (e.g., to identify anomalies in an image / video), location determination (e.g., identifying where an image was generated or seeking location-based tissue scans / images). In some embodiments, data from a scan may have an accepted range, and any data outside the range may be identified as an interest point. For example, a typical blood flow for the intestine may be 6-7% of the total blood flow, and if the blood flow is below that range, the blood flow may be identified as having a category of "low blood flow." In embodiments, a neural network may be utilized (e.g., cognitive image analysis, etc.) to identify an interest point category when the current scan data is outside of an accepted range. In some embodiments, the category may be based on the identified features. For example, any mass (such as a polyp) protruding from the side of the intestine may be tagged with a category of abnormal mass. In some embodiments, the user may be notified if a point of interest is identified. For example, if a mass over a certain size is detected, an ultrasound image may be displayed with the mass highlighted.

[0039] At 215, relevance scores for the identified interest point categories are generated from the current scan data. Continuing with the first colonoscopy example above, one category may be designated as low relevance (e.g., mild calcifications) that are unlikely to cause a problem unless other underlying conditions are present (e.g., do not match any known problem), while another category (e.g., large polyps) may have high relevance (the characteristics of the interest point closely match a problem). Continuing with the second example above regarding diverticulitis, the system may identify inflammation as high relevance (e.g., likely to indicate a pouch) and polyps as low relevance (e.g., unlikely to indicate a pouch). In embodiments, the relevance score may be based on a continuum (e.g., the relevance score may be somewhere between "similar" and "irrelevant"), or the relevance score may be multi-dimensional (e.g., points plotted within one or more 3D models where each axis defines a given analyzed component of the relevance score). In some embodiments, the relevance score may be based on a threshold. For example, the normal blood flow range for the intestine may be 0.88±0.13 ml / min / g, with 0.75 ml / min / g being the lower threshold. Areas of the intestine with blood flow below the threshold may be tagged with a low relevance score (e.g., close to normal) for the "low blood flow" category. Areas of the intestine with no blood flow may be tagged with a high relevance score for the "low blood flow" category. In some embodiments, the relevance score may be a numerical score based on the degree of similarity between the point of interest and the category.

[0040] At 220, a set of historical scan data is identified based on the point of interest category. In an embodiment, the historical scan data repository may be predefined (e.g., a particular file folder on the computing device) or the historical scan data repository may be undefined (e.g., the set of historical scan data may be fetched from the Internet, by searching an entire disk drive in the computing device, by scanning multiple shared folders across multiple devices, by searching an associated historical scan data database, etc.).

[0041] In embodiments, a set of historical scan data may have metadata tags that already describe a particular range of data that should be further investigated. In such cases, metadata tags with appropriate actions may be identified and returned by the search. In some embodiments, a set of historical scan data may have metadata tags that indicate what additional steps should be taken. For example, when an area of ​​low blood flow is found in the intestine (e.g., based on the scan data received in block 205), historical scans in which similar blood flow was found may be identified. Metadata tags for similar scans may indicate that x-rays of the area were able to determine the reason for the historical reduced blood flow.

[0042] At block 230, the identified set of historical data may be analyzed based on the features of the points of interest and the point of interest categories. In some embodiments, the historical data may be analyzed to determine point of interest features (e.g., blood flow velocity, tumor size, etc.) and related external information (e.g., what scan to perform, what angle the scan should be taken at, radiation intensity, etc.). In some embodiments, the point of interest categories may be used to identify specific features in the set of historical data that may be present in the current scan data.

[0043] In some embodiments, the analysis may include assigning a similarity score to one or more sets of data. For example, if the internal scan data received in block 205 identifies a point of interest (e.g., an anomaly), the system may take that internal scan data and compare it to the historical scan data. The more closely the data in the historical scan data matches the current scan data, the higher the similarity score. In some embodiments, the identified sets of historical data and the current scan data may be displayed to a user. For example, if an image shows a mass with characteristics of a tumor, several images of the confirmed tumor may be displayed for comparison.

[0044] At block 240, settings for the external scan may be determined based on historical data. For example, when an ingestible ultrasound device finds an abnormality in tissue, such as an ulcer, a first orientation of the external scan may provide a better image than a second orientation. The historical data may indicate that an x-ray of the ulcer from the side may provide inferior data than a scan of the surface of the ulcer. Similarly, the historical data may be analyzed to determine the area that needs to be scanned. For example, a tumor that shows signs of being malignant may require a larger area of ​​external scanning (e.g., to determine if the cancer has spread) than a tumor that shows signs of being benign.

[0045] In some embodiments, the settings may include angle, direction, intensity, area, focus, and signal strength, among others. For example, historical data may be analyzed to determine the angle of the x-ray to be used to scan the ulcer. One angle may provide more or more complete information than another angle.

[0046] At block 250, a second scan (i.e., an external scan) may be performed based on the first scan. Continuing with the first example above, an internal scanning device may be used to identify polyps and information about the polyps, including their orientation. An X-ray may be performed based on the internal scan, with the X-ray machine oriented to provide an outline view of the polyps. The outline view of the polyps may give the radiologist a better chance of diagnosing whether the polyps are cancerous. Continuing with the second example above, an internal scanning device may be used to detect a possible diverticulitis pouch. Based on the comparison of block 230 and the settings from block 240, an external scan (e.g., a computed tomography (CT) scan) of an adjacent area surrounding the pouch may be performed instead of a large area scan of the entire abdomen. In some embodiments, the external scan is performed automatically. In some embodiments, an external scan may be performed based on a feature from block 240 meeting or exceeding a threshold level, such as blood flow being below an accepted normal range. In some embodiments, the external scan may not be performed automatically at block 250. Rather, in some embodiments, block 250 may include prompting the user to initiate an external scan. For example, if a threshold is exceeded during a scan, an image may be shown to the user and the user may be prompted to initiate an external scan.

[0047] In some embodiments, the threshold level may be one or more identified features. For example, a certain shape or color may indicate a warrant for a second scan. Some shapes, such as polyps, may indicate an underlying medical problem, while other shapes, such as small bumps, may be normal. Significant discoloration may indicate an underlying condition such as necrosis or gangrene, while subtle discoloration may be a natural variation in flesh tone.

[0048] In some embodiments, the threshold may be a particular value exhibited by the tissue being scanned, for example, the threshold may be blood flow velocity, density, a particular angle of curvature for a mass, or the size of a mass.

[0049] In some embodiments, the threshold may be a combination of features. For example, any area of ​​the intestine with blood flow below a certain rate and a temperature above a certain rate may trigger an external scan, even though the blood flow and its temperature may not individually trigger an external scan by themselves. For example, a mass of a certain shape with blood flow above a certain rate may trigger an external scan.

[0050] 3, an exemplary networking environment 300 according to an embodiment of the present disclosure is shown. The networking environment 300 may include a client device 324, a historical scan data database 330, a network 340, and a historical scan data selection tool 301 (e.g., a system) for historical scan data selection based on point of interest category and scan type. The historical scan data selection tool 301 may be implemented as an application running on a user's computing device, as a service provided via the cloud, as a web browser plug-in, as a smartphone application, or as a co-dependent application connected to a secondary application (e.g., as an "overlay" or companion application to a partner application such as a text messaging application).

[0051] Network 340 may be any type or combination of networks. For example, network 340 may include any combination of a personal area network (PAN), a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a wireless local area network (WLAN), a storage area network (SAN), an enterprise private network (EPN), or a virtual private network (VPN). In some embodiments, network 340 may refer to an IP network, a traditional coax-based network, or the like. For example, a server storing historical scan data database 330 may communicate with various client devices (e.g., tablets, laptops, smartphones, portable terminals, client devices 324, etc.) via the Internet.

[0052] In some embodiments, network 340 may be implemented in a cloud computing environment or using one or more cloud computing services. Consistent with various embodiments, a cloud computing environment may include a network-based distributed data processing system that provides one or more cloud computing services. Additionally, a cloud computing environment may include many computers (e.g., hundreds or thousands or more computers) disposed in one or more data centers and configured to share resources via network 340. Cloud computing is discussed in more detail with respect to FIGS. 5 and 6.

[0053] The client device 324 may be a desktop, laptop, smartphone, tablet, or any other suitable computing device for a user to interact with and execute the methods / techniques described herein. In an embodiment, the client device 324 may store one or more sets of scan data, such as the scan data 302. As described herein, the scan data 302 may be a written article, an audio stream, a video stream, etc.

[0054] The historical scan data database 330 may store a wide variety of historical scan data as contemplated herein. For example, the historical scan data may include scan data, still images, video, audio recordings (e.g., heartbeats from a sonogram), or any other type of historical scan data that a creator / user of the scan data 302 may want to add or use with the scan data 302. In an embodiment, the historical scan data database 330 may reside on a single server, multiple servers in a cloud computing environment, and / or on the same physical or virtual system as the client device 324 or the historical scan data selection tool 301.

[0055] The historical scan data selection tool 301 may be a standalone computing system, such as a desktop or laptop, a server, or a virtual system running on one or more servers in a cloud computing environment. The historical scan data selection tool 301 may include a historical scan data processing system 306, a scan data processing system 314, and a scoring module 322.

[0056] In an embodiment, scan data 302 may be received by the historical scan data selection tool 301 over a network 340. The scan data processing system 314 may include, for example, an image processor 316, a search application 318, and a content analysis module 320.

[0057] In an embodiment, the image processor 316 may be configured to analyze the historical scans to identify one or more interest point categories. In an embodiment, the image processor 316 is configured to identify anomaly features from which an interest point category may be identified.

[0058] When a point of interest category is identified, a relevance score may be generated via the content analysis module 320 to determine one or more features of the historical scan data (e.g., signal strength, density, shape of the anomaly, size of the anomaly, blood flow, etc.) with respect to the identified point of interest category. In an embodiment, the content analysis module 320 may include or store information in a relational database linking one or more features to one or more other features. For example, a point of interest may have a higher temperature coupled with increased blood flow, neither of which may be individually abnormal. In another embodiment, the content analysis module 320 may include a convolutional neural network to generate the relevance score. In yet another embodiment, the content analysis module 320 may include, for example, both a relational database and a convolutional neural network, and may use data from the relational database as input to the convolutional neural network. The relevance score may be output to the scoring module 322 for similarity scoring.

[0059] The search application 318 may be utilized to find a set of historical scan data by searching the historical scan data database 330 for the point of interest categories identified by the image processor 316. As described herein, the historical scan data database 330 may include predefined file folders or computers, or the historical scan data database 330 may be construed as a collection of websites, computers, servers, etc. Search results may be returned to the historical scan data processing system 306.

[0060] In some embodiments, the historical scan data processing system 306 may include, for example, a data analysis module 308, an image analysis module 310, and a category receiving module 312. The category receiving module 312 may be configured to receive from the scan data processing system 314 point of interest categories identified by analyzing areas of the scan data 302 that are necessarily related to a set of historical scan data searched by the search application 318.

[0061] For example, in an embodiment, shape recognition is utilized as part of the scan data processing system 314 to identify a particular mass or formation. A superclass for the mass or formation may be determined by parsing a relational database for shape, and the superclass may be assigned as an interest point category. After identifying the interest point category, the scan data processing system 314 may send data regarding the interest point category to the category receiving module 312 when the shape attributes may inform the identification of visual / audio attributes by the image analysis module 310 or data analysis module 308, respectively.

[0062] Based on the digital file format (e.g., image file format (e.g., .jpg), text format (e.g., .docx, .raf, .txt, etc.), audio format (e.g., .mp3, etc.), and video file format (e.g., .wmv)), the historical scan data processing system 306 may determine which processing module (e.g., data analysis module 308 or image analysis module 310) the system should use with to analyze the received historical scan data in response to the results of the search application 318. In embodiments in which textual historical scan data is received, analysis of the historical scan data is performed, for example, in the scan data processor 316. In another embodiment, the historical scan data processing system 306 may include its own scan data processor (not shown).

[0063] In embodiments, the image analysis module 310 may be configured to receive video and image formats and identify objects, locations, points of interest, etc. (e.g., subjects) within the images as described herein. In embodiments in which video files are received, still frame images may be selected at random intervals, at regular intervals, or the "best image" (e.g., the image that most clearly shows the tumor) may be selected according to still image selection criteria.

[0064] In an embodiment, the image analysis module 310 may be configured to identify objects or features (e.g., shape of a mass, color, inflammation, etc.) (e.g., from a still image, a video, or a single frame of a video feed). The image analysis module 310 may consider a combination of objects in an image to further identify the condition of the image. For example, an image with a combination of objects including one or more shapes, masses, and discolorations may provide the basis for identifying the condition of the image as necrosis. The image analysis module 310 may implement the analysis techniques described herein to output a probability of a particular interest point for the analyzed image based on the received interest point category.

[0065] Once the image objects, attributes, context, and relevance scores have been identified, the images may be "tagged" or annotated (e.g., as metadata) with lists or tables reflecting this information and stored in the historical scan data database 330. The relevance scores generated by the image analysis module 310 are sent to a scoring module 322.

[0066] In embodiments, as discussed herein, the scoring module 322 may be used to generate a similarity score based on the received relevance scores for both the content and the historical scan data.

[0067] In an embodiment, the scoring module 322 may utilize a neural network to generate the similarity scores, as described herein, which may be a multi-layer perceptron, a system of sigmoid neurons, a directed acyclic graph with multiple corelets, or any other structure / system capable of neural networking.

[0068] The scoring module 322 may select and display to the user one or more images from the historical scan data based on the similarity score as described herein. The parameters for selection may include the single data set with the highest similarity score or may be a subset of the historical scan data (e.g., the 10 historical scan data with the highest similarity scores). The selection parameters may be adjustable.

[0069] FIG. 4 illustrates representative major components of an exemplary computer system 401 that may be used in accordance with embodiments of the present disclosure. The particular components illustrated are presented for illustrative purposes only and are not necessarily the only such variations. The computer system 401 may include a processor 410, a memory 420, an input / output interface (also referred to herein as I / O or I / O interface) 430, and a main bus 440. The main bus 440 may provide a communication path for other components of the computer system 401. In some embodiments, the main bus 440 may be connected to other components, such as a dedicated digital signal processor (not shown).

[0070] The processor 410 of the computer system 401 may be comprised of one or more CPUs 412. The processor 410 may further comprise one or more memory buffers or caches (not shown) that provide temporary storage of instructions and data for the CPU 412. The CPU 412 may execute instructions on inputs provided from the cache or memory 420 and output results to the cache or memory 420. The CPU 412 may be comprised of one or more circuits configured to execute one or more methods consistent with embodiments of the present disclosure. In some embodiments, the computer system 401 may include multiple processors 410, which is typical of a relatively large system. However, in other embodiments, the computer system 401 may be a single processor with a single CPU 412.

[0071] The memory 420 of the computer system 401 may be comprised of a memory controller 422 and one or more memory modules (not shown) for temporary or permanent storage of data. In some embodiments, the memory 420 may include random access semiconductor memory, storage devices, or storage media (volatile or non-volatile) for storing data and programs. The memory controller 422 may communicate with the processor 410 to facilitate storage of information in the memory modules and retrieval of information in the memory modules. The memory controller 422 may communicate with the I / O interface 430 to facilitate storage and retrieval of inputs or outputs of the memory modules. In some embodiments, the memory modules may be dual in-line memory modules.

[0072] The I / O interface 430 may comprise an I / O bus 450, a terminal interface 452, a storage interface 454, an I / O device interface 456, and a network interface 458. The I / O interface 430 may connect the main bus 440 to the I / O bus 450. The I / O interface 430 may route instructions and data from the processor 410 and memory 420 to the various interfaces of the I / O bus 450. The I / O interface 430 may also route instructions and data from the various interfaces of the I / O bus 450 to the processor 410 and memory 420. The various interfaces may comprise a terminal interface 452, a storage interface 454, an I / O device interface 456, and a network interface 458. In some embodiments, the various interfaces may comprise a subset of the aforementioned interfaces (e.g., an embedded computer system in an industrial application may not include the terminal interface 452 and the storage interface 454).

[0073] Logical modules throughout computer system 401, including but not limited to memory 420, processor 410, and I / O interface 430, may communicate faults and changes to one or more components to a hypervisor or operating system (not shown). The hypervisor or operating system may allocate the various resources available within computer system 401 and track the location of data in memory 420 and processes assigned to the various CPUs 412. In embodiments that combine or rearrange elements, aspects of the functionality of the logical modules may be combined or redistributed. Such variations may be apparent to one of ordinary skill in the art.

[0074] The present invention may be a system, method, or computer program product, or combination thereof, at any possible level of technical detail integration. The computer program product may include a computer readable storage medium having computer readable program instructions that cause a processor to implement aspects of the present invention.

[0075] A computer readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. A computer readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of computer readable storage media includes portable computer diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, mechanically encoded devices such as punch cards or ridges in a groove structure with instructions recorded on them, and any suitable combination of the foregoing. As used herein, computer-readable storage media should not be interpreted as signals that are transitory in nature, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., light pulses passing through a fiber optic cable), or electrical signals transmitted through wires.

[0076] The computer readable program instructions described herein may be downloaded from a computer readable storage medium to the respective computing / processing device or to an external computer or storage device via a network, such as the Internet, a local area network, a wide area network, or a wireless network, or a combination thereof. The network may include copper transmission cables, optical transmission fiber, wireless transmission, routers, firewalls, switches, gateway computers, or edge servers, or a combination thereof. A network adapter card or network interface in each computing / processing device receives the computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in the respective computing / processing device.

[0077] The computer readable program instructions for carrying out the operations of the present invention may be source or object code written in any combination of one or more programming languages, including assembler instructions, instruction set architecture (ISA) instructions, machine language instructions, machine dependent instructions, microcode, firmware instructions, state setting data, configuration data for integrated circuits, or object oriented programming languages ​​such as Smalltalk®, C++, and procedural programming languages ​​such as the “C” programming language and similar programming languages. The computer readable program instructions may be executed entirely on the user's computer, partially on the user's computer as a stand-alone software package, partially on a remote computer, or entirely on a remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or wide area network (WAN), or the connection may be made to an external computer (e.g., through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may execute computer readable program instructions by utilizing state information of the computer readable program instructions to individualize the electronic circuitry to implement aspects of the invention.

[0078] Aspects of the present invention are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer readable program instructions.

[0079] Such computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the instructions, executed via the processor of the computer or other programmable data processing apparatus, produce means for implementing the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams to create a machine. Such computer-readable program instructions may also be stored in a computer-readable storage medium that may direct a computer, programmable data processing apparatus, other device, or other devices, or combinations thereof, to function in a particular manner, such that the computer-readable storage medium storing the instructions includes an article of manufacture including instructions that implement aspects of the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams.

[0080] The computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device such that the instructions, which execute on the computer, other programmable apparatus, or other device, implement the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams, causing the computer, other programmable apparatus, or other device to perform a series of operational steps to create a computer-implemented process.

[0081] Although this disclosure includes detailed descriptions of cloud computing, it should be understood that implementation of the teachings described herein is not limited to a cloud computing environment. Rather, embodiments of the invention may be implemented in conjunction with any other type of computing environment now known or later developed.

[0082] Cloud computing is a model of service delivery for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, network bandwidth, servers, processing, memory, storage, applications, virtual machines, and services) that can be rapidly provisioned and released with minimal administrative effort or interaction with the service provider. This cloud model may include at least five characteristics, at least three service models, and at least four deployment models.

[0083] Its features are as follows.

[0084] On-Demand Self-Service: Cloud consumers may unilaterally provision computing capacity, such as server time or network storage, automatically as needed, without the need for human interaction with the provider of the service.

[0085] Pervasive Network Access: Functionality is available over the network and is accessed through standard mechanisms that facilitate use by heterogeneous thin- or thick-client platforms (e.g., cell phones, laptops, and PDAs).

[0086] Resource Pooling: Provider computing resources are pooled to serve multiple consumers using a multi-tenant model, with different physical and virtual resources dynamically allocated and reallocated according to demand. There is some location independence in that consumers generally have no control or knowledge of the exact location of the resources provided, but may be able to specify location at a higher level of abstraction (e.g., country, state, or data center).

[0087] Rapid Elasticity: Capabilities can be rapidly and elastically provisioned, in some cases automatically, to scale out quickly, release quickly and scale in quickly. To the consumer, the capabilities available for provisioning often appear to be unlimited, with any amount available to be purchased at any time.

[0088] Metering Services: Cloud systems automatically control and optimize resource usage by leveraging metering capabilities at some level of abstraction appropriate to the type of service (e.g., storage, processing, bandwidth, and active user accounts). Resource usage can be monitored, controlled, and reported, providing transparency to both providers and consumers of the services being utilized.

[0089] The service model is as follows:

[0090] Software as a Service (SaaS): The functionality provided to the consumer is the use of the provider's applications running on a cloud infrastructure. The applications are accessible from a variety of client devices through thin-client interfaces such as web browsers (e.g., web-based email). The consumer does not manage or control the underlying cloud infrastructure, including networks, servers, operating systems, storage, or even individual application functions, with the possible exception of limited user-specific application configuration settings.

[0091] Platform as a Service (PaaS): The functionality offered to the consumer is the deployment of applications created or acquired by the consumer, written using programming languages ​​and tools supported by the provider, onto a cloud infrastructure. The consumer does not manage or control the underlying cloud infrastructure, including networks, servers, operating systems, or storage, but does have control over the applications deployed and, in some cases, the application hosting environment configuration.

[0092] Infrastructure as a Service (IaaS): The functionality provided to the consumer is the provisioning of processing, storage, network, and other basic computing resources onto which the consumer can deploy and run any software, which may include operating systems and applications. The consumer does not manage or control the underlying cloud infrastructure, but has control over the operating systems, storage, applications being deployed, and possibly limited control over selected networking components (e.g., host firewalls).

[0093] The deployment model is as follows:

[0094] Private Cloud: The cloud infrastructure is operated solely for the organization. The cloud infrastructure can be managed by the organization or a third party and can exist on-premise or off-premise.

[0095] Community Cloud: The cloud infrastructure is shared by several organizations to support a particular community with shared concerns (e.g., mission, security requirements, policy, and compliance considerations). The cloud infrastructure may be managed by the organization or a third party and may exist on-premise or off-premise.

[0096] Public Cloud: The cloud infrastructure is made available to the general public or large industry groups and is owned by an organization that sells cloud services.

[0097] Hybrid Cloud: The cloud infrastructure is a composition of two or more clouds (private, community, or public) that remain unique entities but are tied together by standardized or proprietary technologies that enable data and application portability (e.g., cloud bursting for load balancing between clouds).

[0098] A cloud computing environment is a service oriented approach that focuses on statelessness, low coupling, modularity, and semantic interoperability. At the heart of cloud computing is an infrastructure that includes a network of interconnected nodes.

[0099] Referring now to FIG. 5, an exemplary cloud computing environment 50 is shown. As shown, the cloud computing environment 50 includes one or more cloud computing nodes 10 with which a local computing device used by a cloud consumer, such as, for example, a personal digital assistant (PDA) or cellular phone 54A, a desktop computer 54B, a laptop computer 54C, or an automobile computer system 54N, or combinations thereof, may communicate. The nodes 10 may communicate with each other. The nodes 10 may be physically or virtually grouped in one or more networks, such as private, community, public, or hybrid clouds as previously described, or combinations thereof (not shown). This enables the cloud computing environment 50 to provide infrastructure, platform, and / or software as a service for which the cloud consumer does not need to maintain resources on the local computing device. It should be understood that the types of computing devices 54A-N shown in FIG. 5 are for illustrative purposes only, and that the computing node 10 and cloud computing environment 50 may communicate with any type of computerized device via any type of network and / or network-addressable connections (e.g., using a web browser).

[0100] Referring now to Figure 6, a set of functional abstraction layers provided by cloud computing environment 50 (Figure 5) is shown. It should be understood in advance that the components, layers, and functions shown in Figure 6 are for illustrative purposes only, and embodiments of the present invention are not limited thereto. As shown, the following layers and corresponding functions are provided:

[0101] Hardware and software layer 60 includes hardware and software components. Examples of hardware components include mainframes 61, RISC (reduced instruction set computer) architecture based servers 62, servers 63, blade servers 64, storage devices 65, and networks and networking components 66. In some embodiments, software components include network application server software 67 and database software 68.

[0102] The virtualization layer 70 provides an abstraction layer from which the following examples of virtual entities may be provided: virtual servers 71, virtual storage 72, virtual networks including virtual private networks 73, virtual applications and operating systems 74, and virtual clients 75.

[0103] In one example, management layer 80 may provide the functionality described below: Resource provisioning 81 provides dynamic procurement of computing and other resources utilized to perform tasks within the cloud computing environment. Metering and pricing 82 provides cost tracking as resources are utilized within the cloud computing environment and billing or invoicing for the consumption of such resources. In one example, such resources may include application software licenses. Security provides identity verification for cloud consumers and tasks, and protection for data and other resources. User portal 83 provides access to the cloud computing environment for consumers and system administrators. Service level management 84 provides cloud computing resource allocation and management such that required service levels are met. Service level agreement (SLA) planning and fulfillment 85 provides proactive coordination and procurement of cloud computing resources for anticipated future needs in accordance with SLAs.

[0104] The workload tier 90 provides examples of functions for which a cloud computing environment may be utilized. Examples of workloads and functions that may be provided from this tier include mapping and navigation 91, software development and lifecycle management 92, virtual classroom instructional delivery 93, data analytics processing 94, transaction processing 95, and predictive neural networks 96.

[0105] The present invention may be a system, method, or computer program product, or combination thereof, at any possible level of technical detail integration. The computer program product may include a computer readable storage medium having computer readable program instructions that cause a processor to implement aspects of the present invention.

[0106] A computer readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. A computer readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of computer readable storage media includes the following: portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically encoded devices such as punch cards or ridges in a groove structure with instructions recorded on them, and any suitable combination of the foregoing. As used herein, computer-readable storage media should not be interpreted as signals that are transitory in nature, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., light pulses passing through a fiber optic cable), or electrical signals transmitted through wires.

[0107] The computer readable program instructions described herein may be downloaded from a computer readable storage medium to the respective computing / processing device or to an external computer or storage device via a network, such as the Internet, a local area network, a wide area network, or a wireless network, or a combination thereof. The network may include copper transmission cables, optical transmission fiber, wireless transmission, routers, firewalls, switches, gateway computers, or edge servers, or a combination thereof. A network adapter card or network interface in each computing / processing device receives the computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in the respective computing / processing device.

[0108] The computer readable program instructions for carrying out the operations of the present invention may be assembler instructions, instruction set architecture (ISA) instructions, machine language instructions, machine dependent instructions, microcode, firmware instructions, state setting data, configuration data for integrated circuits, or source or object code written in any combination of one or more programming languages, including object oriented programming languages ​​such as Smalltalk®, C++, and procedural programming languages ​​such as the “C” programming language and similar programming languages. The computer readable program instructions may be executed entirely on the user's computer, partially on the user's computer as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or wide area network (WAN), or the connection may be made to an external computer (e.g., through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may execute computer readable program instructions by utilizing state information of the computer readable program instructions to individualize the electronic circuitry to implement aspects of the invention.

[0109] Aspects of the present invention are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer readable program instructions.

[0110] Such computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus, such that the instructions, executed via the processor of the computer or other programmable data processing apparatus, produce means for implementing the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams to create a machine. Such computer-readable program instructions may also be stored in a computer-readable storage medium that may direct a computer, programmable data processing apparatus, or other device, or combination thereof, to function in a particular manner, such that the computer-readable storage medium storing the instructions includes an article of manufacture including instructions that implement aspects of the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams.

[0111] The computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device such that the instructions, which execute on the computer, other programmable apparatus, or other device, implement the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams, causing the computer, other programmable apparatus, or other device to perform a series of operational steps to create a computer-implemented process.

[0112] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of instructions that includes one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions described in the blocks may occur in an order other than that described in the figures. For example, two blocks shown in succession may in fact be executed substantially simultaneously, or the blocks may sometimes be executed in the reverse order, depending on the functionality involved. It will also be noted that each block of the block diagrams and / or flowchart illustrations, and combinations of blocks in the block diagrams and / or flowchart illustrations, may be implemented by a dedicated hardware-based system that performs the specified functions or operations, or a combination of dedicated hardware and computer instructions.

[0113] As used herein, a "set" of an object is not equivalent to all available instances of that object. For example, if four files were available, then the set of files may not include all four files. Furthermore, as used herein, the phrase "each of the set" of an object refers only to the instances of that object in that set. For example, if four files were available, then "a set of two files of the four files, each of the files in the set being read-only" would be properly interpreted to suggest that two files (the two files in the set) are read-only. The two files of the four available files that are not in the set may or may not be read-only.

[0114] The description of various embodiments of the present disclosure is presented for illustrative purposes, but is not exhaustive and is not intended to be limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terms used in this specification are selected to describe the principles of the embodiments, practical applications, or technical improvements over the technology found in the market, and to enable those skilled in the art to understand the embodiments disclosed herein.

[0115] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of instructions that includes one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions described in the blocks may occur in an order other than that described in the figures. For example, two blocks shown in succession may in fact be executed substantially simultaneously, or the blocks may sometimes be executed in the reverse order, depending on the functionality involved. It will also be noted that each block of the block diagrams and / or flowchart illustrations, and combinations of blocks in the block diagrams and / or flowchart illustrations, may be implemented by a dedicated hardware-based system that performs the specified functions or operations, or a combination of dedicated hardware and computer instructions.

[0116] The description of various embodiments of the present disclosure is presented for illustrative purposes, but is not exhaustive and is not intended to be limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terms used in this specification are selected to describe the principles of the embodiments, practical applications, or technical improvements over the technology found in the market, and to enable those skilled in the art to understand the embodiments disclosed herein.

Claims

1. A computer program comprising: receiving a first set of data from an ingestible scanning device within the patient's body; identifying points of interest within the body based on the first set of data; determining a location of the point of interest within the body; scanning the point of interest with an external scanning device; A computer program that causes

2. 2. The computer program product of claim 1, wherein the determining of the location is performed by a technique selected from the group consisting of echolocation, Doppler location, x-ray scanning, and triangulation.

3. The computer program product of claim 1, wherein the external scanning device is one of an X-ray machine, an ultrasound machine, a CT scanning machine, and an MRI scanning machine.

4. 2. The computer program product of claim 1, wherein the ingestible scanning device is an ingestible ultrasound scanning device and the external scanning device is an X-ray machine.

5. determining settings for the external scanning device based on the first set of data; The computer program product of claim 1 , further comprising:

6. The computer program product of claim 5 , wherein the settings include an angle of the external scanning device relative to the point of interest.

7. The computer program product of claim 5 , wherein the settings include an area of ​​exposure for the external scanning device.

8. The request for setting determining a category for the point of interest; receiving a set of historical data based on the categories; comparing the first set of data to the historical data; configuring the external scanning device based on the comparison; and The computer program product of claim 5 , further comprising:

9. 1. A system comprising: A processor; and a memory in communication with the processor, the memory including program instructions configured, when executed by the processor, to cause the processor to perform a method, the method comprising: receiving a first set of data from an ingestible scanning device within the patient's body; identifying points of interest within the body based on the first set of data; determining a location of the point of interest within the body; scanning the point of interest with an external scanning device; Including, the system.

10. 10. The system of claim 9, wherein the determining of the location is performed by a technique selected from the group consisting of echolocation, Doppler location, x-ray scanning, and triangulation.

11. The system of claim 1, wherein the external scanning device is one of an X-ray machine, an ultrasound machine, a CT scanning machine, and an MRI scanning machine.

12. 10. The system of claim 9, wherein the ingestible scanning device is an ingestible ultrasound scanning device and the external scanning device is an X-ray machine.

13. determining settings for the external scanning device based on the first set of data; The system of claim 9 further comprising:

14. The system of claim 13 , wherein the settings include an angle of the external scanning device relative to the point of interest.

15. The system of claim 13 , wherein the settings include an area of ​​exposure for the external scanning device.

16. The request for setting determining a category for the point of interest; receiving a set of historical data based on the categories; comparing the first set of data to the historical data; configuring the external scanning device based on the comparison; and The system of claim 13 further comprising:

Images