12164results about "Image generation" patented technology

A system and method in a client-server computing environment is provided for generating and rendering a photorealistic three-dimensional (3D) perspective view of a 3D object selectively positioned within a 3D scene. A client is configured for communicably accessing a server, and includes a client application configured for scene editing and rendering, using a graphical user interface (GUI). The 3D scene may be selectively displayed in a plurality of views, and a 3D object may be retrieved from the server and imported into the 3D scene to generate a composite. The 3D object may also be manipulated within the composite for placement and orientation. A 3D image of the composite may then be rendered at the client and selectively reconfigured in real time. Luminosity characteristics may be applied to the 3D image; followed by rendering a photorealistic 3D view of the composite image.

The present invention relates to a method of generating a three dimensional representation of one or more anatomical joints, wherein the representation comprises two or more movable bodies and one or more links, comprising the steps of inputting anatomically representative data of two or more movable bodies of the selected joint or joints; selecting one or more link types responsive to the representative data of the bodies; selecting link characteristics responsive to each selected link type; generating an equilibrium condition responsive to interaction between the bodies and the links; and displaying a three dimensional representation of the selected joint or joints responsive to the data generated from the equilibrium condition of the anatomical joint or joints. The present invention further relates to a system for generating a three dimensional representation of one or more anatomical joints, and a method of planning surgery of one or more anatomical joints.

Embodiments include a system for determining cardiovascular information for a patient. The system may include at least one computer system configured to receive patient-specific data regarding a geometry of the patient's heart, and create a three-dimensional model representing at least a portion of the patient's heart based on the patient-specific data. The at least one computer system may be further configured to create a physics-based model relating to a blood flow characteristic of the patient's heart and determine a fractional flow reserve within the patient's heart based on the three-dimensional model and the physics-based model.

This invention provides user interfaces that more intuitively display physiological data obtained from physiological monitoring of one or more subjects. Specifically, the user interfaces of this invention create and display one or more avatars having behaviors guided by physiological monitoring data. The monitoring data is preferably obtained when the subject is performing normal tasks without substantial restraint. This invention provides a range of implementations that accommodate user having varying processing and graphics capabilities, e.g., from handheld electronic devices to ordinary PC-type computers and to systems with enhanced graphics capabilities.

The invention provides a method and system for performing an image-guided endoscopic medical procedure. The invention may include registering image-space coordinates of a path of a medical instrument within the anatomy of a patient to patient-space coordinates of the path of the medical instrument within the anatomy of the patient. In some embodiments, the image space coordinates of the path of the medical instrument may be predicted coordinates such as, for example, a calculated centerline through a conduit-like organ, or a calculated “most likely path” of the medical instrument within the anatomy of the patient. In other embodiments, the path of the medical instrument may be an actual path determined using intra-operative images of the patient's anatomy with the medical instrument inserted therein. The registered instrument may then be navigated to one or more items of interest for performance of the endoscopic medical procedure.

An image-based tele-presence system forward warps video images selected from a plurality fixed imagers using local depth maps and merges the warped images to form high quality images that appear as seen from a virtual position. At least two images, from the images produced by the imagers, are selected for creating a virtual image. Depth maps are generated corresponding to each of the selected images. Selected images are warped to the virtual viewpoint using warp parameters calculated using corresponding depth maps. Finally the warped images are merged to create the high quality virtual image as seen from the selected viewpoint. The system employs a video blanket of imagers, which helps both optimize the number of imagers and attain higher resolution. In an exemplary video blanket, cameras are deployed in a geometric pattern on a surface.

A method and system for imaging an artery contained in an arterial tree. A microprocessor generates a three-dimensional reconstruction of the arterial tree from two or more angiographic images obtained from different perspectives. The orientation of the axis of the artery in the arterial tree is then determined, and a perspective of the artery perpendicular to the axis of the artery is determined. A three dimensional reconstruction of the artery from angiographic images obtained from the determined perspective is then generated.

A frame of still picture data is captured at an instant specified by a user from video signals supplied from a given video source, such as a television receiver, a video camera, etc., and the image data is displayed. When the user specifies an area of image to be cut out from the displayed still picture, the image data in the specified area is cut out and recorded as a cutout image. Each cutout image recorded is displayed in the form of an icon. When any of the icons is selected by the user, the corresponding cutout image data is read and pasted in a part to be changed in the original image data. Thus an image can be easily created by user's choice.

A method and system are provided for effecting interactive, three-dimensional renderings of selected body organs for purposes of medical observation and diagnosis. A series of CT images of the selected body organs are acquired. The series of CT images is stacked to form a three-dimensional volume file. To facilitate interactive three-dimensional rendering, the three-dimensional volume file may be subjected to an optional dataset reduction procedure to reduce pixel resolution and / or to divide the three-dimensional volume file into selected subvolumes. From a selected volume or subvolume, the image of a selected body organ is segmented or isolated. A wireframe model of the segmented organ image is then generated to enable interactive, three-dimensional rendering of the selected organ.

Systems and methods for balancing a load among multiple graphics processors that render different portions of a frame. A display area is partitioned into portions for each of two (or more) graphics processors. The graphics processors render their respective portions of a frame and return feedback data indicating completion of the rendering. Based on the feedback data, an imbalance can be detected between respective loads of two of the graphics processors. In the event that an imbalance exists, the display area is re-partitioned to increase a size of the portion assigned to the less heavily loaded processor and to decrease a size of the portion assigned to the more heavily loaded processor.

A method of provisioning avatars comprises receiving at a first computer system associated with a first user, a metadata file relating to an avatar of a second user. In particular, the metadata file comprises data for use with an avatar generator process that is in execution on the first computer system. Data is extracted from the metadata file, and is provided as input data to the avatar generator process, thereby generating locally to the first computer system the avatar of the second user. The avatar of the second user so generated is displayed to the first user within a virtual environment.

Animated frames may illustrate an animated face that has one or more facial features that change during the animation. Each change may be between a photographed facial feature of a real face and a corresponding drawn facial feature of a drawn face. Various related methods are also disclosed.

The present invention provides video and audio assisted surgical techniques and methods. Novel features of the techniques and methods provided by the present invention include presenting a surgeon with a video compilation that displays an endoscopic-camera derived image, a reconstructed view of the surgical field (including fiducial markers indicative of anatomical locations on or in the patient), and / or a real-time video image of the patient. The real-time image can be obtained either with the video camera that is part of the image localized endoscope or with an image localized video camera without an endoscope, or both. In certain other embodiments, the methods of the present invention include the use of anatomical atlases related to pre-operative generated images derived from three-dimensional reconstructed CT, MRI, x-ray, or fluoroscopy. Images can furthermore be obtained from pre-operative imaging and spacial shifting of anatomical structures may be identified by intraoperative imaging and appropriate correction performed.

A system and method for improving a surgeon's vision by overlaying augmented reality information onto a video image of the surgical site. A high definition video camera sends a video image in real time. Prior to the surgery, a pre-operative image is created from MRI, x-ray, ultrasound, or other method of diagnosis using imaging technology. The pre-operative image is stored within the computer. The computer processes the pre-operative image to decipher organs, anatomical geometries, vessels, tissue planes, orientation, and other structures. As the surgeon performs the surgery, the AR controller augments the real time video image with the processed pre-operative image and displays the augmented image on an interface to provide further guidance to the surgeon during the surgical procedure.

System and methods are provided for augmented reality displays for medical and physiological monitoring. Augmented reality user interfaces are virtually pinned to a physical device, a location, or to a patient. An augmented reality position determination process determines the presentation of user interfaces relative to reference positions and reference objects. Detection of gestures causes the augmented reality users interfaces to be updated, such as pinning a user interface to a device, location, or patient. Looking away from an augmented reality user interface causes the user interface to minimize or disappear in an augmented reality display. An augmented reality gesture detection process determines gestures based on captured image data and computer vision techniques performed on the image data.

A method and system for visually annotating an image. Annotations and notes to images, such as digital medical and healthcare images, may be stored in a structured vector representation alongside image information in a single, non-volatile and portable file or in a separate file from the image. The annotations may be composed of point, line and polygon drawings and text symbols, labels or definitions and captions or descriptions. The annotations may be structured in a manner that facilitates grouping and manipulation as user defined groups. The annotations may be related to an image but not inextricably bound such that the original image is completely preserved. Annotations may further be selectively displayed on the image for context appropriate viewing. The annotations may be retrieved for purposes such as editing, printing, display, indexing and reporting for example, and may be displayed on an image for interactive use with an embedded self-contained user interface.

A method and system for creating a transition between a first scene and a second scene on a computer system display, simulating motion. The method includes determining a transformation that maps the first scene into the second scene. Motion between the scenes is simulated by displaying transitional images that include a transitional scene based on a transitional object in the first scene and in the second scene. The rendering of the transitional object evolves according to specified transitional parameters as the transitional images are displayed. A viewer receives a sense of the connectedness of the scenes from the transitional images. Virtual tours of broad areas, such as cityscapes, can be created using inter-scene transitions among a complex network of pairs of scenes.

A method and system for quantifying a cyclic motion within a series of images depicting a moving object subject to composite motion containing a cyclic component and a non-cyclic component of lower frequency than the cyclic component. Composite motion is computed as well as the non-cyclic component as the integral of motion over a motion cycle. The non-cyclic component is subtracted from the composite motion so as to obtain the cyclic component

Methods of manufacturing a custom arthroplasty resection guide or jig are disclosed herein. For example, one method may include: generating MRI knee coil two dimensional images, wherein the knee coil images include a knee region of a patient; generating MRI body coil two dimensional images, wherein the body coil images include a hip region of the patient, the knee region of the patient and an ankle region of the patient; in the knee coil images, identifying first locations of knee landmarks; in the body coil images, identifying second locations of the knee landmarks; run a transformation with the first and second locations, causing the knee coil images and body coil images to generally correspond with each other with respect to location and orientation.

A method and gesture-based control system for manipulating a 3-dimensional medical dataset include translating a body part, detecting the translation of the body part with a camera system. The method and system include translating a crop plane in the 3-dimensional medical dataset based on the translating the body part. The method and system include cropping the 3-dimensional medical dataset at the location of the crop plane after translating the crop plane and displaying the cropped 3-dimensional medical dataset using volume rendering.

Some configurations of method for reconstructing a volumetric image of an object include obtaining a tomosynthesis projection dataset of an object. The method also includes utilizing the tomosynthesis projection dataset and additional information about the object to minimize a selected energy function or functions to satisfy a selected set of constraints. Alternatively, constraints are applied to a reconstructed volumetric image in order to obtain an updated volumetric image. A 3D volume representative of the imaged object is thereby obtained in which each voxel is reconstructed and a correspondence indicated to a single one of the component material classes.

A method and system for determining fractional flow reserve (FFR) for a coronary artery stenosis of a patient is disclosed. In one embodiment, medical image data of the patient including the stenosis is received, a set of features for the stenosis is extracted from the medical image data of the patient, and an FFR value for the stenosis is determined based on the extracted set of features using a trained machine-learning based mapping. In another embodiment, a medical image of the patient including the stenosis of interest is received, image patches corresponding to the stenosis of interest and a coronary tree of the patient are detected, an FFR value for the stenosis of interest is determined using a trained deep neural network regressor applied directly to the detected image patches.

A system and method in a client-server computing environment is provided for generating and rendering a photorealistic three-dimensional (3D) perspective view of a 3D object selectively positioned within a 3D scene. A client is configured for communicably accessing a server, and includes a client application configured for scene editing and rendering, using a graphical user interface (GUI). The 3D scene may be selectively displayed in a plurality of views, and a 3D object may be retrieved from the server and imported into the 3D scene to generate a composite. The 3D object may also be manipulated within the composite for placement and orientation. A 3D image of the composite may then be rendered at the client and selectively reconfigured in real time. Luminosity characteristics may be applied to the 3D image; followed by rendering a photorealistic 3D view of the composite image.

The systems and methods disclosed herein provide visual feedback concerning one or more scanning parameters to a user during acquisition of a three dimensional scan.

A media integration layer including an application programming interface (API) and an object model allows program code developers to interface in a consistent manner with a scene graph data structure in order to output graphics. Via the interfaces, program code adds child visuals to other visuals to build up a hierarchical scene graph, writes Instruction Lists such as geometry data, image data, animation data and other data for output, and may specify transform, clipping and opacity properties on visuals. The media integration layer and API enable programmers to accomplish composition effects within their applications in a straightforward manner, while leveraging the graphics processing unit in a manner that does not adversely impact normal application performance. A multiple-level system includes the ability to combine different media types (such as 2D, 3D, Video, Audio, text and imaging) and animate them smoothly and seamlessly.

Method, system, and computer program product for implementing derivative operators at an interactive rate in computer graphics systems. In an embodiment, a data structure representing the operation of one or more computer program statements is received by a compiler and transformed into a tree data structure. Nodes of the tree data structure that determine derivative information are marked, and a transform rule is applied to the marked nodes to transform the tree data structure into a data structure that can be implemented with graphics hardware interface program statements. In one embodiment of the invention, the compiler transforms shading language statements into graphics application programming interface statements that can be implemented with multiple passes through a graphics pipeline. It is a feature of the present invention that it can be implemented on a wide range of computer graphics systems.

Systems and methods for balancing a load among multiple graphics processors that render different portions of a frame. A display area is partitioned into portions for each of two (or more) graphics processors. The graphics processors render their respective portions of a frame and return feedback data indicating completion of the rendering. Based on the feedback data, an imbalance can be detected between respective loads of two of the graphics processors. In the event that an imbalance exists, the display area is re-partitioned to increase a size of the portion assigned to the less heavily loaded processor and to decrease a size of the portion assigned to the more heavily loaded processor.

Provided is an environment which enables a user to implement 3D space design on a computer accessible to a server computer via a network. The server computer includes a layout design program which is operable on a screen activated by a browser of the client computer to enable the user to implement space design of a layout in the terms of a 2D image, an object database which stores object data used for layout design for retrieval and extraction, and a 3D display program which is operable on the browser screen of the client computer to display the designed space in the terms of a 3D image. The client computer is equipped with the browser capable of executing programs of the layout design program and the 3D display program. Upon receiving the layout design program and the 3D display program from the server computer via the network, the programs of the layout design program and the 3D display program are executable on the browser screen.