The invention enables multimodal cognitive communications,
collaboration, consultation and instruction between and among heterogeneous networked teams of persons, machines, devices, neural networks, robots and algorithms during various stages of medical
disease management, including detection, diagnosis, prognosis, treatment, measurement, monitoring and reporting. The invention enables both synchronous and asynchronous multiparty
collaboration with multichannel, multiplexed streaming imagery data, including interactive curation, multisensory
annotation and
metadata tagging, as well as multi-formatted encapsulation, saving and sharing of collaborated imagery data as packetized augmented intelligence. The invention acquires both live
stream and archived medical modality imagery from network-connected medical devices, cameras, signals and sensors, as well as multiomic data [phenotypic, genomic, metabolomic, pathomic, radiomic, radiopathomic and radiogenomic] maps and clinical data sets from structured reports and clinical documents, including biometric maps and movies, hapmaps, heat maps and
data stream visualizations. The invention also acquires both medical and non-medical streaming imagery data from image data repositories, documents and structured reports, workstations and mobile devices, as well as from wearable computing, signals and sensors. The invention enables networked teams to interactively communicate, concurrently collaborate and bi-directionally exchange multichannel multiplexed imagery data streams, singly or together, in real time or asynchronously, generally by curating, annotating and tagging imagery information objects. The invention encapsulates and saves collaborated imagery data, together with multisensory annotations and
metadata tags, in standard file formats as packetized augmented intelligence. The invention enables recursive cognitive enrichment of clinical cognitive vismemes, and saves packetized imagery information objects, multisensory annotations and
metadata tags in native file formats [PDF, MPEG,
JPEG,
XML, XMPP, QR,TIFF,
RDF,
RDF /
XML, SVG and DAE] as well as in formats compliant with standards for digital communications in
medicine [
DICOM]. The invention enables live
stream multicasting of multimodal cognitive instruction and
collaborative knowledge exchange with multisensory [visual, auditory, haptic]
annotation of streaming imagery data, as well as secure, encrypted transmission of streaming augmented intelligence across
file sharing data networks for
informatics-enabled learning, specialist skills acquisition and accelerated knowledge exchange.