Integrated credential-based, scalable communications system providing remote access to physical sites

Abstract

A unified credential-based, scalable communications system for providing remote access to a physical site is disclosed. The system includes a dashboard in electronic communication with a server. The server is configured to receive access requests from remote users, assign credentials with access profiles to the remote users, and send authorization requests to the dashboard, which displays the credentials for authorization by an authorization agent. The server is configured to receive live streams from the dashboard module, analyze the live streams based on the access profiles, and, upon authorization by the authorization agent, transmit portions of the analyzed live streams to the remote users. The dashboard is configured for the authorization agent to independently modify the access profiles and credentials and terminate the live streams. The dashboard includes a switch that stops the dashboard from transmitting the live streams to the server.

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of and priority to U.S. Provisional Patent Application No. 63 / 022132, filed May 8, 2020, entitled "Credential-Based Access to an Electronic Meeting System in a Surgical Setting," and U.S. Provisional Patent Application No. 63 / 083604, entitled "Integrated Communication and Training System, Network and Method," both of which are incorporated herein by reference in their entireties.

[0002] The present invention is directed to the field of providing remote access to physical venues. More specifically, embodiments of the present invention relate to an integrated, credential-based, scalable communications system that provides remote access to physical venues by live streams of audio, video, data, or a combination thereof from the physical venue, where access to the live streams is analyzed based on an access profile tailored to the remote user's credentials. [Background technology]

[0003] Current technology allows participants who are physically distant from one another to attend together in electronic forums to some degree, using one or a combination of audiovisual means, via telephone and / or the Internet. Electronic meetings are generally initiated by one entity sending an invitation or direct contact to one or more other entities.

[0004] Such a mode of communication is inefficient in that it does not allow a remote user to participate in an event taking place at a physical location without first being invited or contacted to gain access, and it does not allow such a remote user to be involved in the physical location and have variable and coordinated access to and control over one or more of the audio, video, data, and equipment involved in the event at the physical location.

[0005] Additionally, current technology does not include displaying customizable third party branding and product training capabilities based on participants, particularly remote users and physical location, in electronic meeting systems. Summary of the Invention

[0006] According to various embodiments, the present invention is directed to a dashboard module, an electronic meeting participation system, e.g., an operating room entry system, and a method for providing a remote user with real-time access and a level of control over a physical location, e.g., within an operating room or other clinical room, where the access is based on the remote user's pre-established credentials as a member of a dedicated network that includes at least the remote user and the host's physical location. The present invention enables a duly authorized remote user to gain video-based access to a physical location, e.g., an operating room. Authorized access includes access to visual, audio, data, and other room information with varying levels of visual, audio, augmented / virtual reality, or any combination thereof. Authorized access further includes a degree of control, providing the remote user with the option to take over and direct the operation of equipment at the physical location.

[0007] The dashboard module may provide an in-room visual graphical interface to control access by remote users and, optionally, provide visibility into the information the remote users are viewing or accessing. The electronic meeting participation system includes the dashboard and connected computing, database, and networking capabilities, as well as one or more components of audiovisual in-room presentation screens, cameras, lighting, and other controls.

[0008] In some embodiments, the electronic meeting participation system includes access levels based on remote user credentials, including at least one, and in some instances, two or more levels of certification. In some examples, the system provides multiple levels of certification, including enterprise-level certification, hospital-level certification, and room-level certification. For example, enterprise-level certification may include documentation related to Health Insurance Portability and Accountability Act of 1996 ("HIPAA") compliance, technical field, device / system-specific experience, affiliation with clinical trial studies, etc. Hospital-level certification may include hospital-specific requirements. Room-level certification may include affiliation with a specific surgical team or specialist, or may be left to the discretion of the room leader / communicator. Additional certification levels may exist, including access to room controls, such as camera control, robot control, use of a pointer in the room or on a screen, software control, and 3D access control, as well as training requirements for using the equipment.

[0009] In some embodiments, the electronic meeting participation system includes audiovisual access available to remote users, including a shading function directed based on one or both of a room manager's control or credential-based control within the physical location. The shading function invokes a blurring or distortion of a video feed or portion of the field of view to obscure the remote user's view of all or part of the room environment. In examples where multiple video and / or audio feeds exist, each such feed may be separately controlled such that remote user access is restricted with respect to all or only a portion of such feed.

[0010] In various embodiments, room monitoring and control of access levels is represented in a graphical user interface on the dashboard.

[0011] In one exemplary embodiment, an integrated credential-based scalable communications system provides remote access to a physical venue. The system includes a dashboard module and a remote server control hub in electronic communication with the dashboard module and an external network. The dashboard module includes a computer having a computer processor and computer memory, an electronic display in communication with the computer and driven by the computer, dashboard software encoded in the computer memory, and a communications port configured to receive a live stream of audio, video, data, or a combination thereof from the physical venue. The remote server control hub includes a server processor, server memory, and server software encoded in the server memory. The server software is configured to receive an access request from a remote user, assign a credential having an access profile to the remote user, and send an authorization request to the dashboard module. The dashboard software is configured to receive the authorization request and display it on the electronic display for authorization by an authorization agent. The server software is configured to receive a live stream from the dashboard module, parse the live stream based on the access profile, and, upon authorization by the authorization agent, transmit a portion of the live stream corresponding to the access profile to the remote user over the external network. The dashboard software is configured to independently modify access profiles, modify credentials, and terminate live streams upon command by an authorization agent. The dashboard module includes a switching function that stops the dashboard module from transmitting the live stream to the remote server control hub. The switching function may include electronic switching, physical switching, or both. Physical switching may use a control box that includes at least a mechanical switch that can terminate access to all content feeds from a physical location.The control box may be the hub through which all camera and other equipment feeds are controlled.

[0012] In another exemplary embodiment, a method for providing remote access to a physical venue using a unified credential-based scalable communications system includes providing a remote server control hub and providing a dashboard module for use at the physical venue. The remote server control hub is in electronic communication with an external network comprising multiple network participants. Each of the multiple network participants has an access profile corresponding to pre-established credentials for accessing live content at the physical venue. The multiple network participants include the physical venue and at least one remote user. The dashboard module is operably connected to the remote server control hub and enables the physical venue to control access to the remote server control hub by the at least one remote user over the external network. The method further includes controlling the remote server control hub to activate a connection with the external network and allow live communication between the physical venue and the at least one remote user over the external network. The method includes, upon receiving an access request from a remote user to access the remote server control hub at the physical venue, controlling the remote server control hub to determine remote user credentials applicable to the physical venue based on the remote user's access profile and sending an authorization request to the dashboard module. The method further includes, upon receiving a response to the authorization request from the dashboard module, controlling the remote server control hub to grant or deny access to the remote user, and, if access is granted to the remote user, controlling the remote server control hub to provide the remote user with access to receive live content controlled by the physical venue based on the remote user's credentials.The method further includes controlling the remote server control hub to stream live content to the remote user while simultaneously displaying the live content on the communication port of the dashboard module, the live content comprising a live stream of audio, video, data, or a combination thereof originating from the physical venue. The method further includes controlling the remote server control hub to, upon receiving a command from the dashboard module, suspend some or all of the remote user's live content access credentials, or modify some or all of the remote user's live content access credentials, or terminate the live stream to the remote user when the physical venue is disconnected from an external network.

[0013] Other features and advantages of the present invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, which illustrate, by way of example, the principles of the invention. [Brief explanation of the drawings]

[0014] [Figure 1] 1 illustrates an integrated credential-based, scalable communications system for providing remote access to a physical venue, according to an embodiment of the present invention. As those skilled in the art will appreciate, although this diagram shows a single remote user, there may be any number of possible remote users. [Figure 2] 1 illustrates an individual interacting with a remote user via a unified credential-based scalable communications system according to an embodiment of the present invention.

[0015] Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same parts. DETAILED DESCRIPTION OF THE INVENTION

[0016] According to various embodiments, the present invention is directed to an integrated, credential-based, scalable communications system for providing remote access to a physical site, e.g., an operating room entry system, and method (also referred to as the “system”) for providing remote users with real-time access and control levels within an operating room or other clinical room. Through the present invention, a duly authorized remote user gains video-based or other-based access to a physical location, e.g., an operating room. Authorized access may include access to visual, audio, data, and other room information with various levels of control, and may also provide the remote user with the option to assume control of equipment at the physical location upon on-site authorization. This disclosure is directed to elements of the system in the context of an operating room. However, it is recognized that this is merely exemplary, and the present invention more broadly relates to systems that enable authorized access and control levels to one or more remote users in the context of other physical locations and events, such as, but not limited to, a manufacturing floor, laboratory, or other site.

[0017] In some embodiments, the system includes access levels based on remote user credentials, including at least one, and in some instances, two or more levels of certification in an access profile. In some instances, the system provides multiple levels of certification, including enterprise-level certification, hospital-level certification, and room-level certification. In one example, enterprise-level certification includes documentation regarding HIPAA compliance, technical field, device / system-specific experience, affiliation with clinical trial studies, etc. Hospital-level certification may include hospital-specific requirements. Room-level certification may include affiliation with a specific surgical team or specialist, or may be left to the discretion of the room leader / communicator. Additional certification levels may exist, including access to room controls, such as camera control, robot control, use of a pointer in the room or on a screen, software control, and 3D access control, as well as training requirements for using the equipment.

[0018] In some embodiments, the electronic meeting participation system includes audiovisual access available to remote users that includes a shading function directed based on one or both of a room administrator's control or credential-based control within the physical location, where the shading function invokes a blurring or distortion of a video feed or portion of the field of view to obscure the remote user's view of all or part of the room environment.

[0019] In various embodiments, room monitoring and control of access levels is represented in a graphical user interface on a dashboard module.

[0020] definition

[0021] As used herein, certain terms have the meanings set forth below.

[0022] "Computer" broadly means and includes any machine with a processor, memory, and operating system that is capable of interaction with a user or with other computers, including, but not limited to, desktop computers, notebook computers, laptop computers, servers, tablet computers, handheld computers, smartphones, personal digital assistants, hybrids of any of the above (e.g., Chromebooks), and similar devices that use and / or store data.

[0023] "Local" refers to a relationship between two or more computers / electronic devices, where the devices are physically located in a small geographic area, e.g., a home, office, or building, and communicate with each other over a local network or without a network, e.g., by wired or wireless mechanisms. Remote refers to a relationship that is not local, e.g., communication over a wide area network, a global network, or a combination thereof.

[0024] "Control" means using the system by operating electronic devices to control any one or more audiovisual data feeds, visualizing and / or manipulating text and other images and data, controlling entry and exit from the system, taking over and physically manipulating devices such as one or more cameras, laser pointers, lights, robotic devices, and other equipment and devices controllable by electronic means. The system is contemplated to allow control of one or more programmed levels of rights within the system based on credentials, manual granting / revocation of rights by users at physical locations, and / or by authorized or authorized remote users.

[0025] "Remote Server Control Hub" means a central server (or multiple servers) installed with software used to control and route information (audio, video, and data) based on predefined credentials, algorithms, and active user decisions.

[0026] "Credential" means one or more computer-generated, enterprise-generated, or user-generated variables associated with a given user profile that enable software and / or other users to determine what access and control is granted to a given user or group of users based on one variable or combination of variables.

[0027] "Room" means and refers to any location or locations of personnel, equipment, electronic devices, and other system elements present at a physical location.

[0028] "Participant" means and refers to entities and individuals participating in an electronic meeting, including at least one of each of physical locations and remote users. In some examples, the remote users are affiliated with entities, such as, for example, businesses, and thus businesses are also participants based on representations by the remote users, optionally including the inclusion of logos, branding, and other content provided by such participating businesses.

[0029] "Physical location" means and includes any location where any activity occurs where remote user access may be desired. In a healthcare environment, a physical location may be in a medical facility, including, but not limited to, a hospital. In such an environment, the term operating room broadly includes a room, portion of a room, or series of rooms, such as, but not limited to, an operating room, procedure room, dental chair, catheterization lab, clinic, or radiology suite.

[0030] "Real-time communication" is defined as the near-simultaneous exchange of information from a sender to a receiver over any type of telecommunications service in a connection with negligible or low latency.

[0031] "Remote user" means and includes any person or group of people remote from a physical location. In a healthcare environment, a remote user may be any one of a drug or medical device company representative, a clinician, or any person or group of people affiliated with a similar healthcare entity. In some embodiments, the remote user is a drug or device representative with specialized knowledge, skills, and expertise related to a device or drug or system used in the operating room.

[0032] "Augmented reality" or "mixed reality" means an interactive experience of a real-world environment in which real-world objects are augmented with computer-generated perceptual information, possibly across multiple sensory modalities including vision, hearing, touch, somatosensation, and olfaction.

[0033] "Virtual reality" means a computer-generated simulation of three-dimensional images or environments that can be visually realistic or physically interacted with by humans using specialized electronic devices, such as a helmet with a screen inside or gloves fitted with sensors.

[0034] Integrated credential-based scalable communication system

[0035] 1 and 2 , in one embodiment, a unified credential-based scalable communications system 100 provides remote access to a physical venue 102. The system 100 includes a dashboard module 104, a remote server control hub 106 in electronic communication with the dashboard module 104, and an external network 108. The dashboard module 104 includes a computer 110 having a computer processor and computer memory, an electronic display 112 in communication with and driven by the computer 110, dashboard software encoded within the computer memory, and a communications port 114 configured to receive a live stream of audio, video, data, or a combination thereof from the physical venue 102. The remote server control hub includes a server processor, server memory, and server software encoded within the server memory. The server software is configured to receive access requests from remote users 116, assign credentials with access profiles to the remote users 116, and send authorization requests to the dashboard module 104. The dashboard software is configured to receive the authorization request and display it on the electronic display 112 for approval by the authorization agent 118. The server software is configured to receive the live stream from the dashboard module 104, parse the live stream based on the access profile, and, upon authorization by the authorization agent 118, transmit a portion of the live stream corresponding to the access profile to the remote user 116 via the external network 108. The dashboard software is configured to independently modify the access profile, modify credentials, and terminate the live stream upon command input by the authorization agent 118. The dashboard module 104 includes an electronic or mechanical switching function 120 that stops transmission of the live stream from the dashboard module 104 to the remote server control hub 106.In some embodiments, as shown in FIG. 2, the integrated credential-based scalable communications system includes a control box 110 that includes at least a physical switch 120 operable to terminate access to all content feeds from a physical location.

[0036] The live stream originates from the physical venue 102. However, additional live streams may be routed through the remote server control hub 106 and analyzed by the remote server control hub 106 based on credentials or other criteria originated by one or more remote users 116. Such additional live streams may be routed from a first remote user 116 to one or more other remote users 116, to the physical venue 102, or a combination thereof.

[0037] The physical site 102 may be any suitable location, including, but not limited to, a medical procedure room, operating room, doctor's office, veterinary office, or dental office.

[0038] The access profile may include any suitable credential factors, including, but not limited to, HIPAA regulations applicable to the remote user 116, the technical field of the remote user 116, the medical device-specific experience of the remote user 116, the affiliation of the remote user 116 with a clinical trial study, the hospital certification of the remote user 116, the affiliation of the remote user 116 with a particular surgical team or specialist, or a combination thereof.

[0039] The server software configured to analyze the live stream may include selectively blurring or masking portions of the video live stream.

[0040] The dashboard software may be configured to transmit the live audio stream to an audio output device 122 located at the physical site 102, which is received by the remote user 116 via the remote server control hub 106 once authorized by the access profile provided by the credentials.

[0041] The dashboard software, once authorized by the access profile provided by the credentials, may be configured to transmit commands from the remote user 116 via the remote server control hub 106 for remote operation of one or more local devices 124 located at the physical site. The one or more local devices 124 may include any suitable device, including, but not limited to, a camera, a laser pointer, a lighting device, a robotic device, a surgical instrument, or a combination thereof.

[0042] The system may include at least one camera 126 located at the physical site 102 and connected to the communications port 114 to provide a video live stream to the dashboard module 104 as at least a portion of the live stream. In one embodiment in which the physical site 102 is an operating room, the at least one camera 126 is pointed at at least one of an operating table, a patient, an x-ray screen, a patient's surgical site, or an administrator. The at least one camera 126 may include multiple cameras 126, each of which may be pointed at a different portion of the operating room. The server software may be configured to analyze the live stream by restricting access to the camera feeds from one or more of the multiple cameras 126 in addition to, or instead of, selectively blurring or masking the video live stream from any particular camera 126. In one embodiment, at least one camera 126 has a predetermined field of view having a first portion that is less sensitive (from a privacy or confidentiality standpoint) and a second portion that is more sensitive according to the credential's access profile, and the server software is configured to analyze the live stream by selectively blurring or masking the second portion of the field of view if the credential's access profile authorizes access to the first portion but not the second portion.

[0043] In addition to or as electronic display 112, system 100 may include a monitor 128 that may be ceiling-mounted, wall-mounted, freestanding, or a projector paired with a wall-mounted, ceiling-mounted, or freestanding screen.

[0044] The system may further include at least one microphone 130 located at the physical site 102 and connected to the communication port 114 to provide an audio live stream to the dashboard module 104 as at least part of the live stream.

[0045] The server software may be configured to receive a plurality of access requests from a plurality of remote users 116, assign user-specific credentials having a user-specific access profile to each of the plurality of remote users 116, and transmit a user-specific authorization request for each of the plurality of remote users 116 to the dashboard module 104. The server software serving the plurality of remote users 116 is configured to receive the live stream from the dashboard module 104, parse the live stream based on each user-specific access profile, and, upon authorization by the authorization agent 118, transmit a portion of the live stream corresponding to the user-specific access profile to each of the plurality of remote users via the external network 108.

[0046] The dashboard module 104 may include an environmental scanner 132 that generates a three-dimensional virtual model of the physical site 102 and provides the spatial live stream to the dashboard module 104 as at least a portion of the live stream.

[0047] The dashboard software includes an information module that displays the brand strategy interface on the electronic display 112. The brand strategy interface 134, when activated, invokes a remote user 116 via the remote server control hub 106 with an invitation to submit an access request to the remote server control hub 106. The brand strategy interface 134 may include multiple selection options, and the server software may be configured to invoke a particular remote user 116 from among the multiple remote users 116 that correlates to one of the multiple selection options based on which of the multiple selection options the authorization agent 118 selects.

[0048] In one embodiment where the physical site 102 is a surgical room, the branding interface 134 displays at least one infographic correlated to the surgical product, and at least one selectable icon correlated to the surgical product is activated to invoke a product representative for the surgical product as the remote user 116. The infographic may be any suitable indicia, including, but not limited to, text, a still image, a logo, a video, an icon, or a combination thereof.

[0049] Operating Room Entry System

[0050] In various embodiments, the integrated credential-based scalable communications system is an operating room entry system comprising a software program, a server, audiovisual equipment, or a combination thereof, used to facilitate remote live audio and video feed access of an operating room for technical representatives (remote users) of medical devices and medications during a surgical procedure. The operating room entry system allows hospital staff to grant or deny individual feed access to technical representatives requesting access from within the operating room.

[0051] In some embodiments, the operating room entry system includes a tablet mounted on a wall or floor stand that provides a dashboard for controlling the system.

[0052] In some embodiments, the operating room entry system includes one or more cameras mounted on the ceiling, wall, or surgical gown. In some such embodiments, the system includes a combination of ceiling and wall cameras. In some embodiments, the operating room entry system includes one or more dome-type, bullet-type, puck-type, or web-type cameras. In some embodiments, at least one camera is aimed at the operating table (patient). In some embodiments, at least one camera is aimed at the x-ray screen. In some embodiments, at least one camera is aimed at the (patient) surgical site. In some embodiments, at least one camera is aimed at the communicator / OR manager. In some embodiments, the surgeon wears an earpiece for communicating audio information directly to the surgeon. In some embodiments, the surgeon wears a microphone that allows communication to the user.

[0053] In some embodiments, the operating room entry system includes a ceiling or wall-mounted television or monitor. In some embodiments, the operating room entry system includes a projector. In some embodiments, the operating room entry system includes an external microphone or an internal microphone within the electronic device. In some embodiments, the operating room entry system is wireless, hardwired, or a combination thereof. In various embodiments, the operating room entry system includes a data hotspot that is cellular or satellite-based for data transmission.

[0054] In some embodiments, the operating room entry system allows multiple remote users to access a live audiovisual feed of the same operating room.

[0055] In some embodiments, the operating room entry system allows technical representatives to access multiple medical rooms around the world and the feeds of specific cameras within those rooms.

[0056] In various embodiments, the operating room entry system allows for remote monitoring of all locations and remote users virtually present in central software.

[0057] In some embodiments, the operating room entry system allows hospital staff to selectively interrupt, obscure, or distort audio, visual, or both transmissions from feeds from inside the operating room to all remote users. In some such embodiments, the operating room entry system allows hospital staff or remote users to activate controls from outside the operating room. In some such embodiments, the blocking function therefrom obscures the camera feed and / or TD display rather than blanking it completely.

[0058] In some embodiments, at least one camera in the claim is worn by a person in the room and provides a first-person perspective video feed. In some embodiments, the at least one camera is attached to a person in the form of glasses, a headgear piece, or a body-mounted camera on any person involved in the surgical procedure, i.e., surgeon, surgical technician, anesthesia personnel, radiology personnel, nurses, surgical assistant representatives, etc.

[0059] In some embodiments, the operating room entry system automatically activates functionality to selectively interrupt, obscure, or distort audio, visual, or both transmissions from the operating room feed to all remote users based on authorization.

[0060] In some embodiments, the one or more cameras have pan-tilt or zoom capabilities. Operation of the one or more cameras may be under the control of a remote user. In some embodiments, the system includes one or more 360-degree cameras that generate one or more live 360-degree video streams of the room. In some such embodiments, at least one remote user is authenticated to view one or more room video feeds from glasses, a headset, implantable contact lenses that project live video into their eyes, or video projected into the remote user's room.

[0061] In some embodiments, the operating room entry system provides a technical representative with the ability to remotely change one or all of the camera focus positions within the operating room. In some embodiments, the operating room entry system provides a technical representative with the ability to remotely operate a laser pointer or other target light source physically located within the operating room. In some embodiments, the operating room entry system allows hospital staff to selectively grant that capability within the operating room. In some embodiments, the operating room entry system automatically activates the remote user's remote controls based on credentialing.

[0062] In some embodiments, the operating room entry system includes a lidar camera, lidar technology, or similar environmental scanning technology used in the room to scan the room in real time to generate a virtual environment for use by one or more of the remote users. In some embodiments, the operating room entry system includes splicing together live video feeds from two or more camera feeds to generate a virtual viewpoint for the remote users.

[0063] Workflow

[0064] In accordance with the present disclosure, an integrated credential-based scalable communications system, such as an operating room entry system, allows remote users with valid credentials and keys or significant skills and knowledge to participate in surgery or other interventions and provide expertise, guidance, and assistance to improve or achieve surgical goals. This benefit can be understood by illustrating the workflow enabled by the instant system and method.

[0065] In accordance with the present invention, the disclosed integrated credential-based scalable communications system may be utilized in exemplary embodiments in the context of a surgical procedure at a physical location including an operating room, involving at least one remote user. The following workflows for operating rooms and remote users are merely exemplary; steps may be reordered, certain steps may be omitted, others may be repeated, and additional steps may be added.

[0066] Workflow in the operating room

[0067] Field staff at physical locations (communicators, administrators, surgeons, etc.) a) Enter the room and switch on the operating room entry system b) Enter the code or log in on the tablet interface c) Select one or more remote users in the queue to be allowed access to the feed d) Optionally, each remote user chooses to display their user feed on the room screen for identity verification. e) Controlling audio and video feeds via a tablet interface f) Optionally, "lower the shades" or "raise the shades" as needed (i.e., activate shields for information not automatically implemented by automated certification) g) If specified, allows per-user device control, e.g. laser control h) Remove remote users from the feed as needed i) At the end of the procedure, switch off the system j) Optionally, revalidate the remote user for further action.

[0068] One or more of the above steps may occur in a different order, be omitted, or repeated as desired.

[0069] Workflow for remote users (e.g., surgical device company representatives) a) Log in to the operating room entry system from a remote location b) Select a physical location (operating room) to request access to the feed by queuing up c) Optionally, select multiple locations to have access to the feed d) Deselect the position and remove the remote user from that queue e) Controlling audio and video feeds as permitted during the procedure f) Optionally, if allowed, pan-tilt-zoom the camera g) Optionally, control the laser pointer as permitted. h) Exit the feed when you no longer need it i) Optionally, stay on the feed for further action

[0070] One or more of the above steps may occur in a different order, be omitted, or repeated as desired.

[0071] Example of a traditional in-room medical device representative workflow

[0072] In a typical and / or traditional environment, a medical device company representative would be present in person at the medical procedure to assist or at least guide the medical personnel in the use of the medical devices used in the medical procedure. An exemplary workflow in this environment is provided below in the context of a spinal surgical procedure. This exemplary workflow can be modified in accordance with the present disclosure to accommodate a remote user as a substitute for the medical device company representative in person. a) Check in with the nurse communicator 15-20 minutes before the case begins. Then, inspect the set on the back table with the first assistant. Ensure the set is clean and complete. This includes preparing the instruments for the workflow process related to this case and verifying the size and quantity of grafts. b) Check the size and quantity of bone graft. c) The case begins with a timeout from the nurse communicator (option to lower the shade for the communicator). d) Confirm with the assistant the tap or drill size, graft test, etc. Then (if necessary) prepare the graft size, i.e., cage / screw diameter and length. e)Ensure that the bone graft / biologic is opened, properly prepared and ready for implantation as quickly as possible. f) The surgeon requests the desired implant size (cage or screw size depending on the procedure). The implant cage / screw is then identified and properly assembled into the specific inserter / driver. g) The surgeon implants the cage / screw. h) Visualization of the graft occurs by a representative on the C-arm or microscope screen. i) Graft handling is recorded on a handling sheet. This applies to bone grafts / biologics as well. j) Periodically visually inspect back table and mayo stand for specific equipment as needed or requested. Walk assistant through set in location of said equipment(s) and audibly confirm correct equipment is in hand. k) Repeat steps F through J until the case is complete. l) Once all grafts have been implanted by the surgeon, the nurse communicator will verbally confirm the implantations recorded on the utilization sheet and provide a copy of the utilization sheet.

[0073] A variation on the workflow may consist of a dedicated hospital format, film review prior to the case with the surgeon to confirm the specific graft size, but this is case specific.

[0074] One or more of the above steps may occur in a different order, be omitted, or repeated as desired.

[0075] System Elements

[0076] In various contemplated embodiments, the present invention provides a dashboard as part of an integrated, credential-based, scalable communications system. The dashboard may be embodied on an electronic display of any of a variety of electronic computing devices, including, but not limited to, a tablet or laptop device, or, in some embodiments, on a video monitor in communication with one or more electronic computing devices. The electronic display device may have touchscreen capabilities. The dashboard on the electronic display device may include a graphical user interface (GUI) for presenting information about events occurring at a physical location, such as an operating room, and may include graphical representation features, including, but not limited to, information about clinical subjects, facility or building locations, and information about remote user(s), among others. Interactive virtual buttons and other actuatable images may be included in the GUI to enable activation of features and transitions between various information levels of the GUI.

[0077] Credential-based access to an electronic meeting system, for example in a surgical environment, is achieved based on database content containing information about remote users, which is accessed and analyzed according to an algorithm that establishes the remote user's credentials for one or more access methods or levels. For example, in a healthcare environment, methods for access levels may include specialty level, company level, hospital / medical entity organization level, hospital / medical location level, and room / OR level. Remote user information (analyzed parameters) may include, but are not limited to, education, company affiliation, hospital / medical entity affiliation, technical specialty, training certification, and authorized account status with an organization, location, or medical entity.

[0078] The level of access that may be granted to a remote user based on the algorithm may include audio only, limited audio, visual, or a combination thereof, partially screened / obscured audio, visual, or a combination thereof, full audiovisual access, remote control access to one or more of a laser pointer, camera, lighting, device control, robot, and combinations thereof.

[0079] In some embodiments, authorized access can be overridden, supplemented, suspended, or changed by a user with system control in-room or remotely, or by a user with higher levels of authorized access.

[0080] The system includes a program that operates to enforce authorized access. The program that controls the system of the present invention may be written in any of a variety of programming languages, including low-level, high-level, object-oriented, or non-object-oriented languages. Alternatively, the functionality of the triage data display program may be implemented in whole or in part by computer circuitry and other hardware.

[0081] In various contemplated embodiments, the electronic meeting participation system may be adapted to interface with an electronic health record (EHR) system, such as the Epic Health Record System (Epic Systems, Inc., Verona, Wisconsin). In various contemplated embodiments, all system elements are HIPAA compliant and adhere to the highest security standards on the market.

[0082] The electronic meeting participation system is computer-enabled and computer-implemented. Electronic devices located at each of the physical and remote locations may be on a network and in electronic or wireless communication with one or more server computers. In some embodiments, transmissions are encrypted.

[0083] In various embodiments, the system also includes one or various electronic devices, such as, for example, at least one computer. Each computer may include internal components that may include one or more processors, one or more computer-readable random access memories (RAMs), and one or more computer-readable read-only memories (ROMs) on one or more buses, as well as one or more operating systems and one or more computer-readable tangible storage devices. Programs for instructing the systems of the present invention may be stored in one or more of the computer-readable tangible storage devices for execution by one or more of the processors via one or more of the RAMs. Each of the computer-readable tangible storage devices may be a magnetic disk storage device of an internal hard drive, or a semiconductor storage device such as, for example, a ROM, an erasable programmable ROM (EPROM), a flash memory, or any other computer-readable tangible storage device capable of storing computer programs and digital information. Each internal component set may also include a read / write (R / W) drive or interface for reading from and writing to one or more portable computer-readable tangible storage devices, such as, for example, CD-ROMs, DVDs, memory sticks, magnetic tapes, magnetic disks, optical disks, or semiconductor storage devices. Programs that control the inventive system may be stored on one or more of the portable computer-readable tangible storage devices, read via the R / W drive or interface, and loaded onto a hard drive. Each internal component set may also include a network adapter or interface, such as, for example, a Transmission Control Protocol / Internet Protocol (TCP / IP) adapter card, and content and programs for operating the inventive system may be downloaded to the local computer and / or server computer from an external computer, in some examples, from a control hub, via a network (e.g., the Internet, a local area network, or other wide area network) and the network adapter or interface.The external components may include one or more of a display monitor, a keyboard, and / or a computer mouse.

[0084] In general, electronic devices for the meeting system may include, but are not limited to, a tablet, a smartphone or other media device, a computer, a laptop computer, a desktop computer, a modem, a router, a server, or any combination thereof. In a typical embodiment, the dashboard is displayed on the screen of the field communicator's tablet.

[0085] Integrated Brand Strategy and Training System

[0086] In a typical embodiment, a computer-based electronic meeting system for controlling electronic access to a physical venue additionally or alternatively includes a branding display system, a computer, and a first display interface at the physical venue; a server networked to the branding display system, the computer, and the first display interface; at least one remote user electronic access device remote from the physical venue and capable of network communication with the server, the second display interface; and a data repository accessible by the server. The data repository includes one or more remote user parameters specific to at least one remote user and one or more venue parameters specific to the physical venue. The remote user parameters establish an initial credential profile. The system also includes an application capable of analyzing the remote user parameters and the venue parameters according to an algorithm to select at least one brand or advertisement for display on at least one of the first and second display interfaces, the at least one brand or advertisement being displayed on at least one of the first and second display interfaces.

[0087] In another exemplary embodiment, a method includes a computer receiving a request to join an electronic meeting from a remote user. The method also includes the computer accessing a data repository including one or more remote user parameters specific to the remote user and one or more venue parameters specific to the physical venue. The remote user parameters establish an initial credential profile. The method further includes the computer analyzing the remote user parameters and the venue parameters according to an algorithm to select at least one brand or advertisement for display on a display interface of the remote user or the physical venue. The method still further includes the computer directing the display of the at least one brand or advertisement on the display interface.

[0088] According to various embodiments, a branding display system displays third party branding or advertising on an electronic meeting system with credential-based access.

[0089] According to various embodiments, the branding displayed by the branding display system is a third-party branding customized, for example, based on the credentials of one or more remote users who have credential-based access to the electronic meeting system.

[0090] In an exemplary embodiment, a branding display system facilitates targeted branding display during an electronic meeting within an electronic meeting system. In an exemplary embodiment, the branding is a third-party branding or advertisement, and the third party is not a participant in the electronic meeting. In some embodiments, the branding or advertisement is on one or more displays within an operating room ("OR"). In some embodiments, the third party is not the owner, service provider, or supplier of the monitor. The third-party branding may include advertising activities in the OR.

[0091] The third-party branding may include advertising on one or more of the monitors being used during the electronic meeting. In some embodiments, the third-party branding is displayed on one or more of the remote user's monitors. The third-party branding may additionally or alternatively be displayed on one or more monitors in the operating room. The monitor displaying the advertisement in the operating room may or may not be visible to the remote user via a camera through the remote user's monitor. The branding in the operating room may be the same as or different from the branding on the remote user's monitor. The timing and triggers for what is shown as branding in the operating room may be the same as or different from the timing and triggers for what is shown as branding on the remote user's monitor.

[0092] In a typical embodiment, the presentation or display of branding or advertising is controlled by an electronic meeting system.

[0093] In typical embodiments, the branding or advertising is service-related, product-related, personal-related, or business or corporate-related. The branding or advertising may be in the form of, include, or be associated with text, one or more still images, logos, video, graphics, statistics, data points, or current or updated general information, such as, for example, the current date, the current time, the current weather or forecast, or breaking news. In some embodiments, the branding or advertising includes audio.

[0094] In some embodiments, the branding or advertising includes participant branding. In some embodiments, the participant is given the option to upload or provide a logo to display in association with the participant's name and optionally the participant's contact information. In some embodiments, the logo appears along with the participant's name on an application screen on the communicator's tablet. In some embodiments, the logo appears on a television or display monitor if one or more criteria are met. In some embodiments, the logo is the logo of the company the participant represents. In some embodiments, the logo is the logo of the participant's personal business. In some embodiments, the logo appears next to the participant's name on the communicator's tablet.

[0095] In some embodiments, the branding or advertising includes corporate branding. In some embodiments, the corporate branding is displayed only if one or more criteria are met. In some embodiments, the criteria include the remote user being set as the primary user, the remote user having an uploaded logo file, the remote user being associated with a particular company, and payment of a fee. When the criteria are met, the remote user's corporate logo appears next to the remote user's name on the communicator's tablet. Other displays of the corporate logo may occur if the screen temporarily obscures or goes blank. In some embodiments, available audiovisual information is displayed on a screen in the operating room and / or the remote user's screen. If the remote user is not sharing a camera feed, available audiovisual information may instead be displayed on a screen in the operating room or from associated corporate branding.

[0096] In a typical embodiment, the branding display system allows corporate sponsors to upload a standard corporate logo for all participants associated with the corporate sponsor. In such an embodiment, when the user camera feed is displayed on a television monitor in the operating room, this may include identification and / or contact information about the user as well as product bottom thirds, a news information strip displayed, or athlete statistics and other information displayed across the bottom of the screen during an athlete interview or appearance.

[0097] In some embodiments, branding or advertising is directed to participants on the login page. In some embodiments, branding or advertising on the login page is targeted to participants based on their attributes and / or location.

[0098] In a typical embodiment, pricing for audiovisuals displayed on the operating room screen, such as videos, animations, screensavers, and / or photos, is time-based and / or quantity-based and can be triggered by participants in the room, geography, procedure, date, and words spoken during the e-meeting.

[0099] In an exemplary embodiment, the branding display system allows participants to upload or download information about products used during a surgical procedure.

[0100] In some embodiments, the method provides a remote user with authorized real-time access and control levels within an operating room or other clinical room. The method also selects and directs branding or advertising displayed to the remote user based on the remote user's credentials. This method allows a duly authorized remote user to gain video-based access to a physical location, such as an operating room. Authorized access includes visual, audio, data, and other room information access with various levels of control, and also provides the remote user with the option to take over and direct the operation of equipment at the physical location.

[0101] In some embodiments, the branding display systems and methods are fully automated. In some embodiments, the branding display systems and methods include some initial human intervention while the artificial intelligence accumulates training data and is trained before becoming fully automated.

[0102] In some embodiments, the electronic meeting system includes access levels based on remote user credentials, including at least one, and in some instances, two or more, certification levels. In some instances, the system provides multiple levels of certification, including enterprise-level certification, hospital-level certification, and room-level certification. In one example, enterprise-level certification includes documentation of HIPAA compliance, technical field, device / system-specific experience, affiliation with clinical trial studies, etc. Hospital-level certification may include hospital-specific requirements. Room-level certification may include affiliation with a specific surgical team or specialist, or may be left to the discretion of the room instructor / communicator. Additional certification levels may exist, including access to room controls, such as camera control, robot control, use of a pointer in the room or on a screen, software control, and training requirements for use of equipment, such as 3D access control.

[0103] In some embodiments, the electronic meeting system includes audiovisual access available to remote users, including an occlusion feature directed based on one or both of a room manager's control at a physical location or credential-based control. The occlusion feature invokes blurring or distortion of a video feed or portion of the field of view to obscure the remote user's view of all or part of the room environment. In some embodiments, the branding display system allows brands or advertisements to obscure the remote user's view.

[0104] While the present invention has been described with reference to one or more embodiments, those skilled in the art will recognize that various changes can be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from the essential scope of the invention. Therefore, it is not intended that the invention be limited to the particular embodiment disclosed as the best mode contemplated for carrying out this invention, but rather, it is intended to include all embodiments falling within the scope of the appended claims. Furthermore, all numerical values ​​identified in the detailed description are intended to be understood as both exact and approximations.

Claims

1. 1. An integrated credential-based, scalable communications system for providing remote access to a physical site, the system comprising:

1. A dashboard module, comprising: a computer having a computer processor and a computer memory; an electronic display in communication with and driven by said computer; dashboard software encoded within said computer memory; a communications port configured to receive a live stream of audio, video, data, or a combination thereof, said live stream originating from said physical venue; a dashboard module including: a remote server control hub in electronic communication with the dashboard module and an external network, the remote server control hub comprising: a server processor; Server memory; server software encoded within said server memory; a remote server control hub including: Equipped with the server software is configured to receive an access request from a remote user, assign a credential having an access profile to the remote user, and send an authorization request to the dashboard module; the dashboard software is configured to receive the approval request and display it on the electronic display for approval by an approval agent; the server software is configured to receive the live stream from the dashboard module, parse the live stream based on the access profile, and, upon authorization by the authorization agent, transmit a portion of the live stream corresponding to the access profile to the remote user via the external network; the dashboard software is configured to independently modify the access profile, modify the credentials, and terminate the live stream upon command by the authorization agent; the dashboard module includes a switch that stops the dashboard module from transmitting the live stream to the remote server control hub. system.

2. The system of claim 1 , wherein the physical location is a medical treatment room.

3. The system of claim 2 , wherein the medical procedure room is an operating room.

4. 4. The system of claim 3, wherein the access profile includes at least one credential factor selected from the group consisting of HIPAA regulations applicable to the remote user, the remote user's technical field, the remote user's medical device-specific experience, the remote user's affiliation with a clinical trial study, the remote user's hospital certification, the remote user's affiliation with a particular surgical team or specialist, or a combination thereof.

5. The system of claim 1 , wherein the server software configured to analyze the live stream includes selectively blurring or masking portions of the video live stream.

6. 2. The system of claim 1, wherein the dashboard software is configured to transmit an audio live stream to an audio output device located at the physical site received from the remote user via the remote server control hub upon authorization by the access profile provided by the credential.

7. 2. The system of claim 1, wherein the dashboard software is configured to transmit instructions for remote operation of local devices located at the physical site from the remote user via the remote server control hub when authorized by the access profile provided by the credentials.

8. The system of claim 7 , wherein the local device is selected from the group consisting of a camera, a laser pointer, a light, a robotic device, a surgical tool, and combinations thereof.

9. 10. The system of claim 1, further comprising at least one camera located at the physical site, the at least one camera connected to the communication port and providing a video live stream to the dashboard module as at least a portion of the live stream.

10. 10. The system of claim 9, wherein the physical location is an operating room, and the at least one camera is aimed at at least one of an operating table, a patient, an x-ray screen, a surgical site on the patient, or a caregiver.

11. 11. The system of claim 10, wherein the at least one camera comprises a plurality of cameras, each of the plurality of cameras directed at a different portion of the operating room, and wherein the server software configured to analyze the live stream comprises restricting access to camera feeds from one or more of the plurality of cameras.

12. 10. The system of claim 9, wherein the at least one camera has a predetermined field of view having a first portion that needs less protection and a second portion that needs more protection according to an access profile of the credential, and wherein the server software being configured to analyze the live stream includes selectively obscuring or masking the second portion of the field of view if the access profile of the credential authorizes access to the first portion but not the second portion.

13. 10. The system of claim 1, further comprising a projector paired with a ceiling-mounted monitor, a wall-mounted monitor, a free-standing monitor, or a wall-mounted, ceiling-mounted, or free-standing screen.

14. 10. The system of claim 1, further comprising at least one microphone located at the physical site, the at least one microphone connected to the communication port and providing an audio live stream to the dashboard module as at least a portion of the live stream.

15. 2. The system of claim 1, wherein the server software is configured to receive a plurality of access requests from a plurality of remote users, assign user-specific credentials having a user-specific access profile to each of the plurality of remote users, and send user-specific authorization requests for each of the plurality of remote users to the dashboard module, and the server software is configured to receive the live stream from the dashboard module, analyze the live stream based on each user-specific access profile, and, once authorized by the authorization agent, transmit a portion of the live stream corresponding to the user-specific access profile to each of the plurality of remote users via the external network.

16. 10. The system of claim 1, wherein the dashboard module includes an environmental scanner that generates a three-dimensional virtual model of the physical site, the environmental scanner providing the dashboard module with a spatial live stream as at least a portion of the live stream.

17. 10. The system of claim 1, wherein the dashboard software includes an information module that displays a branding interface on the electronic display, the branding interface, when activated, calls the remote user through the remote server control hub with an invitation to send an access request to the remote server control hub.

18. 20. The system of claim 17, wherein the brand strategy interface includes a plurality of selection options, and the server software is configured to invoke a particular remote user from among a plurality of remote users that correlates to one of the plurality of selection options based on which of the plurality of selection options the authorization agent selects.

19. 18. The system of claim 17, wherein the physical location is a surgical room, the branding interface displays at least one selectable infographic correlated to a surgical product, and activation of the at least one selectable icon correlated to the surgical product invokes a product representative for the surgical product as the remote user.

20. 20. The system of claim 19, wherein the infographic is selected from the group consisting of text, a still image, a logo, a video, an icon, and combinations thereof.

21. 1. A method for providing remote access to a physical site using a unified credential-based scalable communications system, the method comprising: providing a remote server control hub; A dashboard module for use at a physical site, comprising: the remote server control hub is in electronic communication with an external network comprising a plurality of network participants; each of the plurality of network participants having an access profile corresponding to pre-established credentials for accessing live content at a physical venue; the plurality of network participants includes the physical site and at least one remote user; The dashboard module is operably connected to the remote server control hub and enables the physical site to control access to the remote server control hub by the at least one remote user via the external network. And, controlling the remote server control hub to activate a connection with the external network and allow live communication between the physical site and the at least one remote user via the external network; upon receiving an access request from a remote user to access the remote server control hub at the physical venue, controlling the remote server control hub to determine credentials for the remote user applicable to the physical venue based on an access profile of the remote user, and sending an authorization request to the dashboard module; upon receiving a response to the authorization request from the dashboard module, controlling the remote server control hub to grant or deny access to the remote user, and if access is granted to the remote user, controlling the remote server control hub to provide the remote user with access to receive live content controlled by the physical venue based on the remote user's credentials; controlling the remote server control hub to stream live content to the remote user while simultaneously displaying the live content on a communication port of the dashboard module, the live content comprising a live stream of audio, video, data, or a combination thereof originating from the physical venue; upon receiving a command from the dashboard module, controlling the remote server control hub to modify some or all of the remote user's live content access credentials or to terminate the live stream to the remote user when the physical venue is disconnected from the external network; A method comprising:

22. The method of claim 21, further comprising controlling access to content at the physical location by multiple remote users.

Images