Method and system for providing remote visibility into a simulated environment - Patents.com

Abstract

A method for providing remote visibility into a simulated environment includes establishing a connection between a first video conferencing client running on a first computer and a second video conferencing client running on a second computer over a secure public network; receiving at the first computer a first live camera feed encompassing a first portion of the simulated environment over a secure private network, the second computer being located outside the secure private network; displaying in a viewer the first live camera feed and a simulation control interface, a representation of a second portion of the simulated environment, and / or a second live camera feed encompassing a third portion of the simulated environment; and granting visual access of the second video conferencing client to a viewer application through the first video conferencing client.

Description

[Technical field]

[0001] The present invention relates to the field of simulators, and in particular to remote access and / or control of simulators. [Background technology]

[0002] Aircraft simulators are used to train and evaluate pilots and co-pilots such that the humans responsible for training and evaluating the pilots or co-pilots are physically present within the simulator.

[0003] However, it may be desirable to provide third parties, such as existing clients, potential clients, regulatory agencies, and flight instructors, with remote visual access to the simulated environment. This is especially true during a pandemic. Several custom solutions exist that provide such remote visual access to the simulated environment. However, their design and implementation aspects are typically time consuming and / or expensive. Summary of the Invention [Problem to be solved by the invention]

[0004] Thus, there is a need for improved methods and systems that reliably provide remote visibility into a simulated environment. [Means for solving the problem]

[0005] According to a first broad aspect, there is provided a computer-implemented method for providing remote visibility into a simulated environment, the method being executed by a processor and including the steps of: establishing a connection between a first video conferencing client running on a first computer and a second video conferencing client running on a second computer over a secure public network; receiving a first live camera feed at the first computer over a secure private network, the live camera feed encompassing a first portion of the simulated environment and captured by a first camera, the second computer being located outside the secure private network; displaying within a viewer application running on the first computer, at least one of the first live camera feed, a simulation control interface, a computer-generated representation of a second portion of the simulated environment, and a second live camera feed encompassing a third portion of the simulated environment, different from the first portion, captured by a second camera; and granting visual access of the second video conferencing client to the viewer application through the first video conferencing client.

[0006] In one embodiment, the method further includes receiving, at the first computer, a live audio feed from a microphone present in the simulated environment, and transmitting the live audio feed to the second computer through the first video conferencing client over a secure public network to enable the second computer to play back the live audio feed in substantially real time.

[0007] In one embodiment, the method further includes receiving, at the first computer, a live audio feed from the second computer through the first video conferencing client, and transmitting the received live audio feed to a speaker mounted within the simulated environment.

[0008] In one embodiment, the simulation environment includes a flight simulator and a first portion of the simulation environment includes an instrument and control portion of the flight simulator.

[0009] In one embodiment, the at least one video feed includes at least two video feeds.

[0010] In one embodiment, a given one of the at least two video feeds includes an interior portion of a flight simulator, the interior portion of the flight simulator including a screen of the flight simulator displaying an image of a computer-generated environment.

[0011] In one embodiment, the flight simulator includes a motion-based flight simulator, and a given one of the at least two video feeds includes an external portion of the motion-based flight simulator.

[0012] In one embodiment, the viewer application is further configured to provide a view of a simulation control interface of the simulator.

[0013] In one embodiment, the simulation control interface includes an interface for an instructor control station, and the second live camera feed includes the instructor control station.

[0014] In one embodiment, the method further includes receiving a view of the simulation control interface from the simulation engine.

[0015] In one embodiment, the viewer application is further configured to provide a view of an interface of the data analysis platform.

[0016] In one embodiment, the view of the data analysis platform interface corresponds to an image of a display unit on which the data analysis platform interface is displayed, the image of the display being captured by a further camera connected to the private network.

[0017] In one embodiment, the method further includes receiving a view of an interface of the data analytics platform from a server hosting the data analytics platform.

[0018] In one embodiment, the method further includes granting control over the viewer application to the second videoconferencing client.

[0019] In one embodiment, the method further includes granting control over the operating system interface to the second videoconferencing client.

[0020] In one embodiment, the method further includes granting control over an interface of the data analysis platform to the second videoconferencing client.

[0021] In one embodiment, the method further includes receiving an instruction from the first video conferencing client to project a visual indication within the environment and controlling a projector mounted within the simulator to project the visual indication.

[0022] In one embodiment, the method further includes the steps of receiving coordinates of at least one point selected within a given image of at least a portion of the simulated environment, the given image being displayed on a display unit, identifying an area of ​​interest within the simulated environment based on the received coordinates of the at least one point, and remotely pointing to the area of ​​interest within the simulated environment by providing control signals to a projector to visually distinguish the area of ​​interest within the simulated environment.

[0023] In one embodiment, identifying the area of ​​interest in the simulator includes mapping the received coordinates to a pointer area in a coordinate system associated with the projector, and providing the control signal includes generating an overlay image based on the pointer area, the overlay image encompassing the area of ​​interest, and providing the control signal to a projector to project the overlay image on the simulator.

[0024] In one embodiment, mapping the received coordinates to the pointer area includes mapping the received coordinates to at least one given point in a coordinate system of the simulated environment, and mapping the at least one given point to the pointer area in a coordinate system associated with the projector.

[0025] In one embodiment, the method further includes establishing a connection between a first video conferencing client running on the first computer and a second video conferencing client running on the second computer over a telecommunications network and transmitting a given image through the first video conferencing client to the second computer, where the second computer provides the given image for display on a remote display unit, and the step of receiving coordinates includes receiving the coordinates from the second computer through the first video conferencing client over the secure public network.

[0026] In one embodiment, the telecommunications network includes one of a public network, a secure public network, a private network, and a secure private network.

[0027] In one embodiment, providing the control signal includes selecting a projector from among a plurality of available projectors based on the received coordinates, and providing the control signal to the selected projector.

[0028] In one embodiment, providing the control signal includes determining a target position for the projector, the target position ensuring that the area of ​​interest is included within the field of view of the projector, and providing a control signal further indicative of the target position.

[0029] In one embodiment, the method further includes receiving a given image of at least a portion of the simulated environment from a camera located within the simulated environment.

[0030] In one embodiment, the method further comprises generating a given image of at least a portion of the simulated environment.

[0031] In one embodiment, the step of generating a given image is performed using a 3D model of the simulated environment.

[0032] In one embodiment, receiving coordinates includes receiving coordinates for a plurality of points selected within the given image, identifying the areas of interest includes identifying the plurality of areas of interest based on the received coordinates for the plurality of points, and providing control signals includes providing control signals to a projector to visually and simultaneously distinguish the plurality of areas of interest within the simulated environment.

[0033] In one embodiment, the method further comprises selecting at least one characteristic for the pointer area, and the control signal indicates the at least one characteristic.

[0034] In one embodiment, the at least one characteristic includes at least one of shape, intensity, and color.

[0035] According to another broad aspect, a system for providing remote visibility into a simulated environment is provided, the system including: a processor; and a non-transitory storage medium operatively connected to the processor, the non-transitory storage medium including computer readable instructions, the processor, when executing the computer readable instructions, establishes a connection between a first video conferencing client running on a first computer and a second video conferencing client running on a second computer over a secure public network; receives a first live camera feed at the first computer over a secure private network, the live camera feed displaying a first view of a simulated environment; a second computer is located outside the secure private network and configured to display, within a viewer application running on the first computer, at least one of the first live camera feed, the simulation control interface, a computer-generated representation of the second portion of the simulated environment, and a second live camera feed captured by the second camera and encompassing a third portion of the simulated environment different from the first portion, and to allow visual access of the second video conferencing client to the viewer application through the first video conferencing client.

[0036] In one embodiment, the processor is further configured to receive, at the first computer, a live audio feed from a microphone present in the simulated environment and transmit the live audio feed to the second computer through the first video conferencing client over the secure public network to enable the second computer to play back the live audio feed in substantially real time.

[0037] In one embodiment, the processor is further configured, at the first computer, to receive a live audio feed from the second computer through the first videoconferencing client and to transmit the received live audio feed to speakers mounted within the simulated environment.

[0038] In one embodiment, the simulation environment includes a flight simulator and a first portion of the simulation environment includes an instrument and control portion of the flight simulator.

[0039] In one embodiment, the at least one video feed includes at least two video feeds.

[0040] In one embodiment, a given one of the at least two video feeds includes an interior portion of a flight simulator, the interior portion of the flight simulator including a screen of the flight simulator displaying an image of a computer-generated environment.

[0041] In one embodiment, the flight simulator includes a motion-based flight simulator, and a given one of the at least two video feeds includes an external portion of the motion-based flight simulator.

[0042] In one embodiment, the viewer application is further configured to provide a view of a simulation control interface of the simulator.

[0043] In one embodiment, the simulation control interface includes an interface for an instructor control station, and the second live camera feed includes the instructor control station.

[0044] In one embodiment, the processor is further configured to receive a view of the simulation control interface from the simulation engine.

[0045] In one embodiment, the viewer application is further configured to provide a view of an interface of the data analysis platform.

[0046] In one embodiment, the view of the data analysis platform interface corresponds to an image of a display unit on which the data analysis platform interface is displayed, the image of the display being captured by a further camera connected to the private network.

[0047] In one embodiment, the processor is further configured to receive a view of the interface of the data analytics platform from a server hosting the data analytics platform.

[0048] In one embodiment, the processor is further configured to grant control over the viewer application to the second videoconferencing client.

[0049] In one embodiment, the processor is further configured to grant the second videoconferencing client control over the operating system interface.

[0050] In one embodiment, the processor is further configured to grant the second videoconferencing client control over an interface of the data analysis platform.

[0051] In one embodiment, the processor is further configured to receive instructions from the first videoconferencing client to project a visual indication within the environment and to control a projector mounted within the simulator to project the visual indication.

[0052] In one embodiment, the system is further adapted to remotely point to an area of ​​interest within the simulator, and the processor is further configured to receive coordinates of at least one point selected within a given image of at least a portion of the simulated environment, the given image being displayed on a display unit, identify the area of ​​interest within the simulated environment based on the received coordinates of the at least one point, and provide control signals to a projector to visually distinguish the area of ​​interest within the simulated environment.

[0053] In one embodiment, the processor is configured to map the received coordinates to a pointer area in a coordinate system associated with the projector, generate an overlay image based on the pointer area, the overlay image encompassing the area of ​​interest, and provide control signals to the projector to project the overlay image on the simulator.

[0054] In one embodiment, the processor is configured to map the received coordinates to at least one given point in a coordinate system of the simulated environment and to map the at least one given point to a pointer area in a coordinate system associated with the projector.

[0055] In one embodiment, the processor is configured to establish a connection between a first video conferencing client running on a first computer and a second video conferencing client running on a second computer over a telecommunications network and transmit a given image through the first video conferencing client to the second computer, the second computer providing the given image for display on a remote display unit, and receiving the coordinates includes receiving the coordinates from the second computer through the first video conferencing client over a secure public network.

[0056] In one embodiment, the telecommunications network includes one of a public network, a secure public network, a private network, and a secure private network.

[0057] In one embodiment, the processor is further configured to select a projector from among the plurality of available projectors based on the received coordinates, and provide a control signal to the selected projector.

[0058] In one embodiment, the processor is further configured to determine a target position for the projector that ensures that the region of interest is included within the field of view of the projector, and to provide a control signal further indicative of the target position.

[0059] In one embodiment, the processor is further configured to receive a given image of at least a portion of the simulated environment from a camera located within the simulated environment.

[0060] In one embodiment, the processor is further configured to generate a given image of at least a portion of the simulated environment.

[0061] In one embodiment, the processor is configured to generate the given image using a 3D model of the simulated environment.

[0062] In one embodiment, the processor is configured to receive coordinates for a plurality of selected points within a given image, identify a plurality of areas of interest based on the received coordinates for the plurality of points, and provide control signals to the projector to visually and simultaneously distinguish the plurality of areas of interest within the simulated environment.

[0063] In one embodiment, the processor is further configured to select at least one characteristic for the pointer area, and the control signal indicates the at least one characteristic.

[0064] In one embodiment, the at least one characteristic includes at least one of shape, intensity, and color.

[0065] According to a further broad aspect, there is provided a computer program product for providing remote visibility into a simulated environment, the computer program product including a computer readable memory having computer executable instructions stored thereon, which when executed by a processor, include establishing a connection between a first video conferencing client running on a first computer and a second video conferencing client running on a second computer over a secure public network; and receiving at the first computer a first live camera feed over a secure private network, the live camera feed including a first portion of the simulated environment. The method includes: displaying, within a viewer application running on the first computer, at least one of the first live camera feed, a simulation control interface, a computer-generated representation of a second portion of the simulated environment, and a second live camera feed captured by the second camera and encompassing a third portion of the simulated environment different from the first portion; and granting visual access of the second videoconferencing client to the viewer application through the first videoconferencing client.

[0066] In one embodiment, the computer program product is further adapted, when executed by the processor, to remotely point to an area of ​​interest within the simulated environment, and the computer readable memory has further computer executable instructions stored therein that perform the method steps of receiving coordinates of at least one point selected within a given image of at least a portion of the simulated environment, the given image being displayed on a display unit; identifying the area of ​​interest within the simulated environment based on the received coordinates of the at least one point; and providing control signals to a projector to visually distinguish the area of ​​interest within the simulated environment.

[0067] According to yet another broad aspect, there is provided a kit for providing remote visibility into a simulated environment, the kit including the computer program product described above and a pole removably secureable within the simulated environment, the pole including an elongated body having an adjustable length and at least one camera holding device for holding a camera, the camera holding device secureable at a desired position along the elongated body, the camera configurable to capture an image of a desired portion of the simulated environment.

[0068] In one embodiment, the extension body is telescopic.

[0069] In one embodiment, the camera holding device is rotatably securable to the extension body.

[0070] In one embodiment, the camera holding device includes a clamp securable to the extension body and an arm extending between a first end rotatably connected to the clamp and a second end mountable to the camera.

[0071] In one embodiment, the camera holding device further includes a first ball joint mounted between the first end of the arm and the clamp, and a second ball joint mounted at the second end of the arm and securable to the camera.

[0072] Further features and advantages of the present invention will become apparent from the following detailed description taken in conjunction with the accompanying drawings. [Brief description of the drawings]

[0073] [Figure 1] 1 is a flow chart illustrating a computer-implemented method for providing remote visibility into a simulated environment, according to an embodiment. [Diagram 2] FIG. 2 shows an image of an exemplary pole installed in a cockpit, the pole having multiple cameras mounted thereon to capture images of different parts of the cockpit. [Diagram 3] FIG. 13 shows an example image generated by the viewer application and containing six regions. [Figure 4] FIG. 4 illustrates an example videoconferencing client interface with the image of FIG. 3 displayed. [Diagram 5] FIG. 1 is a block diagram illustrating a system for providing remote visibility into a simulated environment, according to an embodiment. [Figure 6] FIG. 1 is a conceptual diagram illustrating an example cockpit of an instrumented aircraft simulator, according to an embodiment. [Figure 7] FIG. 13 is a conceptual diagram illustrating an interface for simultaneously displaying four different images, according to an embodiment. [Figure 8] A conceptual diagram illustrating four interfaces, each of which may be displayed on a respective display unit, according to an embodiment. [Figure 9] 1 is a flow chart illustrating a method for remotely illuminating an area of ​​interest in a simulator, according to an embodiment. [Figure 10] 1 is a flow chart illustrating a method for remotely controlling a projector to illuminate an area of ​​interest in a simulator, according to an embodiment. [Figure 11]FIG. 2 shows an exemplary computer-generated image illustrating portions of a simulator. [Figure 12] FIG. 13 illustrates an exemplary image captured by a camera located within a simulator in which an area of ​​interest is illuminated. [Figure 13] FIG. 1 is a block diagram illustrating a system for remotely controlling a projector to illuminate an area of ​​interest in a simulator, according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0074] It will be noted that throughout the accompanying drawings, like features are identified by like reference numerals.

[0075] In one embodiment, the methods and systems described below may be used in the context of an aircraft simulator for training, for example, pilots and / or co-pilots. An aircraft simulator typically includes a training room that mimics an aircraft cockpit. The training room is typically movable to simulate movements of the simulated aircraft. The training room is equipped with instruments and controls that typically correspond to or mimic real instruments and controls found in the aircraft. The training room is also typically equipped with two seats for a pilot and a co-pilot. Additionally, the training room is typically equipped with an instructor operating station located behind the pilot and co-pilot seats, which allows an instructor to control the simulation and / or monitor the performance of the pilot and co-pilot during the simulation. For example, an instructor may set parameters of the simulation or load a given simulation via the instructor operating station. The instructor operating station may also be used by agents of regulatory agencies, such as the Federal Aviation Administration (FAA), to evaluate pilots and / or co-pilots to renew their certification.

[0076] The typical architecture of an aircraft simulator requires an instructor or agent to be physically present in the simulator's training room to instruct, guide, and / or evaluate the pilot and / or co-pilot during the simulation. However, in some specific circumstances, such as during a pandemic, it may be advantageous to remotely instruct, guide, and / or evaluate the pilot and / or co-pilot during the simulation. To that end, the present method and system provides a third-party human, such as an instructor or agent, with remote visibility or remote visual access to at least a portion of the cockpit or flight deck, including instruments and controls located within the simulator. The present method and system may further enable remote control of the simulation engine by the instructor or agent. The present method and system may also provide communication between the pilot and / or co-pilot and the third party.

[0077] In one embodiment, the technology is implemented using an off-the-shelf video conferencing platform, which allows for quick and / or inexpensive implementation regardless of the location and system used by a third party.

[0078] FIG. 1 illustrates one embodiment of a method 10 for providing remote visibility into a simulated environment. It should be understood that the method 10 is executed by at least one processor. As described above, the simulated environment includes at least instruments and controls at a user's location, such as a pilot, during a simulation. The simulated environment is further provided with at least one camera positioned and oriented to capture at least a portion of the simulator, such as at least a portion of the instruments and controls. The camera is connected to a first computer machine via a private network. The first computer machine is also connected to a second computer machine located outside the private network via a telecommunications network. The second computer machine does not have access to the private network. The first and second computer machines communicate via a videoconferencing platform using the telecommunications network.

[0079] In step 12, the first computer machine receives a first video feed from a camera over the private network. The first video feed includes at least a first portion of the simulator, i.e., the camera captures an image of at least a portion of the interior space of the simulator, and the captured image is transmitted to the first computer machine. For example, the camera may be positioned behind the pilot and co-pilot seats, such that the video feed may include the pilot, the co-pilot, and portions of the cockpit.

[0080] In step 14, the viewer application and the first video conference client are running simultaneously on a first computer machine. The first computer machine includes a first display unit, and the viewer application is configured for displaying the video feeds received in step 12 on the first display unit. For example, the viewer application may be configured for generating an interface for displaying at least one video feed thereon and / or for formatting the video feeds such that they may be displayed on a first display unit connected to the first computer machine. The first video conference client is configured for transmitting and receiving data to and from a second video conference client via a telecommunications network.

[0081] In one embodiment, the first computing machine further receives, at step 12, the simulation control interface, a computer-generated representation of a second portion of the simulator, and / or a second live camera feed captured by a second camera and covering a portion of the simulator different from the portion of the simulator covered by the first video feed. In this case, at step 14, the simulation control interface, the computer-generated representation of the second portion of the simulator, and / or the second live camera feed are displayed within the viewer application in addition to the first video feed.

[0082] It should be appreciated that the viewer application may be configured to display an image, such as a video feed or any image. In one embodiment, the viewer application has the ability to handle a variety of graphic file formats. In one embodiment, the viewer application may be configured to render the image according to display characteristics, such as color depth, display resolution, and color profile.

[0083] In step 16, a second videoconferencing client running on a second computer machine is granted access to the viewer application through the first videoconferencing client running on the first computer machine. As a result, a video feed is transmitted by the first videoconferencing client to the second videoconferencing client over a telecommunications network. As a result, the same image displayed on the first display unit connected to the first computer machine can be displayed remotely on a second display unit connected to the second computer machine, and a third party can have remote visibility into the simulated environment while using the videoconferencing platform.

[0084] In one embodiment, method 10 further includes establishing a connection between a first videoconferencing client running on the first computer and a second videoconferencing client running on the second computer over a secure public network.

[0085] In one embodiment, the first and second video conferencing clients are part of an off-the-shelf video conferencing platform configured to at least transmit a video feed between computer machines participating in the video conferencing session. For example, the off-the-shelf video conferencing platform may be Teams®, Webex®, Google Meet®, or the like.

[0086] It should be understood that the position and orientation of the camera relative to the simulator is chosen depending on the desired view of the simulator. As explained above, the camera may be located inside the simulator. In this case, the position and orientation of the camera may be chosen to capture at least the pilot and a portion of the cockpit. In another example, the position and orientation of the camera may be chosen to capture only a given area or portion of the cockpit. In a further embodiment, the camera may be positioned outside the simulator to capture the outside of the simulator to allow a third party to view the simulator's movements.

[0087] In one embodiment, the position and orientation of the camera is fixed in time. In another embodiment, the position and / or orientation of the camera may change relative to the simulator as different views of the simulator may be captured. In this case, the position and / or orientation of the camera may be controlled by the first computing machine.

[0088] Although the above description refers to a single camera for capturing images of the simulator, it should be understood that multiple cameras can be used to capture images of the simulator. For example, several cameras can be mounted inside the simulator to capture different views of the simulator's interior space. In this case, the position and orientation of each camera mounted inside the simulator is chosen according to the respective desired view of the simulator's interior space. For example, a first camera can be positioned and oriented to capture images of the pilot, co-pilot, and cockpit, and a second camera can be positioned and oriented to capture images of a given part of the cockpit. At least one further camera can be mounted outside the simulator to capture images of at least an external part of the simulator.

[0089] When several views of the simulator are captured by several cameras, step 12 includes receiving, at the first computer machine, video feeds from the cameras over the private network. In one embodiment, the viewer application is configured to select a given one of the received video feeds and provide the selected video feed for display on a first display unit connected to the first computer machine. In another embodiment, the viewer application is configured to select at least two of the received video feeds, generate an image including the two selected video feeds, and provide the generated image for display on a first display unit connected to the first computer machine. For example, a first video feed including an interior portion of the simulator and a second video feed including an exterior portion of the simulator may be received at step 12. Then, at step 14, the viewer application generates an image including a first image from the first video feed and a second image from the second video feed. For example, half of the generated image may correspond to an image of the first video feed and the other half of the generated image may correspond to an image of the second video feed. For example, images from two video feeds may be positioned side-by-side in the generated image, or one on top of the other, etc. The image generated by the viewer application is then transmitted to the first display unit to be displayed thereon. Furthermore, simultaneously with the display of the generated image on the first display unit connected to the first computer machine, the generated image is transmitted by the first videoconferencing client to a second videoconferencing client via a telecommunications network, such that the display of the generated image on the first display unit connected to the first computer machine and the display of the same generated image on the second display unit connected to the second computer machine occur substantially simultaneously.

[0090] For example, an image generated by a viewer application from three video feeds may include three regions with each video feed integrated into them. The top left region of the generated image may be used to display a first video feed captured by a first camera and including the pilot, co-pilot, and instruments and control panels. The top right region of the generated image may be used to display a second video feed captured by a second camera and including pieces of instruments and control panels. The bottom left region of the generated image may be used to display a third video feed captured by a third camera and including a display unit present in the simulator to display a simulated image, e.g., a computer-generated image of the external environment of the aircraft as seen through a window of the real aircraft.

[0091] FIG. 2 illustrates an exemplary pole 50 that may be used to removably mount a plurality of cameras 51 within a cockpit of a simulator. The pole 50 includes an extension 52 extending longitudinally between a first end adapted to abut the cockpit floor and a second end adapted to abut the cockpit ceiling. The length of the extension 52 is adjustable to accommodate cockpits having different heights. For example, the extension 52 may be telescopic. In one embodiment, the extension 52 is equipped with respective rubber pads at the first and second ends to improve the securing of the pole 50 to the cockpit. It should be understood that the extension 52 may have any suitable shape. For example, the extension 52 may have a circular cross-section, a square cross-section, etc.

[0092] The pole 50 further includes a plurality of camera holding devices 54, each of the plurality of camera holding devices 54 mountable at a respective position along the length of the elongated body 52 and configured to have a respective one of the cameras 51 secured thereto. Each camera holding device 54 includes a clamp 60 mountable to the pole 50 and an arm 62 extending between a first end 64 rotatably secured to the clamp 60 and a second end 66 rotatably secured to a respective one of the cameras 51. When mounted to the second end 66 of the arm 62, the respective one of the cameras 51 is then rotatable relative to the arm 62. In one embodiment, the clamp 60 is slidably mounted to the elongated body 52.

[0093] In one embodiment, a first ball joint is connected between a first end 64 of the arm 62 and the clamp 60 to provide rotation of the arm 62 about three axes of rotation relative to the clamp 60. Similarly, a second ball joint is present at a second end 66 of the arm 62 to secure a camera to the arm 62 and provide rotation of the camera about three axes of rotation relative to the arm 62.

[0094] To mount the pole 50 in the cockpit, the length of the extension 52 is adjusted to correspond to the height of the cockpit, i.e. the distance between the cockpit ceiling and the floor. The pole 50 is then positioned in the desired position above the floor with its first end in contact with the cockpit floor and its second end in contact with the cockpit ceiling. As the length of the pole 50 is substantially equal to the distance between the cockpit floor and the ceiling, a compressive force exists between the pole 50 and the cockpit floor and ceiling, which allows the pole 50 to be secured to the cockpit. It should be understood that the pole 50 extends substantially vertically when secured to the cockpit.

[0095] Once the pole 50 is secured to the cockpit at the desired position on the floor, each of the camera holding devices 54 is positioned at a respective desired vertical position along the elongated body 52. ​​Once in the desired vertical positions, clamps 60 are used to fixedly secure each one of the camera holding devices 54 to the elongated body 52. ​​Each one of the cameras 51 is then secured to each camera holding device 54. Alternatively, the cameras 51 may be secured to the camera holding devices 54 prior to positioning the camera holding devices 54 in their desired vertical positions.

[0096] Each of the cameras 51 is then oriented to capture an image of the respective desired view of the cockpit by rotating each respective camera 51 relative to its corresponding arm 62 and / or rotating its corresponding arm 62 relative to its corresponding clamp 60.

[0097] In embodiments in which the elongated body 52 has a cylindrical shape, the clamp 60 is further rotatable about the longitudinal axis of the elongated body 52. ​​In this case, the clamp 60 can be positioned at a desired radial position along the circumference of the elongated body 52 prior to securing the clamp to the elongated body in order to properly orient each one of the cameras 51.

[0098] It should be understood that the pole 50 may be removably secured within the cockpit in any suitable position that allows capture of a desired view of the cockpit by the camera 51. In one embodiment, the pole 50 is secured in a suitable position within the cockpit that allows the pilot and co-pilot to access their respective seats and / or to easily leave the cockpit in case of an emergency.

[0099] In one embodiment, the pole 50 is secured within the simulated area of ​​the cockpit. For example, the pole 50 may be secured forward of a center pedestal of the cockpit, such as between the pilot and co-pilot seats. In another example, the pole 50 is secured to the rear of the pilot and co-pilot seats, facing the center pedestal.

[0100] In one embodiment, the poles 50 are mounted at positions within the cockpit such that the distance between each of the cameras 51 mounted on the poles 50 and its respective portion of the cockpit to be imaged ranges from about 4 feet to about 6 feet.

[0101] It should be understood that the number of camera holding devices 54, and therefore the number of cameras 51, can be variable so long as the pole 50 includes at least one of the camera holding devices 54. In one embodiment, the pole 50 includes at least three of the camera holding devices 54. In this case, a first one of the camera holding devices 54 can be configured to have one of the cameras 51 mounted thereon to provide a first video feed encompassing a center pedestal of the cockpit. A second one of the camera holding devices 54 can be configured to have one of the cameras 51 mounted thereon to provide a second video feed encompassing an overhead instrument panel. A third one of the camera holding devices 54 can be configured to have one of the cameras 51 mounted thereon to provide a third video feed encompassing a pilot instrument panel. An additional one of the camera holding devices 54 can be provided such that the additional one of the cameras 51 provides a video feed of other portions of the cockpit, such as a video feed encompassing a co-pilot instrument panel, the pilot when in the pilot's seat, the co-pilot when in the co-pilot's seat, a display unit, etc.

[0102] In some embodiments, the method 10 further provides for remote access to a simulation control interface of the simulator, such as an interface of an instructor operating station. The simulation control interface of the operating system provides for exchanging data with a simulation engine that generates the simulation. For example, the simulation control interface can be used to set and display parameters for the simulation. In one embodiment, the first computing machine communicates with the simulation engine over a private network, and the simulation engine transmits the simulation control interface directly to a viewer application. The viewer application combines the simulation control interface with a video feed received from the camera to display an image including both the video feed and the simulation control interface on the first display unit. For example, two side-by-side sections of the generated image can be used to display the simulation control interface and the video feed, respectively.

[0103] As explained above, the operating system interface may be received by the viewer application from the simulation engine, while other embodiments are possible. For example, the simulation control interface may be displayed on a further display unit separate from the first display unit, for example a display unit provided on an instructor station in the simulator, and a camera captures an image of the further display unit to provide a video feed containing the control interface. The video feed containing the simulation control interface is then sent to the viewer application, which generates an image using the video feed containing the simulation control interface and the video feed containing parts of the simulator.

[0104] In one embodiment, images generated by the simulation engine may also be transmitted to the first computer machine, such that a viewer application combines them with at least one video feed and, optionally, an operating system interface.

[0105] In one embodiment, the first computing machine is connected over a private network to a server hosting a data analysis platform. The data analysis platform stores the user's historical interactions with the second computing machine, such as the amount of time the user spent on a given view, the location of user clicks relative to the image displayed on the second display unit, etc. In this case, method 10 further provides for remote access to an interface of the data analysis platform.

[0106] In this embodiment, the first computing machine transmits the data analysis platform interface directly to a viewer application, which combines the data analysis platform interface with the video feed received from the camera to display an image including both the video feed and the data analysis platform interface on the first display unit.

[0107] As explained above, the data analysis platform interface may be received by the viewer application directly from a server hosting the data analysis platform, while other embodiments are possible. For example, the data analysis platform interface may be displayed on a further display unit separate from the first display unit, and a further camera may capture an image of the further display unit to provide a video feed including the data analysis platform interface. The video feed including the data analysis platform interface is then transmitted to the viewer application, which generates an image using the video feed including the data analysis platform interface and the video feed including a portion of the simulator.

[0108] FIG. 3 illustrates an exemplary image resulting from the combination of six different images or video feeds implemented by a viewer application. The illustrated image is divided into six equal regions, each region used to display a respective image or video feed thereon. At the top right, an image of an instructor operating system interface is displayed. At the top middle, a video feed encompassing an upper portion of the simulator is displayed. At the top right, a simulated image of the external environment of the aircraft is displayed. At the bottom left, a video feed encompassing an external portion of the simulator is displayed. At the bottom middle, a video feed encompassing a first portion of the cockpit is displayed. At the bottom right, a video feed encompassing a second portion of the cockpit is displayed.

[0109] The image illustrated in Figure 3 is transmitted by the first videoconferencing client to the second videoconferencing client over a telecommunications network. Figure 4 illustrates an exemplary interface of the second videoconferencing client displayed on a second display unit of a second computing machine. The illustrated interface includes the image generated by the viewer application and transmitted to the second videoconferencing client, and further includes icons below the image, each icon corresponding to a respective participant to the videoconferencing session.

[0110] For example, the image generated by the viewer application may combine seven video feeds and a simulated image. The image generated by the viewer application may be divided into four regions. The top left region may be used to display six different video feeds, each covering a respective portion of the simulator. The top right region of the image may be used to display a video feed covering a portion of the command and control panel. The bottom right region of the image may be used to display a simulated map with overlaid aircraft positions. The bottom left region of the image may be used to display a magnified version of one of the six images displayed in the top left. For example, by double clicking on one of the six video feeds displayed in the top left, the selected video feed is magnified and displayed on the bottom left region.

[0111] In one embodiment, the method 10 further includes transmitting audio signals between the first video conference client and the second video conference client over a telecommunications network. In one embodiment, at least one microphone and / or at least one speaker may be present in the simulator to capture sound and / or emit audio signals. The microphone and speaker are in communication with the first computing machine. For example, the microphone and speaker may be connected to the first computing machine over a private network. In another example, Bluetooth® communication may be used between the first computing machine and the microphone and / or speaker.

[0112] When the microphone is located within the simulator, the microphone captures sounds emitted within the simulator and an audio feed is transmitted by the microphone to the first computer machine. The received audio feed is then transmitted by the first video conference client to the second video conference client over a telecommunications network during the video conference session. It should be understood that at least one speaker is provided on the second computer machine for playing the received audio feed so that a third party can hear the sounds generated within the simulator.

[0113] Similarly, the second computer machine may be provided with a microphone for capturing audio, and a corresponding audio feed is then transmitted by the second videoconferencing client to the first videoconferencing client over a telecommunications network. The first computer machine then receives the audio feed from the second computer machine and transmits the audio feed to a speaker present in the simulator.

[0114] Thus, voice communications may be established in substantially real time between the pilot and / or co-pilot present within the simulator and a remotely located third party via a videoconferencing session, where the third party may send vocal commands or comments to the pilot and co-pilot, while listening to any discussions between the pilot and co-pilot, in addition to listening to noises within the simulator.

[0115] In one embodiment, the pilot and co-pilot are each provided with a respective headset connected to the first computer machine, in another embodiment, at least one microphone may be provided within an internal portion of the simulator, such as between the pilot and co-pilot, to capture audio within the simulator, and at least one speaker may be provided within an internal portion of the simulator.

[0116] In one embodiment, the method 10 may provide visual communication between a third party and a pilot. For example, the third party may enter a command / request / instruction, such as text, an image, a diagram, etc., into a second computing device. The command is transmitted by the second videoconferencing client to the first videoconferencing client over a telecommunications network. Upon receiving the command, the first computing device transmits the received command to a display unit located within the simulator to inform the pilot and / or copilot of the command. For example, the command may be displayed on a display unit included in an instrument and control panel of the simulator. In another embodiment, the display unit may include a projector configured to project the command within the simulator for informing the pilot and / or copilot.

[0117] In one embodiment, the viewer application running on the first computer machine may be remotely controlled by a second computer machine via a videoconferencing platform. In this case, the method 10 further includes allowing a second videoconferencing client control over the viewer application via the first videoconferencing client. In this case, a third party may enter commands in the second videoconferencing client. In doing so, the third party may interact with an interface of, for example, an instructor operator station of the simulator. When input is entered into the second videoconferencing client of the second computer machine, the input is transmitted by the second videoconferencing client to the first videoconferencing client over a telecommunications network. The input is then received by the viewer application configured to execute the command. For example, when it detects a mouse click, the second videoconferencing client may determine a cursor position within an image displayed by the second videoconferencing client. The second video conferencing client then transmits the cursor position to the first video conferencing client, which transmits the received cursor position to the viewer application. The viewer application interprets the received cursor as a mouse click at the same position in the image generated by the viewer application. For example, if the cursor position corresponds to a button on the interface of the instructor-operator station, the viewer activates the button, i.e., it sends a command to the simulation engine indicating that the identified button should be activated. A third party may interact with the interface of the data analysis platform.

[0118] In one embodiment where the first and second video conferencing clients are part of an off-the-shelf video conferencing platform, existing features such as "Give control" and "Take control" may be used to grant the second video conferencing client control over the viewer application. The second video conferencing client may then be granted control of the operating system interface and / or the data analysis platform interface.

[0119] It should be understood that the above-described method 10 is embodied as a system for providing remote visibility into a simulated environment, the system including at least one processor and a non-transitory storage medium operatively connected to the processor, the non-transitory storage medium including computer-readable instructions, and the processor configured to perform the steps of method 10 upon execution of the computer-readable instructions.

[0120] It should also be understood that the method 10 described above may be embodied as a computer program product that provides remote visibility into a simulated environment, the computer program product including a computer-readable memory having computer-executable instructions stored thereon that, when executed by a processor, perform the method steps of method 10.

[0121] 5 illustrates one embodiment of a system 100 for providing remote visibility into a simulated environment. The system 100 may be used to perform the method 10.

[0122] The system 100 includes a simulation environment or simulator 102, a private location 102, and a remote location 104. The simulator 102 includes at least instruments and controls (not shown) with which a user of the simulator 102 interacts to perform a simulation, at least one camera 110 for capturing images of at least a portion of the simulator 102, such as at least a portion of the instruments and controls, at least one speaker 112 positioned within the simulator 102, and at least one microphone 104 positioned within the simulator 102.

[0123] The private location 104 includes a first computer machine 120 and a first display unit 122 connected thereto. A viewer application and a first videoconferencing client are running simultaneously on the first computer machine. The first computer machine 120 is in communication with the camera 110, the speaker 112, and the microphone 114 of the simulator 102. The camera 110 is connected to the computer machine 120 via a private network. In one embodiment, the speaker 112 and the microphone 114 are also connected to the computer machine 120 via a private network. In another embodiment, wireless communication such as Bluetooth® communication may be used to connect the first computer machine and the speaker 112 and the microphone 114 as described above. In this case, it should be understood that the private location 122 is located in close proximity to the simulator to enable wireless communication between the speaker 112 and the microphone 114 and the first computer machine 120.

[0124] The remote location includes a second computer machine 130, a second display unit 132, a speaker 134, and a microphone 136. A second videoconferencing client is running on the second computer machine 130. Data may be exchanged between the first videoconferencing client running on the first computer machine 120 and the second videoconferencing client running on the second computer machine 130 via a telecommunications network 138. It should be understood that the second computer machine 130 does not have access to the private network 124.

[0125] As described above, a viewer application running on a first computing machine 120 receives a video feed from a camera 110 over a private network 124 and provides the video feed for display on a first display unit 122. In addition, the viewer application transmits the video feed to a first video conferencing client, which transmits the video feed to a second video conferencing client over a telecommunications network 138.

[0126] A second video conferencing client running on a second computer machine 130 receives the video feed from the first video conferencing client and transmits the received video feed for display on a second display unit 132.

[0127] The speaker 112 and microphone 114, and the speaker 134 and microphone 136, as described above, enable audio communication between the simulator environment 102 and the remote location 106. Any audio signals captured by the microphone 114 are transmitted over the telecommunications network 138 via the first and second video conference clients to the first computer machine 1210 and then to the second computer machine 130. The audio signals are then played back by the speaker 134. Similarly, any audio signals captured by the microphone 136 are transmitted over the telecommunications network 138 via the first and second video conference clients to the first computer machine 120. The first computer machine 120 then transmits the received audio signals to the speaker 112, which plays the audio signals.

[0128] In one embodiment, the system 100 further includes a simulation engine 140 that generates a simulation for the simulator 102. The simulation engine 140 is in communication with the first computing machine 120 over the private network 124. The simulation engine 140 is configured to transmit an operating system interface to the first computing machine 120 over the private network 124. A viewer application running on the first computing machine 120 receives the simulation engine 140 interface and generates an image that includes the video feed received from the camera 110 and the operating system interface. The viewer application then transmits the generated image to be displayed thereon to the first display unit 122 and the first videoconferencing client, which transmits the image to the second videoconferencing client as described above.

[0129] In one embodiment, system 100 further includes a data analysis platform hosted on a server 142 connected to the private network. Server 142 is configured to transmit an interface of the data analysis platform to first computing machine 120 over private network 124. A viewer application running on first computing machine 120 receives the interface of the data analysis platform and generates an image including the video feed received from camera 110 and the interface of the data analysis platform. The viewer application then transmits the generated image to be displayed thereon to first display unit 122 and the first video conferencing client, which transmits the image to the second video conferencing client as described above.

[0130] As described above, commands / requests may be sent from the second computing machine 130 to the first computing machine 120 via the first and second videoconferencing clients over the telecommunications network 138. For example, a predefined input entered into the second computing machine 130 may be recognized as a command and sent to the view application of the first computing machine 120. For example, a mouse click or actuation of a given key of a user interface connected to the second computing machine 130 may be identified as a command. In this case, the second videoconferencing client sends the command to the first videoconferencing client and the viewer application executes the command.

[0131] As described above, in embodiments in which the first and second videoconferencing clients are part of an off-the-shelf videoconferencing platform, control of the viewer application may be granted to the second computing device using predefined functionality of the off-the-shelf videoconferencing platform.

[0132] FIG. 6 illustrates an exemplary cockpit of an aircraft simulator. The simulator: a main instrument panel including a pilot instrument panel and a co-pilot instrument panel; a central pedestal located between the pilot and co-pilot seats; an overhead instrument panel; at least one display unit for displaying the simulation image thereon; Two front cameras positioned in front of the pilot and co-pilot, three rear cameras positioned behind the pilot and copilot and each oriented to capture a full view of the pilot instrument panel, the copilot instrument panel, and the cockpit; an upward looking camera positioned and oriented to image an overhead instrument panel; a downward looking camera positioned and oriented to image the central pedestal; an external camera for imaging an external portion of the simulator; Two projectors positioned behind the pilot and co-pilot to display images inside the cockpit; two microphones, each positioned on an opposite side of the main instrument panel; a central microphone positioned on the pedestal; two speakers, each positioned on an opposite side of the main instrument panel; and a center speaker positioned on the pedestal.

[0133] The camera, microphone and speaker, and the projector are all in communication with the first computer machine. The video feed captured by the camera is received by a viewer application that generates an image combining the received video feeds, and the generated image is transmitted by the first video conference client to the second video conference client and to the first display unit. The audio feed received from the microphone is also transmitted by the first video conference client to the second video conference client. Any audio feed received by the first video conference client from the second video conference client is transmitted to the speaker for playback. Any visual instructions, such as text or images, received by the first video conference client from the second video conference client are transmitted to at least one of the two projectors for display within the cockpit. As described in more detail below, the projector may be used to display images on different instrument panels to point to specific instruments.

[0134] In one embodiment, the pilot and copilot may each be provided with a headset connected to the first computer machine, in which case the speaker and microphone described above may be omitted.

[0135] It should be understood that some of the components of the simulator illustrated in Figure 6 may be omitted or other components may be added, and it should be understood that the positions and orientations of the components are merely exemplary.

[0136] 7 illustrates an exemplary visual interface generated by a second videoconferencing client. Using this interface, a user of the second computing machine can select the interface video feeds and images the user desires to view. At the top left of the visual interface, the user can select the layout of the displayed images. For example, the user can select to display a single video feed or interface image, two different video feeds or interface images positioned side-by-side, four video feeds or interface images, or six video feeds or interface images.

[0137] The top control bar contains boxes that indicate which video feeds and interface images are available. In this example, five different video feeds and four different interface images are available. In the illustrated example, since the layout contains four windows, the user may select four items from the available video feeds and interface images that will each be displayed in a respective window.

[0138] 8 illustrates an exemplary setup when four display units are connected to a second computer machine. In this embodiment, each display unit is provided with an identical visual interface by the second videoconferencing client. A user may select different layouts for different display units. In the illustrated embodiment, three display units display an interface including a single window each displaying a single video feed or interface, and a fourth display unit displays an interface including four windows displaying four different video feeds or interfaces therein.

[0139] While the above methods and systems are described in the context of a flight or aircraft simulator, it should be understood that they may be used for other types of simulators.

[0140] In embodiments where the simulator is already provided with integrated cameras, microphones, and speakers, the already existing cameras, microphones, and speakers may be used to implement the present techniques.

[0141] In one embodiment, the camera used to image at least a portion of the simulator is an Internet Protocol (IP) camera adapted for streaming of captured images. In one embodiment, the camera is a color camera with low light sensitivity. In one embodiment, the camera is provided with a zoom to adjust its field of view. In this case, the field of view can be controlled from the first computer machine or the second computer machine. In one embodiment, the camera can be mounted such that it does not move with the buffet up to 3G. In one embodiment, the camera supports a minimum resolution of 1080 pixels and 30 frames per second, and / or supports RTSP (streaming protocol) and H.264 compression.

[0142] In one embodiment, the camera is a Panasonic® WV-S1131. In another embodiment, the camera is a miniature camera, such as an Axis camera. For example, the camera may be a pen camera or a pinhole camera with a wide field of view, such as better than 90 degrees, and excellent low light characteristics. Such miniature cameras may be used where a larger camera would be obtrusive or too intrusive.

[0143] In one embodiment, the camera is mounted on a custom made or custom assembled bracket that is specific to each cockpit to maximize the view and minimize the level of intrusion. When it is a miniature camera, the camera can be mounted either in the Main Instrument Panel (MIP) or in the Glare Shield Control Panel (GCP).

[0144] In one embodiment, a dedicated segment is created within a private network to prevent operation of the system from affecting the overall operation of the simulator.

[0145] In one embodiment, a Virtual Private Network (VPN) is used to communicate with the simulator over a Wide Area Network (WAN). VPN allows tunneling through various network firewalls / routers / switches to ensure good performance. Password protection is provided via standard VPN procedures. In one embodiment, there may be no encryption or VPN when running the system on a Local Area Network (LAN).

[0146] In one embodiment, the camera is connected to an on-board router to access a dedicated segment of the simulator network, and a first computer machine connects to the segment to receive the video feed from the camera.

[0147] In one embodiment, a first computer machine has simultaneous access to a simulator network and the Internet for managing bidirectional communication between the simulator and a second computer machine. The first computer machine acts as a bridge between the Internet and the simulator network, and the bridge prevents the second computer machine from having direct access to the simulator network. The second computer machine may belong to, for example, a client or a regulated entity.

[0148] In one embodiment, an application, such as a viewer application, may run locally on a processor of the first computing machine and the first videoconferencing client may run at least partially in the cloud, hi another embodiment, the application may run primarily in the cloud.

[0149] In one embodiment, the first computing machine is located on-board and enables a wired connection to a conference speaker. In one embodiment, the first computing machine can be co-located with the simulator when the first computing machine is located adjacent to the simulator, such as when the first computing machine and the simulator are located in the same building, or when the first computing machine is located remotely from the simulator, such as when the first computing machine and the simulator are located in different buildings.

[0150] The first and second computing machines may be any device provided with at least one processor, memory, and communication means, for example, the first or second computing machine may be a laptop, a desktop, a tablet, a smartphone, etc.

[0151] In one embodiment, the management of audio within the system described above involves three aspects: 1) Simulated ambient cockpit sounds, such as engine noise, external airflow, aerodynamic hiss, and mechanical sounds such as gear and flap deployment; 2) Radio communications simulating, for example, conversations between air traffic control and flight crew; 3) Take into account crew-instructor communication, which is a natural part of the instruction process.

[0152] In embodiments in which the pilot and / or co-pilot are provided with headsets, the pilot or co-pilot hears communications and interactions through the headset, ambient sounds are generated by the simulator sound system, and the pilot's voice is captured by the headset microphone.

[0153] In embodiments where the pilot and / or co-pilot are provided with headsets, special microphones are installed at key locations along with additional speakers that may be connected to a digital signal processing system to eliminate echo and ambient noise. Simulated aircraft sounds are generated by the simulator sound system.

[0154] In one embodiment, the following six views are available: Pilot's main instrument panel; Copilot's main instrument panel, The central pedestal and Overhead panel and A close-up of one of the primary flight displays; At least six different cameras are used, each one capturing an over-the-shoulder view between the two pilots as well as a view with an instructor leaning forward from behind them. Such views provide an overall wide angle that encompasses the instruments, out-of-window vision, and the pilots.

[0155] In one embodiment, a camera mounted unobtrusively in the main instrument panel facing rearward provides a view of the pilot's face / reactions.

[0156] In one embodiment, the data analytics platform is hosted in the cloud, and the analytics data can either be downloaded to a simulator for viewing, such as for instance simulators with limited internet connectivity, or the analytics data can be viewed directly from the cloud.

[0157] Below, methods and systems are described for remotely operating at least one projector to point to an area of ​​interest in a simulator. In one embodiment, the methods described below may be used in conjunction with the system 100 described above to enable a user, such as the third party described above, to remotely operate a projector to point to an area of ​​interest in a simulator via a video conferencing platform.

[0158] The methods and systems described below attempt to replicate some of the interaction that exists between an instructor and a pilot / co-pilot when the instructor is physically present in a simulator with the pilot / co-pilot. During such training, when the instructor is physically present in the simulator, the instructor is typically required to point out certain aspects of aircraft system operation and / or content on one or more multifunction displays.

[0159] The conventional method adopted requires the instructor to move forward towards the pilot / co-pilot or point from a seated position with the seat belt fastened as a safety precaution for aircraft simulators equipped with a movement system. However, in some circumstances, such as during a pandemic, it may be advantageous for the instructor to be located remotely, i.e. outside the simulator, for example to reduce contamination risks.

[0160] FIG. 9 illustrates one embodiment of a method 150 for remotely pointing to an area of ​​interest within a simulator or simulated environment. It should be understood that the method 150 is performed by a computing machine provided with at least one processor, at least one memory, and a communication interface. The method 150 allows a user, such as an instructor, not present within the simulator to visually interact with a human, such as a pilot or co-pilot, located within the simulator by remotely pointing to a given area of ​​interest within the simulator. As described below, the method 150 may be performed via a video conferencing platform over a secure public network.

[0161] At step 152, an image of at least a portion of the simulator is provided by the first computing machine for display on a remotely located display unit. The image represents at least a portion of the interior of the simulator, such as at least a portion of the cockpit, and at least a portion of the instruments and controls.

[0162] In one embodiment, the images are captured by at least one camera mounted within the simulator. For example, a single camera movable within the simulator may be used to capture a view of the interior of the simulator. In another example, a single camera having a fixed position and / or orientation may be used to capture a view of the interior of the simulator. In a further example, multiple cameras, each having a fixed position and orientation, may be mounted within the simulator. The image provided for display in step 150 may correspond to an image captured by a given camera. In another embodiment, the image may result from a combination of multiple images captured by multiple cameras. In this case, method 150 further includes combining the multiple images received together from different cameras to obtain a single image.

[0163] In another embodiment, the image provided for display in step 152 may be a simulated or computer-generated image of at least a portion of the interior of the simulator. In one embodiment, the image may be a three-dimensional (3D) image of at least a portion of the simulator. In this case, method 150 further includes generating an image of at least a portion of the interior of the simulator.

[0164] The images are transmitted by the first computer machine over a communications network to a second or remote computer machine located outside the simulator. For example, the communications network may be a secure private network. In another example, the communications network may be a public network such as the Internet. The remote computer machine is connected to a user interface for inputting commands to the remote computer machine and to a display unit for displaying the received images of the simulator thereon.

[0165] When the received image of the simulator is displayed, a user of the remote computer machine may select at least one point on the displayed image using any suitable user interface, such as a mouse, keyboard, stylus, etc., when the display unit includes a touch screen.

[0166] In one embodiment, a single point is selected on the displayed image of the simulator. In another embodiment, multiple points are selected by a user. The multiple points may be discrete, i.e., the selected points may be spaced apart from one another. Alternatively, the points may be adjacent to form a continuous geometric shape, such as a line, circle, square, etc.

[0167] It should be understood that any suitable method of selecting at least one point on an image may be used. For example, a mouse may be used to move a cursor over the desired points, a right or left click on the mouse may be used to generate a click event and select the desired points, or a keyboard key may be pressed to select the desired points. In another example, multiple points may be selected by right or left clicking on the mouse while moving the mouse to move the cursor over the desired points. In a further example, a user of a remote computer machine may drag over the displayed image to select a point or multiple points.

[0168] The coordinates of a selected point within the displayed image are captured by the remote computer machine and transmitted over a communications network to the first computer machine.

[0169] It should be understood that when the remotely displayed image is a 2D image, the captured coordinates are 2D coordinates, and when the remotely displayed image is a 3D image, the captured coordinates are 3D coordinates.

[0170] In step 154, the position of the selected point within the remotely displayed image is received, ie, the coordinates of the selected point are received by the first computer machine over the communications network.

[0171] In one embodiment, the first and remote computer machines are connected via a public secure network, the first computer machine is provided with a first video conferencing client, and the second computer machine is provided with a second video conferencing client, in which case the coordinates of the selected point are transmitted to the first computer machine through the second video conferencing client and received by the first computer machine through the first video conferencing client.

[0172] In step 156, an area of ​​interest located on the simulator is identified based on the received coordinates of the selected point. For example, if a user of a remote computer machine selects a given button or actuator displayed on the image, step 156 consists in identifying an area of ​​interest on the simulator that includes the selected button or actuator.

[0173] In one embodiment, the identification of the region of interest is performed based on a mapping between the coordinate system of the remotely displayed image and the coordinate system of the simulator.

[0174] In one embodiment, the region of interest has a predefined shape and / or dimensions. In this case, step 156 includes identifying a position of the region of interest on the simulator based on the received coordinates. For example, if coordinates of a single point are received in step 154, step 156 includes identifying a position of the region of interest on the simulator based on the received coordinates of the single selected point and assigning the region of interest a predefined shape and predefined dimensions. For example, the region of interest may have a square shape with predefined side lengths.

[0175] In embodiments in which coordinates of more than one point are received, the relative size of the region of interest may be greater than the relative size of the geometric object formed by the selected points. For example, if the selected points form a circle having a given diameter, the region of interest may also have a circular shape, and the diameter of the circular region of interest may be greater than the diameter of the circle formed by the selected points.

[0176] In embodiments where coordinates of more than one selected point are received in step 154, a position for the area of ​​interest may be identified based on the coordinates of at least one of the selected points and a shape and dimensions of the area of ​​interest may be determined based on the coordinates of the selected points. For example, if a user of the second computing machine draws a diagram to select a point, the area of ​​interest may be given a shape identical to the shape of the diagram, dimensions of the area of ​​interest may be chosen based on the dimensions of the diagram, and a position of the area of ​​interest in the simulator is identified based on the position of the diagram in the displayed image, i.e., based on the coordinates of at least one point of the diagram in the displayed image.

[0177] In one embodiment, a first coordinate system is assigned inside the simulator and a second coordinate system is assigned to the displayed image. The position of the region of interest is determined using the received coordinates and a mapping between the first and second coordinate systems, such as a transfer function between the first and second coordinate systems. The mapping between the coordinate systems allows mapping a given point in the displayed image to a respective point in the simulator, i.e. determining the coordinates of the respective point in the first coordinate system based on the coordinates of the given point in the second coordinate system.

[0178] In one embodiment, the method further comprises a calibration step to determine a mapping between the first coordinate system and the second coordinate system.

[0179] Once the position of the area of ​​interest within the simulator is identified in step 156, the area of ​​interest of the simulator is visually distinguished in step 158, e.g., the area of ​​interest is illuminated. It should be understood that any suitable method of visually distinguishing the area of ​​interest may be used. The simulator may be provided with at least one light source connected to a first computer machine that controls the light source. For example, the simulator may be provided with a single light source, and the position and / or orientation of the single light source is adjusted to illuminate the area of ​​interest on the simulator. In another embodiment, the simulator may be provided with multiple light sources, and the method further includes selecting a given light source to be manipulated to illuminate the area of ​​interest based on the position of the area of ​​interest. In an embodiment in which the simulator is provided with multiple light sources, the position and / or orientation of the light sources may be fixed. Alternatively, the position and / or orientation of at least one light source may be adjustable.

[0180] While using method 150, a user, such as an instructor, may be located remotely from the simulator and still have the ability to visually interact with a user of the simulator, such as a pilot or co-pilot. For example, by pointing a cursor at a given location on the displayed image of the simulator, a corresponding location in the simulator is illuminated, thereby allowing the instructor to visually indicate locations in the simulator of controls, commands, buttons, etc. that will be activated during the simulation. It should be appreciated that method 150 is performed in substantially real-time, such that any area or point selected on the displayed image is illuminated in the simulator in substantially real-time.

[0181] In one embodiment, the method 150 further enables a user of the second computing machine to talk with a user of the simulator. In this case, the second computing machine is connected to a microphone and the simulator is provided with at least one speaker. Alternatively, the user of the simulator may be provided with a headset. The user of the second computing machine may then talk into the microphone and a generated live audio feed is transmitted to the first computing machine. In an embodiment where the first and second computing machines are connected via a videoconferencing platform, the live audio feed is transmitted by the second computing machine through the second videoconferencing client and received by the first computing machine through the first videoconferencing client. The first computing machine then transmits the received live audio feed to a speaker, which plays the audio feed in substantially real time.

[0182] 10 illustrates a further embodiment of a method 200 for remotely pointing to an area of ​​interest in a simulator. Method 200 corresponds to a particular implementation of method 150 in which a projector is used to illuminate the area of ​​interest in the simulator.

[0183] In step 202, similar to step 152, an image of at least a portion of the simulator is provided by the first computing machine to a second computing machine for remote display, as described above.

[0184] In step 204, similar to step 154, coordinates of at least one point selected within the displayed image are received by the first computing machine, as described above.

[0185] In step 206, the received coordinates are mapped to a pointer area within the field of view of the projector. The pointer area corresponds to a portion of the field of view of the projector and is defined by a position, a shape, and a size within the field of view of the projector. In step 206, a position of the pointer area within the field of view of the projector is determined based on the received coordinates.

[0186] In one embodiment, the pointer area has a predefined shape and / or size, as described above with respect to method 150.

[0187] In step 204, in embodiments in which coordinates of more than one selected point are received, as described above with respect to method 150, a position of the pointer area within the projector's field of view may be identified based on the coordinates of at least one of the selected points, and a shape and dimensions of the region of interest may be determined based on the coordinates of the selected points.

[0188] In one embodiment, a first coordinate system is assigned to the projector or the field of view of the projector, and a second coordinate system is assigned to the displayed image. The position of the pointer area in the first coordinate system is determined based on the received coordinates using a mapping between the first coordinate system and the second coordinate system, such as a transfer function between the first coordinate system and the second coordinate system. The mapping between the coordinate systems allows for determining the coordinates of a respective point in the first coordinate system based on the coordinates of a given point in the second coordinate system. The position of the pointer area in the field of view of the projector is then chosen based on the position of the point in the first coordinate system that corresponds to the selected point.

[0189] In one embodiment, the projector's coordinate system is mapped to the simulator's coordinate system such that at least one given point in the simulator's coordinate system that corresponds to a selected point in the displayed image is first determined using the mapping between the simulator's coordinate system and the displayed image, and the location of the pointer area in the projector's coordinate system is then identified by mapping the identified given point in the simulator's coordinate system to the projector's coordinate system.

[0190] In one embodiment, the method further comprises a calibration step to determine a mapping between the first coordinate system and the second coordinate system.

[0191] In embodiments in which the displayed image corresponds to a portion of the simulator encompassed by the field of view of the projector, the coordinate system associated with the field of view of the projector may match the coordinate system of the displayed image, such that a point having coordinates (x,y) in the displayed image also has coordinates (x,y) in the field of view of the projector. In embodiments in which the displayed image is a simulated image of the simulator, the displayed image may match the portion of the simulator encompassed by the field of view of the projector.

[0192] In embodiments where there are small differences between the displayed image and the portion of the simulator encompassed by the projector's field of view, such that the coordinate system associated with the projector's field of view does not match that of the displayed image, the coordinates of a point in the projector's field of view may still be considered to match its corresponding point in the displayed image, and the size of the pointer area may be increased. In this case, the illuminated region of interest may be larger to ensure that the point of the simulator corresponding to the selected point is included within the region of interest. This may be the case when the displayed image is an image captured by a camera located within the simulator, where the camera is positioned adjacent to the projector and the camera has substantially the same orientation and the same field of view as those of the projector.

[0193] Once the pointer area has been identified, the next step 208 involves generating an overlay image based on the pointer area.

[0194] In one embodiment, the overlay image corresponds to a pointer area so that the projector projects light only within the pointer area and not within portions of the projector's field of view outside the pointer area.

[0195] In another embodiment, the overlay image is larger than the pointer area. In this case, the overlay image includes a first and a second area. The first area corresponds to the pointer area and the second area corresponds to the remainder of the overlay image outside the pointer area. In this case, the first and second areas have at least one different characteristic to visually distinguish the pointer area from the remainder of the overlay image. For example, the color of the light generated within the pointer area may be different from the color of the light generated for the remainder of the overlay image. In the same or another embodiment, the intensity of the light may be different. For example, the intensity of the light within the pointer area may be set to zero and the intensity of the remainder of the overlay image may be greater than zero, so that the area of ​​interest is visually distinguished by not being illuminated and by the area surrounding the area of ​​interest being illuminated. In another example, the light intensity in the pointer area may be greater than zero and the intensity of the remainder of the overlay image may be set to zero, such that the area of ​​interest is visually distinguished by being illuminated and the area surrounding the area of ​​interest being not illuminated.

[0196] In step 210, the projector is controlled to project an overlay image on the simulator, i.e., a control signal is provided to the projector indicating the overlay image, thereby visually distinguishing the simulator's area of ​​interest. In one embodiment, the simulator illuminated by the projected light within a pointer area of ​​the projector's field of view forms the simulator's area of ​​interest.

[0197] In an embodiment where the overlay image includes a single region corresponding to the pointer area, the projector projects light only within the identified pointer area within its field of view. FIGS. 11 and 12 illustrate such a scenario. FIG. 11 illustrates an exemplary remotely displayed image of a portion of a cockpit. A cursor having a square shape and an orange color is displayed over the image of the cockpit. A user of the second computer machine may move the square cursor to select an area of ​​interest that will be highlighted on the simulator's cockpit. The position of the square cursor is transmitted to the first computer machine, which determines a position for the pointer area within the projector's field of view based on the received position of the square cursor in the displayed image. The projector then projects an overlay image corresponding to the pointer area. The overlay image is given a square shape and an orange color. FIG. 12 illustrates the cockpit when the overlay image is projected over the cockpit. An orange square is then projected onto the cockpit at a position on the cockpit that is substantially the same as the position of the square cursor over the portion of the cockpit depicted in the displayed image.

[0198] In another embodiment, where only a given area of ​​the overlay image corresponds to the pointer area, a projector projects an image onto the simulator and the area of ​​interest corresponds to the portion of the simulator illuminated by the given area, as explained above, to visually distinguish the area of ​​interest, the light emitted within the pointer area may be of a first color, such as orange, and the light emitted corresponding to a second area of ​​the overlay image may have a second and different color, such as white.

[0199] The size of the overlay image can be chosen so that it occupies the entire field of view of the projector and then the pointer area corresponds to a portion of the field of view.

[0200] In one embodiment, methods 150, 200 are embodied as a system including a processor and a non-transitory storage medium operably connected to the processor, the non-transitory storage medium including computer-readable instructions, the processor configured to perform the steps of methods 150, 200 upon execution of the computer-readable instructions.

[0201] In another embodiment, the methods 150, 200 are embodied as a computer program product including a computer-readable memory having computer-executable instructions stored thereon that, when executed by a processor, perform the steps of the methods 150, 200.

[0202] FIG. 13 illustrates one embodiment of a system 250 that allows a user to remotely point to an area of ​​interest within a simulator.

[0203] The system 250 includes a simulation environment or simulator 252, a private location 253, and a remote location 254. The simulator 252 includes at least instruments and controls (not shown) with which a user of the simulator 152 interacts to perform a simulation, and at least one projector 260. The simulator may further be provided with at least one camera 262 for capturing images of at least a portion of the simulator 252, such as at least a portion of the instruments and controls, at least one speaker 266 positioned within the simulator 252, and at least one microphone 264 positioned within the simulator 252.

[0204] The private location 253 includes a first computing machine 270 configured to perform the steps of the method 200. The first computing machine 270 is also provided with a first videoconferencing client. The first computing machine 270 is in communication with the projector 260 via a private secure network 274. The first computing machine 270 may also be in communication with the camera 262, the speaker 266, and / or the microphone 264, if present in the simulator 252.

[0205] The remote location 254 includes a second computer machine 280, a second display unit 282, and a user interface 284. It should be understood that if the second display unit 282 includes, for example, a touch screen, the user interface 284 may be omitted. The remote location 254 may optionally include a speaker 288 and a microphone 286. A second video conference client is provided on the second computer machine 280. Data may be exchanged between the first video conference client running on the first computer machine 270 and the second video conference client running on the second computer machine 280 via a public secure network 290. It should be understood that the second computer machine 280 does not have access to the private network 274.

[0206] In one embodiment, system 250 includes an image generator 292 for generating an image of at least a portion of simulator 252, such as a portion of a cockpit. Image generator 292 may be configured to generate an image from a 3D model of simulator 252. In another embodiment, simulator 252 includes a camera 262 for capturing a live image of at least a portion of simulator 252.

[0207] The image is transmitted over secure private network 274 to first computer machine 270. First computer machine 270 transmits the image of simulator 252 over secure public network 290 through a first video conferencing client to second computer machine 280. Second computer machine 280 receives the image of simulator 252 through a second video conferencing client and provides the received image to display unit 282 for display thereon. A user of second computer machine 280, such as an instructor, may then select at least one point within the displayed image of simulator 252. For example, if user interface 284 includes a mouse, the user may left-click on a given command displayed within the image to provide the user of simulator 252 with a visual indication of the location of the given command within simulator 252.

[0208] The second computing machine 280 captures coordinates of the selected point and transmits the captured coordinates through the second video conferencing client over the secure public network 290 to the first computing machine 270. The first computing machine 270 then receives the coordinates of the selected point through the first video conferencing client and maps the received coordinates to a pointer area within the field of view of the projector 260 before generating an overlay image based on the pointer area, as described above. The first computing machine 270 transmits the overlay image to the projector 260, which projects the overlay image on the simulator 252 to illuminate the area of ​​interest, as described above.

[0209] In one embodiment, the displayed image is static, while in another embodiment, the displayed image may be dynamic and changeable over time.

[0210] In one embodiment, speakers 266 and 288 and microphones 264 and 286 enable audio communication between simulator 252 and a remote location so that an instructor and pilot may talk, for example, during a training simulation. In this case, a live audio feed captured by microphone 286 is transmitted over secure public network 290 through a second video conference client to first computer machine 270. First computer machine 270 receives the live audio feed through the first video conference client and transmits to speaker 266 the live audio feed to be played in simulator 252. Similarly, microphone 264 captures a live audio feed from simulator 252 and transmits the captured live audio feed over secure private network 274 to first computer machine 270. First computer machine 270 then transmits the live audio feed over secure public network 290 through the first video conference client to second computer machine 280. A second computer machine 280, through a second videoconferencing client, receives the live audio feed and transmits the live audio feed to a speaker 288 to be played.

[0211] In embodiments where the displayed image of the simulator is a live video feed captured by a camera located within the simulator, the orientation, position, and / or zoom of the camera may be adjusted so that the camera captures a desired view of the simulator.

[0212] In an embodiment in which the simulator is provided with multiple cameras, each positioned and oriented to capture a respective view of the simulator, a desired view of the simulator is obtained by selecting a given camera.

[0213] In one embodiment, the view may be selected remotely from a second computing machine upon granting control over the camera, for example, via a videoconferencing platform. A user of the second computing machine may then remotely control the position, orientation, and / or zoom of a camera located within the simulator and / or select a given camera to obtain a desired view of the simulator.

[0214] Although the above description refers to one projector, such as projector 260, it should be understood that the simulator may be provided with multiple projectors, each covering a different area of ​​the simulator. In this case, method 200 further includes selecting a given projector based on the coordinates of the selected point such that the area of ​​interest to be differentiated is comprised within the field of view of the given projector.

[0215] In an embodiment where a single projector is used, the projector has a fixed position and orientation. In another embodiment, the position and / or orientation of the projector is adjustable. In this case, the method 200 may further include determining a required movement, such as a required translation or a required rotation, for the projector when the region of interest is not within the field of view of the projector, and moving the projector according to the determined required movement.

[0216] In one embodiment, at least one characteristic of the region of interest or pointer area may be selected by a user of the second computing machine. For example, a shape, size, and / or color may be selected for the region of interest or pointer area. For example, the region of interest or pointer area may have the shape of a circle, an arrow, an "X", etc.

[0217] In embodiments where a projector is used, the image projected by the projector may be animated.

[0218] In one embodiment, the method further includes determining mapping parameters to ensure alignment between the projected image and the cockpit instruments and controls, in this case, mapping the coordinates includes applying the mapping parameters to the coordinates to determine a pointer area within the overlay image.

[0219] In one embodiment, the parameters are determined as a function of the position of the projector, the optical properties of the projector, and the geometry of the cockpit structure.

[0220] In one embodiment, the parameters are determined by projecting a series of features and identifying the locations of the features on the simulator.

[0221] In one embodiment, identifying the location of features is performed automatically through image processing means.

[0222] In one embodiment, the projector includes at least one of the following characteristics: (a) The projector has Power-Over-Ethernet (POE) capability, since power may not be easily accessible in the cockpit area; (b) the Projector has the built-in capability to run a client application; (c) The projector produces low heat and minimal fan noise.

[0223] In one embodiment, the projector includes a lens that provides the required cockpit coverage, HD resolution, and brightness.

[0224] In one embodiment, there is a dedicated monitor for the pointer system, including a server application, in the off-board IOS. The server application interfaces directly with each of the clients running on each of the projectors. The server application includes UI management; interface with the instructor. A projector / view is selected in the IOS and a corresponding static image is displayed. As the cursor is moved to the desired position, positioning data is transferred to the projector / client application. The actual cursor is viewed by the instructor using a camera feed back from the cockpit. The server application may include different options for at least some characteristics of the cursor, such as cursor symbol type, size, and color.

[0225] In one embodiment, the server application is extended to capture pre-defined areas of interest that demonstrate usage for the purposes of product usage analysis.

[0226] In one embodiment, the use of a movable camera delivering a (3D) dynamic image may allow the number of projectors required to be reduced. A 3D model of the cockpit area is needed along with additional logic to display a pointer that moves virtually within the 3D world as commanded by the instructor. This may be achieved by creating a mapping matrix between the camera orientation (azimuth, elevation) and simulator coordinates. This may be done manually or through a semi-automatic procedure in which the camera displays a test pattern (e.g., a grid) swivels through its range, stopping at each grid interval. The user is then asked to confirm the grid position on the interface display.

[0227] In one embodiment, the remote instruction method and system is quicker, more intuitive, and less ambiguous than verbally describing an area of ​​interest.

[0228] In one embodiment, method 10 may be adapted to further include the steps of method 200 such that a user of a second computing machine may remotely point to an area of ​​interest within the simulator using the same video conferencing platform.

[0229] Similarly, the system 100 may be configured to allow a user of a second computing machine 130 to point to an area of ​​interest within the simulator 102. In this case, the first computing machine 120 is configured to transmit an image of at least a portion of the simulator 102 through a first video conferencing client over the secure public network 138, and the second computing machine 130 is configured to receive the image of the portion of the simulator 102 through the second video conferencing client and display the received image on the display unit 132. The second computing machine is further configured to capture coordinates of at least one point selected within the image by a user of the second computing machine 130 and transmit the captured coordinates to the first computing machine 120 through the second video conferencing client over the secure public network 138. Upon receiving the coordinates, the first computer machine 120 identifies a corresponding area of ​​interest within the simulator 102 based on the received coordinates and controls a light source present within the simulator 102, such as a projector, to illuminate the area of ​​interest within the simulator 102 in order to visually distinguish the area of ​​interest.

[0230] The above-described embodiments of the invention are intended to be exemplary only, and the scope of the invention is therefore intended to be limited only by the appended claims.

Claims

1. A computer-implemented method for providing remote visibility into a simulator, the computer-implemented method being executed by a processor, comprising: establishing a connection between a first videoconferencing client running on a first computer and a second videoconferencing client running on a second computer over a secure public network; over a secure private network, at the first computer; (a) a first live camera feed encompassing a first interior portion of the simulator and captured by a first camera; (b) a simulation control interface used to set and display parameters of a simulation of the simulator; (c) if the simulator includes a motion-based flight simulator, a second live camera feed captured by a second camera and encompassing an exterior portion of the motion-based flight simulator; and receiving a signal from the second computer, the second computer being located outside the secure private network; a viewer application running on the first computer; (a) the first live camera feed; and (b) the simulation control interface; (c) if the simulator comprises the motion-based flight simulator, the second live camera feed; generating a combined image; displaying the generated image in the viewer application; granting visual access of the second videoconference client to the viewer application through the first videoconference client; A computer-implemented method comprising:

2. receiving, at the first computer, a live audio feed from a microphone present within the simulator; transmitting the live audio feed through the first videoconferencing client over the secure public network to the second computer so as to enable the second computer to play back the live audio feed in substantially real time; The computer-implemented method of claim 1 , further comprising:

3. receiving, at the first computer, a live audio feed from the second computer through the first videoconferencing client; transmitting the received live audio feed to a speaker mounted within the simulator; The computer-implemented method of claim 1 , further comprising:

4. 4. The computer-implemented method of claim 1, wherein the simulator comprises a flight simulator and the first internal portion of the simulator includes an instrument and control portion of the flight simulator.

5. The computer-implemented method of claim 4, wherein the image generated by a viewer application running on the first computer is further combined with a third live camera feed captured by a third camera and encompassing a third portion of the simulator different from the first internal portion.

6. The computer-implemented method of claim 5, wherein the third live camera feed includes a second internal portion of the flight simulator, the second internal portion of the flight simulator including a screen of the flight simulator displaying a computer-generated image of an environment.

7. 6. The computer-implemented method of claim 5, wherein the flight simulator includes a motion-based flight simulator and the third live camera feed encompasses a second exterior portion of the motion-based flight simulator.

8. A computer-implemented method as described in any one of claims 1 to 4, wherein the image generated by a viewer application running on the first computer is further coupled to a third live camera feed captured by a third camera and encompassing a third portion of the simulator different from the first internal portion, and the simulation control interface includes an interface of an instructor operation station, and the third live camera feed encompasses the instructor operation station.

9. 10. The computer-implemented method of claim 8, further comprising receiving the view of the simulation control interface from a simulation engine.

10. The computer-implemented method of claim 1 , wherein the viewer application is further configured to provide a view of an interface of a data analysis platform.

11. 11. The computer-implemented method of claim 10, wherein the view of the interface of the data analysis platform corresponds to an image of a display unit on which the interface of the data analysis platform is displayed, the image of the display being captured by a further camera connected to the private network.

12. 11. The computer-implemented method of claim 10, further comprising receiving the view of the interface of the data analytics platform from a server hosting the data analytics platform.

13. The computer-implemented method of claim 1 , further comprising granting control over the viewer application to the second videoconferencing client.

14. 14. The computer-implemented method of claim 13, further comprising granting the second videoconferencing client control over an operating system interface.

15. 15. The computer-implemented method of claim 11, further comprising granting the second videoconferencing client control over an interface of a data analytics platform.

16. receiving an instruction from the first videoconferencing client to project a visual indication within the simulator; controlling a projector mounted within the simulator to project the visual indication; 16. The computer-implemented method of claim 1, further comprising:

17. A computer-implemented method as described in any one of claims 1 to 11, further comprising displaying a computer-generated representation of a second portion of the simulator within the viewer application running on the first computer.

18. A system for providing remote visibility into a simulator, comprising: A processor; a non-transitory storage medium operatively connected to the processor, the non-transitory storage medium including computer readable instructions; The system, wherein the processor, upon execution of the computer readable instructions, is configured to perform the method of any one of claims 1 to 17.

19. A computer program product for providing remote visibility into a simulator, the computer program product including a computer-readable memory having computer-executable instructions stored therein, the computer-executable instructions, when executed by a processor, establishing a connection between a first videoconferencing client running on a first computer and a second videoconferencing client running on a second computer over a secure public network; over a secure private network, at the first computer; (a) a first live camera feed encompassing a first interior portion of the simulator and captured by a first camera; (b) a simulation control interface used to set and display parameters of a simulation of the simulator; (c) if the simulator includes a motion-based flight simulator, a second live camera feed captured by a second camera and encompassing an exterior portion of the motion-based flight simulator; and receiving a signal from the second computer, the second computer being located outside the secure private network; a viewer application running on the first computer; (a) the first live camera feed; and (b) the simulation control interface; (c) if the simulator comprises the motion-based flight simulator, the second live camera feed; generating a combined image; displaying the generated image in the viewer application; granting visual access of the second videoconference client to the viewer application through the first videoconference client; A computer program product for performing the method steps of.

20. A kit for providing remote visibility into a simulator, comprising: A computer program product according to claim 19; a pole removably securable to an interior of the simulator, the pole including an elongated body having an adjustable length and at least one camera holding device for holding a camera, the camera holding device being securable at a desired position along the elongated body, the camera being configured to capture an image of a desired portion of the simulator. kit.

21. The kit of claim 20 , wherein the extension is telescopic.

22. 22. The kit of claim 20 or 21, wherein the camera holding device is rotatably secured to the extension.

Images