Modular Circuit Card Assembly for Advanced Training Applications

The common interface board (CIB) addresses the interoperability and cybersecurity issues of VR training systems by enabling seamless integration and reliable operation in harsh environments, enhancing the flexibility and effectiveness of military training simulations.

JP2025501676AActive Publication Date: 2025-01-23RAYTHEON CO
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2024528492
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-11-15
Filing Date
2022-07-29
Publication Date
2025-01-23
Estimated Expiration
2042-07-29

Smart Images

  • Figure 2025501676000001_ABST
    Figure 2025501676000001_ABST
Patent Text Reader

Abstract

The assembly includes a processor, a communication system, a sensor subsystem, a health management system, and a security system in operable communication, the assembly configured to interface between a simulation system and a computer system controlling the simulation system. The communication system controls communication between the simulation system and the computer system. The sensory subsystem provides commands to the simulation system to enable a user to be provided with a simulated user experience that couples one or more of the user's senses to a simulation in which the respective one or more senses can be detected. The health management system monitors health event information related to one or more environmental characteristics in which the simulation system operates. The security system monitors security events associated with the assembly, the security events related to at least one of a physical intrusion and a logical intrusion into the assembly.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001]

[0002] Embodiments of the present disclosure relate generally to devices, systems, and methods for simulating situations for tactical, maintenance, and training purposes. More specifically, the present disclosure describes embodiments relating to devices, systems, and methods for providing a modular, configurable interface configured to provide a universal data and control interface between various computer systems that execute simulation scenarios and various types of physical training devices and simulation systems that need to interact with the computer systems. [Background technology]

[0002] In military or aerospace environments, training users often require the use of training simulation systems when simulating situations that may involve human interaction with devices and systems, such as weapon systems, aircraft, ships, spacecraft, etc. that may be dangerous, expensive, inconvenient, or difficult to replicate. Currently, there are many types of simulation systems in use, including, but not limited to, air traffic control (ATC) simulators, radar simulators, flight simulators, tank simulators, weapons simulators, ship handling simulators, driving simulators, shooting simulators, rocket simulators, etc. There are even training simulation systems that simulate human interaction with other humans, such as performing surgery or other medical / dental procedures. The advantage of a simulation system is that it allows users in training to experience and respond to situations (and / or operate devices or equipment) that would be difficult to replicate or utilize for training purposes without the use of a simulation system, due to constraints such as limited budgets, limited resources, risks involved, time, availability of equipment / location, and difficulty in replicating the real world on demand the type of situations and configurations that require training.

[0003] Virtual reality (VR) is an interactive computer-generated experience that takes place within a simulated (virtual) environment. VR systems typically incorporate auditory, visual, and sensory feedback. Many VR systems use a head-mounted display, including a virtual reality headset with display and audio capabilities configured to generate realistic images, sounds, and other sensations that simulate the user's physical presence in the virtual environment. A person using a virtual reality system can look around the artificial world, move around in it, and interact with virtual features and items within such an environment. A VR system can also transmit vibrations and other sensations to the user via a controller, which also receives input and instructions from the user, such as moving forward or backward, moving slowly or quickly, turning, touching, grasping, and controlling objects, while using designated functions of the game controller, such as buttons, joysticks, and icons. The controller provides input from the user to the VR system, activating various buttons / dials, by connecting to one of the controller ports on the console (e.g., headset) or by wirelessly pairing the controller with the console system / VR system. Examples of controllers may include a directional pad, multiple buttons, an analog stick, a joystick, motion sensing, and a touch screen, all of which require activation by the user's hands. Summary of the Invention

[0004] The following presents a simplified summary in order to provide a basic understanding of one or more aspects of the embodiments described herein. This summary is not an extensive overview of all possible embodiments, and is not intended to identify key or critical elements of the embodiments or to delineate the scope thereof. Rather, the primary purpose of this summary is to present some concepts of the embodiments described herein in a simplified form as a prelude to the more detailed description that is presented later.

[0005] As VR systems become more available and commercial gaming systems become more sophisticated, it is becoming more common to use surprisingly realistic and advanced simulation systems to train users in a variety of disciplines. For example, the U.S. military currently uses various types of simulator systems to train personnel in the use of various weapon systems. FIGS. 1A and 1B are exemplary block diagrams 100A, 100B, respectively, of an example of a conventional virtual reality training system that can be used to simulate the operation of the U.S. Army's Stinger® missile, and FIG. 2 is an exemplary diagram of an actual user being trained using a simulation system similar to FIGS. 1A-1B. The exemplary system 100A provides a simulation and virtual environment 102, which can include simulations of various scenes, three-dimensional (3D) models of targets (e.g., helicopters, aircraft) to be fired and Stinger missiles to be launched, simulated weather and terrain imagery, simulated sensors, launch sequences, etc.

[0006] Stinger is a type of man-portable air defense system (MANPADS) that includes surface-to-air missiles that can be launched by individuals or small teams against aircraft. These weapon systems are often referred to as shoulder-fired anti-aircraft missiles. In the simulator system of Figs. 100A and 100B, headphones / speakers 104 provide audio information of the environment, targets, and weapons, as well as simulated sounds, to a user simulating the operation of a STINGER missile in a training environment. The VR headset and head tracker 106 can include features such as a front-facing camera, one or more controllers, and tracking sensors to facilitate the simulation. Hand tracking functionality 108 can be implemented in a variety of ways, such as via a wearable component (which can include, for example, finger tracking), buttons that simulate finger movements, motion controllers 108 attached to the headset, and custom triggers 116 (Fig. 1B) and / or Stinger controllers 118 to help track the user's orientation and the position of the user's hands, provide user control, and provide haptic feedback, such as vibration.

[0007] Additionally, the Stinger simulation device 120 helps provide a passive haptic sensation that helps simulate the weight, weight, and physical feel of using a Stinger missile during a simulation / training exercise, as shown in illustration 200 of Figure 2. A separate computer system associated with the control display 110 and keyboard allows for the creation of simulation scenarios that may be provided to the simulated environment 102, and may allow another user (not shown) of the computer system to observe the user 114 performing the simulation and / or control the experience the user 114 undergoes during the simulation.

[0008] Many different types of simulators and systems for various weapons can be used to provide various kinds of synthetic training environments, using various types of weapons or other devices, with or without virtual reality or computer control, as will be appreciated. As simulation systems become more common in some applications, such as military training, there is a need to ensure that training scenarios can be created and used using multiple different types of training hardware and systems. However, many currently developed simulation systems use proprietary systems and hardware, particularly hardware designed to provide haptics associated with specific weapons, and these systems are often not interoperable. Thus, it is difficult to integrate multiple different simulation systems and use them together to train for the diverse and complex situations that a user may encounter in the real world without extensive redesign and programming to ensure that commands are properly translated for use with a particular type of simulation system.

[0009] In contrast, commercial systems used for entertainment purposes, such as gaming systems like Microsoft's Xbox and Sony's PlayStation, are more flexible to use with a wider variety of hardware and are much less expensive, but lack the robustness, reliability, and safety features required to operate in harsh environments and applications, such as military training and simulation. While commercial devices have the advantage of price and availability, they also lack the features required for industrial and / or military applications, such as cybersecurity features, encryption, intrusion prevention, the ability to operate in harsh / harsh industrial and / or military environments (e.g., extreme temperatures, shock, vibration, etc.), and the ability to operate in classified and / or enclosed spaces. Commercially available simulation systems (and many known military simulation systems) do not monitor or track the environmental factors and conditions to which the simulation device is exposed, and tend not to have the same reliability requirements as more robust systems required for some applications.

[0010] At least some embodiments herein attempt to address at least some of these problems.

[0011] In one aspect, an assembly is provided that includes a processor, a communication system, a sensor subsystem, a health management system, and a security system. The processor is in operative communication with a memory, the memory storing instructions for operation of the processor, the processor is configured to convert first instructions received from the computer system into control signals to operate the simulation system according to a first simulation scenario, and the processor is operative to respond to a user action and control the first simulation scenario executed by the simulation system based at least in part on the user action. A communication system is in operative communication with the processor and the computer system, the communication system is configured to control communication between the simulation system and the computer system, and is configured to provide at least one of wired and wireless communication between the assembly and the computer system. A sensory subsystem is in operative communication with the processor, the sensory subsystem is configured to provide commands to the simulation system to enable the simulation subsystem to provide a simulated user experience to a user, the simulated user experience is configured to couple one or more senses of the user to a simulation in which the respective one or more senses can be detected. The health management system is in operative communication with the processor and is configured to monitor health event information associated with one or more environmental characteristics in which the simulation system is operating. The security system is in operative communication with the processor and is configured to monitor security events associated with the assembly, the security events relating to at least one of a physical intrusion and a logical intrusion into the assembly. The assembly constitutes an interface between the simulation system and the computer system.

[0012] In some embodiments, the assembly further comprises a log configured to store event information, the stored event information including information associated with at least one of a simulation event, a health event, and a security event. In some embodiments, the processor is configured to provide the event information stored in the log to a computer system for analysis of a first simulation scenario. In some embodiments, the processor is configured to receive second instructions from the computer system for operating the simulation system according to a second scenario, the second scenario being created based at least in part on an analysis of the simulation information stored in the log provided to the first computer system. In some embodiments, the processor is configured to provide the security event information stored in the log to a computer system for analysis related to detection of an intrusion into and communication with at least one of the assemblies.

[0013] In some embodiments, the processor is configured to provide the health event information stored in the log to the computer system for analysis regarding detection of one or more health events associated with use of the simulation system. In some embodiments, the assembly is configured to be disposed within a simulation device of the simulation system. In some embodiments, the simulation system includes at least one of a virtual reality (VR) system, an augmented reality system, and a system operable within a synthetic training environment (STE). In some embodiments, the communication subsystem is configured to be switchable between wired communication and wireless communication. In some embodiments, the assembly is housed within a first device of the simulation system, and the communication system of the assembly is operably coupled to a second device different from the first device, and the communication system is configured to enable the second device to have pass-through communication with the computer system. In some embodiments, the communication system is operably connected to the computer system via a first wired connection, and the second device is connected to the communication system to ensure that communication from the second device to the computer system is provided only via the first wired connection.

[0014] In some embodiments, the security system includes a reverse engineering protection system (REPS), the REPS configured to protect the assembly from at least one of physical intrusion into the assembly and logical intrusion into the assembly. In some embodiments, the security system includes a hardware security method subsystem including at least one of an encryption system, an authentication system, and a tamper detection system. In some embodiments, the security system is configured in cooperation with the processor and the communication system to provide a root of trust (RoT) for the assembly.

[0015] In some embodiments, the security system is configured to cooperate with the processor and the communication system to provide a Root of Trust (RoT) for the assembly.

[0016] In another aspect, a method is provided. An assembly is provided, the assembly configured as an interface between a computer system and a simulation system, the assembly configured to be physically part of the simulation system. The assembly is used to convert a first instruction received from the computer system into a control signal to operate the simulation system according to a first simulation scenario, the simulation system is configured to respond to the user's actions and provide a simulated user experience to the user, the simulated user experience being configured to couple one or more senses of the user to a simulation in which the respective one or more senses are detectable. The assembly is used to configure communication between the simulation system and the computer system, providing at least one of wired communication and wireless communication between the simulation system and the computer system. Events associated with the simulation system are monitored, the events including at least one of health event information associated with one or more environmental characteristics in which the simulation system is operating and security events associated with the assembly, the monitoring configured to detect at least one of a physical intrusion and a logical intrusion into the assembly.

[0017] In some embodiments, monitoring for events occurs during at least one of operation of the simulation system and during a time when the simulation system is not operating. In some embodiments, the method further includes operating the simulation system according to a second scenario, the second scenario being developed based at least in part on analysis of the monitored event information.

[0018] In a further aspect, means are provided for interfacing between a simulation system and a computer system, the interfacing means including means for translating first instructions received from the computer system into control signals for operating the simulation system according to a first simulation scenario, means for controlling communication between the simulation system and the computer system, means for providing commands to the simulation system such that the simulation subsystem can provide a simulated user experience to a user, means for monitoring health event information associated with one or more environmental characteristics in which the simulation system is operating, and means for monitoring security events associated with the assembly.

[0019] The conversion means is responsive to the user action and operable to control a first simulation scenario executed in the simulation system based at least in part on the user action. The means for controlling communication is further configured to provide at least one of wired and wireless communication between the assembly and the computer system. The simulated user experience is configured to couple one or more senses of the user to a simulation in which the respective one or more senses are detectable. The security event is associated with at least one of a physical intrusion and a logical intrusion into the means for providing an interface and the means for protecting the assembly and the communication between the assembly from intrusion.

[0020] In some embodiments, the means for interfacing further comprises means for storing event information, the stored event information including information associated with at least one of a simulation event, a health event, and a security event.

[0021] It should be understood that individual elements of different embodiments described herein can be combined to form other embodiments not specifically described above. Various elements described in the context of a single embodiment may be provided separately or in any suitable subcombination. Other embodiments not specifically described herein should be understood to be within the scope of the claims contained herein.

[0022] Details regarding these and other embodiments are described more fully herein.

[0023] Advantages and aspects of the described embodiments, as well as the embodiments themselves, will be more fully understood in conjunction with the following detailed description and the accompanying drawings. [Brief description of the drawings]

[0024] [Figure 1A] FIG. 1 is a block diagram of a first prior art simulation system, according to one embodiment. [Figure 1B] FIG. 2 is a block diagram of a second prior art simulation system, according to one embodiment. [Diagram 2] 1 illustrates a prior art simulation system in use, according to one embodiment. [Figure 3A] FIG. 1 is a first simplified block diagram of an example system utilizing a common interface board (CIB), illustrating the physical and logical interfaces between the CIB and other components of the simulation subsystem, according to one embodiment. [Figure 3B] FIG. 4 is a second simplified block diagram of an example system utilizing the common interface board (CIB) of FIG. 3, according to one embodiment. [Figure 3C] FIG. 4 is a third simplified block diagram of an example system that utilizes the CIB of FIG. 3, according to one embodiment. [Figure 4]FIG. 3B is a block diagram of the common interface board (CIB) of FIGS. 3A-3b, according to one embodiment. [Diagram 5] FIG. 2 is an example block diagram illustrating data flow in an example simulation system having a common interface board, according to one embodiment. [Figure 6] 8 is a flowchart outlining the operation, interaction, and data flow of the common interface board of FIGS. 3-7, according to one embodiment. [Figure 7] FIG. 7 is a block diagram of an exemplary computer system usable with at least some of the systems, components, boards, and devices of FIGS. 1-6, according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025] The drawings are not to scale, emphasis instead being placed upon illustrating the principles and features of embodiments of the present disclosure.In the drawings, like reference numbers refer to like elements.

[0026] Before describing the details of particular systems, devices, and methods, it should be noted that the concepts disclosed herein include, but are not limited to, novel structural combinations of components and circuits, and are not necessarily limited to their particular detailed configurations. Accordingly, the structure, method, function, control, and arrangement of components and circuits have been illustrated in the drawings, for the most part, by easily understood simplified block diagrams and schematic illustrations, so as not to obscure the disclosure with structural details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.

[0027] Unless otherwise specifically stated, those skilled in the art will understand that throughout the detailed description herein, discussions using terms such as "opening," "composing," "receiving," "detecting," "getting," "converting," "providing," "storing," "reviewing," "uploading," "transmitting," "determining," "reading," "loading," "overriding," "writing," "creating," "including," "generating," "associating," and "disposing" refer to at least the operations and processes of a computer system or similar electronic computing device. A computer system or similar electronic computing device manipulates data, which is represented as physical (electronic) quantities in the registers and memory of the computer system, and converts it to other data, which is also represented as physical quantities in the memory or registers of the computer system, or other information storage, transmission, or display device. The disclosed embodiments are also suitable for use with other computer systems, such as optical computers and mechanical computers. Additionally, it should be understood that in the embodiments disclosed herein, one or more steps can be performed manually.

[0028] While the following detailed description is provided in at least some examples using the particular context of a simulation system for a military environment, those skilled in the art will appreciate that the detailed description includes examples applicable to many different environments and the contexts in which the simulation system may be used, including simulating actions and scenarios related to commercial, industrial, medical, scientific, research, recreational, and / or gaming environments. Additionally, terms such as "training," "trainer," "synthetic training environment," "simulated training environment," "virtual environment," "virtual trainer," and the like may be used interchangeably and may refer to at least a controlled training environment in which weapons, replica weapons, and / or simulated weapons may be used, including weapons, replica weapons, and / or simulated weapons used with "blanks," simulated munitions, virtual munitions, or no munitions, as well as a controlled training environment in which one or more users interact with others who may be using such weapons, replica weapons, and / or simulated weapons.

[0029] The following definitions of terms (in alphabetical order) may be helpful in understanding one or more of the embodiments described herein and should be considered in light of the description herein, the context in which they appear, and the knowledge of one of ordinary skill in the art.

[0030] "Audio" refers at least to signals, sounds, noises, etc., provided to one or more users of a simulation system as part of a simulation, whether through the operating environment, headphones or headsets, or even the equipment being used, and may be created in a number of ways, including, but not limited to, simulated sounds, actual sounds, sounds generated in response to control signals, sounds generated in response to user actions, and sounds originating from other users.

[0031] "Augmented reality" can be considered a type of virtual reality (VR) and refers, at a minimum, to a system configured to overlay virtual information onto a live camera feed via a headset or portable device, allowing a user to view a three-dimensional image that appears to be a real-world setting but is fully simulated. Like VR, augmented reality involves computer-generated simulation, but augmented reality uses computer-generated simulations of video, sound, graphics, and / or sensory inputs such as haptic feedback to supplement, replace, and / or augment certain real-world elements. For example, such computer-generated simulations can be overlaid onto a computer-generated recreation of a real-world environment, including, among other things, text, graphics, symbols, images, and / or combinations thereof.

[0032] "Big data" refers to, at a minimum, analytical techniques that rely on identifying trends in sufficiently large data sets. Two techniques used in big data analytics are clustering and forecasting. Clustering is the process of grouping records, objects, etc., often using machine learning. Forecasting is the process of using similarities identified through clustering to predict potential future impacts and benefits.

[0033] A "closed area" refers to a defined area or location where access is controlled to prevent at least unauthorized access. Such control can be accomplished through a variety of methods, including but not limited to the use of authorized personnel and / or access control devices or systems. In a closed area, access is generally limited to authorized personnel with appropriate security clearance and a need-to-know regarding classified material / information within the area, and those without the appropriate level of clearance and / or need-to-know are escorted at all times by authorized personnel. Closed areas are provided with additional protection during off-hours with appropriate locks and appropriate access control systems. In some embodiments herein, types of communication may be prioritized in a closed area, such as wired communication only and no wireless communication.

[0034] "Cloud computing" refers, at a minimum, to on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal administrative effort or interaction with a service provider.

[0035] "Communications network" refers to at least the methods and types of communication between components of a computer system, such as a computer-enabled simulation system, including, but not limited to, wired communications, wireless communications (including wireless communications, Wi-Fi networks, BLUETOOTH® communications, etc.), cloud computing networks, networks that communicate using various network protocols known in the art, military networks (e.g., Department of Defense Networks (DDN)), and any means of transmitting data or signals between two devices.

[0036] "Environment" refers at least to the operating environment in which the simulator is used and may refer to or include one or more types of characteristics of that environment, including, but not limited to, security status (e.g., closed environment), physical location (e.g., indoor, outdoor, and / or mixed controlled environments), operational status (e.g., training, maintenance, live interaction, simulated interaction), and / or physical environmental conditions (e.g., temperature, humidity, movement, shock, vibration, pressure). Environment also refers at least to the texture or details of natural areas that may be part of a particular simulation, i.e., terrain relief, weather, day, night, cultural features of the terrain (urban or agricultural), sea state, etc., and external objects, conditions, and processes that affect the operation of the system.

[0037] "Haptic" refers at least to devices and systems that incorporate or relate to a sense of touch or touch, whether actively (e.g., via sensors or other components) or passively (by having a size, weight, texture, etc. that is felt during use). Haptic can be incorporated via devices that incorporate haptic feedback components, and in some cases, a device or system having a haptic sense can respond to computerized control signals to control the operation of one or more haptic components. In at least some embodiments, haptic refers to the sense of touch at the skin level and all physical sensors that provide force feedback information from muscles and joints.

[0038] A "hardware security method" (HSM) refers to at least a subsystem and / or device embedded in and / or connected to hardware (but optionally operating in conjunction with some programming or software) configured to detect and / or address security issues such as at least one of physical or logical intrusion, at least one of logical and physical reverse engineering attempts, and at least one of physical and logical tampering. Hardware security methods can be implemented in various ways as needed. For example, a first type of sensor can be used to detect / track intrusion of outside air or water into an enclosed compartment, and thus contribute to implementing a function such as tamper detection for at least one type of HSM according to embodiments herein. Another type of sensor can detect / track if and when ambient light above a certain threshold hits the sensor, also indicating a possible intrusion (e.g., a cover or lid on the device was removed at some point and later replaced). A magnetic contact switch can be used to detect / track when an opening between two contacts breaks the magnetic signal. Various types of electronic alarm systems can be configured to trigger and / or record events based on some action that causes a change in a monitored electrical value (e.g., some action effectively interrupts the continuity of an electrical circuit, triggering an alarm, etc.). Those skilled in the art will appreciate that many other types of intrusion detection systems (including, but not limited to, motion detection devices, infrared sensors, earthquake sensors, pressure sensors, etc.) can be configured as part of the HSM. In some embodiments, depending on the type of hardware security methodology being implemented, additional types of devices, such as commercially available hardware security module chips, can be used as part of the HSM to help provide authenticated encrypted communications, thereby implementing another type of HSM that helps to perform logical intrusion attempts, such as hacking.Another method that can help implement detection of logical intrusion attempts is to use devices configured to monitor communications (e.g., monitoring network traffic) to detect anomalies.

[0039] "Interoperability" refers at least to the ability of models or simulations to provide services to and accept services from other models and simulations, and to work together effectively using these exchanged services.

[0040] "Pass-through communication" refers at least to a communication that can be sent from a sending device or system to a receiving device or system through an intermediate device or system, where the communication simply "passes through" the intermediate device so as to be substantially unchanged on its way to the receiving device or system. The sending device itself may include a subsystem that converts the communication or signal into a form that the intermediate device can pass through (e.g., a USB dongle that can receive wireless or Bluetooth communications from a device such as a wireless mouse or tracking puck, known in the art as a "USB pass-through"). Pass-through communication effectively functions as if the sending system were communicating directly with the receiving system to convey the signal. The intermediate device or system provides a conduit or connection that allows the transmission of the signal or communication. In some embodiments, a particular connection for pass-through communication may also be configured to serve other functions (e.g., charging the device).

[0041] "Simulation system" refers to at least a device, computer program, or system that performs a simulation, including, but not limited to, a machine, apparatus, or system that imitates or represents any real-world condition or phenomenon, and / or system, developed for multiple purposes, including, but not limited to, training, field exercises, so-called "war games," maintenance, recreation, research and development (R&D), analysis, testing, and evaluation.

[0042] "Synthetic environment" refers to, at a minimum, an integrated set of data elements that define the environment in which a particular simulation application operates. The data elements include information about the initial and subsequent states of the terrain, including cultural features, and the atmospheric and marine environments throughout the exercise. The data elements include a database of externally observable information about instantiable entities, appropriately correlated depending on the type of exercise being performed. Synthetic environments are also known by other terms such as "virtual worlds".

[0043] A "synthetic training environment" (STE) refers to at least a single environment in which users, such as soldiers, can advantageously train together (potentially integrating both synthetic and real-world environments) as part of the same training experience, from anywhere in the world. In some embodiments, STEs are implemented to blend multiple types of technologies, such as augmented reality, virtual reality, artificial intelligence, and big data, during simulated exercises, connecting users and enabling them to perform actions (e.g., training) in new and different ways.

[0044] "Virtual reality" (VR) refers at least to an interactive computer-generated experience that takes place within a simulated environment, including a computer-generated simulation of a three-dimensional image or environment that a person can interact with in a seemingly realistic or physical way using special electronic devices such as a helmet with a screen inside, gloves with sensors attached, custom controllers, tools, weapons, user input devices (e.g., keyboard, joystick, trackball, mouse, etc.), or other suitable equipment that includes external sensors that can detect the user's movements and position. Virtual reality includes at least an artificial environment that is experienced through sensory stimuli (such as sights and sounds) provided by a computer or other suitable devices, and in at least some examples, the actions of the user at least partially determine what happens in the environment. In some embodiments, virtual reality is implemented by computer technology that replicates an environment, which may be a simulation of a real or imaginary environment, and that simulates the user's presence in the environment and allows the user to interact with the environment. Virtual reality environments can be provided in a variety of ways, such as by displaying them on a computer display or using special virtual reality headsets worn on the user's eyes to provide a visual and acoustic simulation of the virtual reality experience. In at least some embodiments, the virtual reality includes additional sensory input, such as haptic / tactile feedback to the user, which can simulate various interactions with the virtual reality.

[0045] In the embodiments described herein, the term "virtual reality" is intended to encompass either or both of virtual reality and augmented reality, the distinction between which does not affect the present invention.

[0046] VR training and simulation, including VR currently used in some fields (e.g., military training), may have several shortcomings. For example, current virtual training systems may lack optimal, modular capabilities to perform desired functions or provide desired features, such as collecting and transmitting mission data, recording data regarding both the mission and the environmental conditions associated with such missions, providing interoperability between various types of proprietary virtual training systems, providing cybersecurity and other types of security protections, preventing, detecting, and / or logging intrusions into the system and its data, providing the ability to operate in closed environments, tracking environmental and other data during use to ensure the reliability and security of the system, for post-processing, analysis, etc.

[0047] VR and virtual training systems, especially those used by the military, are often proprietary and difficult to integrate with each other in a modular, easily configurable manner. Such proprietary systems can be difficult to upgrade or customize. Additionally, because many of the current systems are proprietary and difficult to modularly connect to each other and to various types of computer systems, it can be difficult to run simulations that span multiple domains, that use formats (e.g., terrain formats), simulation devices, and / or simulation features (e.g., audio features, haptics features) that are only available on a particular simulation system, or that are configured or controlled differently depending on the particular simulation system.

[0048] Simulations often operate in closed and limited networks, are facility-based, require high labor costs, and have multiple incompatible features such as different simulation formats, audio and haptic capabilities, and environmental tracking that may require customized control or translation of conflicting commands. Reconfiguring haptic, audio, and visual command and control and / or modifying them to work with different types of systems can be costly and time-consuming. Also, some types of simulations, such as live, virtual, and constructive exercises, can take months to set up and often can only be performed at pre-determined physical locations. This limits the availability of training and responsiveness to user needs, and increases the time and expense of some types of simulation systems to plan and execute training and other activities. It would be advantageous to give existing simulation systems the ability to translate user inputs, command and control, and communications such as commands and / or messages from simulation software from traditional simulation scenarios into standardized instructions that can be used by a wide range of simulation systems. In certain embodiments described herein, by including a Common Interface Board (CIB) as hardware that can be included or installed in a wide range of simulation devices, in certain embodiments, the CIB serves as a development kit around which specific training devices can be built. In certain embodiments, the CIB helps provide the ability for different types of simulation subsystems to adapt and respond to a simulation scenario by translating instructions transmitted in a unified format into commands and controls tailored to the tactile, audio, and visual capabilities of a particular simulation system, as well as by translating user input into a standardized format.

[0049] In certain embodiments, the CIB functions as the "brain" of the physical training device. For example, in some embodiments, the CIB detects when a user performs an action, such as pressing a button, squeezing a trigger, extending an antenna, replacing a battery, etc., and translates that user input into a message that can be processed and understood by a connected computer system (e.g., a personal computer running a conventional operating system such as Microsoft Windows) and simulation software (e.g., which may be running on that computer system). Advantageously, in some embodiments, this interaction through the CIB allows any action performed on the physics simulator (e.g., a device simulator) to be reflected in the simulation software. Furthermore, in certain embodiments, the CIB receives commands or messages from the simulation software and outputs those messages as haptic events. For example, when a user squeezes the trigger of a simulation device (e.g., a simulated weapon), in certain embodiments, the CIB detects that the trigger switch is closed and sends a signal to the simulation software (running on a simulation computer subsystem in operative communication with the CIB) to "fire" the simulated weapon. The simulation software then sends a signal back to the CIB instructing it to simulate the recoil of the weapon (e.g., as a haptic effect). In response, the CIB activates a vibration motor according to a pre-programmed vibration profile to simulate the recoil of the weapon. In certain embodiments, the CIB is configured to provide communications capabilities that allow for "pass-through" communications between a third party device (a device separate from the simulation system) and a connected communications system.

[0050] Additionally, some environments, such as certain closed area systems, may require communication exclusively via wired rather than wireless connections, or the ability to switch between using both, but not all VR and simulation equipment provides that flexibility. Because end users of high-fidelity training environments need a way to securely pass input and output data from the physical training device to the computing solution that runs the virtual reality-enabled scenario, if simulation components can only communicate one way (e.g., wireless only or wired only), this can limit their usefulness.

[0051] Additionally, end users of high-fidelity training environments need a way to securely pass input and output data from physical training devices to the computing solutions running the virtual reality-enabled training scenarios, ensuring that the data and other simulation information is not compromised. While there are commercial off-the-shelf (COTS) components, such as circuit card assemblies, that translate physical user input into keystrokes that can be used as input by computer systems, these are typically designed to be low-cost and proprietary for purely commercial applications and do not operate with the reliability, security features, and configurability required for applications such as military simulation systems.

[0052] Because the components of some types of simulation systems, particularly military simulation systems, are expensive and may contain classified components, it may be important to ensure reliability and that the components are used properly in the appropriate environment (e.g., indoors only if the simulation device has limitations). However, military simulation systems built or modified from commercial off-the-shelf (COTS) VR equipment often do not include any means of detecting if the device has been exposed to inappropriate or harsh environmental conditions during use, and without a way to track the environments to which the simulation equipment has been exposed to see if any effects on reliability may have occurred, it may be difficult to ensure reliability and plan proper maintenance. Known systems also do not incorporate cybersecurity features, such as anti-intrusion features, that ensure the integrity and confidentiality of components that keep data and other simulation information safe. As one skilled in the art can appreciate, data generated during the simulation of a weapon system can be used to determine or derive information about weaknesses and limitations of such systems, as well as to identify classified information (e.g., operating frequencies, secure passwords, encrypted information, etc.). For example, an adversary who acquires an opponent's weapon simulation device may attempt to infiltrate and / or reverse engineer a particular simulation subsystem to determine how the opponent's corresponding weapon system functions, which may be sufficient information to formulate a way to overcome and defeat the particular weapon system. A malicious actor may also attempt to use information gleaned from the intrusion and / or reverse information related to the first system to gain access to a second system.

[0053] As military simulation systems, including virtual reality systems, become more prevalent, there is an increasing need for low-cost, cyber-secure, modular interface devices between computer systems and advanced training hardware. In certain embodiments described further herein, an interface assembly is provided that helps address at least some of the above concerns. The interface assembly is also referred to herein as a common interface board (CIB), interface circuit cart assembly (CCA), and "interface assembly." The CIB helps meet the need for secure computer interfaces between computer systems and advanced training hardware and simulation systems, including, but not limited to, hardware, devices, and / or systems used in virtual reality training environments, synthetic environments, and synthetic training environments.

[0054] FIG. 3A is a high-level block diagram of a first exemplary system 300 utilizing a common interface board (CIB) 316 (described in further detail below in connection with FIG. 4 ), illustrating the physical and logical interfaces between the CIB and other components of the simulation subsystem 301, according to one embodiment. FIG. 3B, also described further herein, presents a more detailed block diagram of a second exemplary system 300B, similar to the first exemplary system of FIG. 3A. FIG. 3C, also described further herein, presents another more detailed block diagram of a third exemplary system 300C, similar to the first exemplary system of FIG. 3A, but illustrating an exemplary enclosed area configuration. FIGs. 3B and 3C each illustrate the components of the high-level block diagram 300 of FIG. 3A in more detail, illustrating in more detail the elements of each subsystem and the interactions between the CIB 316 and other systems in the environment in which it operates. For example, as shown in FIG. 3B, any one or more of the types of simulation subsystem 301 illustrated next to the left bracket can be used as part of the simulation subsystem 301.

[0055] 3A, 3B, and 3C, the system 300 includes one or more simulation subsystems 301 operatively connected to one or more first computer subsystems 318 used as simulation computer subsystems 318. The first computer subsystems / simulation computer subsystems 318 are in operative communication with one or more second computer subsystems used as further processing and storage subsystems 303. The simulation subsystem 301 (which may also include a computer system) is the subsystem with which a first user 312a running a simulation typically interacts. Other users 312b, 312c of the system can interact with various parts of the system. For example, user 312b can interact with the simulation computer subsystem 318, user 312c can interact with the second computer subsystem 303, and in some environments, the first user 312a can also optionally interact with one or more of the other computer subsystems. In some embodiments, for example, the same user may interact with multiple subsystems. It should also be noted that in some embodiments, user 312 may be physically separate from one or more of the subsystems with which he or she interacts.

[0056] In some embodiments, the first user 312a (and users 312d and 312e in FIG. 3B ) interacts with the simulation subsystem 301 via a simulation device 313, which may include VR goggles / headgear 106, a headset with a microphone (not shown, but well understood), and / or any one or more types of simulator devices 313a-313f. For example, the simulator device 313 (also referred to herein as simulation device 313) may include a device simulating a gun, a shoulder-fired missile (e.g., a Stinger®), a device simulating a weapon such as a Mk 153 shoulder-fired multipurpose assault weapon, a device simulating a rocket-propelled grenade (e.g., as described in commonly assigned U.S. Patent No. 7,922,491, which is incorporated herein by reference). Additionally, as shown in FIG. 3C, in some embodiments, the user 312e can interact with the simulation computer subsystem 318 via a custom or COT device 331, such as a tracking puck or similar device (e.g., a VIVE Tracker available from HTC VIVE, Seattle, Washington). Note that the examples of simulator devices 313 shown in FIGS. 3A-3C are illustrative and not limiting. Additionally, in some embodiments, the VR goggles / headgear 106 may include smart glasses, such as Google Glass, a smart visor or band, or any other device including a display capable of generating VR and / or augmented reality images in a head-up device.

[0057] In some embodiments, the simulation subsystem 301 and its haptic, audio, and / or vision devices 311 are configured to stimulate sight / vision, sound, and touch / touch modalities. As will be appreciated, in some embodiments, sight presents a user with a natural view and allows the user to view the simulated environment (e.g., a common synthetic environment (CSE)) from a first-person perspective. Audio / sound allows the user to hear voices and provide speech input to the CSE. Touch / touch allows the user to interact with the CSE using physical and tactile controls of systems, subsystems, components, and mission command information system interfaces.

[0058] Each simulation subsystem 301 includes a respective common interface board (CIB) 316 (described in more detail in FIG. 4 herein). That is, in certain embodiments, each simulation device 313 includes its own CIB 316, which in some embodiments is housed within the simulation device 313 and operably connected directly to circuitry within the simulation device 313. In some embodiments, the first user 312a may also optionally interact with the simulation computer subsystem 318, for example, to set up and execute simulation scenarios.

[0059] The CIB 316 in the embodiment of FIG. 3A represents a critical interface between the components of the exemplary general simulation system 301 and the rest of the environment in which it operates (e.g., a synthetic training environment (STE)). For example, the exemplary simulation system 301 includes a simulator device 313, a number of health management / environmental input sensors 309, and one or more haptic, audio, and / or visual devices (e.g., a VR headset 106) 311. The health management / environmental input sensors 309 can sense and / or track environmental factors (including, but not limited to, temperature, humidity, motion, shock, and time) that may affect the operation, reliability, and / or “health” of the simulation subsystem 201. The number of haptic, audio, and / or visual devices 311 generate various simulated effects for the user 312a during the simulation in response to received commands, including, but not limited to, sounds, motion / vibrations, visual effects, and the like.

[0060] 3B, in various embodiments, the simulation subsystem 301 includes one or more of a tactical training subsystem 302, a maintenance training subsystem 304, a simulator device simulation subsystem 313, an other training / simulation / applications subsystem 306, a custom simulation subsystem with one of many different types of commercial off-the-shelf (COTS) controllers 308, such as a tracking puck 331, and / or a custom simulation subsystem with keyboard control 310. In some embodiments, the simulation subsystem 301 may be a commercial gaming system or a virtual reality system. In some embodiments, the simulation subsystem 301 may be similar to the prior art simulator subsystems described in connection with FIGS. 1A-2.In some embodiments, the simulation subsystem is implemented using methods and systems described in any one or more of the following commonly assigned U.S. patents: 10,198,957 ("Computer-Based Virtual Trainer"), 8,662,892 ("Universal Hands-On Trainer"), 7,507,089 ("Methods and apparatus to provide training against improvised explosive devices"), 7,927,102 ("Simulation devices and systems for rocket propelled grenades and other weapons"), 7,922,491 ("Methods and apparatus to provide training against improvised explosive devices"), 8,157,565 ("Military Training Device"), 9,011,151 ("System and method for simulating firing a gun"), 9,593,911 ("Blank firing simulated firearm for use in combat training"), and 9,767,615 ("Systems and methods for context based information delivery using augmented Nos. 10,508,913 (“Environment recording system using virtual or augmented reality”), and 10,788,889 (“Virtual reality locomotion without motion controllers”), each of which is hereby incorporated by reference.

[0061] It will be appreciated that any type of simulation subsystem 301 is possible, so long as it is operably connected to the common interface board 316 and capable of communicating physical inputs and outputs between the user 312, the simulation subsystem 301, and the simulation computer 318 (e.g., in some embodiments, the CIB 316 is hardwired inside the simulator of the simulation subsystem 301).

[0062] 3B, each simulation subsystem that interacts with the simulation computer subsystem 318 has its own CIB 316 configured to respond to various types of user inputs applicable to the system. For example, the tactical training subsystem 302 has a CIB 316a, the maintenance training subsystem 304 has a CIB 316b, a first user 312a (wearing a VW headpiece 106) carries a simulation device 313 having a CIB 316c operatively connected to the simulation device 313, various other optional training / simulation application subsystems 306 each have a respective CIB 316d, and any custom subsystems, such as the custom controller 308 or custom subsystem 310, each have a respective CIB 316e, 316f.

[0063] 3B, the tactical training simulation subsystem 302 may be any type of simulation system 301 configured to allow a user to simulate being in a tactical, warfare, and / or military type environment, including various types of scenarios of actions that may occur or be performed in that environment, whether alone or with other users 312 participating in the simulation in the same environment. The tactical training subsystem 302 may involve the user using weapons, but this is not required. For example, some tactical training simulation subsystems 302 may allow the user 312 to simulate driving or flying in an environment where others are using weapons, or surveying an area or building for objects or people while avoiding hazards in the area, or operating a replica radar system monitoring a simulated target to track, or repairing a tactical machine or tactical vehicle or aircraft, etc. Of course, these examples are not limited to these. Similarly, it should be noted that the users 312 of the tactical training subsystem 302 do not need to be physically in the same location, even if they are all in their respective closed areas 380. As will be appreciated, the connectivity provided using the CIB 316, simulation computer subsystem 318, and various wireless and wired communication configurations (e.g., cloud network 320 of FIG. 3B) is compatible with existing multiplayer and networked training scenarios (e.g., common operating environments, etc.) such that users can run simulation scenarios anywhere in the world.

[0064] The maintenance training simulation subsystem 304 of Figure 3B, in some embodiments, allows a user to practice performing maintenance related tasks on equipment, vehicles, aircraft, parts, etc. As shown in Figure 3B, the simulator device simulation subsystem 313 allows a user 312b to practice operating and firing a weapon.

[0065] Depending on the application, in some embodiments, the simulation subsystem 301 may also include one or more of many other simulation systems 306, such as those that can be used to simulate activities such as construction, machine operation, vehicle and / or aircraft control, equipment repair and / or maintenance, and of course games and other recreational applications. In some embodiments, the simulation subsystem 301 may be implemented using a custom simulation subsystem 308 that utilizes, for example, a COT controller (e.g., any type of game controller, joystick, steering well, mouse, etc.), configured to have a respective CIB 316 connected as described herein. In some embodiments, instead of using a separate simulation device 313, the simulation subsystem 301 may be implemented using a computer system under keyboard control 310 (including an on-screen haptic keyboard), in which case the CIB 316f is incorporated as part of the computer system under keyboard control 310. For example, in some embodiments, the computer simulation system under keyboard control 310 may be a desktop computer, laptop computer, tablet computer, mobile communication device (e.g., mobile phone), etc., in operative communication with or attached to an appropriately configured CIB 316f.

[0066] The CIB 316 is a modular component discussed further below (particularly in relation to FIG. 4 ) and represents an interface between the user 312a, the simulation device 313 (also referred to as the training simulator 313), and the simulation computer subsystem 318, which hosts the simulation software. In certain embodiments, the CIB 316 acts as the “brain” that communicates the intent of the user 312a to the simulation subsystem 301 (which may be a virtual training simulator) in which the user is “immersed.” The CIB 316 receives input from various sources (user, machine, computer) and outputs one or more signals corresponding to computer, haptic, and visual commands. Additionally, in some embodiments, the CIB 316 receives data and information from the simulation computer subsystem 318, such as software and firmware (including software and firmware updates), and in some embodiments, information regarding the control signals (e.g., haptic and audio signals) of the simulation subsystem 302, and other information that may be required to schedule, execute, modify, track, and / or record one or more simulation(s) being executed by the simulation subsystem 301.

[0067] In one embodiment, the CIB 316 is an assembly configured to pass commands between the simulation subsystem 302 (e.g., the physical training simulator 313 used by the user 312a) and the simulation computer subsystem 318 that hosts the software simulation. The CIB 316 differs from commercial gaming options (e.g., the board inside a traditional commercial game controller) in at least the following ways: The CIB 316 is configured to ensure cybersecurity rigor for use in military-related environments. The CIB 316 has an on-board health management system (described further herein) and is configured and designed to be adaptable to a variety of security environments, including operations in classified spaces, as described in more detail below.

[0068] In some embodiments, the CIB 316 outputs computer, haptic, audio, and visual signals and / or commands that serve to control, in part, how the simulation subsystem 301 operates, including how the simulation device 313 responds to user inputs, environmental inputs, and control signals that control the simulation scenario, and how it operates to determine how audio and visual information is provided to the user 312 via the simulation device 313, the simulation headset 106, a visual display (not shown in FIGS. 3A-3B, but visible, e.g., in the exemplary simulation system of FIG. 2), or other simulation components, such as indicators (e.g., light emitting diode (LED) devices) that can provide information to the user. The simulation computer subsystem 318 transmits received inputs to the CIB 316 (e.g., via Bluetooth or a wired connection, as shown in FIG. 3B) and converts them into haptic or audio commands that are sent to components of the simulation subsystem 301 and / or the simulation device 313.

[0069] The functionality of the CIB 316 of the systems of Figures 300A and 300B helps to ensure that a wide variety of simulation subsystems and simulation computer systems are interoperable and can exchange information related to simulation scenarios in a standardized modular format, among other things. The CIB 316 is also configured to ensure that the simulation subsystem 301 adheres to specific requirements for training simulations, such as cybersecurity rigor for advanced training simulations, provide the simulation subsystem 301 with on-board health management capabilities, and provide the simulation subsystem 301 with the ability to adapt to different security environments (e.g., classified and unclassified spaces) to provide a high level of reliability for demanding applications, such as military environments. Advantageously, in at least some embodiments, the CIB 316 is configured to be housed within the simulation device 313 associated with a given simulation subsystem.

[0070] The simulation subsystem 301 receives information regarding user input and / or user actions (e.g., a button is pressed, a weapon is fired, a user moves, etc.). In some embodiments, the CIB 316 may receive this information directly, for example, via an operative connection to the appropriate button. In some embodiments, circuitry within the simulation device receives the input and then forwards it to the CIB 316. The CIB 316 communicates the user input information, or information related to the user input information, to the simulation computer 318. Note that FIG. 3B illustrates one or more respective computer subsystems 318a-318n in communication with multiple respective CIBs 316a-316f, each associated with a respective simulation subsystem 301. That is, in the embodiment of FIG. 3B, each respective subsystem 301 is associated with its own respective simulation computer subsystem 218. In further embodiments, the system 300B may be implemented such that in certain embodiments, one simulation computer 318 serves multiple simulation systems 301 (e.g., multiple CIBs 316). In other embodiments, each simulation system 301 may be in communication with a dedicated respective simulation computer subsystem 318 .

[0071] As shown in Figures 3B and 3C, some of the communications 317, 319, 353, 321, 329a, 329b between a particular simulation subsystem 301 and a simulation computer subsystem 318 occur within any closed or secure area or boundary 380 (e.g., at least within a secure training or maintenance facility as previously defined), at least some of which are shown with a "lock" symbol to indicate secure communications. Figure 3B shows a first closed area 380a and Figure 3C shows a second closed area 380b, where a user 312a is using a tracking puck 331 as part of a custom simulation system 308. As shown in Figures 3A-3C, communications between the simulation subsystem 301 and the simulation computer subsystem 318 may be wired (e.g., via USB-C) or wireless (e.g., via Bluetooth 315, via wireless network 314, etc., if within appropriate distance and configuration), as further described herein. In some embodiments, the choice of wired or wireless communication may depend on the environment in which the simulation system 301 is used. In some embodiments, operation in a particular enclosed area 380b may require that all communications between the simulation system 301 and the simulation computer subsystem 318 be wired. In certain embodiments, the CIB 316 may be configured to be switchable between wired and wireless communication (e.g., via a wired / wireless switch 436, as shown in FIG. 4, which is described further herein). Any other communications shown in FIG. 3B, such as communications 323, 325, 327, may be outside any enclosed area 380 and may not need to meet the same security requirements as the secure communications 317, 319, 353, 321.

[0072] Upon receiving communication from the CIB 316, the simulation computer 318 can respond with an appropriate response to the user 312's actions, and the simulation computer 318 (and / or optionally the CIB 316) is configured to respond to the user input and generate appropriate output controls / commands to control and / or respond to the simulated actions, such as haptic commands, audio commands, visual commands, and / or other computer commands that can control simulation components. In certain embodiments, the CIB 316 is configured to control all physical circuitry associated with responding to the user 312's actions, including storing in memory the information (e.g., a profile) necessary to generate the desired simulated response (see FIG. 4). For example, consider a situation in which the CIB 316 receives a trigger signal from the simulation computer subsystem 318. In response, the CIB 316 selects an appropriate vibration file from a library stored in memory and activates the appropriate haptics (e.g., vibration motors) as instructed in the profile. In certain embodiments, CIB output 316 includes output sent internal to the simulation subsystem 301 itself (e.g., to simulation device 313), as well as output sent external to the system, such as communicating information regarding user commands, logs of simulation information, etc. to the simulation computer subsystem 318. This is described further herein, particularly with respect to FIG.

[0073] The CIB 316 may also communicate environmental information to which the simulation subsystem and / or simulator device 313 was exposed (e.g., temperature, humidity, simulator device drop impact, time information), and may communicate that information to the simulation computer subsystem 318. Environmental information is also referred to herein as health information, and such information may be obtained via sensors (e.g., included as part of the CIB itself and / or as part of the simulation subsystem 301 itself), via external systems configured to provide that information (e.g., for information such as temperature and humidity, via external sensors or devices, via a local weather information service, etc.). In certain embodiments, this information may be communicated from the simulation computer subsystem 318 to a second computer system 303 that performs post-processing and may analyze and / or store the results, although in certain embodiments, the simulation computer subsystem 318 may perform post-processing and store the results itself, as shown in FIGS. 3B-3C and further described herein.

[0074] As shown in FIGS. 3A-3C, the CIB 316 is in operative communication with a simulator computer subsystem 318, which in at least some embodiments may be any type of computer system including, for example, a laptop or tablet computer, a mobile phone, or any computing device similar to that shown and described in connection with FIG. 10 (further described herein). In certain embodiments, the simulation computer subsystem 318 performs all processing required for a particular simulation, provides all data storage, performs all post-processing analysis, etc. In certain embodiments, the simulation computer subsystem 318 may be under the control of user 312a, under the control of user 312b or 312c, under automatic control, under remote control, under the control of other users not shown in FIG. 3, etc.

[0075] In certain embodiments, the simulation computer subsystem 318 is configured to send and receive information to and from one or more second computer systems 303, which may or may not be remote from the simulation computer subsystem 318 (e.g., via wired or wireless communication, such as via wireless network 314b and / or via cloud 320, as described above). In at least one embodiment, the simulation computer subsystem 318 is generally configured to communicate with one other computer system at a time, but is configured to be operable to communicate with multiple different external systems, such as software / firmware subsystem 330, trainer subsystem 340, non-tactical network 360, etc., at various times. The second computer subsystem 303 (described further below) may also be a computer system similar to that shown in FIG. 7. In some embodiments, one or more third users 312c interact with the second computer subsystem 303. As shown in FIGS. 3B and 3C, in certain embodiments, the second computer system 303 includes a software / firmware subsystem 330 and / or a trainer subsystem 340. Although not specifically shown in FIG. 3B or FIG. 3C , to simplify the complexity of the figures, in at least some embodiments, the components of the second computer system (e.g., software / firmware subsystem 330 and / or trainer subsystem 340) can be in operative communication with each other.

[0076] The one or more other second computer subsystems 303 include subsystems that can perform pre-processing, post-processing, data storage, analysis, and the like. For example, in certain embodiments, pre-processing includes generating simulation scenarios for the simulation computer subsystem 318 to execute, providing software and / or firmware updates to both simulation computer subsystems 318, providing sufficient information to the simulation computer subsystem 318 so that it can send appropriate haptic controls, audio controls, visual controls, and the like to the CIB 316 (including responses to user input / actions at the simulation device 313) so that the CIB 316 can adapt them to the needs / requirements of the simulation subsystem 301. In certain embodiments, post-processing may include performing one or more various types of post-simulation analysis, including, but not limited to, analyzing the simulation itself (e.g., based on simulation data and / or log data sent from the CIB 316 to the simulation computer subsystem 318), user data and responses, simulator health and usage data, reliability data, error logs, security and intrusions, and the like. In some embodiments, the second computer system 303 may be an external subsystem, which may include any entity that may require or be interested in information regarding the simulation.

[0077] 3B and 3C include illustrative examples of second computer subsystem 303 that may perform at least some of these functions. Software / firmware subsystem 330, in certain embodiments, includes software / firmware update module 332, computer-based maintenance module 334, and data storage 336a. Software / firmware update module 332 may optionally push distributed data via digital distribution. In certain embodiments, software / firmware subsystem 330 implements a distributed data and digital distribution (so-called "D4") configuration, which allows information generated by simulator subsystem 301 to be available for analysis and troubleshooting purposes, for example, by non-tactical network 360 (discussed further below). At the same time, in certain embodiments, the D4 arrangement provides the ability for software embedded in CIB 316 to be updated remotely, which in certain embodiments may help address discovered vulnerabilities and reduce the overall risk of cyber exploitation. In certain embodiments, D4 reduces the mean time to patch software, allowing for faster response to vulnerabilities. In certain embodiments, the D4 configuration provides the ability to know the health status of all field simulation systems 301 that utilize the CIB 316.

[0078] In certain embodiments, the software / firmware subsystem 330 may also implement automated data collection, for example, via telemetry offload (telemetry refers to at least the collection of measurements or other data at remote or inaccessible locations and their automatic transmission to receiving equipment for monitoring). In certain embodiments, the software / firmware subsystem 330 provides functions such as training material updates, maintenance data reports, report distribution, and / or cyber audits. Advantageously, in certain embodiments, the software / firmware subsystem performs its actions in a platform-independent manner.

[0079] In certain embodiments, the trainer subsystem 340 includes data storage 336 and modules 342 configured to perform after action reviews, analyze and / or store simulator health data, and analyze and / or store usage data. In some embodiments, the use of the simulator subsystem 301, exposure to adverse environmental conditions, reverse engineering attempts, and / or intrusion / security issues are all logged and recorded in the CIB 316. The trainer subsystem 340 can use and analyze this information to improve next generation products, support warranty claims, reduce vulnerability of the simulation subsystem 301 and / or other components to cyber or other types of attacks. In some embodiments, the trainer subsystem 340 (or other subsystems that receive the collected information) can be configured to perform various types of analysis, such as big data analysis, to analyze the data regarding the simulation and make recommendations for adjusting the training performed in the simulation to optimize results, implement predictive analytics, etc., as will be appreciated.

[0080] The type of interconnection and interoperability permitted by systems such as those of FIGS. 300A-300B allows user 312 the benefit of post-action review (e.g., information about actions as they occur, etc.) immediately after the completion of a simulation or even during the simulation. Consider an example in which simulation device 313 and simulation subsystem 301 replicate the look, feel, and operation of a shoulder-fired missile system such as a Stinger® (e.g., as shown by device 313b in FIG. 3A). Simulation device 313b provides the user with the ability to press buttons and configure other controls that simulate the operation of an actual weapon such as a Stinger®, after which the user can see and hear the launch of a virtual missile and strike a target, and feel the vibrations and launch of the Stinger® missile as the missile "leaves" the launch canister. Further, in some embodiments, system 300B includes provisions for post-action review of the simulation and data analysis (as described above), so that user 312d can, for example, use the simulation device for practice without an instructor and then potentially obtain automated feedback from one or more second computer systems 303, which feedback is transmitted to simulation computer subsystem 318a and then transmitted via CIB 316 to simulation subsystem 301 for post-processing and other analysis that is automatically operatively connected to the simulation device via CIB 316.

[0081] The feedback can be provided in multiple ways, such as via a screen display associated with the simulation subsystem 301 or the simulation device 313, via audio or video, etc. The video can be provided separately from the simulation device 313 itself, for example. For example, the video can be displayed on a smartphone in operative communication with and connected to the simulation device (as will be appreciated, such a configuration can also be used during actual simulation). Additionally, the interconnections shown in FIG. 3B mean that a particular simulation subsystem can be connected to other simulation and training devices in the U.S. Department of Defense's Synthetic Training Environment (STE) or other high-level architecture networks. The CIB 316 makes the simulation subsystem modular and open, enabling multi-service combined training across a variety of virtual and augmented reality systems.

[0082] The simulation computer subsystem 318, in certain embodiments, sends commands and controls to the CIB 316 and receives information from the CIB 316 related to user, machine, and hardware simulator inputs received by the CIB 316. In one embodiment, the simulation computer subsystem 318 sends inputs to the CIB 316 that are received and converted into haptic or voice commands and sent to the components of the CIB 316 and to the simulator device 313 in use so that the user 312 can experience or use them during a simulation scenario. Communication between the subsystems shown in Figures 3A-3C, and even between the user 312 and the subsystems (or between the user 312 and each other), can be done in a variety of ways, including wired connections, wireless connections, or a combination of the two types in certain embodiments. It will also be understood that users 312a, 312b, 312c can communicate with one another in many different ways not specifically shown in Figures 3A-3C, such as by mobile or landline telephones, two-way radio transceivers (e.g., so-called "walkie-talkies"), pagers, proprietary headset communications, Voice over IP (VOIP) protocols using computing devices, and / or various face-to-face communications.

[0083] For example, with reference to Figure 3B, the various simulation systems 302, 304, 306, 308, 310 (and user 312d) are in operative communication with one or more respective simulation computer subsystems 318a-318n. In certain embodiments, the simulation systems 302-310 may all be in communication with a single computer subsystem 318. In certain embodiments, the simulation subsystems 302-310 may all be in communication with corresponding simulation computer subsystems 318a-318n. The communication may be wired or wireless, as previously described, over a secure or non-secure network, and / or within an enclosed area 380 or a non-enclosed area, depending on the application and needs. In the exemplary embodiment of FIG. 3B, within the enclosed area 380a, the tactical training subsystem 302, the maintenance training subsystem 304, and the user 312d are all located within the enclosed area 380a and can communicate via respective secure communication links 317, 319, 321, which can be wired (such as links 317, 319) or wireless (such as 321). For example, in some embodiments, the wired connections 317, 319 are implemented directly via Universal Serial Bus C (USB-C) and the third communication link 321 is implemented via Bluetooth® 315, by way of example and not by way of limitation. It is contemplated that any secure communication connection, wired or wireless, whether currently known or developed in the future, can be used to implement a communication connection or link in accordance with at least some embodiments herein. Additionally, in at least some embodiments, a given communication link can be configured to use one or more types of encryption, including, by way of example and not by way of limitation, encryption algorithms and standards approved by, for example, the National Security Agency (NSA) or Federal Information Processing Standards (FIPS), as appropriate. It should be noted that in some embodiments, in certain enclosed areas, such as enclosed area 380b in FIG. 3C, only wired communication may be permitted.

[0084] A suitable wired connection between the CIB 316 and the simulation computer subsystem 318 may include any type of cable or connection capable of sending or receiving data or information to and from the computer, including, but not limited to, any one or more of a Universal Serial Bus (USB) connection (e.g., USB-C), FireWire, Ethernet, IEEE-488, Small Computer Standard Interface (SCSI), serial and / or parallel data cable connection, and / or any other connection now known or later developed that may provide a direct wired connection capable of exchanging information / data between the CIB 316 of the simulation subsystem 301 and the simulation computer subsystem 318.

[0085] In a preferred embodiment, the suitable wireless connection between the CIB 316 and the simulation computer subsystem 318 is a 1:1 Bluetooth® link, and the CIB 316 and the simulation computer subsystem 318 are so connected, and the CIB 316 does not have any other type of Internet Protocol (IP) connection. Furthermore, as one skilled in the art will appreciate, in some embodiments, other possible network connections may be used depending on the security needs of the application and / or operating environment, including any one or more of a wireless local area network (LAN), a wireless metropolitan area network (MAN) (e.g., so-called "Wi-Fi hotspots"), a wireless personal area network (PAN) (e.g., Zigbee, near field communication (NFC), possibly infrared), a wireless wide area network (e.g., mobile communication networks such as LTE, 3G / 4G / 5G, etc.), a cellular network, a wireless (Wi-Fi) network, a radio frequency communication system, and / or any other suitable wireless communication method and / or any type of wireless connection now known or later developed that can provide a wireless connection over which information / data can be exchanged between the CIB 316 of the simulation subsystem 301 and the simulation computer subsystem 318 in accordance with the standards required by the application and operating environment. As will be appreciated, in certain embodiments, information need not be shared directly between two entities (which could be a human user or a non-human user, such as another computer or a process running on a computer), but instead can be shared by uploading (using available or suitable wired or wireless configurations) to a secure location in the cloud where another entity can later access the information and view, use, store, analyze, etc.

[0086] In certain embodiments, the wired and / or wireless connections are configured to help the CIB316 provide a layer of security through software assurance practices on the CIB316 board embedded software development and proper configuration to ensure secure wireless communication over technologies such as Bluetooth. Software assurance aims to shift the focus from software patches to creating secure software. Secure coding practices, penetration testing and code analysis, and supply chain risk management all contribute to overall software assurance. In certain embodiments, the CIB316 includes embedded software developed according to software assurance best practices.

[0087] In certain embodiments, the CIB 316's wireless communication over BLUETOOTH is defined by hard-coded on-board software. In some embodiments, the components of the CIB 316 are configured and selected to be in a design configuration that ensures both the integrity and confidentiality of the pairing process and the overall communication thereafter to the computing device to which the CIB 316 transmits information, such as the simulation computing subsystem 318 or any other computing subsystem with which the CIB 316 communicates. In certain embodiments, the CIB 316 is configured to support the latest secure BLUETOOTH version. In certain embodiments, the CIB 316 includes a module that provides protection against downgrade attacks that may force the CIB 316 to accept insecure version / protocol communication.

[0088] Those skilled in the art will appreciate that many different types of wired and wireless connections are available, and the selection of a particular type will depend at least in part on the particular application and configuration of system 300 (e.g., distances between subsystems, environmental conditions, cost, types of devices being used, applicable military / commercial standards, security requirements, type of enclosed area, etc.).

[0089] 3A-3C, in certain embodiments, the simulation computer subsystem 318 and the CIB 316 may also perform mutual authentication and validation checks, as further described herein. This ensures that validation of the integrity of the CIB 316 does not rely solely on the CIB 316 itself (e.g., validating that no intrusion, damage, and / or other potentially harmful actions have been performed on the CIB 316 or the simulation subsystem 301 to which it is operably coupled). Security and authentication features are described in more detail below with reference to FIG. 4.

[0090] FIG. 4 is a functional block diagram 400 of the common interface board (CIB) 316 of FIG. 3 according to one embodiment. In certain embodiments, the CIB 316 utilizes as many commercial off-the-shelf (COTS) parts as possible to provide an appropriate balance between price and performance, including but not limited to this. In some embodiments, COTS hardware can be used in the CIB 316 as long as the hardware can meet the constraints of a particular application, taking into account factors such as size, weight, power, limited input / output (I / O), etc. As one skilled in the art will appreciate, a particular simulation subsystem 301 may be subject to additional constraints depending on the nature of its use, including but not limited to cybersecurity, reliability, and operating system constraints (e.g., military vs. manufacturing training vs. recreational environments, etc.).

[0091] In certain embodiments, the CIB 316 is adapted primarily for indoor use, but is not limited to such. In certain embodiments, the CIB 316 has security features (described further herein) that allow it to be granted an Authority to Operate (ATO) in enclosed space. In certain embodiments, the CIB 316 is designed not to include any classified components or hardware itself (even though it may interface with the simulation system 301 to perform simulations of classified systems).

[0092] As the example block diagram 400 of FIG. 4 illustrates, the CIB 316 includes several subsystems. One subsystem that includes the main operating circuitry of the CIB 316 includes a main microcontroller / microprocessor(s) 450, a communications subsystem / module 430 (including a BLUETOOTH® module 434 in some embodiments), a haptic / audio subsystem 420 that includes haptic modules 422_a, 422_b, and audio modules 424a, 424b along with a memory subsystem 470, and a power subsystem 402 that includes a power switch 405. Another subsystem provides a USB hub 432 that, in certain embodiments, allows for a wired USB connection for closed-area data transfer and / or possible USB charging. In certain embodiments, the USB hub 432 also allows data from a third party device, such as a tracking pack (e.g., tracking pack 331 of FIG. 3C), to be transmitted in a wired configuration rather than wireless communication. In certain embodiments, as shown in FIG. 3, the USB hub 324 can enable “pass-through” communication between third party USB-connectable devices and the simulation computer subsystem 318 via pass-through communication 329a, 329b. In certain embodiments, data can also be transferred via the USB connection in a non-closed area configuration. In certain embodiments, the CIB 316 also includes a health management subsystem 440 configured to measure temperature and humidity, simulator drop impact, and time. In certain embodiments, the CIB 316 also includes a reverse engineering protection system (REPS) 410 configured to provide the CIB 316 with several security features. Each of these subsystems is described in further detail below.

[0093] While the simulation subsystems 301 and simulation devices 131 that communicate with the CIB 316 will vary depending on the type of training product and simulation subsystem, in certain embodiments, there are universal features that are built into all training products. In certain embodiments, as will be appreciated, there are features that allow the CIB 316 to be customized for the type of simulation subsystem and / or simulation device 313. For example, in certain embodiments, universal features associated with the functionality of the CIB may include, but are not limited to, the following: - Standard button and switch states (examples include, but are not limited to, on, off, open, closed, states indicating event detection (e.g., trigger, safety), continuous press (e.g., uncaged), position change (e.g., potentiometer), rotation change (e.g., encoder, etc.)) - Sensor data (sensor data of health management systems, reliability thresholds) - BLUETOOTH or other wireless communication (unless in a closed area configuration) - USB connection for data transfer in closed areas, please note that wired connections such as USB can also transfer data outside closed areas, - USB connectivity for selected other functions such as battery charging, tracking pack charging, charging and / or updating USB peripherals, etc. - Timers for power-on times and battery saving modes (in certain embodiments, this functionality is implemented as part of a health management system, as further described herein) - I / O pin power allocation control and high and low power levels - Customizable features including but not limited to simulator-specific button and switch states, haptic and audio feedback

[0094] Universal functionality is described in more detail herein.

[0095] 3A-3C and 4, in certain embodiments, the CIB 316 receives a number of CIB inputs 480, such as mechanical and hardware simulator inputs, via a wiring harness (not shown, but readily understood) operably coupled directly from the simulator system 313 or simulation device 313 in which the CIB 316 is installed. In certain embodiments, the CIB 316 receives power from the CIB 316, such as via a USB cable connected to a power source (shown as one of the constraints 486 in FIG. 4). The wiring between the components of the CIB 316 allows the board to send computer commands over wired or wireless connections to other subsystems, such as the simulation computer subsystem 318. Inputs to the CIB 315 from the computer subsystem 418 (e.g., as shown in FIG. 4, via the CIB inputs 480 for computer inputs, via portions of the enablers 486, including but not limited to communication control, firmware, software, and simulation security standards, and via one or more constraints 482, including operating systems and drivers). As mentioned above, simulation computer subsystem 318 sends input, which may be received via a wired or wireless connection, to CIB 316, which converts the input to haptic and / or voice commands and sends them to CIB 316 and components of simulation subsystem 301 (including simulator device 313). These data flows are illustrated in Figure 5, which is an example block diagram illustrating basic data flows in an example simulation system 500 with a common interface board, according to one embodiment.

[0096] 5, it can be seen that the exemplary simulation device 313 communicates switch and sensor inputs 502 to a CIB 316 (located within the simulator device 131 in certain embodiments) via a wiring harness 503. The CIB 316 (also referred to in this figure as an "interface board" and also referred to in this document as an "interface assembly") is powered by current received via a USB cable 504 from a USB connected to a current source 506 (e.g., a wall plug). Wiring 508 within the CIB 316 enables the CIB 316 to communicate switch and sensor inputs 510 to a computing system 318 via a BLUETOOTH® or wired connection 314a, and to receive haptic and / or audio inputs 512 from the computing system 318 at the CIB 316.

[0097] 3A-3C and 5, the CIB 316 subsystems will now be described more briefly. In one exemplary embodiment, the CIB 316 includes a power subsystem 402, a reverse engineering protection subsystem (REPS) (also referred to herein as a security subsystem 410), a haptic subsystem 420, a communications subsystem 430, a health management system 440, a microprocessor or microcontroller 450, other support circuits 460, and a memory subsystem 470.

[0098] The power subsystem 402 includes one or more batteries 404, an electrical distribution system 406, one or more voltage regulators 408, and one or more power budget controls 409. In a particular embodiment, the CIB 316 operates on a tolerant voltage direct current (DC) system capable of driving two to four haptic, audio, and / or visual devices simultaneously. The power subsystem 402 provides a similar function to a standard power subsystem of any circuit card assembly (CCA) to provide the necessary voltage and current to all components of the CIB 316 as required. The power budget control 409 serves to control high and low power levels of the input / output pins of the CIB 316. Power for the power subsystem can be derived from either or both the battery 404 and / or an external power input to the CIB 316 (shown as one of the constraints 486). Those skilled in the art will appreciate that depending on the simulator subsystem 301 and / or associated simulator device 313, a given CIB 316 may require cooling from its power subsystem 402 (and possibly other subsystems of the CIB 316), as shown via optional cooling subsystem 490 (described further herein), although in at least some embodiments, cooling for the CIB 316 may come from other portions of the simulation subsystem 301 to which it is connected.

[0099] Reverse Engineering Protection System (REPS) 410 is a system configured to help detect whether an intrusion into the simulator subsystem 301 has occurred, and in at least some embodiments includes an intrusion detection system / hardware security method (HSM) subsystem 412, an encryption system 414, and an authentication subsystem 416. In certain embodiments, REPS 410 is configured to address (e.g., detect, log, and / or mitigate) at least one (and advantageously both) of logical and physical reverse engineering attempts and / or intrusions. Physical intrusion includes at least any action(s) that involves physical access to the CIB, whether manual, automated, or any combination thereof, and in certain embodiments, physical intrusion into the simulation system in which the CIB is located, including, but not limited to, physical intrusions that cause harm or damage, such as attempts to physically destroy, change, alter, and / or access (other than in an authorized manner) any component(s) or subsystem of the CIB 316. Logical intrusions include at least any action configured to cause damage without requiring physical access to the CIB 316 or the simulation system in which the CIB is located, such as damaging software or data without causing any physical damage to the CIB 316, attacks on the logical operational flow of the CIB 316, etc. For example, in some embodiments, the REPS system 410 is configured to support investigation of any problems (e.g., performance issues, simulation issues, reliability issues, incorrect operation, warranty claims, etc.) of the simulation system 301 that may arise due to circumstances, environments, simulation scenarios, software and / or hardware upgrades and / or modifications, user actions, and / or any other actions, particularly those resulting from unauthorized intrusion into the simulator system 301, whether intentional or not. Intrusions can result from many different types of actions, events, and circumstances, including, but not limited to, the following: - if an entity attempts to remove, disassemble, or otherwise obtain information about components of the simulation system 301 for the purpose of "reverse engineering" one or more components; - Unauthorized attempts to download data from the Simulation Subsystem 301; - Attempting to modify or replace any component, firmware, and / or software of the Simulation System 301 by interfering with its operation, installing malware / spyware, or as part of improper maintenance or repair; - Installing additional components in the simulation system in order to modify or maliciously track the operation of the simulator system 301; - Abuse or neglect of the system, such as failing to perform required maintenance, performing maintenance improperly, using the system in an inappropriate environment (e.g., using a simulator subsystem 301 outdoors when it is designed for indoor use only), spilling liquids on the simulator subsystem 301, dropping, throwing, or otherwise "banging" the simulator subsystem 301 if it is not designed to withstand such forces or excessive vibrations, etc. - Exposing the Simulator Subsystem 301 to an environment other than that for which it was designed or for which it does not have adequate weather resistance, such as extreme temperatures, humid or wet environments (e.g., dropping the Simulator Subsystem 301 into water), snow or ice, blowing sand and / or sea air.

[0100] In certain embodiments, a focus area for identifying threats and vulnerabilities to the CIB 316 and the systems it operates on is the so-called initial access phase of exploitation. The CIB 316 helps prevent initial unauthorized access or manipulation of the CIB 316, which in certain embodiments may be used for lateral movement to a broader training environment or for exfiltration of IP / proprietary information. In certain embodiments, security considerations for the CIB 316 take into account whether attacks on the CIB 316 are local (e.g., attacks on BLUETOOTH® communications that require physical proximity) or remote (more indirect types of attacks). As another example, another type of intrusion / attack attempt may be an attack / intrusion resulting from a supply chain compromise, such as a supply chain attack that affects hardware or software critical to the operation of the CIB.

[0101] In certain embodiments, CIB 316 (and indeed any subsystems in which it is installed) remains within a physically secure location, such as a physically secured area within a military installation, a closed area (e.g., as defined above), etc. Security measures known in the art, such as guns, guards, gates, and physically secure storage procedures, may help reduce the likelihood of a physical external attack on CIB 316. Additional policies, such as secure storage, may further mitigate the risk of physical exploitation, as will be appreciated.

[0102] In at least some embodiments, to help support the overall security of the CIB 316 as well as reverse engineering protection and / or to mitigate some or all of the above concerns, the REPS system 410, along with the rest of the CIB 316, is configured to ensure the integrity of the board / assembly. In certain embodiments, configuring the design of the CIB 316 to ensure the integrity of the board can include selecting components and connecting them to ensure that the physical, boot level, data storage, device pairing, communications, and update integrity are all verified. Additionally, ensuring the confidentiality and integrity of the communications carried by the CIB 316 is an important consideration in the operation of the REPS 410 and the overall design of the CIB 316. Confidentiality and integrity are paramount for communications for which the Board is responsible, including wireless communications (primarily BLUETOOTH®) and wired communications (e.g., USB-C).

[0103] In certain embodiments, as part of the REPS 410 system, the CIB 316 includes an intrusion detection / hardware security method (HSM) 412 configured to provide security and reverse engineering protection. In some embodiments, the HSM 312 is implemented using one or more commercially available circuits / modules that provide the necessary tools to achieve all levels of system security, from physical integrity to communication security. For example, in one embodiment, the HSM subsystem 412 is implemented at least in part using a physical computing device that protects and manages digital keys, performs digital signature encryption 414 and decryption functions, and strong authentication 416. As understood in the art, circuitry exists that can act as a "trust anchor" that helps protect the cryptographic infrastructure by securely managing, processing, and storing cryptographic keys within a hardened, tamper-resistant device. The exemplary HSM subsystem 412 can, in certain embodiments, include dedicated hardware that helps implement some of these functions, such as via one or more secure crypto-processor chips. In certain embodiments, the HSM subsystem 412 can be configured to leverage other functionality in the CIB 316, such as the microcontroller / microprocessor 450, to provide encryption, authentication, and / or cryptographic processing functionality. In certain embodiments, the HSM subsystem 412 is configured with one or more features that provide tamper detection 419 and / or evidence of tampering, such as visible signs of tampering or logs and warnings, or tamper resistance that makes tampering difficult without rendering the HSM 412 subsystem inoperable, or tamper responsiveness, such as deleting keys upon tamper detection.

[0104] As discussed above, in at least some embodiments, cryptographic processing functionality 418 can be implemented through functionality provided as part of HSM subsystem 412 (e.g., via a dedicated component) or through operations performed in, for example, microcontroller / microprocessor 450 and / or BLUETOOTH® 434 module. In certain embodiments, cryptographic processing 418 is configured to prevent tampering and bus probing. Note that in some embodiments, HSM subsystem 412 itself is protected by tamper-evident, tamper-resistant, or tamper-responsive packaging. In some embodiments, HSM 412 works in conjunction with other components, such as microcontroller / microprocessor 450, to help protect and manage digital keys for strong authentication. As discussed herein, in some embodiments, commercially available components can implement at least some hardware security functions, and illustrative examples of COTS hardware security devices usable in at least some embodiments of CIB 316 include, but are not limited to, HSM4 devices available from Zymbit of Santa Barbara, California.

[0105] In some embodiments, the presence of HSM subsystem 412 allows CIB 316 to be configured for an appropriate level of security while providing additional configuration options if a specific deployment requires more stringent security measures. In some embodiments, some functionality of HSM subsystem 412 works in conjunction with microcontroller / microprocessor 450 to act as a root of trust (RoT) for CIB 316, enabling authenticated updates, secure boot, and secure device pairing. Additionally, in certain embodiments, HSM 412 works in conjunction with microcontroller / microprocessor 450 to securely store public / private key pairs locally to enable verification of signed embedded software.

[0106] In certain embodiments, the security protections provided by the REPS 410 subsystem are compliant with the Risk Management Framework NIST 800-53 Rev5, a standard for security and privacy management of information systems and organizations issued by the National Institute of Standards and Technology (NIST) of the United States Department of Commerce. In certain embodiments, the requirements specified in this document serve to define the requirements applicable to the CIB 316 and / or the environment in which it operates, e.g., systems having high confidentiality, integrity, and availability classifications. These security requirements represent the highest possible level of security requirements and, in certain embodiments, can be adjusted down to a moderate classification depending on the particular deployment and use of the systems and components described herein, such as the CIB 316. This document includes customizable requirements for, for example, data and communications integrity / confidentiality, access control, authentication, auditing, software assurance, supply chain security, and reverse engineering protection. Those skilled in the art will appreciate that the components and systems described herein, such as the CIB 316, need not meet all applicable security controls in all embodiments. In certain embodiments, for example, the CIB 316 is categorized between a peripheral and a full-fledged mobile device to provide an appropriate level of security.

[0107] 4, the CIB 316 also includes a haptic / sensory subsystem 420 that includes multiple haptic components 422a, 422b and audio components 424a, 424b. While the terms "haptic subsystem" or "sensory subsystem" are used to describe this subsystem, it will be understood that the haptic / sensory subsystem 420 is not limited to providing haptic feedback to the user, but can also provide other user experiences and feedback, including audio and visual user feedback and experiences. In at least some embodiments, the haptic / sensory subsystem 420 is configured to provide a simulated user experience to the user 312, where the simulated user experience is configured to stimulate one or more of the user's 312 senses by having the device simulate what can be detected by a particular sense (e.g., sights, sounds, touch, smells, etc.). In at least some embodiments, the haptic subsystem 420 may not provide actual haptics or may not provide only haptics, but instead may be a sensory subsystem 420 configured to provide controls for providing multiple user experience functional simulations that may or may not include haptics and may or may not include other sensory simulations such as audio and visual simulations. As discussed herein, the simulation computer subsystem 318 receives input via a wired or wireless connection, which transmits input that is converted into haptic or audio or other sensory commands to the CIB 316, which transmits the converted commands to the CIB 316 and components of the simulation subsystem 301.

[0108] The CIB 316 receives CIB input 480 from various sources (user, machine, computer, simulator, environment, health data, etc.). For example, in certain embodiments (e.g., as shown in FIGS. 3A-4B), the simulation subsystem 301 includes a simulation device 313 that a user 312 can control and interact with, at least in part, by pressing a button, pulling a trigger, pointing it in a particular direction, flipping a switch, moving a lever or joystick, speaking commands, etc., and in response to user interaction with the simulation device 313, translated haptic, voice, or video commands are sent to the simulation subsystem 301 to control the simulation experience for the user 312a, including providing the user with haptic effects (e.g., vibrations), or particular sounds or images in the VR headset 106, etc. Additionally, in certain embodiments, input to the CIB 316 may include haptic information from or associated with devices or sensors that the user 312a may wear (e.g., information from or associated with clothing equipped with sensors such as a Multiple Integrated Laser Engagement System (MILES) device configured on the garment as described in commonly assigned U.S. Pat. No. 8,157,565, incorporated herein by reference, or even biometric sensors configured to track certain user data (e.g., the user's heart rate or body temperature). As will be appreciated, based on the haptic information from the user, or other user interactions, additional new haptics may be sent back to the user, or information may be recorded, or aspects of the simulation may be altered.

[0109] For example, where simulation device 313 replicates the look, feel, and operation of a shoulder-fired missile system such as a Stinger® (e.g., as shown via device 313B), simulation device 313 provides the ability for a user to press buttons and set other controls that simulate the operation of an actual weapon such as a Stinger®, see and hear the virtual missile being fired and striking its target, and feel vibrations and reactions as the Stinger® launcher simulates the actions that occur when the missile "leaves" the launcher.

[0110] 4, in some embodiments, CIB 316 further includes a health management system (HMS) 440 configured to monitor one or more environmental characteristics associated with the physical environment in which simulation system 301 is operating, which may include, for example, motion, temperature, humidity, and / or time. In some embodiments, HMS 440 includes one or more of a motion / orientation / position device or sensor, such as an accelerometer 442, a system for receiving environmental inputs, such as temperature and humidity 444, and an event timer.

[0111] As is known, motion sensors can be configured to measure acceleration and rotational forces along three axes and can include devices such as accelerometers, gravity sensors, gyroscopes, and rotation vector sensors. In certain embodiments, the accelerometer 442 (or other motion orientation device) is configured to detect motion of the CIB 316, and therefore any simulation device 313 and / or simulation subsystem 301 in which it is installed. The accelerometer 442 can detect, for example, whether a harmful drop or other impact ("drop impact") has occurred. As will be appreciated, other types of motion detection components can also be used to accomplish the function of detecting motion, including but not limited to the aforementioned devices, as well as altimeters, inertial measurement units (IMUs), magnetometers, barometers, compasses, and the like, that can detect certain types of motion.

[0112] In certain embodiments, the position sensor may be usable to detect movement in different ways (e.g., by calculating relative position and then determining the difference, but not necessarily as a function of time). As will be understood, a position sensor measures the physical location of the device. This category includes orientation sensors and magnetometers. The CIB 316 may use the position sensor in conjunction with other information (e.g., timers) to derive acceleration and other measurements that may be useful in determining whether the CIB 316 (and thus the simulated device 313) has been subjected to a particular type of event, such as a drop impact.

[0113] Environmental input component 444, in certain embodiments, includes one or more environmental sensors configured to measure one or more environmental parameters, such as ambient air temperature and pressure, salinity, illuminance, and humidity. This category includes barometers, light meters, and thermometers. In some embodiments, these types of sensors may be separate from CIB 316 or may provide input to CIB 316. In some embodiments, these devices may be included as part of CIB 316.

[0114] Event timer 446, in certain embodiments, can record elapsed time and can be used to match times to when certain events occurred, such as certain simulation events, environmental events (e.g., extreme temperatures, drop impact events), times between relative positions (helpful for obtaining operational information), provide timers for auto shutoff and battery time (such as to track power-on times and battery saver modes), provide timing functions that can be used by simulation subsystem 301 (e.g., times of simulation events, times between weapon fires, user response times), etc.

[0115] In further embodiments, those skilled in the art will appreciate that in a particular simulation, and depending on the needs of the application, the simulation subsystem in which the CIB 316 is installed, may also track other types of environmental factors, such as light levels (e.g., via a lighting sensor), and information from these sensors (or any sensors) may be used by other portions of the CIB 316. For example, the REPS system 410 described above may examine a log of events detected by the light and / or humidity sensors 44 to determine if the simulated device 313 in which the CIB 316 is installed has been opened or if a seal on a sealed unit in which the CIB 316 is installed has been broken.

[0116] Referring again to FIG. 4, the CIB also includes a memory subsystem 470 including memory such as, for example, NAND memory 472, flash memory 474, and non-volatile memory (NVM) 476 (e.g., to provide a device for logging data and simulation information). In at least some environments, the memory subsystem 470 includes components that store instructions that the microcontroller / microprocessor uses to operate the CIB 316. For example, the CIB 316, in certain embodiments, uses an elapsed time recording device (e.g., event timer 446) with collected data stored in non-volatile memory (e.g., NVM 476) even when the CIB 316 is not active. In certain embodiments, if an event occurs while the CIB 316 is inactive (e.g., an intrusion attempt), the CIB 316 stores information about the event in memory (e.g., NVM 476) until the board is activated, at which point it writes the event(s) to a device in the CIB 316 used to log the CIB. For example, in some embodiments, the log may be stored in NAND flash memory 472 and temporarily stored in microcontroller / microprocessor 450 until microcontroller / microprocessor 450 can write it to NAND 472.

[0117] 4, the CIB 316 includes one or more microcontrollers and / or microprocessors 450 that control the operation of the CIB 316. In one embodiment, for example, two microcontrollers may be used. In one embodiment, a single microcontroller is used. In at least some embodiments, examples of microcontrollers that may be used include (but are not limited to) the SAMX8 microcontroller and the ATSAMD21G18 microcontroller, both available from Atmel of San Jose, Calif., and / or the STM32F439 microcontroller available from ST Microelectronics of Geneva, Switzerland. Those skilled in the art will appreciate that many types of microcontrollers and / or microprocessors may be configured for use on the CIB 316.

[0118] The CIB 316 may also, in some embodiments, include various support circuits 460, such as one or more digital-to-analog (DAC) converters 462, digital amplifier(s) 464, etc., as will be appreciated by those skilled in the art.

[0119] Optionally, in some embodiments, the CIB 316 may include its own cooling subsystem 490. For example, in some embodiments, the cooling subsystem 490 may include one or more elements configured to ensure that the components of the CIB 316 do not overheat, such as one or more heat sinks 492, fans 494, heat exchangers / heat pipes, etc. 496, a thermoelectric cooling (TEC) system 499, and / or built-in thermal features 499 on the circuit board of the CIB 316 itself, such as thermal pads, vias, specific patterns or paths of routing wires / traces, as will be appreciated by those skilled in the art, and even the type and thickness of the board used in the CIB 316 may aid in cooling. In some embodiments, the CIB 316 also relies, in whole or in part, on external cooling provided by the environment in which it is installed or other devices of the simulation subsystem 301 or simulation device 313. For example, in some embodiments, the CIB 316 does not require its own cooling and does not include a cooling subsystem 490, and instead may utilize cooling available in the environment or system in which it is installed.

[0120] In certain embodiments, the CIB 316 is scalable and configured to employ a Modular Open Systems Architecture (MOSA) strategy. Advantageously, the embodiments described herein can be implemented in a Synthetic Training Environment (STE), such as a Common Operating Environment (COE). In some embodiments, the COE replaces or complements current "boxed" simulators that fill large rooms with screens, sensors, and projectors with laptop-powered virtual reality headsets that users (e.g., soldiers) can use to train anywhere, anytime, in open or closed environments. For example, some embodiments disclosed herein are configured to operate in a common operating environment developed for simulation operations, such as the Raytheon Technologies INSTINCT® common operating environment. Common operating environments such as INSTINCT® provide warfighting capabilities as software applications to military agencies. The INSTINCT® environment is configured to replicate realistic terrain and targets and enable users (e.g., military personnel) to collaborate and remotely train from anywhere in the world. In some embodiments, the techniques and devices described herein can be used in other STE environments, such as cloud-enabled STE environments, providing access to the entire system whenever and wherever needed.

[0121] In certain embodiments, as described herein, the CIB 316 is configured to be able to grant operational privileges in a closed area space, including at least the closed area defined as above. In certain embodiments, the primary method of enabling operation in this mode is to terminate any wireless communication capabilities. FIG. 3B above illustrates multiple simulation subsystems 301, each with a respective CIB, operating within a closed area 380b. As will be appreciated by those skilled in the art, in the closed area configuration embodiment of FIG. 3B, there is a secure wired connection between the CIB 316 and the simulation computer subsystem 318, with the closed area configuration simulation computer subsystem 318 performing authentication, monitoring, and providing updates. In an exemplary embodiment of the exemplary closed area configuration (e.g., closed area 380a of FIG. 3A and / or 380b of FIG. 3C), the CIB 316 is placed in a wired mode and communicates back to the simulation computer subsystem 318 via a wired interface, such as a USB-C interface, through the host computer.

[0122] Further, in certain embodiments, not only can data from the CIB 316 be sent to the simulation computer subsystem 318, but the USB hub circuitry 432 allows other separate USB wired party devices, such as a tracking puck 331 (FIG. 3B) or other device having an associated USB dongle or connector, to send data (e.g., via a USB connection from the dongle / connector to the USB hub 432) as a pass-through for communication between the third party device and the simulation computer subsystem 318, and / or for bidirectional pass-through communication with the simulation computer subsystem 318. The use of several types of tracking pucks as part of a VR simulation system is described, for example, in commonly assigned U.S. Patent No. 10,788,889, which is incorporated herein by reference. The use of tracking pucks and / or other separate USB connected devices is illustrated with respect to one exemplary embodiment in FIG. 3B, where the CIB 316e of the custom simulation subsystem 308 is configured to enable pass-through communication 329a, 329b (shown in dotted lines) between the tracking puck 331 and the simulation computer subsystem 318. All human system interface, health management system and cybersecurity functionality remains intact in the closed domain configuration. In certain embodiments, when the CIB 316 is in a wired configuration, if a tracking pack is used, a USB dongle for wireless communication may not be required as communications are handled via a wired USB connection pass-through.

[0123] In contrast, in the exemplary embodiment of the exemplary non-closed domain, it can be seen that the simulation computer subsystem 318 receives pushed firmware / software updates from an external database 336a (e.g., as shown in FIG. 3B), e.g., wirelessly via wireless network 314a and / or cloud 320A, and also provides post-action review and / or simulator health and usage data for storage in database system 336A. In certain embodiments, the CIB 316 is not considered classified hardware in itself, even if it is located in a closed domain. Rather, the CIB 316 can adapt its communications (e.g., wired (e.g., USB-C) or wireless (e.g., BLUETOOTH)) to operate appropriately within the environment in which it is located (classified / closed vs. non-classified / open).

[0124] FIG. 6 is a flow chart 800 outlining the operation, interaction, and data flow of the common interface board (CIB) 316 and simulation system 301 of FIGS. 3A-5, according to one embodiment. With reference to FIGS. 3A-4 and 6, the CIB 316 receives appropriate software / firmware to initialize and / or update the simulation subsystem 301 (block 805) as necessary. The simulation begins (and / or continues) when the check made in block 810 detects that a simulation subsystem 301 activity has begun or continued, such as by actuation of the power switch 405. Additionally, detectable simulation subsystem 301 activity includes, but is not limited to, various user 312 actions, such as pressing a switch or trigger. However, intrusion attempts can be detected even before a simulation begins. Thus, even if the answer in block 810 is no (simulation has not yet started, e.g., power is not turned on or the simulator device 313 is on but no simulation actions are occurring), the CIB 316 still monitors (block 812) for intrusions or other security issues (e.g., an intrusion attempt) to be detected. If the answer in block 812 is yes, a security issue is logged (block 814) and processing returns to block 810 to wait and see if the simulation subsystem is activated and / or continues to be used. If the simulation is activated and / or continues (answer in block 810 is yes), intrusion and / or security issues continue to be checked (block 835, described further below).

[0125] In response to simulation requests and / or user actions, the necessary simulation haptic, audio, video, and / or application control information is obtained (block 815), such as by the CIB 316. In the CIB 316, the haptic, audio, video, and / or application control information is converted for the simulation, as needed (block 820), and then provided to the simulation (block 825). During the simulation, the CIB 316 receives and stores user inputs, user data, simulation data, log information, health management system information, environmental data, simulated device inputs and responses, and / or custom inputs / data, as appropriate (block 830).

[0126] If during the simulation an intrusion or other security problem (e.g., a failed intrusion attempt) is detected (block 835), it is logged (block 840). A check is made to see if the simulation can continue after the intrusion (block 845). If yes, processing returns to block 837. If no, processing proceeds to block 870 where CIB 316 transmits the received, stored, and / or logged information to the simulation computer subsystem as appropriate during and / or after the simulation.

[0127] Returning to block 835, if no intrusion or security issue was detected at block 835 (answer NO at block 835) or if a security issue was logged (block 840) and the simulation can continue (answer YES at block 845), then processing proceeds to determine whether the simulation is complete (block 837). If so (answer YES at block 837), processing proceeds to block 870 (described above). If the simulation is not complete (answer NO at block 837), then optionally a check is made to determine whether it is time to upload the relevant information received and / or stored in the CIB 316 to the simulation computer subsystem 318 (block 850). For example, this determination may be made at least in part based on a predetermined amount of time having elapsed, whether one or more predetermined events have occurred, whether the storage of the CIB 316 is full, whether the simulation is configured for periodic uploads, whether a message has been received requesting the stored data, etc. If the answer at block 850 is no, processing continues with the simulation (block 855) and returns to block 805 where system processing optionally checks for updates and then proceeds to check if the simulation is continuing (block 810), etc. If the answer at block 850 is yes, the relevant received and / or stored information is sent to the simulation computer subsystem (block 860), which can then be sent or pushed to the second computer system 303 (FIG. 3A) or other databases (FIGS. 6, 7), as appropriate.

[0128] A check is made to see if the simulation is complete (block 865). This can be determined in a variety of ways, such as when the simulation activity is paused for a predetermined period of time, when the power is turned off, when time has passed, when a predetermined condition occurs, etc. For example, in a simulation scenario, the predetermined condition can include: - user 312 completes a simulation mission; the simulation mission is changed or switched through the control of the user 312 or in response to some other signal, condition, and / or command; - an external command to end the simulation is received (this could come, for example, from an instructor running the mission, another entity or application with the authority to send commands to start and stop the mission, etc.); - the user 312 selects to end the simulation; - During a simulation mission, an action occurs that corresponds to the completion of a user's actions during the mission (e.g., a user becomes "injured" or "dies" during a simulation mission, or "escapes" or "exits" an environment associated with a particular simulation mission).

[0129] If the answer at block 864 is no, processing continues at block 855. If the answer at block 865 is yes, processing continues at block 870. At block 870, simulation information, health information, etc. are logged and stored as appropriate, and appropriate during-simulation and / or post-simulation information, and any other appropriate received and / or stored and recorded and logged information is transmitted to the simulation computer subsystem as appropriate.

[0130] It is contemplated that any or all of the embodiments described herein and / or shown in Figures 3-7 herein may be adapted to be combined with and / or in conjunction with many simulation systems and devices currently in existence, as well as those developed in the future.Moreover, those skilled in the art will appreciate that the embodiments described and claimed herein and illustrated in FIGS. 3A-7 may be implemented in a variety of ways, including but not limited to, various other embodiments, including but not limited to, various other embodiments, and may be implemented in a variety of ways ... It will be appreciated that the present invention may be combined and / or adapted with many different systems, devices, and technologies described in commonly assigned U.S. patents, including but not limited to 10,508,913 (“Environment recording system using virtual or augmented reality”), 10,508,913 (“Environment recording system using virtual or augmented reality”), and 10,788,889 (“Virtual reality locomotion without motion controllers”), each of which is incorporated herein by reference.

[0131] However, it should be understood that the disclosed embodiments are not limited to the use of the described simulation system / program. The embodiments described herein have numerous applications and are not limited to the exemplary applications described herein. It should be recognized that such references and examples are made as an effort to enhance the clarity of the description of the concepts disclosed herein. Such references are not intended, and should not be construed, as limiting the use or application of the concepts, systems, arrangements, and techniques described herein to use only with these or with any other systems.

[0132] Figure 7 is a block diagram of an exemplary computer system usable in at least some of the systems and methods of Figures 1-8, according to one embodiment. In some embodiments, the computer system 900 of Figure 7 may be usable as the simulation computer subsystem 318 for any one or more second computer systems 303, and as part of any simulation subsystem 301 and / or simulation device 313. Referring briefly to Figure 7, it shows a block diagram of a computer system 900 usable in at least some embodiments. The computer system 50 may also be used to implement all or a portion of any of the methods, formulas and / or calculations described herein.

[0133] As shown in FIG. 7, computer 900 may include a processor / CPU 902, a volatile memory 904 (e.g., RAM), a non-volatile memory 906 (e.g., one or more hard disk drives (HDDs), one or more solid state drives (SSDs) such as flash drives, one or more hybrid magnetic and solid state drives, and / or one or more virtual storage volumes such as cloud storage, or a combination of physical and virtual storage volumes), a graphical user interface (GUI) 910 (e.g., touch screen, display, etc.), and input and / or output (I / O) devices 908 (e.g., mouse, keyboard, etc.). Non-volatile memory 904 stores, for example, journal data 904a, metadata 904b, and pre-allocated memory regions 904c. Non-volatile memory 906 may include an operating system 914, computer instructions 912, and data 916 in some embodiments. In some embodiments, the computer instructions 912 are configured to provide several subsystems, including a routing subsystem 912A, a control subsystem 912b, a data subsystem 912c, and a write cache 912d. In particular embodiments, the computer instructions 912 are executed by the processor / CPU 902 from the volatile memory 904 to implement and / or execute at least a portion of the systems and processes illustrated in Figures 1-6. The program code may also be applied to data entered using an input device or GUI 910 or received from an I / O device 908.

[0134] The systems, architectures and processes of Figures 1-7 are not limited to use with the hardware and software described and illustrated herein, but may find applicability in any computing or processing environment, as well as in any type of machine or set of machines capable of executing a computer program and / or implementing a simulation system (including, in some embodiments, a simulation system that is part of an STE). The processes described herein may be implemented in hardware, software, and combinations of the two. Logic for performing the methods described herein may be embodied as part of the system described in Figure 7. The processes and systems described herein are not limited to the particular embodiments described, or that they are specifically limited to the particular processing order shown. Rather, any of the blocks of the processes may be performed in parallel or serially rearranged, combined or removed as necessary to achieve the results described herein.

[0135] The processor 902 may be implemented by one or more programmable processors that execute one or more computer programs to perform the functions of the system. The term "processor" as used herein refers to an electronic circuit that performs a function, operation, or sequence of operations. The function, operation, or sequence of operations may be hard-coded into the electronic circuit or soft-coded by instructions held in a memory device. The "processor" may perform the function, operation, or sequence of operations using digital values ​​or using analog signals. In some embodiments, the "processor" may be embodied in one or more application specific integrated circuits (ASICs). In some embodiments, the "processor" may be implemented in one or more microprocessors with associated program memory. In some embodiments, the "processor" may be embodied in one or more discrete electronic circuits. The "processor" may be analog, digital, or mixed signal. In some embodiments, the "processor" may be one or more physical processors, or one or more "virtual" (e.g., remotely located processors or "cloud") processors.

[0136] The various functions of the circuit elements may also be implemented as processing blocks of a software program. Such software may be used, for example, in one or more digital signal processors, microcontrollers, or general-purpose computers. The described embodiments may be implemented in hardware, a combination of hardware and software, software, or software executed by one or more physical or virtual processors.

[0137] Some embodiments can be implemented in the form of methods and apparatuses for carrying out such methods. The described embodiments can also be implemented in the form of program code, for example stored in a storage medium, loaded and / or executed by a machine, or transmitted via some transmission medium or carrier, for example via electrical wiring or cable, via optical fiber, or via electromagnetic radiation. Non-transitory machine-readable media can include, but are not limited to, tangible media, for example, magnetic recording media including hard drives, floppy disks, and magnetic tape media, optical recording media including compact disks (CDs) and digital versatile disks (DVDs), solid-state memories such as flash memories, hybrid magnetic and solid-state memories, non-volatile memories, volatile memories, and the like, but not including the transitory signals themselves. When the program code is embodied in a non-transitory machine-readable medium and loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for carrying out the method.

[0138] When implemented in one or more processing devices, the program code segments combine with the processor to provide a unique device that operates similarly to specific logic circuits. Such processing devices may include, for example, general purpose microprocessors, digital signal processors (DSPs), reduced instruction set computers (RISCs), complex instruction set computers (CISCs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), microcontrollers, embedded controllers, multi-core processors, and / or others, including combinations of one or more of the above. The described embodiments may also be implemented in the form of a bit stream or other sequence of values ​​of a signal transmitted electrically or optically through a medium, magnetic field fluctuations stored on a magnetic recording medium, etc., generated using the claimed methods and / or apparatus.

[0139] For example, when the program code is loaded into and executed by a machine, such as the computer of FIG. 7, the machine becomes an apparatus for implementing one or more of the previously described embodiments. When implemented in one or more general-purpose processors, the program code combines with such processors to provide a unique apparatus that operates similarly to specific logic circuits. Thus, a general-purpose digital machine can be transformed into a special-purpose digital machine. FIG. 7 shows program logic 924 embodied in a computer-readable medium 920 as shown, the logic being encoded with computer executable code configured to execute the reservation service process of the present invention, thereby forming a computer program product 922. The logic may be the same logic in a memory loaded into a processor. The program logic may also be embodied in a software module, as a module, or as a hardware module. The processor may be a virtual processor or a physical processor. The logic may be distributed across multiple processors or virtual processors to execute the logic.

[0140] In some embodiments, the storage medium may be a physical or logical device. In some embodiments, the storage medium may consist of a physical or logical device. In some embodiments, the storage medium may be mapped across multiple physical and / or logical devices. In some embodiments, the storage medium may reside in a virtual environment. In some embodiments, the processor may be virtual or physical. In some embodiments, the logic may be executed via one or more physical or virtual processors.

[0141] For purposes of describing the present embodiments, the disclosed embodiments are described as being embodied in specific configurations and using particular logical configurations, however, those skilled in the art will recognize that the present device is not limited to any particular configuration, but rather is limited only by the scope of the claims contained herein. Moreover, it is expected that many related technologies will be developed during the life of the patents which mature from this application, and the scope of the corresponding terms is intended to include all such novel technologies a priori.

[0142] The terms "comprises," "comprising," "includes," "including," "having," and compounds thereof mean at least "including, but not limited to." As used herein, the singular forms "a," "an," and "the" include plural references unless the context clearly indicates otherwise. Various elements that are described in the context of a single embodiment may also be provided separately or in any suitable subcombination. Furthermore, it will be understood that various changes in the details, materials, and arrangements of parts described and illustrated herein may be made by those skilled in the art without departing from the scope of the following claims.

[0143] Throughout this disclosure, unless the context clearly indicates to the contrary, it should be understood that individual elements as described may be singular or plural. For example, the terms "circuit" and "circuitry" can include either a single component or multiple components, either active and / or passive, connected or coupled together to provide a described function. Furthermore, the term "signal" can refer to one or more currents, one or more voltages, and / or data signals. In the figures, like or related elements have like or related alpha, numeric, or alphanumeric designators. Furthermore, although the disclosed embodiments have been described in the context of implementations using separate components, including some components including one or more integrated circuit chips, the functionality of any component or circuit may alternatively be implemented using one or more appropriately programmed processors, depending on the signal frequency or data rate to be processed and / or the function to be accomplished.

[0144] Similarly, and further, in the drawings of the present application, in some cases, multiple system elements may be shown as illustrations of a particular system element and a single system element, or multiple illustrations of a particular system element. It should be understood that the showing of multiple particular elements is not intended to suggest that a system or method implemented in accordance with the present invention must include two or more of that element, nor is the showing of a single element intended to limit the present invention to embodiments having only one of each of the elements. Furthermore, the total number of elements shown for a particular system element is not intended to be limiting, and one of ordinary skill in the art will recognize that the number of particular system elements may be selected to suit the needs of a particular user, in some cases.

[0145] In describing and illustrating the embodiments herein, specific terminology (e.g., language, phrases, product brand names, etc.) may be used in the text and drawings for clarity. These names are merely examples and are not limiting. The embodiments described herein are not limited to the specific terminology so selected, and each specific term includes at least all grammatical, literal, scientific, technical, and functional equivalents, and any other equivalents that operate in a similar manner to accomplish a similar purpose. Furthermore, in the drawings, figures, and text, specific features, elements, circuits, modules, tables, software modules, systems, etc. may be given specific names. However, such terms used herein are for purposes of explanation and not limitation.

[0146] Although the embodiments contained herein have been described and illustrated in a particular and advantageous manner with a particular degree of detail, it will be understood that the present disclosure has been described by way of example only, and that many changes in the details of the construction and the combination and arrangement of parts may be made without departing from the spirit and scope of the described embodiments. Although at least some principles of the technology have been described and illustrated with reference to specific embodiments, it will be recognized that the technology and embodiments described herein can be implemented in many other different forms and in many different environments. The technology and embodiments disclosed herein can be used in combination with other technologies. Furthermore, all publications and references cited herein are expressly incorporated herein by reference in their entirety.

[0147] It is to be understood that individual elements of different embodiments described herein can be combined to form other embodiments not specifically described above. Various elements that are described in the context of a single embodiment may be provided separately or in any suitable subcombination. Other embodiments not specifically described herein are to be understood to be within the scope of the following claims.

Claims

1. 1. An assembly comprising: a processor in operative communication with a memory, the memory storing instructions for operation of the processor, the processor configured to convert first instructions received from a computer system into control signals to operate a simulation system according to a first simulation scenario, the processor responsive to user actions and operable to control the first simulation scenario executed on the simulation system based at least in part on the user actions; a communication system in operative communication with said processor and said computer system, said communication system configured to control communications between said simulation system and said computer system and configured to provide at least one of wired and wireless communications between said assembly and said computer system; a sensory subsystem in operative communication with the processor, the sensory subsystem configured to provide commands to the simulation system to enable the simulation subsystem to provide a simulated user experience to a user, the simulated user experience configured to couple one or more senses of the user to a simulation in which the one or more senses can each be detected; a health management system in operable communication with the processor and configured to monitor health event information associated with one or more environmental characteristics in which the simulation system is operating; and a security system in operative communication with the processor and configured to monitor security events associated with the assembly, the security events relating to at least one of a physical intrusion and a logical intrusion into the assembly; The assembly constitutes an interface between the simulation system and the computer system.

2. 10. The assembly of claim 1, further comprising a log configured to store event information, the stored event information including information associated with at least one of a simulation event, a health event, and the security event.

3. The assembly of claim 2 , wherein the processor is configured to provide event information stored in the log to the computer system for analysis of the first simulation scenario.

4. 4. The assembly of claim 3, wherein the processor is configured to receive second instructions from the computer system for operating the simulation system according to a second scenario, the second scenario being created based at least in part on an analysis of the simulation information stored in the log provided to the computer system.

5. 2. The assembly of claim 1, wherein the processor is configured to provide security event information stored in a log to the computer system for analysis related to detection of intrusion into and communication with at least one of the assemblies.

6. 2. The assembly of claim 1, wherein the processor is configured to provide health event information stored in a log to the computer system for analysis upon detection of one or more health events associated with use of the simulation system.

7. The assembly of claim 1 , wherein the assembly is configured to be placed within a simulation device of the simulation system.

8. The assembly of claim 1 , wherein the simulation system comprises at least one of a virtual reality (VR) system, an augmented reality system, and a system capable of operating within a synthetic training environment (STE).

9. The assembly of claim 1 , wherein the communication subsystem is configured to be switchable between wired communication and wireless communication.

10. 2. The assembly of claim 1, wherein the assembly is contained within a first device of the simulation system, the communication system of the assembly is operatively connected to a second device different from the first device, and the communication system is configured to enable the second device to have pass-through communication with the computer system.

11. 11. The assembly of claim 10, wherein the communications system is operatively connected to the computer system via a first wired connection, and the second device is connected to the communications system in a manner that ensures that communications from the second device to the computer system are provided only via the first wired connection.

12. 2. The assembly of claim 1, wherein the security system includes a reverse engineering protection system (REPS), the REPS configured to protect the assembly from at least one of physical intrusion into the assembly and logical intrusion into the assembly.

13. The assembly of claim 1 , wherein the security system includes a hardware security method subsystem including at least one of an encryption system, an authentication system, and a tamper detection system.

14. The assembly of claim 1 , wherein the security system is configured to cooperate with the processor and the communication system to provide a root of trust (RoT) for the assembly.

15. The assembly of claim 1 , wherein the environmental characteristics include at least one of temperature, humidity, movement, and time.

16. 1. A method comprising: providing an assembly configured as an interface between a computer system and a simulation system, the assembly being configured to be physically part of the simulation system; using the assembly to convert first instructions received from the computer system into control signals to operate the simulation system according to a first simulation scenario, the simulation system being configured to respond to actions of a user and provide a simulated user experience to the user, the simulated user experience being configured to couple one or more senses of the user to a simulation in which the one or more senses can each be detected; configuring communication between the simulation system and the computer system using the assembly to provide at least one of wired and wireless communication between the simulation system and the computer system; and monitoring events associated with the simulation system, the events including at least one of health event information associated with one or more environmental characteristics in which the simulation system is operating and security events associated with the assembly, the monitoring being configured to detect at least one of physical and logical intrusions into the assembly.

17. The method of claim 16 , wherein the monitoring of events occurs during at least one of operation of the simulation system and during times when the simulation system is not operating.

18. 17. The method of claim 16, further comprising operating the simulation system according to a second scenario, the second scenario being developed based at least in part on an analysis of the monitored event information.

19. A means for interfacing between a simulation system and a computer system, comprising: means for converting first instructions received from the computer system into control signals for operating the simulation system according to a first simulation scenario, the means for converting being responsive to a user action and operable to control the first simulation scenario executed on the simulation system based at least in part on the user action; means for controlling communication between the simulation system and the computer system, the means for controlling being further configured to provide at least one of wired and wireless communication between the assembly and the computer system; means for providing commands to the simulation system to enable a simulation subsystem to provide a simulated user experience to a user, the simulated user experience being configured to couple one or more senses of the user with a simulation in which the one or more senses can each be detected; means for monitoring health event information associated with one or more environmental characteristics in which the simulation system is operating; and The means for interfacing includes a means for monitoring security events associated with the assembly, the security events associated with at least one of a physical intrusion and a logical intrusion into the means for providing an interface and the means for protecting the assembly and communications between the assembly from intrusion.

20. 20. The interfacing means of claim 19, further comprising: means for storing event information, the stored event information including information associated with at least one of a simulation event, a health event, and the security event.

Citation Information

Patent Citations

  • Multi-soldier military training assessment system based on large space virtual reality

    CN108694871A

  • A secure terminal equipped with a chip card reader for communicating with a server over an internet-type network

    JP2003513363A

  • Information processor, authentication system, authentication method, authentication device and program

    JP2010238102A

  • Information processing method, apparatus, and program for implementing that information processing method in computer

    JP2018124826A

  • Communication network system

    WO2019092873A1