Resource accountability management
Patent Information
- Application Number
- PCT/US2026/019059
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-03-14
- Filing Date
- 2026-03-13
- Publication Date
- 2026-09-17
Smart Images

Figure US2026019059_17092026_PF_FP_ABST
Abstract
Description
RESOURCE ACCOUNTABILITY MANAGEMENTStatement of Government Rights
[0001] This invention was made with government support under Medical Technology Enterprise Consortium (MTEC) Contract No.: 2019-399 awarded by the Defense Health Agency (DHA). The government has certain rights in the invention.Related Application
[0002] The present application claims the benefit of U.S. Provisional Patent Application No.63 / 772,077, filed March 14, 2025 and titled “Personnel Accountability,” the disclosure of which is incorporated by reference herein in its entirety.Technical Field
[0003] The present disclosure relates to the field of physiologic and asset monitoring and, more particularly, to devices and systems for physiologic and asset monitoring.Background
[0004] During various workflows, such as missions in a military context, it may be desired to track various resources such as personnel, vehicles, equipment and other assets and resources. For example, specific resources may be expected or needed for use in different stages or for different tasks at specific locations. Tracking and management of resources presents various technical challenges, particularly in remote and constrained environments.Summary
[0005] Illustrative embodiments provide techniques for resource accountability management. For example, in some embodiments the presence of personnel, assets or other resources at particular locations are tracked and used to generate accountability management visualizations, such as for comparing the resources determined to be present at a given location and time against excepted numbers and types of resources that are assigned to one or more tasks of a workflow.
[0006] In one illustrative embodiment, an apparatus comprises at least one processing device comprising a processor coupled to a memory. The at least one processing device is configuredto determine, for a workflow comprising one or more tasks associated with one or more locations, (i) an assignment of two or more resources of a plurality of resources to the one or more tasks and (ii) hierarchical associations between different ones of the two or more resources assigned to the one or more tasks. The at least one processing device is also configured to monitor, at a given location associated with a given one of the one or more tasks, presence of respective ones of the plurality of resources utilizing one or more sensor devices associated with the plurality of resources. The at least one processing device is further configured to generate, based at least in part on the monitored presence of respective ones of the plurality of resources, one or more accountability management visualizations for the given task, the one or more accountability management visualizations characterizing whether expected numbers and types of the plurality of resources are present in the given location at a time when the given task of the workflow is to be performed, the expected numbers and types of the plurality of resources being based at least in part on the determined (i) assignment of the two or more resources to the one or more tasks and (ii) the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks.
[0007] The plurality of resources may comprise at least one of: one or more users; and one or more assets. The one or more assets may comprise at least one of: one or more vehicles; one or more equipment containers; and equipment.
[0008] The hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks may comprise one or more command-based hierarchical associations characterizing personnel-based groupings of subsets of the plurality of resources.
[0009] The hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks may comprise one or more container-based hierarchical associations characterizing location-based groupings of subsets of the plurality of resources.
[0010] The hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks may comprise two or more nested levels of containers. The containers may comprise at least one of: organizational containers comprising personnel-based groupings of subsets of the plurality of resources; and physical containers comprising at least one of one or more geographic locations and one or more physical assets configured to hold subsets of the plurality of resources. The two or more nested levels of containers may comprise: a first level comprising atomic containers not capable of subdivision; and one or more additional levels comprising subdividable containers. A given one of the plurality ofresources in the first level may be associated with an asset tree comprising one or more additional ones of the plurality of resources assigned to the given resource.
[0011] A given one of the one or more accountability management visualizations may comprise two or more user interface features associated with two or more of the containers, wherein activation of a given one of the two or more activatable user interface features associated with a given one of the two or more containers expands a view of a given subset of the plurality of resources, determined to be present at the given location, which are assigned to the given container.
[0012] A given one of the one or more accountability management visualizations may comprise two or more user interface features associated with two or more of the containers, wherein the two or more user interface features comprise status information for the two or more containers. The status information for the two or more containers may comprise: a first visual encoding for ones of the two or more containers having the expected numbers and types of the plurality of resources present in the given location at the time when the given task of the workflow is to be performed; a second visual encoding for ones of the two or more containers missing at least one resource that is expected to be present in the given location at the time when the given task of the workflow is to be performed; a third visual encoding for ones of the two or more containers that are empty but which are expected to include one or more of the plurality of resources in the given location at the time when the given task of the workflow is to be performed; and a fourth visual encoding for ones of the two or more containers that are empty and are not expected to include one or more of the plurality of resources in the given location at the time when the given task of the workflow is to be performed.
[0013] Monitoring the presence of respective ones of the plurality of resources at the given location associated with the given task may comprise monitoring, via at least one sensor monitoring device at the physical location, ones of the one or more sensor devices associated with the plurality of resources determined to be in range of the at least one sensor monitoring device at the physical location. The at least one sensor monitoring device may comprise a Near Field Communication (NFC) reader and the one or more sensor devices associated with the plurality of resources comprise one or more NFC tags.
[0014] In another illustrative embodiment, a method comprises determining, for a workflow comprising one or more tasks associated with one or more locations, (i) an assignment of two or more resources of a plurality of resources to the one or more tasks and (ii) hierarchicalassociations between different ones of the two or more resources assigned to the one or more tasks. The method also comprises monitoring, at a given location associated with a given one of the one or more tasks, presence of respective ones of the plurality of resources utilizing one or more sensor devices associated with the plurality of resources. The method further comprises generating, based at least in part on the monitored presence of respective ones of the plurality of resources, one or more accountability management visualizations for the given task, the one or more accountability management visualizations characterizing whether expected numbers and types of the plurality of resources are present in the given location at a time when the given task of the workflow is to be performed, the expected numbers and types of the plurality of resources being based at least in part on the determined (i) assignment of the two or more resources to the one or more tasks and (ii) the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks. The method is performed by at least one processing device comprising a processor coupled to a memory.
[0015] The hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks may comprise two or more nested levels of containers. The containers may comprise at least one of: organizational containers comprising personnel-based groupings of subsets of the plurality of resources; and physical containers comprising at least one of one or more geographic locations and one or more physical assets configured to hold subsets of the plurality of resources.
[0016] In another illustrative embodiment, a computer program product comprises a non-transitory processor-readable storage medium having stored therein executable program code which, when executed, causes at least one processing device to determine, for a workflow comprising one or more tasks associated with one or more locations, (i) an assignment of two or more resources of a plurality of resources to the one or more tasks and (ii) hierarchical associations between different ones of the two or more resources assigned to the one or more tasks. The executable program code, when executed, also causes the at least one processing device to monitor, at a given location associated with a given one of the one or more tasks, presence of respective ones of the plurality of resources utilizing one or more sensor devices associated with the plurality of resources. The executable program code, when executed, further causes the at least one processing device to generate, based at least in part on the monitored presence of respective ones of the plurality of resources, one or more accountability management visualizations for the given task, the one or more accountability managementvisualizations characterizing whether expected numbers and types of the plurality of resources are present in the given location at a time when the given task of the workflow is to be performed, the expected numbers and types of the plurality of resources being based at least in part on the determined (i) assignment of the two or more resources to the one or more tasks and (ii) the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks.
[0017] The hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks may comprise two or more nested levels of containers. The containers may comprise at least one of: organizational containers comprising personnel-based groupings of subsets of the plurality of resources; and physical containers comprising at least one of one or more geographic locations and one or more physical assets configured to hold subsets of the plurality of resources.
[0018] These and other features and advantages of embodiments described herein will become more apparent from the accompanying drawings and the following detailed description.Brief Description of the Drawings
[0019] Several aspects of the disclosure can be better understood with reference to the following drawings. In the drawings, like reference numerals designate corresponding parts throughout the several views.
[0020] FIG. 1 illustrates aspects of a modular physiological monitoring system, according to an embodiment of the invention.
[0021] FIGS. 2A-2D illustrate a modular physiological monitoring system, according to an embodiment of the invention.
[0022] FIGS. 3 A-3E illustrate a wearable sensor system configured for detecting and analyzing firearm discharges, according to an embodiment of the invention.
[0023] FIG. 4 illustrates a system with a body area network controller configured for personnel and asset accountability management, according to an embodiment of the invention.
[0024] FIG. 5 illustrates an example of parts of a wearable sensor system in a body area network mounted on a subject and equipment, according to one or more embodiments of the invention.
[0025] FIGS. 6 A and 6B shows systems including management devices and managed devices configured for personnel and asset accountability management, according to embodiments of the invention.
[0026] FIGS. 7A-7C show workflow setup for personnel and asset accountability management, according to embodiments of the invention.
[0027] FIGS. 8 A and 8B show dynamic expansion of resource accountability management visualizations, according to embodiments of the invention.
[0028] FIGS. 9A-9C show hierarchy and nesting of containers in resource accountability management visualizations, according to embodiments of the invention.
[0029] FIGS. 10A-10D show visual status encoding of resource accountability management visualizations, according to embodiments of the invention.
[0030] FIG. 11 shows a resource accountability management visualization, according to embodiments of the invention.
[0031] FIGS. 12A-12C show views of a graphical user interface including a map and drilldown pane with one or more resource accountability management visualizations, according to embodiments of the invention.
[0032] FIG. 13 illustrates a methodology for resource accountability management, according to an embodiment of the invention.Detailed Description
[0033] Particular embodiments of the present disclosure are described herein below with reference to the accompanying drawings; however, the disclosed embodiments are merely examples of the disclosure and may be embodied in various forms. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present disclosure in virtually any appropriately detailed structure. Like reference numerals may refer to similar or identical elements throughout the description of the figures.
[0034] The accompanying drawings illustrate various embodiments of systems, methods, and embodiments of various other aspects of the disclosure. One of ordinary skill in the art will appreciate that the illustrated element boundaries (e.g., boxes, groups of boxes, or other shapes) in the figures represent one example of the boundaries. It may be that in some examples oneelement may be designed as multiple elements or that multiple elements may be designed as one element. In some examples, an element shown as an internal component of one element may be implemented as an external component in another, and vice versa. Furthermore, elements may not be drawn to scale. It is also noted that components and elements in the figures are not necessarily drawn to scale, emphasis instead being placed upon illustrating principles.
[0035] The words “comprising,” “having,” “containing,” and “including,” and other forms thereof, are intended to be equivalent in meaning and be open ended in that an item or items following any one of these words is not meant to be an exhaustive listing of such item or items, or meant to be limited to only the listed item or items.
[0036] It must also be noted that as used herein and in the appended claims, the singular forms “a,” “an,” and “the” include plural references unless the context clearly dictates otherwise. Although any systems and methods similar or equivalent to those described herein can be used in the practice or testing of embodiments of the present disclosure, the preferred, systems and methods are now described.
[0037] Embodiments of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings in which like numerals represent like elements throughout the several figures, and in which example embodiments are shown. Embodiments of the claims may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. The examples set forth herein are non-limiting examples and are merely examples among other possible examples.
[0038] One illustrative, non-limiting objective of this disclosure is to provide systems, devices, methods, and kits for monitoring physiological and / or physical signals from a subject. Another illustrative, non-limiting objective of this disclosure is to provide systems, devices, and methods for managing networks, including body area networks including different types of devices configured for monitoring physiological and / or physical signals from a subject as well as contextual and environmental information regarding an environment that the subject is in. Another illustrative, non-limiting objective is to provide a flexible architecture enabling sharing of contextual and environmental information about different types of devices that are part of a body area network associated with a subject. Yet another illustrative, non-limiting objective is to provide systems, devices, and methods for physiological monitoring of subjects, including physiological monitoring utilizing contextual and environmental information sharedamongst different types of sensing devices that are part of a body area network associated with a subject. Yet another illustrative, non-limiting objective is to provide systems for facilitating interaction between a user and a subject with regard to physiological and / or environmental monitoring of the subject.
[0039] Still further, in the context of one or more of the above objectives, as well as in the context of one or more other objectives, another illustrative, non-limiting objective of this disclosure is to provide systems, devices, and methods for personnel and asset accountability management for personnel and / or assets (e.g., during one or more stages of workflows to which personnel and / or assets are assigned).
[0040] The above illustrative, non-limiting objectives are wholly or partially met by devices, systems, and methods according to the appended claims in accordance with the present disclosure. Features and aspects are set forth in the appended claims, in the following description, and in the annexed drawings in accordance with the present disclosure.
[0041] A modular physiological monitoring system in accordance with the present disclosure is configured to monitor one or more physiological and / or physical signals, also referred to herein as physiological parameters, of a subject (e.g., a human subject, a patient, a soldier, an athlete, a trainer, an animal such as equine, canine, porcine, bovine, etc.). The modular physiological monitoring system may include one or more patches, each patch adapted for attachment to the body of the subject (e.g., attachable to the skin thereof, reversibly attachable, adhesively attachable, with a disposable interface and a reusable module, etc.). In aspects, the physiological monitoring system may also include one or more modules (also referred to as hubs in some illustrative embodiments), configured and dimensioned to mate with corresponding ones of the one or more patches, and to interface with the subject therethrough. One or more of the modules may be configured to convey and / or store one or more physiological and / or physical signals, signals derived therefrom, and / or metrics derived therefrom obtained via the interface with the subject.
[0042] Each module may include a power source (e.g., a battery, a rechargeable battery, an energy harvesting transducer, microcircuit, an energy reservoir, a thermal gradient harvesting transducer, a kinetic energy harvesting transducer, a radio frequency energy harvesting transducer, a fuel cell, a biofuel cell, etc.), signal conditioning circuitry, communication circuitry, one or more sensors, or the like, configured to generate one or more signals (e.g., physiological and / or physical signals), stimulus, etc.
[0043] One or more of the patches may include one or more interconnects, configured and dimensioned so as to couple with one or more of the modules, said modules including a complementary interconnect configured and dimensioned to couple with the corresponding patch. The patch may include a bioadhesive interface for attachment to the subject, the module retainable against the subject via interconnection with the patch.
[0044] In aspects, the patch may be configured so as to be single use (e.g., disposable). The patch may include a thin, breathable, stretchable laminate. In aspects, the laminate may include a substrate, a bioadhesive, one or more sensing or stimulating elements in accordance with the present disclosure, and one or more interconnects for coupling one or more of the sensing elements with a corresponding module.
[0045] In aspects, to retain a high degree of comfort and long term wearability of the patch on a subject, to limit interference with normal body function, to limit interference with joint movement, or the like, the patch may be sufficiently thin and frail, such that it may not substantially retain a predetermined shape while free standing. Such a definition is described in further detail below. The patch may be provided with a temporary stiffening film to retain the shape thereof prior to placement of the patch onto the body of a subject. Once adhered to the subject, the temporary stiffening film may be removed from the patch. While the patch is adhered to the subject, the shape and functionality of the patch may be substantially retained. Upon removal of the patch from the subject, the now freestanding patch is sufficiently frail such that the patch can no longer substantially retain the predetermined shape (e.g., sufficiently frail such that the patch will not survive in a free standing state). In aspects, stretch applied to the patch while removing the patch from the subject may result in snap back once the patch is in a freestanding state that renders such a patch to crumple into a ball and no longer function. Removal of the patch from the skin of the subject may result in a permanent loss in shape of the patch without tearing of the patch. In aspects, the interconnect may be sufficiently frail such that removal of the patch from the skin of the subject may result in a permanent loss of shape of the interconnect.
[0046] In aspects, the patch may include a film (e.g., a substrate), with sufficiently high tear strength, such that, as the patch is peeled from the skin of a subject, the patch does not tear. In aspects, the ratio between the tear strength of the patch and the peel adhesion strength of the patch to skin (e.g., tear strength: peel adhesion strength), is greater than 8:1, greater than 4:1,greater than 2:1, or the like. Such a configuration may be advantageous so as to ensure the patch may be easily and reliably removed from the subject after use without tearing.
[0047] In aspects, the patch may include a bioadhesive with peel tack to mammalian skin of greater than 0.02 Newtons per millimeter (N / mm), greater than O.lN / mm, greater than 0.25N / mm, greater than 0.50N / mm, greater than 0.75N / mm, greater than 2N / mm, or the like. Such peel tack may be approximately determined using an American Society for Testing and Materials (ASTM) standard test, ASTM D3330: Standard test method for peel adhesion of pressure-sensitive tape.
[0048] In aspects, the patch may exhibit a tear strength of greater than 0.5N / mm, greater than IN / mm, greater than 2N / mm, greater than 8N / mm, or the like. Such tear strength may be approximately determined using an ASTM standard test, ASTM D624: Standard test method for tear strength of conventional vulcanized rubber and thermoplastic elastomers. In aspects, a patch in accordance with the present disclosure may have a ratio between the tear strength of the patch and the peel tack of the adhesive to mammalian skin is greater than 8:1, greater than 4:1, greater than 2: 1, or the like.
[0049] In aspects, the patch may be provided with a characteristic thickness of less than 50 micrometer (pm), less than 25pm, less than 12pm, less than 8pm, less than 4pm, or the like. Yet, in aspects, a balance between the thickness, stiffness, and tear strength may be obtained so as to maintain sufficiently high comfort levels for a subject, minimizing skin stresses during use (e.g., minimizing skin stretch related discomfort and extraneous signals as the body moves locally around the patch during use), minimizing impact on skin health, minimizing risk of rucking during use, and minimizing risk of maceration to the skin of a subject, while limiting risk of tearing of the patch during removal from a subject, etc.
[0050] In aspects, the properties of the patch may be further altered so as to balance the hydration levels of one or more hydrophilic or amphiphilic components of the patch while attached to a subject. Such adjustment may be advantageous to prevent over hydration or drying of an ionically conducting component of the patch, to manage heat transfer coefficients within one or more elements of the patch, to manage salt absorption into a reservoir in accordance with the present disclosure, and / or migration during exercise, to prevent pooling of exudates, sweat, or the like into a fluid measuring sensor incorporated into the patch or associated module, etc. In aspects, the patch or a rate determining component thereof may be configured with a moisture vapor transmission rate of between 200 grams per meter squaredper 24 hours (g / m2 / 24hrs) and 20,000g / m2 / 24hrs, between 500g / m2 / 24hrs and 12,000g / m2 / 24hrs, between 2,000g / m2 / 24hrs and 8,000g / m2 / 24hrs, or the like.
[0051] Such a configuration may be advantageous for providing a comfortable wearable physiological monitor for a subject, while reducing material waste and / or cost of goods, preventing contamination or disease spread through uncontrolled re-use, and the like.
[0052] In aspects, one or more patches and / or modules may be configured for electrically conducting interconnection, inductively coupled interconnection, capacitively coupled interconnection, with each other. In the case of an electrically conducting interconnect, each patch and module interconnect may include complementary electrically conducting connectors, configured and dimensioned so as to mate together upon attachment. In the case of an inductively or capacitively coupled interconnect, the patch and module may include complementary coils or electrodes configured and dimensioned so as to mate together upon attachment.
[0053] Each patch or patch-module set may be configured as a sensing device to monitor one or more local physiological and / or physical parameters of the attached subject (e.g., local to the site of attachment, etc.), local environment, combinations thereof, or the like, and to relay such information in the form of signals to a host device (e.g., via a wireless connection, via a body area network connection, or the like), one or more patches or modules on the subject, or the like. Each patch and / or patch-module set may also or alternatively be configured as a stimulating device to apply a stimulus to the subject in response to signaling from the host device and / or other source, the signaling being based on analysis of the physiological and / or physical parameters of the subject measured by the sensing device(s).
[0054] The patch or patch-module sets are examples of what are more generally referred to herein as “primary” sensing devices, which are advantageously designed as on-body sensing devices with a small form factor as part of the modular monitoring system. While such primary sensing devices may be used to obtain some desired information (e.g., local physiological and / or physical parameters of the attached subject, local environment, combinations thereof, etc.), in some cases it is beneficial to obtain contextual information from other types of sensors which are difficult to integrate into such primary sensing devices designed as on-body sensing devices with small form factors. Such other types of sensors may be integrated into “secondary” or accessory sensing devices that do not have the limitations of the “primary” sensing devices. For example, while the primary sensing devices may be designed as on-bodysensing devices with a small form factor for comfortable long-term wear by the subject, the secondary or accessory sensing devices may have larger form factors to accommodate different types of sensors than the primary sensing devices. It should be noted that the secondary or accessory sensing devices may be incorporated into equipment or gear that is carried by a subject, into one or more wearable computing devices, etc. In some cases, an accessory sensing device is directly attached to the body of the subject. Also, in some embodiments, primary sensing devices can be attached or otherwise incorporated in equipment or gear carried by the subject.
[0055] The on-body physiological monitoring or other primary sensing devices can benefit from additional contextual and environmental information about the conditions surrounding a subject under study, where the additional contextual and environmental information may be obtained from one or more accessory sensing devices. For example, the primary sensing devices may be used to acquire one or more physiological metrics of the subject such as heart rate, core temperature, respiratory cycle status, etc. Such physiological metric data may be augmented by contextual or environmental data obtained using primary sensing devices and / or additional external sensing capabilities of accessory sensing devices, where the devices may target exposure of the subject to infectious agents, insolation, etc. This contextualization capability may, under some circumstances, need to be flexible, requiring different sensing modalities at different times with different subjects under study. In addition, some sensors may not be easily integrated into a single primary (e.g., on-body) sensing device with a small form factor, and thus may need to be externalized into one or more accessory sensing devices that may be placed at different locations relative to the primary sensing devices on the same individual. These various primary and accessory sensing devices may require a dedicated body area network to manage their functions, to enable efficient data sharing among them, and to facilitate contextual analysis of the different data obtained therefrom.
[0056] In aspects, the host device (also referred to as a gateway in some illustrative embodiments) may be configured to coordinate information exchange to / from each module and / or patch or other on-body primary sensing device as well as accessory sensing devices that are part of a body area network associated with a subject, and to generate one or more physiological signals, physical signals, environmental signals, kinetic signals, diagnostic signals, alerts, reports, recommendation signals, commands, combinations thereof, or the like for the subject, a user, a network, an electronic health record (EHR), a database (e.g., as part ofa data management center, an electronic health record or EHR, a social network, an field operational network, etc.), a processor, combinations thereof, or the like. In aspects, the host device may include features for recharging and / or performing diagnostic tests on one or more of the modules. In aspects, a host device in accordance with the present disclosure may be integrated into a subject’s equipment or gear, housed in an accessory, within a purse, a backpack, a wallet, or may be included in a mobile computing device, a smartphone, a tablet computer, a pager, a laptop, a local router, a data recorder, a network hub, a server, a secondary mobile computing device, a repeater, a combination thereof, or the like.
[0057] In aspects, a system in accordance with the present disclosure may include a plurality of substantially similar modules (e.g., generally interchangeable modules, but with unique identifiers), for coupling with a plurality of patches, each patch, optionally different from the other patches in the system (e.g., potentially including alternative sensors, sensor types, sensor configurations, electrodes, electrode configurations, etc.). Each patch may include an interconnect suitable for attachment to an associated module. Upon attachment of a module to a corresponding patch, the module may validate the type and operation of the patch to which it has been mated. In aspects, the module may then initiate monitoring operations on the subject via the attached patch, communicate with one or more other patches on the subject, a module, etc. The data collection from each module may be coordinated through one or more modules and / or with a host device in accordance with the present disclosure. The modules may report a timestamp along with the data in order to synchronize data collection across multiple patchmodule sets on the subject, between subjects, etc. Thus, if a module is to be replaced, a hot swappable replacement (e.g., replacement during a monitoring procedure) can be carried out easily by the subject, a caregiver, practitioner, etc., during the monitoring process. Such a configuration may be advantageous for performing redundant, continuous monitoring of a subject, and / or to obtain spatially relevant information from a plurality of locations on the subject during use.
[0058] One or more devices in the network may include a time synchronization service, the time synchronization service configurable so as to periodically align the local time sources of each device to those of each of the other devices in the network. In aspects, the time synchronization may be performed every second, every ten seconds, every thirty seconds, every minute, or the like. In aspects, one or more local devices may be coupled to an external time source such as an internet accessible time protocol, a dedicated or public atomic clock source,or a geolocation-based time source. Such information may be brought into the network so as to help align a global time reference for devices in the network. Such information may propagate through the network devices using the time synchronization service.
[0059] In a time aligned configuration, one or more metrics measured from a subject in connection with one or more devices in the network may be time aligned with one or more metrics from a different subject in the network. As such, events that can simultaneously affect multiple subjects can be registered and higher level event classification algorithms are configured so as to generate an appropriate alert based on the metrics measured.
[0060] In aspects, an event may include a loud audible event, or a physiological response to an event, the event classification algorithm is configured so as to increase the priority of an alert if the number of subjects affected by the event increases beyond a set number. In aspects, an event may be one or more temporally-triggered events, one or more spatially-triggered events, one or more occurrence-triggered events, a combination thereof, or the like.
[0061] In aspects, the modules and / or patches may include corresponding interconnects for coupling with each other during use. The interconnects may include one or more connectors, configured such that the modules and patches may only couple in a single unique orientation with respect to each other. In aspects, the modules may be color coded by function. A temporary stiffening element attached to a patch may include instructions, corresponding color coding, etc., so as to assist a user or subject with simplifying the process of monitoring.
[0062] In addition to physiological monitoring, one or more patches and / or modules may be used to provide a stimulus to the subject, as will be described in further detail below.
[0063] According to aspects, there is provided use of a modular physiological monitoring system in accordance with the present disclosure to monitor a subject, to monitor an electrocardiogram (EKG) of a subject, to perform one or more tasks in accordance with the present disclosure, etc.
[0064] According to aspects, there is provided an interface (e.g., a patch in accordance with the present disclosure) for monitoring a physiological, physical, and / or electrophysiological signal from a subject. The interface or patch may include a substrate, an adhesive coupled to the substrate formulated for attachment to the skin of a subject, and one or more sensors and / or electrodes each in accordance with the present disclosure coupled to the substrate, arranged, configured, and dimensioned to interface with the subject. The substrate may be formed froman elastic or polymeric material, such that the patch is configured to maintain operation when stretched to more than 25%, more than 50%, or more than 80%.
[0065] According to aspects, there is provided an isolating patch for providing a barrier between a handheld monitoring device with a plurality of contact pads and a subject, including a flexible substrate with two surfaces, a patient facing surface and an opposing surface, and an electrically and / or ionically conducting adhesive coupled to at least a portion of the patient facing surface configured so as to electrically and mechanically couple with the subject when placed thereupon, wherein the conducting adhesive is exposed within one or more regions of the opposing surface of the substrate, the regions patterned so as to substantially match the dimensions and layout of the contact pads. In aspects, the conducting adhesive may include an anisotropically conducting adhesive, with the direction of conduction oriented substantially normal to the surfaces of the substrate.
[0066] In aspects, the adhesive may be patterned onto the substrate so as to form one or more exposed regions of the substrate, one or more of the sensors and / or electrodes arranged within the exposed regions. One or more of the electrodes may include an inherently or ionically conducting gel adhesive.
[0067] In aspects, one or more of the electrodes may include an electrode feature arranged so as to improve the electrical connection between the electrode and the skin upon placement on a subject. In aspects, the improved electrical connection may be achieved after pressure is applied to the electrode (e.g., after the patch is secured to the subject and then a pressure is applied to the electrode). The electrode feature may include one or more microfibers, barbs, microneedles, or spikes to penetrate into a stratum comeum of the skin. The electrode feature may be configured to penetrate less than 2 mm into the skin, less than 1 mm, less than 0.5 mm, less than 0.2 mm, or the like during engagement therewith. In aspects, a gel adhesive in accordance with the present disclosure located adjacent to the electrode features (e.g., between the features and the skin) may be configured to maintain the improved electrical connection to the skin for more than 1 hour, more than 1 day, or more than 3 days after the electrode contacts the skin or pressure is applied to the electrode.
[0068] In aspects, a patch interface in accordance with the present disclosure may include one or more stretchable electrically conducting traces attached to the substrate, arranged so as to couple one or more of the sensors and / or electrodes with one or more of the interconnects.
[0069] In aspects, the interconnect may include a plurality of connectors, the connectors physically connected to each other through the substrate. The patch may include an isolating region arranged so as to isolate one or more of the connectors from the skin while the patch is engaged therewith.
[0070] According to aspects, there is provided a device (e.g., a module in accordance with the present disclosure) for monitoring a physiological, physical, and / or electrophysiological signals from a subject. The module may include a housing, a printed circuit board (PCB) including one or more microcircuits, and an interconnect configured for placement of the device onto a subject interface (e.g., a patch in accordance with the present disclosure). The PCB may constitute at least a portion of the housing in some embodiments. The module may include a three-dimensional antenna coupled to the microcircuits (e.g., coupled with a transceiver, transmitter, radio, etc., included within the microcircuits). In aspects, the antenna may be printed onto or embedded into the housing. In aspects, the antenna may be printed on an interior wall of or embedded into the housing, the circuit board providing a ground plane for the antenna. In aspects, the housing may be shaped like a dome and the antenna may be patterned into a spiraling helix centered within the dome.
[0071] In aspects, a module in accordance with the present disclosure may include a sensor coupled with one or more of the microcircuits, the sensor configured to interface with the subject upon attachment of the module to the patch. The module may include a sensor and / or microelectronics configured to interface with a sensor included on a corresponding patch. In aspects, one or more of the sensors may include an electrophysiological sensor, a temperature sensor, a thermal gradient sensor, a barometer, an altimeter, an accelerometer, a gyroscope, a humidity sensor, a magnetometer, an inclinometer, an oximeter, a colorimetric monitor, a sweat analyte sensor, a galvanic skin response sensor, an interfacial pressure sensor, a flow sensor, a stretch sensor, a microphone, a combination thereof, or the like.
[0072] In aspects, the module may be hermetically sealed. The module and / or patch may include a gasket coupled to the circuit board or the substrate, the gasket formed so as to isolate the region formed by the module interconnect and the patch from a surrounding environment, when the module is coupled with the patch.
[0073] In aspects, the module interconnect may include an electrically conducting magnetic element, and the patch may include one or more ferromagnetic regions coupled to the substrate, the magnetic elements arranged so as to physically and / or electrically couple the module to thepatch when the magnetic elements are aligned with the ferromagnetic regions. In aspects, the ferromagnetic regions may be formed from stretchable pseudo elastic material and / or may be printed onto the substrate. In aspects, the module and / or the patch may include one or more fiducial markings to visually assist with the alignment of the module to the patch during coupling thereof.
[0074] According to aspects, there is provided a kit for monitoring one or more physiological, physical, and / or electrophysiological signals from a subject, including one or more patches in accordance with the present disclosure, one or more modules in accordance with the present disclosure, a recharging bay in accordance with the present disclosure, and one or more accessories in accordance with the present disclosure. One or more of the accessories may include an adhesive removing agent configured to facilitate substantially pain free removal of one or more of the patches from a subject. One or more other ones of the accessories may include an accessory sensing device configured to complement (e.g., provide contextual or environmental information that augments) physiological data obtained from patches and / or patch-module sets providing primary sensing devices.
[0075] According to aspects there is provided a service system for managing the collection of physiological and / or other data from a subject, including a subject data management service, configured to generate and / or store a subject profile referencing customer preferences, data sets, and / or monitoring sessions, an automated product delivery service configured to provide the subject with one or more monitoring products or supplies in accordance with the present disclosure, and a datacenter configured to store, analyze, and / or manage the data obtained from the subject during one or more monitoring sessions.
[0076] In aspects, the service system may include a report generating service configured to generate one or more monitoring reports based upon the data obtained during one or more monitoring sessions, a report generating service coupled to the datacenter configured to generate one or more monitoring reports based upon the data obtained during one or more monitoring sessions, and / or a recurrent billing system configured to bill the subject or a responsible entity based upon the number or patches consumed, the data stored, and / or the reports generated throughout the course of one or more monitoring sessions.
[0077] According to aspects, there is provided a method for monitoring one or more physiological and / or electrophysiological signals from a subject, including attaching one or more soft, breathable and hypoallergenic devices to one or more sites on the subject, obtainingone or more local physiological and / or electrophysiological signals from each of the devices, obtaining contextual or environmental information from secondary or accessory sensing devices, and analyzing the signals obtained from the primary and secondary sensing devices to generate a metric, diagnostic, report, and / or additional signals therefrom.
[0078] In aspects, the method may include hot swapping one or more of the devices without interrupting the step of obtaining, and / or calibrating one or more of the devices while on the subject. In aspects, the step of calibrating may be performed with an additional medical device (e.g., a blood pressure cuff, a thermometer, a pulse oximeter, a cardiopulmonary assessment system, a clinical grade EKG diagnostic system, etc.).
[0079] In aspects, the method may include determining the position and / or orientation of one or more of the devices on the subject, and / or determining the position and / or orientation from a photograph, a laser rangefinder, a radio frequency rangefinder, a video, or a surveillance video.
[0080] In aspects, one or more steps of a method in accordance with the present disclosure may be performed at least in part by one or more devices, patches, modules, and / or systems each in accordance with the present disclosure.
[0081] According to aspects, there is provided a system for measuring blood pressure of a subject in an ambulatory setting including an EKG device in accordance with the present disclosure (e.g., a patch / module pair in accordance with the present disclosure configured to measure local electrophysiological signals in adjacent tissues), configured for placement onto a torso of the subject, the EKG device configured to measure an electrocardiographic signal from the torso of the subject so as to produce an EKG signal, one or more pulse devices (e.g., patch / module pairs in accordance with the present disclosure configured to measure local blood flow in adjacent tissues) each in accordance with the present disclosure, configured for placement onto one or more sites on one or more extremities of the subject, each of the pulse devices configured to measure a local pulse at the placement site so as to produce one or more pulse signals; and a processor included in or coupled to one or more of the EKG device and the pulse devices, the processor configured to receive the EKG signal, the pulse signals, and / or signals generated therefrom, the processor including an algorithm, the algorithm configured to analyze one or more temporal metrics from the signals in combination with one or more calibration parameters, to determine the blood pressure of the subject.
[0082] In aspects, the system for monitoring blood pressure of a subject may include a blood pressure cuff configured to produce a calibration signal, the processor configured to generate one or more of the calibration parameters, from the calibration signal in combination with the EKG signal, and pulse signals.
[0083] In aspects, one or more of the devices may include an orientation sensor, the orientation sensor configured to obtain an orientation signal, the processor configured to receive the orientation signal or a signal generated therefrom, and to incorporate the orientation signal into the analysis. Some non-limiting examples of orientation sensors include one or more of an altimeter, a barometer, a tilt sensor, a gyroscope, combinations thereof, or the like.
[0084] A system for measuring the effect of an impact on a physiological state of a subject including an electroencephalogram (EEG) device (e.g., a patch / module pair in accordance with the present disclosure configured to measure local electrophysiological signals associated with brain activity in adjacent tissues) in accordance with the present disclosure, configured for placement behind an ear, on the forehead, near a temple, onto the neck of the subject, or the like, the EEG device configured to measure an electroencephalographic signal from the head of the subject so as to produce an EEG signal, and configured to measure one or more kinetic and / or kinematic signals from the head of the subject so as to produce an impact signal, and a processor included in or coupled to the EEG device, the processor configured to receive the EEG signal, the impact signals, and / or signals generated therefrom, the processor including an algorithm, the algorithm configured to analyze the impact signals to determine if the subject has suffered an impact, to separate the signals into pre impact and post impact portions and to compare the pre and post impact portions of the EEG signal, to determine the effect of the impact on the subject.
[0085] In aspects, the EEG device may include additional sensors such as a temperature sensor configured to generate a temperature signal from the subject or a signal generated therefrom, the processor configured to receive the temperature signal and to assess a thermal state of the subject therefrom. In aspects, the EEG device may include a hydration sensor configured to generate a fluid level signal from the subject, the processor configured to receive the fluid level signal or a signal generated therefrom, and to assess the hydration state of the subject therefrom.
[0086] In aspects, the EEG device and / or the processor may include or be coupled to a memory element, the memory element including sufficiently large space to store the signals for a period of 3 minutes, 10 minutes, 30 minutes, or 1 hour.
[0087] In aspects, the system for measuring the effect of an impact on a physiological state of a subject may include an EKG device (e.g., a patch / module pair in accordance with the present disclosure configured to measure local electrophysiological signals in adjacent tissues) in accordance with the present disclosure, the EKG device configured for placement onto the torso or neck of the subject, the EKG device configured to measure an electrophysiological signal pertaining to cardiac function of the subject so as to produce an EKG signal, the processor configured to receive the EKG signal or a signal generated therefrom, the algorithm configured so as to incorporate the EKG signal into the assessment. In aspects, the processor may be configured to extract a heart rate variability (HRV) signal from the EKG signal, to compare a pre impact and post impact portion of the HRV signal to determine at least a portion of the effect of the impact, etc.
[0088] According to aspects, there is provided a system for assessing a sleep state of a subject including an electromyography (EMG) / electrooculography (EOG) device (e.g., a patch / module pair in accordance with the present disclosure configured to measure local electromyographic and / or electrooculographic signals from adjacent tissues), in accordance with the present disclosure, configured for placement behind an ear, on a forehead, substantially around an eye, near a temple, or onto a neck of the subject, the EMGZEOG device configured to measure one or more electromyographic and / or electrooculographic signals from the head or neck of the subject so as to produce an EMGZEOG signal, and a processor included in or coupled to the EMGZEOG device, the processor configured to receive the EMGZEOG signal, and / or signals generated therefrom, the processor including an algorithm, the algorithm configured to analyze EMGZEOG signal, to determine the sleep state of the subject.
[0089] In aspects, the EMGZEOG device may include a microphone, the microphone configured to obtain an acoustic signal from the subject, the processor configured to receive the acoustic signal or a signal generated therefrom, the algorithm configured so as to incorporate the acoustic signal into the assessment.
[0090] In aspects, the system may include a sensor for evaluating oxygen saturation (SpO2) at one or more sites on the subject to obtain an oxygen saturation signal from the subject, the processor configured to receive the oxygen saturation signal or a signal generated therefrom, the algorithm configured so as to incorporate the oxygen saturation signal into the assessment.
[0091] In aspects, the processor may include a signal analysis function, the signal analysis function configured to analyze the EMGZEOG signals, the acoustic signal, and / or the oxygensaturation signal to determine the sleep state of the subject, to identify snoring, to identify a sleep apnea event, to identify a bruxism event, to identify a rapid eye movement (REM) sleep state, to identify a sleep walking state, a sleep talking state, a nightmare, or to identify a waking event. In aspects, the system may include a feedback mechanism, configured to interact with the subj ect, a user, a doctor, a nurse, a partner, a combination thereof, or the like. The processor may be configured to provide a feedback signal to the feedback mechanism based upon the analysis of the sleep state of the subject. The feedback mechanism may include a transducer, a loudspeaker, tactile actuator, a visual feedback means, a light source, a buzzer, a combination thereof, or the like to interact with the subject, the user, the doctor, the nurse, the partner, or the like.
[0092] A modular physiological monitoring system, in some embodiments, includes one or more sensing devices, which may be placed or attached to one or more sites on the subject. Alternatively, or additionally, one or more sensing devices may be placed “off’ the subject, such as one or more sensors (e.g., cameras, acoustic sensors, etc.) that are not physically attached to the subject. The sensing devices are utilized to establish whether or not an event is occurring and to determine one or more characteristics of the event by monitoring and measuring physiological parameters of the subject. The determination of whether an event has occurred or is occurring may be made by a device that is at least partially external and physically distinct from the one or more sensing devices, such as a host device in wired or wireless communication with the sensing devices as described below with respect to FIG. 1. The modular physiological monitoring system may include one or more stimulating devices, which again may be any combination of devices that are attached to the subject or placed “off’ the subject, to apply a stimulus to the subject in response to a detected event. Various types of stimulus may be applied, including but not limited to stimulating via thermal input, vibration input, mechanical input, a compression or the like with an electrical input, etc.
[0093] The sensing devices of a modular physiological monitoring system, such as patchmodule sets described below with respect to FIG. 1, may be used to monitor one or more physiological functions or parameters of a subject, as will be described in further detail below. The sensing devices of the modular physiological monitoring system, or a host device configured to receive data or measurements from the sensing devices, may be utilized to monitor for one or more events (e.g., through analysis of signals measured by the sensing devices, from metrics derived from the signals, etc.). The stimulating devices of the modularphysiological monitoring system may be configured to deliver one or more stimuli (e.g., electrical, vibrational, acoustic, visual, etc.) to the subject. The stimulating devices may receive a signal from one or more of the sensing devices or a host device, and provide the stimulation in response to the received signal.
[0094] As will be further described herein in accordance with illustrative embodiments, sensing devices, monitoring systems, networks, and the like, can be adapted to or otherwise be used for personnel and asset accountability management (e.g., for verifying the presence of personnel and / or assets at different stages of one or more workflows).
[0095] Exemplary sensing devices, monitoring systems, body area networks, and the like, in which personnel and asset accountability management functionality according to illustrative embodiments can be implemented, will be described in conjunction with the figures. Note that patch-module sets or pairs are examples of such sensing devices.
[0096] Referring initially to FIG. 1, aspects are disclosed of a modular physiological monitoring system in accordance with the present disclosure. In FIG. 1, a subject 1 is shown with a number of patches and / or patch-module sets each in accordance with the present disclosure attached thereto at sites described below, a host device 145 in accordance with the present disclosure, a feedback / user device 147 in accordance with the present disclosure displaying some data 148 based upon signals obtained from the subject 1, and one or more feedback devices 135, 140, in accordance with the present disclosure configured to convey to the subject 1 one or more aspects of the signals or information gleaned therefrom. In some embodiments, the feedback devices 135, 140 may also or alternatively function as stimulating devices. The host device 145, the feedback / user device 147, the patches and / or patch-module sets, and / or the feedback devices 135, 140 may be configured for wireless communication 146, 149 during a monitoring session.
[0097] In aspects, a patch-module set may be adapted for placement almost anywhere on the body of a subject 1. As shown in FIG. 1, some sites may include attachment to the cranium or forehead 131, the temple, the ear or behind the ear 50, the neck, the front, side, or back of the neck 137, a shoulder 105, a chest region with minimal muscle mass 100, integrated into a piece of ornamental jewelry 55 (may be a host, a hub, a feedback device, etc.), arrangement on the torso HOa-c, arrangement on the abdomen 80 for monitoring movement or breathing, below the rib cage 90 for monitoring respiration (generally on the right side of the body to substantially reduce EKG influences on the measurements), on a muscle such as a bicep 85, ona wrist or in combination with a wearable computing device 60 on the wrist (e.g., a smart watch, a fitness band, etc.), on a buttocks 25, on a thigh 75, on a calf muscle 70, on a knee 35 particularly for proprioception based studies and impact studies, on a shin 30 primarily for impact studies, on an ankle 65, over an Achilles tendon 20, on the front or top of the foot 15, on a heel 5, or around the bottom of a foot or toes 10. Other sites for placement of such devices are envisioned. Selection of the monitoring and / or stimulating sites is generally determined based upon the intended application of the patch-module sets described herein.
[0098] Additional placement sites on the abdomen, perineal region 142a-c, genitals, urogenital triangle, anal triangle, sacral region, inner thigh 143, or the like may be advantageous in the assessment of autonomic neural function of a subject. Such placements regions may be advantageous for assessment of parasympathetic nervous system (PNS) activity, somatosensory function, assessment of sympathetic nervous system (SNS) functionality, etc.
[0099] Placement sites on the wrist 144a, hand 144b or the like may advantageous for interacting with a subject, such as via performing a stress test, performing a thermal stress test, performing a tactile stress test, monitoring outflow, afferent traffic, efferent traffic, etc.
[0100] Placement sites on the nipples, areola, lips, labia, clitoris, penis, the anal sphincter, levator ani muscle, over the ischiocavernous muscle, deep transverse perineal muscle, labium minus, labium majus, one or more nerves near the surface thereof, posterior scrotal nerves, perineal membrane, perineal nerves, superficial transverse perineal nerves, dorsal nerves, inferior rectal nerves, etc., may be advantageous for assessment of autonomic neural ablation procedures, autonomic neural modulation procedures, assessment of the PNS of a subject, assessment of sexual dysfunction of a subject, etc.
[0101] Placement sites on the face 141, over ocular muscles, near the eye, over a facial muscle (e.g., a nasalis, temporalis, zygomaticus minor / major, orbicularis oculi, occipitofrontalis), near a nasal canal, over a facial bone (e.g., frontal process, zygomatic bone / surface, zygomaticofacial foreman, malar bone, nasal bone, frontal bone, maxilla, temporal bone, occipital bone, etc.), may be advantageous to assess ocular function, salivary function, sinus function, interaction with the lips, interaction with one or more nerves of the PNS (e.g., interacting with the vagus nerve within, on, and / or near the ear of the subject), etc.
[0102] In aspects, a system in accordance with the present disclosure may be configured to monitor one or more physiological parameters of the subject 1 before, during, and / or after one or more of, a stress test, consumption of a medication, exercise, a drill, a mission, arehabilitation session, a massage, driving, a movie, an amusement park ride, sleep, intercourse, a surgical, interventional, or non-invasive procedure, a neural remodeling procedure, a denervation procedure, a sympathectomy, a neural ablation, a peripheral nerve ablation, a radio-surgical procedure, an interventional procedure, a cardiac repair, administration of an analgesic, a combination thereof, or the like.
[0103] Additional details regarding modular physiological monitoring systems, kits and methods are further described in PCT application serial no. PCT / US2014 / 041339, published as WO 2014 / 197822 and titled “Modular Physiological Monitoring Systems, Kits, and Methods,” PCT application serial no. PCT / US2015 / 043123, published as WO 2016 / 019250 and titled “Modular Physiological Monitoring Systems, Kits, and Methods,” PCT application serial no. PCT / US2017 / 030186, published as WO 2017 / 190049 and titled “Monitoring and Management of Physiological Parameters of a Subject,” PCT application serial no. PCT / US2018 / 062539, published as WO 2018 / 098073 and titled “Continuous Long-Term Monitoring of a Subject,” PCT application serial no. PCT / US2018 / 043068, published as WO 2019 / 023055 and titled “Physiological Monitoring Kits,” PCT application serial no. PCT / 2019 / 033036, published as WO 2019 / 226506 and titled “Monitoring Physiological Parameters for Timing Feedback to Enhance Performance of a Subject During an Activity,” PCT application serial no. PCT / US2020 / 031851, published as WO 2020 / 227514 and titled “Monitoring and Processing Physiological Signals to Detect and Predict Dysfunction of an Anatomical Feature of an Individual,” PCT application serial no. PCT / US2021033441, published as WO 2021 / 236948 and titled “Gateway Device Facilitating Collection and Management of Data from a Body Area Network to Study Coordinating System,” PCT application serial no. PCT / US2021 / 028611, published as WO 2021 / 216847 and titled “Visualizing Physiological Data Obtained from Subjects,” PCT application serial no. PCT / US2021 / 033442, published as WO 2021 / 236949 and titled “Non-invasive Detection of Anomalous Physiological Events Indicative of Hypovolemic Shock of a Subject,” PCT application serial no. PCT / US2021 / 041414, published as WO 2022 / 015719 and titled “Wearable Sensor System Configured for Monitoring and Modeling Health Data,” PCT application serial no. PCT / US2021041418, published as WO 2022 / 015722 and titled “Wearable Sensor System Configured for Facilitating Telemedicine Management,” and PCT application serial no. PCT / US2021 / 041420, published as WO 2022 / 015724 and titled“Wearable Sensor System Configured for Alerting First Responders and Local Caregivers,” the disclosures of which are incorporated by reference herein in their entirety.
[0104] In some embodiments, modular monitoring systems may include sensing and stimulating devices that are physically distinct, such as sensing and stimulating devices that are physically attached to a subject at varying locations. For example, the sensing and stimulating devices may include different ones of the patch-module sets described above with respect to FIG. 1. In other embodiments, one or more devices may provide both monitoring and stimulating functionality. For example, one or more of the patch-module sets described above with respect to FIG. 1 may be configured to function as both a sensing device and a stimulating device. It is to be appreciated, however, that embodiments are not limited solely for use with the patch-module sets of FIG. 1 as sensing and stimulating devices. Various other types of sensing and stimulating devices may be utilized, including but not limited to sensors that are “off-body” with respect to subject 1.
[0105] The sensing and / or stimulating devices of a modular physiological monitoring system may be configured for radio frequency (RF) or other wireless and / or wired connection with one another and / or a host device. Such RF or other connection may be used to transmit or receive feedback parameters or other signaling between the sensing and stimulating devices. The feedback, for example, may be provided based on measurements of physiological parameters that are obtained using the sensing devices to determine when events related to cardiac and / or other physiological output are occurring. Various thresholds for stimulation that are applied by the stimulating devices may, in some embodiments, be determined based on such feedback. Thresholds may relate to the amplitude or frequency of electric or other stimulation. Thresholds may also be related to whether to initiate stimulation by the stimulating devices based on the feedback.
[0106] During and / or after stimulus is applied with the stimulating devices, the sensing devices may monitor the physiological response of the subject. If stimulation is successful in achieving a desired response, the stimulation may be discontinued. Otherwise, the type, timing, etc., of stimulation may be adjusted.
[0107] In some embodiments, a user of the modular physiological monitoring system may set preferences for the stimulus type, level, and / or otherwise personalize the sensation during a setup period or at any point during use of the modular physiological monitoring system. The user of the modular physiological monitoring system may be the subject being monitored andstimulated by the sensing devices and stimulating devices, or a doctor, nurse, physical therapist, medical assistant, caregiver, a supervisor, a group leader, a medic, etc., of the subject being monitored and stimulated. The user may also have the option to disconnect or shut down the modular physiological monitoring system at any time, such as via operation of a switch, pressure sensation, voice operated instruction, etc.
[0108] Stimulus or feedback which may be provided via one or more stimulating devices in a modular physiological monitoring system may be in various forms, including physical stimulus (e.g., electrical, thermal, vibrational, pressure, stroking, a combination thereof, or the like), optical stimulus, acoustic stimulus, etc.
[0109] Physical stimulus may be provided in the form of negative feedback, such as in a brief electric shock or impulse as described above. Data or knowledge from waveforms applied in conducted electrical weapons (CEWs), such as in electroshock devices, may be utilized to avoid painful stimulus. Physical stimulus may also be provided in the form of positive feedback, such as in evoking pleasurable sensations by combining non-painful electrical stimulus with pleasant sounds, music, lighting, smells, etc. Physical stimulus is not limited solely to electrical shock or impulses. In other embodiments, physical stimulus may be provided by adjusting temperature or other stimuli, such as in providing a burst of cool or warm air, a burst of mist, vibration, tension, stretch, pressure, etc.
[0110] Feedback provided via physical stimulus as well as other stimulus described herein may be synchronized with, initiated by or otherwise coordinated or controlled in conjunction with one or more monitoring devices (e.g., a host device, one or more sensing devices, etc.). The monitoring devices may be connected to the stimulating devices physically (e.g., via one or more wires or other connectors), wirelessly (e.g., via radio or other wireless communication), etc. Physical stimulus may be applied to various regions of a subject, including but not limited to the wrist, soles of the feet, palms of the hands, nipples, forehead, ear, mastoid region, the skin of the subject, etc.
[0111] Optical stimulus may be provided via one or more stimulating devices. The optical stimulus may be positive or negative (e.g., by providing pleasant or unpleasant lighting or other visuals). Acoustic stimulus similarly may be provided via one or more stimulating devices, as positive or negative feedback (e.g., by providing pleasant or unpleasant sounds). Acoustic stimulus may take the form of spoken words, music, etc. Acoustic stimulus, in some embodiments may be provided via smart speakers or other electronic devices such as AmazonEcho®, Google Home®, Apple Home Pod®, etc. The stimulus itself may be provided so as to elicit a particular psychophysical or psychoacoustic effect in the subject, such as directing the subject to stop an action, to restart an action (such as breathing), to adjust an action (such as a timing between a step and a respiratory action, between a muscle contraction and a leg position, etc.).
[0112] As described above, the modular physiological monitoring system may operate in a therapeutic mode, in that stimulation is provided when one or more cardiac parameters of a subject indicate some event (e.g., actual, imminent or predicted failure or worsening). The modular physiological monitoring system, however, may also operate as or provide a type of cardiac “pacemaker” in other embodiments. In such embodiments, the modular physiological monitoring system has the potential to reduce the frequency of cardiac events, or to possibly avoid certain cardiac events altogether. A modular physiological monitoring system may provide functionality for timing and synchronizing periodic compression and relaxation of microvascular blood vessel networks with cardiac output. Such techniques may be utilized to respond to a type of failure event as indicated above. Alternatively or additionally, such techniques may be provided substantially continuously, so as to improve overall cardiac performance (e.g., blood flow) with the same or less cardiac work.
[0113] In some embodiments, a modular physiological monitoring system may be configured to provide multi-modal stimuli to a subject. Multi-modal approaches use one or more forms of stimulation (e.g., thermal and electrical, mechanical and electrical, etc.) in order to mimic another stimulus to trick local nerves into responding in the same manner to the mimicked stimulus. In addition, in some embodiments multi-modal stimulus or input may be used to enhance a particular stimulus. For example, adding a mimicked electrical stimulus may enhance the effect of a thermal stimulus.
[0114] Modular physiological monitoring systems may use pulses across space and time (e.g., frequency, pulse trains, relative amplitudes, etc.) to mimic vibration, comfort or discomfort, mild or greater pain, wet sensation, heat / cold, training neuroplasticity, taste (e.g., using a stimulating device placed in the mouth or on the tongue of a subject to mimic sour, sweet, salt, bitter or umami flavor), tension or stretching, sound or acoustics, sharp or dull pressure, light polarization (e.g., linear versus polar, the hai dinger-brush effect), light color or brightness, etc.
[0115] Stimulus amplification may also be provided by one or more modular physiological monitoring systems using multi-modal input. Stimulus amplification represents a hybrid approach, wherein a first type of stimulus may be applied and a second, different type of stimulus provided to enhance the effect of the first type of stimulus. As an example, a first stimulus may be provided via a heating element, where the heating element is augmented by nearby electrodes or other stimulating devices that amplify and augment the heating stimulus using electrical mimicry in a pacing pattern. Electrical stimulus may also be used as a supplement or to mimic various other types of stimulus, including but not limited to vibration, heat, cold, etc. Different, possibly unique, stimulation patterns may be applied to the subject, with the central nervous system and peripheral nervous system interpreting such different or unique stimulation patterns as different stimulus modalities.
[0116] Another example of stimulus augmentation is sensing a “real” stimulus, measuring the stimulus, and constructing a proportional response by mimicry such as using electric pulsation. The real stimulus, such as sensing heat or cold from a Peltier device, may be measured by electrical-thermal conversion. This real stimulus may then be amplified using virtual mimicry, which may provide energy savings and the possibility of modifying virtual stimulus to modify the perception of the real stimulus.
[0117] In some embodiments, the stimulating devices in a modular physiological monitoring system include an electrode array that attaches (e.g., via an adhesive or which is otherwise held in place) to a preferred body part. One or more of the stimulating devices may include a multiplicity of both sensing and stimulation electrodes, including different types of sensing and / or stimulation electrodes. The sensing electrodes on the stimulation devices, in some embodiments, may be distinct from the sensing devices in the modular physiological monitoring system in that the sensing devices in the modular physiological monitoring system may be used to measure physiological parameters of the subject while the sensing electrodes on the stimulation devices in the modular physiological monitoring system may be utilized to monitor the application of a stimulus to the subject.
[0118] A test stimulus may be initiated in a pattern in the electrode array, starting from application via one or a few of the stimulation electrodes and increasing in number over time to cover an entire or larger portion of the electrode array. The test stimulus may be used to determine the subject’s response to the applied stimulation. Sensing electrodes on the stimulation devices may be used to monitor the application of the stimulus. The electrode arraymay also be used to record a desired output (e.g., physiological parameters related to cardiac output). As such, one or more of the electrodes in the array may be configured so as to measure the local evoked response associated with the stimulus itself. Such an approach may be advantageous to confirm capture of the target nerves during use. By monitoring the neural response to the stimulus, the stimulus parameters including amplitude, duration, pulse number, etc., may be adjusted while ensuring that the target nerves are enlisted by the stimulus in use.
[0119] The test stimulus may migrate or be applied in a pattern to different electrodes at different locations in the electrode array. The response to the stimulus may be recorded or otherwise measured, using the sensing devices in the modular physiological monitoring system and / or one or more of the sensing electrodes of the stimulating devices in the modular physiological monitoring system. The response to the test stimulus may be recorded or analyzed to determine an optimal sensing or application site for the stimulus to achieve a desired effect or response in the subject. Thus, the test stimulus may be utilized to find an optimal sensing (e.g., dermatome driver) location. This allows for powerful localization for optimal pacing or other application of stimulus, which may be individualized for different subjects.
[0120] A stimulating device applied to the subject via an adhesive (e.g., an adhesively applied stimulating device), may be in the form of a disposable or reusable unit, such as a patch and or patch-module or patch / hub pair as described above with respect to FIG. 1. An adhesively applied stimulating device, in some embodiments, includes a disposable interface configured so as to be thin, stretchable, able to conform to the skin of the subject, and sufficiently soft for comfortable wear. The disposable interface may be built from very thin, stretchable and / or breathable materials, such that the subject generally does not feel the device on his or her body.
[0121] Actuation means of the adhesively applied stimulating device may be applied over a small region of the applied area of the subject, such that the adhesive interface provides the biasing force necessary to counter the actuation of the actuation means against the skin of the subject.
[0122] Adhesively applied stimulating devices may be provided as two components - a disposable body interface and a reusable component. The disposable body interface may be applied so as to conform to the desired anatomy of the subject, and wrap around the body suchthat the reusable component may interface with the disposable component in a region that is open and free from a natural interface between the subject and another surface.
[0123] An adhesively applied stimulating device may also be a single component, rather than a two component or other multi-component arrangement. Such a device implemented as a single component may include an adhesive interface to the subject including two or more electrodes that are applied to the subject. Adhesively applied stimulating devices embodied as a single component provide potential advantages such as easier application to the body of the subject, but may come at a disadvantage with regards to one or more of breathability, conformity, access to challenging interfaces, etc., relative to two component or multicomponent arrangements.
[0124] A non-contacting stimulating device may be, for example an audio and / or visual system, a heating or cooling system, etc. Smart speakers and smart televisions or other displays are examples of audio and / or visual non-contacting stimulation devices. A smart speaker, for example, may be used to provide audible stimulus to the subject in the form of an alert, a suggestion, a command, music, other sounds, etc. Other examples of non-contacting stimulating devices include means for controlling temperature such as fans, air conditioners, heaters, etc.
[0125] One or more stimulating devices may also be incorporated in other systems, such as stimulating devices integrated into a bed, chair, operating table, equipment, etc., that a subject interfaces with. A bed, for example, may include one or more pneumatic actuators, vibration actuators, shakers, or the like to provide a stimulus to the subject in response to a command, feedback signal or control signal generated based on measurement of one or more physiological parameters of the subject utilizing one or more sensing devices. Similarly, equipment that the subject is wearing or carrying can have one or more stimulating devices incorporated therein and / or thereon.
[0126] Although the disclosure has discussed devices attached to the body for monitoring aspects of the subject’s disorder and / or physiological information, as well as providing a stimulus, therapeutic stimulus, etc., alternative devices may be considered. Non-contacting devices may be used to obtain movement information, audible information, skin blood flow changes (e.g., such as by monitoring subtle skin tone changes which correlate with heart rate), respiration (e.g., audible sounds and movement related to respiration), and the like. Such noncontacting devices may be used in place of or to supplement an on-body system for themonitoring of certain conditions, for applying stimulus, etc. Information captured by noncontacting devices may, on its own or in combination with information gathered from sensing devices on the body, be used to direct the application of stimulus to the subject, via one or more stimulating devices on the body and / or via one or more non-contacting stimulating devices.
[0127] In some embodiments, aspects of monitoring the subject utilizing sensing devices in the modular physiological monitoring system may utilize sensing devices that are affixed to or embodied within one or more contact surfaces, such as surfaces on a piece of furniture on which a subject is positioned (e.g., the surface of a bed, a recliner, a car seat, etc.). The surface may be equipped with one or more sensors to monitor the movement, respiration, HR, etc., of the subject. To achieve reliable recordings, it is advantageous to have such surfaces be well positioned against the subject. It is also advantageous to build such surfaces to take into account comfort level of the subject to keep the subject from feeling the sensing surfaces and to maintain use of the sensing surface over time.
[0128] Stimulating devices, as discussed above, may take the form of audio, visual or audiovisual systems or devices in the sleep space of the subject. Examples of such stimulating devices include smart speakers. Such stimulating devices provide a means for instructing a subject to alter the sleep state thereof. The input or stimulus may take the form of a message, suggestion, command, audible alert, musical input, change in musical input, a visual alert, one or more lights, a combination of light and sound, etc. Examples of such non-contacting stimulating devices include systems such as Amazon Echo®, Google Home®, Apple Home Pod®, and the like.
[0129] FIGS. 2A-2D show a modular physiological monitoring system 200. The modular physiological monitoring system 200 includes a sensing device 210, an accessory device 215 and a stimulating device 220 attached to a subject 201 that are in wireless communication 225 with a host device 230. The host device 230 includes a processor, a memory and a network interface. In some embodiments, the accessory sensing device 215 is mounted on equipment carried by the subject 201, such as a firearm, firearm holster, etc.
[0130] The processor may comprise a microprocessor, a microcontroller, an applicationspecific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other type of processing circuitry, as well as portions or combinations of such circuitry elements.
[0131] The memory may comprise random access memory (RAM), read-only memory (ROM) or other types of memory, in any combination. The memory and other memoriesdisclosed herein may be viewed as examples of what are more generally referred to as “processor-readable storage media” storing executable computer program code or other types of software programs. Articles of manufacture comprising such processor-readable storage media are considered embodiments of the invention. A given such article of manufacture may comprise, for example, a storage device such as a storage disk, a storage array or an integrated circuit containing memory. The processor may load the computer program code from the memory and execute the code to provide the functionalities of the host device 230.
[0132] The network interface provides circuitry enabling wireless communication between the host device 230, the sensing device 210, the accessory device 215 and the stimulating device 220.
[0133] FIG. 2A illustrates a modular physiological monitoring system 200 that includes only a single instance of the sensing device 210, the accessory device 215 and the stimulating device 220 for clarity. It is to be appreciated, however, that modular physiological monitoring system 200 may include multiple sensing devices, accessory devices, and / or stimulating devices. In addition, although FIG. 2A illustrates a modular physiological monitoring system 200 in which the sensing device 210 and the stimulating device 220 are attached to the subject 201 while the accessory device 215 is not attached to the subject 201, embodiments are not limited to such arrangements. As described above, one or more sensing and / or stimulating devices may be part of contacting surfaces or non-contacting devices. Further, accessory devices may alternatively be “on-body” or attached to the subject 201 as described elsewhere herein. In addition, the placement of sensing device 210 and stimulating device 220 on the subject 201 may vary as described above. Also, the host device 230 (and possible the accessory device 215) may be worn by the subject 201, such as being incorporated into a smartwatch or other wearable computing device. The functionality provided by host device 230 may also be provided, in some embodiments, by one or more of the sensing device 210, the accessory device 215 and the stimulating device 220. In some embodiments, as will be described in further detail below, the functionality of the host device 230 may be provided at least in part using cloud computing resources.
[0134] FIG. 2B shows a schematic diagram of aspects of the sensing device 210 in modular physiological monitoring system 200. The sensing device 210 includes one or more of a processor, a memory device, a controller, a power supply, a power management and / or energy harvesting circuit, one or more peripherals, a clock, an antenna, a radio, a signal conditioningcircuit, optical source(s), optical detector(s), a sensor communication circuit, vital sign sensor(s), and secondary sensor(s). The sensing device 210 is configured for wireless communication 225 with the accessory device 215, the stimulating device 220 and the host device 230.
[0135] FIG. 2C shows a schematic diagram of aspects of the stimulating device 220 in modular physiological monitoring system 200. The stimulating device 220 includes one or more of a processor, a memory device, a controller, a power supply, a power management and / or energy harvesting circuit, one or more peripherals, a clock, an antenna, a radio, a signal conditioning circuit, a driver, a stimulator, vital sign sensor(s), a sensor communication circuit, and secondary sensor(s). The stimulating device 220 is configured for wireless communication 225 with the sensing device 210, the accessory device 215, and the host device 230.
[0136] FIG. 2D shows a schematic diagram of aspects of the accessory device 215 in modular physiological monitoring system 200. The accessory device 215 includes one or more of a processor, a memory device, a controller, a power supply, a power management and / or energy harvesting circuit, one or more peripherals, a clock, an antenna, a radio, a signal conditioning circuit, a driver, a stimulator, vital sign sensor(s), a sensor communication circuit, and secondary sensor(s). The accessory device 215 is configured for wireless communication 225 with the sensing device 210, the stimulating device 220, and the host device 230.
[0137] Communication of data from the sensing devices and / or stimulating devices (e.g., patches and / or patch-module sets), as well as accessory devices, may be performed via a local personal communication device (PCD). Such communication in some embodiments takes place in two parts: (1) local communication between a patch and / or patch-module set (e.g., via a hub or module of a patch-module set) and the PCD; and (2) remote communication from the PCD to a back-end server, which may be part of a cloud computing platform and implemented using one or more virtual machines (VMs) and / or software containers. The PCD and back-end server may collectively provide functionality of the host device as described elsewhere herein. The PCD may also be part of or provide functionality of an accessory device.
[0138] FIGS. 3A-3E show a wearable sensor system 300 configured for monitoring physiologic, location, and contextual and / or environmental data for a plurality of users and / or assets, and for analyzing such data for use in managing personnel and asset accountability. The wearable sensor system 300 provides the capability for assessing the condition of the human body of a plurality of users (e.g., including user 336 and a crowd of users 338). As shown inFIG. 3 A, the wearable sensor system 300 includes a wearable device 302 that is affixed to user 336, as well as one or more accessory devices 315 having sensors configured for capturing contextual and / or environmental information for the user 336 and / or the crowd of users 338. While the wearable device 302 is shown as being “on-body” relative to the user 336, the accessory devices 315 may, but are not required to be, “off-body” devices relative to the user 336 and / or the crowd of users 338. The accessory devices 315, for example, may comprise, be attached to, or otherwise incorporate within a firearm or other equipment that is carried on or worn by the user 336.
[0139] Data collected from the user 336 via the wearable device 302, as well as contextual and / or environmental data collected from the accessory devices 315, is communicated using a wireless gateway 340 to an artificial intelligence (Al) wearable device network 348 over or via network 384. The network 384 may comprise a physical connection (wired or wireless), the Internet, a cloud communication network, etc. Examples of wireless communication networks that may be utilized include networks that utilize Visible Light Communication (VLC), Worldwide Interoperability for Microwave Access (WiMAX), Long Term Evolution (LTE), Wireless Local Area Network (WLAN), Infrared (IR) communication, Public Switched Telephone Network (PSTN), Radio waves, and other communication techniques known in the art. Also coupled to the network 384 is a crowd of users 338 and a verification entity 386 coupled to a set of third-party networks 368. Detailed views of the wearable device 302, wireless gateway 340, Al wearable device network 348 and third-party networks 368 are shown in FIGS. 3B-3E, respectively.
[0140] In some embodiments, the wearable device 302 is implemented using one or more patch-module sets as described above with respect to FIGS. 1 and 2A-2C. The patch-module sets described above with respect to FIGS. 1 and 2A-2C, however, are just one example of wearable technology that may be used to provide the wearable device 302. Various other types of wearable technology may be used to provide the wearable device in other embodiments, including but not limited to wearables, fashion technology, tech togs and other types of fashion electronics that include “smart” electronic devices (e.g., electronic devices with microcontrollers) that can be incorporated into clothing or worn on the body as implants or accessories. Wearable devices such as activity trackers are examples of Internet of Things (loT) devices, and such “things” include electronics, software, sensors and connectivity units that are effectors enabling objects to exchange data (including data quality) through the Internetwith a manufacturer, operator and / or other connected devices without requiring human intervention. Wearable technology has a variety of applications, which grows as the field itself expands. Wearable technology appears prominently in consumer electronics with the popularization of smartwatches and activity trackers. Apart from commercial uses, wearable technology is being incorporated into navigation systems, advanced textiles, and health care.
[0141] In some embodiments, the wearable device 302 is capable of detecting and collecting medical data (e.g., body temperature, respiration, heart rate, etc.) from the wearer (e.g., user 336). The wearable device 302 can remotely collect and transmit real-time physiological data to health care providers and other caretakers responsible for ensuring their communities stay healthy. The wearable sensor system 300, in some embodiments, is user-friendly, hypoallergenic, unobtrusive, and cost-effective. In service of enabling remote evaluation of individual health indicators, the wearable sensor system 300 is configured to transmit data directly into existing health informatics and health care management systems from the comfort of patients’ homes or in other remote environments outside health care facilities. The wearable device 302 is designed to monitor the cardiopulmonary state of a subject (e.g., user 336) over time in home or in clinical settings. Onboard sensors of the wearable device 302 can quantitatively detect and track severity of a variety of disease symptoms including fever, coughing, sneezing, vomiting, infirmity, tremor, and dizziness, as well as signs of decreased physical performance and changes in respiratory rate / depth. The wearable device 302 may also have the capability to monitor blood oxygenation.
[0142] In some embodiments, the wearable device 302 collects physiologic monitoring data from the subject user 336 utilizing a combination of a disposable sampling unit 312 and a reusable sensing unit 314 (FIG. 3B). The patch-module sets described above with respect to FIGS. 1 and 2A-2C are an example implementation of the disposable sampling unit 312 and reusable sensing unit 314. The disposable sampling unit 312 may be formed from a softer-than-skin patch. The wearable device 302, formed from the combination of the disposable sampling unit 312 and reusable sensing unit 314, is illustratively robust enough for military use, yet extremely thin and lightweight. For example, the disposable sampling unit 312 and reusable sensing unit 314 may collectively weigh less than 0.1 ounce, about the same as a U.S. penny. The wearable device 302 may be adapted for placement almost anywhere on the body of the user 336, such as the various placement sites shown in FIG. 1 and described above.
[0143] In addition to the disposable sampling unit 312 and reusable sensing unit 314, the wearable device 302 may include a number of other components as illustrated in FIG. 3B. Such components include a power source 304, a communications unit 306, a processor 308, a memory 310, a GPS unit 330, an UWB communication unit 332, contextual analysis module 334 and firearm discharge detection and analysis module 339.
[0144] The power source or component 304 of the wearable device 302, in some embodiments, includes one or more modules with each module including a power source (e.g., a battery, a rechargeable battery, an energy harvesting transducer, a microcircuit, an energy reservoir, a thermal gradient harvesting transducer, a kinetic energy harvesting transducer, a radio frequency energy harvesting transducer, a fuel cell, a biofuel cell, combinations thereof, etc.).
[0145] The communications unit 306 of the wearable device 302 may be embodied as communication circuitry, or any communication hardware that is capable of transmitting an analog or digital signal over one or more wired or wireless interfaces. In some embodiments, the communications unit 306 includes transceivers or other hardware for communications protocols, such as Near Field Communication (NFC), WiFi, Bluetooth, infrared (IR), modem, cellular, ZigBee, a Body Area Network (BAN), and other types of wireless communications. The communications unit 306 may also or alternatively include wired communication hardware, such as one or more universal serial bus (USB) interfaces. The communications unit 306 and / or the sensing unit 314 may implement an NFC reader and / or NFC tag facilitating tracking of the presence of resources at particular locations.
[0146] The processor 308 of the wearable device 302 is configured to decode and execute any instructions received from one or more other electronic devices and / or servers. The processor 308 may include any combination of one or more general-purpose processors (e.g., Intel® or Advanced Micro Devices (AMD)® microprocessors), one or more special-purpose processors (e.g., digital signal processors or Xilink® system on chip (SOC) field programmable gate array (FPGA) processors, application-specific integrated circuits (ASICs), etc.), etc. The processor 308 is configured in some embodiments to execute one or more computer-readable program instructions, such as program instructions to carry out any of the functions described herein including but not limited to those of the contextual analysis module 334 and the firearm discharge detection and analysis module 339 described below. The processor 308 isillustratively coupled to the memory 310, with the memory 310 storing such computer-readable program instructions.
[0147] The memory 310 may include, but is not limited to, fixed hard disk drives, magnetic tape, floppy diskettes, optical disks, compact disc read-only memories (CD-ROMs), magnetooptical disks, semiconductor memories such as read-only memory (ROM), random-access memory (RAM), programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, magnetic or optical cards, or other type of media / machine-readable medium suitable for storing electronic instructions. The memory 310 may comprise modules implemented as one or more programs. In some embodiments, a non-transitory processor-readable storage medium has stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device (e.g., the processor 308) causes said at least one processing device to perform one or more aspects of the methods, algorithms and process flows described herein.
[0148] The processor 308 and memory 310 are an example of a processing device or controller. The controller may comprise a central processing unit (CPU) for carrying out instructions of one or more computer programs for performing arithmetic, logic, control and input / output (VO) operations specified by the instructions (e.g., as specified by the contextual analysis module 334 and / or the firearm discharge detection and analysis module 339 as described in further detail below). Such computer programs may be stored in the memory 310. The memory 310 provides electronic circuitry configured to temporarily store data that is utilized by the processor 308. In some embodiments, the memory 310 further provides persistent storage for storing data utilized by the processor 308. Although not explicitly shown, other components of the wearable sensor system 300 (e.g., the accessory devices 315, the wireless gateway 340 (FIG. 3C), the Al wearable device network 348, one or more of the third-party networks 368, the verification entity 386, etc.) may also include one or more processors coupled to one or more memories providing processing devices implementing the functionality of such components.
[0149] As noted above, the wearable device 302 illustratively includes the disposable sampling unit 312 which may be embodied as a physical interface to the skin of the user 336. Patches as described elsewhere herein are examples of a disposable sampling unit 312. Such patches are adapted for attachment to a human or animal body (e.g., attachable to the skin thereof, reversibly attachable, adhesively attachable, with a disposable interface that couplesto a reusable module, etc.). In some embodiments, the disposable sampling unit 312 is part of a system that is capable of modular design, such that various wearable devices or portions thereof (e.g., reusable sensing unit 314) are compatible with various disposable sampling units with differing capabilities. In some embodiments, the patch or more generally the disposable sampling unit 312 allows sterile contact between the user 336 and other portions of the wearable device 302, such as the reusable sensing unit 314. In such embodiments, the other portions of the wearable device 302 (e.g., which may be embodied as a module as described above with respect to FIGS. 1 and 2A-2C) may be returned, sterilized and reused (e.g., by the same user 336 or another user) while the patch or disposable sampling unit 312 is disposed of. In some embodiments, the patch or other disposable sampling unit 312 is suitable for wearing over a duration of time in which the user 336 is undergoing physiological monitoring. In such embodiments, the patch or disposable sampling unit 312 may be disposed of after the monitoring duration has ended.
[0150] The reusable sensing unit 314 includes various sensors, such as one or more temperature sensors 316, one or more heart rate sensors 318, one or more respiration sensors 320, one or more pulse oximetry sensors 322, one or more accelerometer sensors 324, one or more gyroscope sensors 326, one or more audio sensors 328, and one or more other sensors 329. One or more of the sensors 316-329 may be embodied as electric features, capacitive elements, resistive elements, touch sensitive components, analyte sensing elements, printed electrochemical sensors, light sensitive sensing elements, electrodes (e.g., including but not limited to needle electrodes, ionically conducting electrodes, reference electrodes, etc.), electrical traces and / or interconnects, stretch sensing elements, contact interfaces, conduits, microfluidic channels, antennas, stretch resistant features, stretch vulnerable features (e.g., a feature that changes properties reversibly or irreversibly with stretch), strain sensing elements, photo-emitters, photodiodes, biasing features, bumps, touch sensors, pressure sensing elements, interfacial pressure sensing elements, piezoelectric elements, piezoresistive elements, chemical sensing elements, electrochemical cells, electrochemical sensors, redox reactive sensing electrodes, light sensitive structures, moisture sensitive structures, pressure sensitive structures, magnetic structures, bioadhesives, antennas, transistors, integrated circuits, transceivers, sacrificial structures, water soluble structures, temperature sensitive structures, light sensitive structures, light degrading structures, flexible light emitting elements, piezoresistive elements, moisture sensitive elements, mass transfer altering elements, etc.
[0151] In some embodiments, one or more of the sensors 316-329 have a controlled mass transfer property, such as a controlled moisture vapor conductivity so as to allow for a differential heat flux measurement through the patch or other disposable sampling unit 312. Such properties of one or more of the sensors 316-329 may be used in conjunction with the one or more temperature sensors 316 to obtain core temperature measurements of the user 336. It should be noted that one or more of the sensors 316-328 or the sensing unit 314 generally may be associated with signal conditioning circuitry used in obtaining core temperature or other measurements of physiologic parameters of the user 336. Core temperature measurements may, in some embodiments, be based at least in part on correlation parameters extracted from sensors of multiple wearable devices, or from sensors of the same wearable device that interface with different portions of the user 336. The correlation parameters may be based on thermal gradients computed as comparisons of multiple sensor readings (e.g., from a first subset of sensors oriented to make thermal contact with the user 336 and from a second subset of sensors oriented to make thermal contact with ambient surroundings, etc.). Core temperature readings may thus be estimated from the thermal gradients.
[0152] Changes in core temperature readings from multiple sensor readings over some designated period of time (e.g., a transitionary period where two wearable devices are attached to the user 336 and obtain core temperature readings) are analyzed to generate correlation parameters that relate changes in core temperature readings from the multiple sensors. In some embodiments, this analysis includes determining which of the multiple sensors has a lowest thermal gradient and weighting the correlation parameters to the sensor or device having the lowest thermal gradient. Consider an example where a first set of one or more sensors is at a first site on the user 336 and a second set of one or more sensors is at a second site on the user 336, with the first site being associated with a lower thermal gradient than the second site but with the second site being more conducive to long-term wear relative to the first site. In such cases, it may be desired to obtain core temperature readings from the first and second sets of sensors, establish the correlation parameter, and then subsequently use only the second set of sensors at the second site more conducive to long-term wear by the user 336. In some embodiments, the temperature sensors 316 comprise one or more digital infrared temperature sensors (e.g., Texas Instruments TMP006 sensors).
[0153] The heart rate sensors 318 in some embodiments are configured to sense physiological parameters of the user 336, such as conditions of the cardiovascular system ofthe user 336 (e.g., heart rate, blood pressure, heart rate variability, etc.). In some embodiments, the physiological parameters comprise one or more bioimpedance measurements, and correlation parameters may be generated by extracting local measures of water content from bioimpedance signals recorded from multiple sensors potentially at different sites on the body of the user 336. The local measures of water content recorded by different devices or sensors may be recorded during at least a portion of a transitionary period as described above to generate correlation parameters for application to bioimpedance signals recorded by the different sensors to offset at least a portion of identified differences therebetween. The correlated changes in the local measures of water content may be associated with a series of postural changes by the user 336.
[0154] The respiration sensors 320 are configured to monitor the condition of respiration, rate of respiration, depth of respiration, and other aspects of the respiration of the user 336. The respiration sensors 320 may obtain such physiological parameters by placing the wearable device 302 (e.g., a patch-module pair thereof) on the abdomen of the user 336 for monitoring movement or breathing, below the rib cage for monitoring respiration (generally on the right side of the body to substantially reduce EKG influences on the measurements), such placement enabling the respiration sensors 320 to provide rich data for respiration health, which may be advantageous in detection of certain infectious diseases that affect the respiratory tract of victims, such as, for example, coronavirus / COVID-19.
[0155] The pulse oximetry sensors 322 are configured to determine oxygen saturation (SpO2) using a pulse oximeter to measure the oxygen level or oxygen saturation of the blood of the user 336.
[0156] The accelerometer sensors 324 are configured to measure acceleration of the user 336. Single and multi-axis models of accelerometers may be used to detect the magnitude and direction of the proper acceleration as a vector quantity, and can be used to sense orientation (e.g., based on the direction of weight changes), coordinate acceleration, vibration, shock, and falling in a resistive medium (e.g., a case where the proper acceleration changes, since it starts at zero then increases). The accelerometer sensors 324 may be embodied as micromachined microelectromechanical systems (MEMS) accelerometers present in portable electronic devices such as the wearable device 302. The accelerometer sensors 324 may also be used for sensing muscle contraction for various activities, such as running and other erect sports. In the case of running and other erect sports, resistance rises as either (or both) of the right and leftextremities (e.g., feet, shins, knees, etc.) strike the ground. This rise or peak may be synchronized to bolus ejection as detailed herein. The accelerometer sensors 324 may detect such activity by measuring the body or extremity center of mass of the user 336. In some cases, the body center of mass may yield the best timing for the injection of fluid. Embodiments, however, are not limited solely to use with measuring the body center of mass.
[0157] The gyroscope sensors 326 are configured to measure orientation and angular velocity, and may be used to detect deviation of an object (e.g., the sensing unit 314, the wearable device 302) from a desired orientation.
[0158] The audio sensors 328 are configured to convert sound into electrical signals, and may be embodied as one or more microphones or piezoelectric sensors that use the piezoelectric effect to measure changes in pressure, acceleration, temperature, strain, or force by converting them to an electrical charge. In some embodiments, the audio sensors 328 may include ultrasonic transducer receivers capable of converting ultrasound into electrical signals.
[0159] It should be noted that the sensors 316-328 described above are presented by way of example only, and that the sensing unit 314 may utilize various other types of sensors 329 as described elsewhere herein. For example, in some embodiments the other sensors 329 include one or more of motion sensors, humidity sensors, cameras, radiofrequency receivers, thermal imagers, radar devices, lidar devices, ultrasound devices, speakers, etc.
[0160] The GPS unit 330 is a component of the wearable device 302 configured to detect global position using GPS, a satellite-based radio navigation system owned by the U.S. government and operated by the U.S. Space Force. GPS is one type of global navigation satellite system (GNSS) that provides geolocation and time information to a GPS receiver anywhere on or near the Earth where there is an unobstructed line of sight to four or more GPS satellites.
[0161] The UWB communication unit 332 is a component of the wearable device 302 configured to detect UWB radiofrequencies. UWB is a short-range, wireless communication protocol similar to Bluetooth or WiFi, which uses radio waves at a very high frequency. Notably, UWB also uses a wide spectrum of several gigahertz (GHz). The functioning of a UWB sensor is to provide the ability to continuously scan an entire room and provide spatial awareness data to the wearable device 302, improving the localization of the wearable device 302 particularly in conjunction with use of the GPS unit 330.
[0162] The contextual analysis module 334 is configured to execute various functionality for combining sensor data from multiple ones of the sensors of the sensing unit 314 (e.g., physiologic monitoring data for the user 336), possibly along with sensor data from the accessory devices 315 (e.g., contextual and / or environmental information associated with the user 336 and / or the crowd of users 338), for higher-level analysis.
[0163] The personnel and asset accountability module 339 is configured to execute various functionality for monitoring and tracking personnel (e.g., the user 336 and / or one or more of the plurality of users 338) and / or assets (e.g., accessory devices 315) in accordance with some defined workflow having multiple stages, where different personnel and / or assets are assigned for use during the two or more stages of the workflow. The personnel and asset accountability module 339 is configured to determine whether particular personnel and / or assets are present and accounted for during the different stages of the workflow, and to generate visualizations thereof. The personnel and asset accountability module 339 may utilize various information collected utilizing components of the wearable device 302 (e.g., the sensing unit 314 including one or more of the sensors 316 through 329, the GPS unit 330, the UWB communication unit 332, etc.) and / or results of contextual analysis (e.g., which takes into account accessory devices 315) performed by the contextual analysis module 334.
[0164] The user 336 may be a human or animal to which the wearable device 302 is attached. Sensor data and localization data collected by the wearable device 302, along with contextual and / or environmental data collected from the accessory devices 315, may be provided to Al wearable device network 348 for analysis, with portions or such analysis being provided to one or more of the third-party networks 368 for various purposes. Communication of the sensor and localization data from the wearable device 302, as well as communication of the contextual and / or environmental data from the accessory devices 315, to the Al wearable device network 348 may take place via a wireless gateway 340, with the communication between the wireless gateway 340 and the Al wearable device network 348 taking place over one or more networks 384.
[0165] As shown in FIG. 3C, the user 336 may configure the wireless gateway 340 to include a user profile 344. The user profile 344 may include various health and physiological data about the user 336 that may not be obtained by sensors 316-329 of the wearable device 302. The user profile 344, for example, may include information such as a name (e.g., first, last and middle name), biological sex, age (e.g., in years), weight (e.g., in pounds, kilograms, etc.), andheight (e.g., in feet or inches, in meters, etc.). The user profile 344 may also include known diseases and disorders (e.g., asthma, allergies, current medications, family medical history, other medical data, etc.), where such information may include Protected Health Information (PHI) regulated by American Health Insurance Portability and Accountability Act (HIPAA) or other applicable rules and regulations. PHI includes individually identifiable health information that relates to one or more of: the past, present, or future physical or mental health or condition of an individual; provision of health care to the individual by a covered entity (e.g., a hospital or doctor); the past, present, or future payment for the provision of health care to the individual; telephone numbers, fax numbers, email addresses, Social Security numbers, medical record numbers, health plan beneficiary numbers, license plate numbers, uniform resource locators (URLs), full-face photographic images or any other unique identifying numbers, characteristics, codes, or combination thereof that allows identification of an individual. The user profile 344 may further include an emergency contact (e.g., name, phone number, address, etc.), next of kin (e.g., name, phone number, address, etc.), preferred hospital (e.g., name, phone number, address, etc.) and primary care physician (PCP) of the user 336 (e.g., name, phone number, place of business, etc.). The user profile 344 may further include local caregiver information (e.g., name, phone number, address, etc.) and preferred first responder network information (e.g., name, phone number, address, etc.). The local caregiver may be, for example, a nursing agency, a private caregiver such as a family member, a nursing home, or other local caregivers such as physical therapists, chiropractors, pharmacists, pediatricians, acupuncture specialists, massage therapists, etc. In some cases, the local caregiver is associated with one or more telemedicine networks. The preferred first responder network may be, for example, a local hospital and / or a local ambulatory rescue agency. In some embodiments, the preferred first responder network may be an interface with an emergency calling network (e.g., 911).
[0166] The wireless gateway 340 sends the sensor data and localization data obtained from the user 336 by the wearable device 302, as well as contextual and / or environmental data obtained from the accessory devices 315, utilizing communications unit 346, which may comprise any type of transceiver for coupling the wireless gateway 340 to the network 384. The communications unit 346 of the wireless gateway 340 may be embodied as communication circuitry or any communication hardware capable of transmitting an analog or digital signal over wired or wireless network interfaces. Such network interfaces may support not onlycommunication with the Al wearable device network 348 over network 384, but also communications between the wearable device 302 and the wireless gateway 340. Any combination of network types may be utilized, including but not limited to UWB, NFC, WiFi, Bluetooth, BLE, IR, modem, cellular, ZigBee, BAN, etc. The wireless gateway 340 may also be provisioned with contextual analysis module 347 and personnel and asset accountability module 349, which provide functionality similar to that of the contextual analysis module 334 and the personal and asset accountability module 339, respectively.
[0167] The wireless gateway 340 may be, for example, a smartphone, a tablet, a laptop or desktop computer, an Internet-connected modem, a wireless router or standalone wireless hub device connected to the Internet, etc. The wireless gateway 340, in some embodiments, may itself comprise or be incorporated into one or more wearable devices (e.g., a smartwatch, an activity tracker, etc.). In some cases, the wireless gateway 340 may be part of the wearable device 302, or vice versa. The wireless gateway 340 is illustratively a smart device that is owned or controlled by the user 336, such as a smartphone, and allows rapid onboarding of wearable devices such as wearable device 302 to the Al wearable device network 348.
[0168] The wireless gateway 340 includes a wearable device module 342 and accessory device module 343 that provides software programs or computer instructions for providing various functionality of the wireless gateway 340. Although not shown in FIG. 3C, the wireless gateway 340 is assumed to comprise at least one processing device or controller including a processor coupled to a memory for executing the functionality of the wearable device module 342, the accessory device module 343, the contextual analysis module 347 and the personnel and asset accountability module 349. Such functionality may include, for example, wirelessly pairing the wearable device 302 and one or more of the accessory devices 315 in a BAN associated with the user 336. Such functionality may also include receiving the sensor data and the localization data from the wearable device 302 and the contextual and / or environmental data from the accessory devices 315 via the communications unit 346, and possibly performing a preliminary analysis of the sensor data, the localization data and the contextual and / or environmental data. Such analysis may be based at least in part on information stored in the user profile 344. Based on such analysis, the wearable device module 342 and the accessory devices module 343 may determine whether any immediate notifications should be provided to the user 336. Such notifications may comprise, for example, indications of symptoms associated with at least one disease state, indications of one or more problem situations (e.g.,where personnel and / or assets which are assigned for use during a particular stage of a workflow are not detected to be present during that stage of the workflow, where personnel and / or assets that are not assigned for used during a particular stage of a workflow are detected to be present, etc.). In other embodiments, the wearable device 302 functions as a pass-through entity and does not perform such preliminary analysis. Instead, the wireless gateway 340 may provide the sensor data and the localization data received from the wearable device 302, along with the associated user profile 344 and the contextual and / or environmental data obtained from the accessory devices 315, to the Al wearable device network 348 over network 384 as a pass-through entity.
[0169] Regardless of whether or not the wireless gateway 340 performs such preliminary analysis, the wearable device module 342 and the accessory device module 343 of the wireless gateway 340 may receive any combination of diagnostic information, world health information, sensor data analysis, localization analysis, analysis created from a fusion of data from a plurality of sensors from the Al wearable device network 348, etc. At least a portion of the received information is based on analysis of the sensor data, the localization data, the user profile 344, the contextual and / or environmental data, or information derived therefrom previously provided by the wireless gateway 340 to the Al wearable device network 348. At least a portion of the received information is used to generate notifications or other output via a graphical user interface (GUI) of the wireless gateway 340, the wearable device 302, one or more of the accessory devices 315, or another type of local or remote indicator device.
[0170] The wearable device module 342 and / or the accessory device module 343 may provide functionality for determining notification settings associated with the user 336, and to execute or deliver notifications in accordance with the determined notification settings utilizing the wearable device 302 and / or one or more of the accessory devices 315 or other devices. The notification settings, in some embodiments, may specify the types of indicator devices that are part of or otherwise accessible to the wearable device 302 and / or the accessory devices 315 for delivering notifications to the user 336 (or to a doctor, nurse, physical therapist, medical assistant, caregiver, etc. associated with the user 336). The indicator devices in some embodiments may be configured to deliver visual or audible alarms. In other embodiments, the indicator devices may be configured to provide stimulus or feedback via stimulating devices as described elsewhere herein. Such stimulus or feedback, as detailed above, may include physical stimulus (e.g., electrical, thermal, vibrational, pressure, stroking, a combinationthereof, or the like), optical stimulus, acoustic stimulus, etc. In some embodiments, notifications may be delivered to remote terminals or devices other than the wearable device 302 and / or the accessory devices 315 associated with user 336. For example, notifications may be delivered to one or more devices associated with a doctor, nurse, physical therapist, medical assistant, caregiver, etc. associated with the user 336.
[0171] The notification delivery method may also or alternatively comprise a visual or audible read-out or alert from a “local” device that is in communication with the wearable device 302. The local device may comprise, for example, a mobile computing device such as a smartphone, tablet, laptop etc., or another computing device, that is associated with the user 336. The wearable device 302 is one example of a local device. A local device may also include devices connected to the wearable device 302 via a BAN or other type of local or short-range wireless network (e.g., a Bluetooth network connection).
[0172] The notification delivery method may further or alternatively comprise a visual or audible read-out or alert from a “remote” device that is in communication with the wearable device 302 or the wireless gateway 340 via network 384, such as one or more of the accessory devices 315. The remote device may be a mobile computing device such as a smartphone, tablet, laptop, etc., or another computing device (e.g., a telemetry center or unit within a hospital or other facility), that is associated with a doctor, nurse, physical therapist, medical assistant, caregiver, etc. monitoring the user 336. It should be understood that the term “remote” in this context does not necessarily indicate any particular physical distance from the user 336. For example, a remote device to which notifications are delivered may be in the same room as the user 336. The term “remote” in this context is instead used to distinguish from “local” devices (e.g., in that a “local” device in some embodiments is assumed to be owned by, under the control of, or otherwise associated with the user 336, while a “remote” device is assumed to be owned by, under the control of, or otherwise associated with a user or users other than the user 336 such as a doctor, nurse, physical therapist, medical assistance, caregiver, etc.).
[0173] The indicator devices may include various types of devices for delivering notifications to the user 336 (or to a doctor, nurse, physical therapist, medical assistant, caregiver, etc. associated with the user 336). In some embodiments, one or more of the indicator devices comprise one or more light emitting diodes (LEDs), a liquid crystal display (LCD), a buzzer, a speaker, a bell, etc., for delivering one or more visible or audible notifications. More generally, the indicator devices may include any type of stimulating deviceas described herein which may be used to deliver notifications to the user 336 (or to a doctor, nurse, physical therapist, medical assistant, caregiver, etc. associated with the user 336).
[0174] FIG. 3A also shows the crowd of users 338, each of which is assumed to provide sensor data and localization data obtained by a plurality of wearable devices and / or accessory devices to the Al wearable device network 348, possibly via respective wireless gateways. The wearable devices, accessory devices and wireless gateways for the crowd of users 338 may be configured in a manner similar to that described herein with respect to the wearable device 302, the accessory devices 315, and the wireless gateway 340 associated with the user 336.
[0175] It should be appreciated that although the wearable device 302 may be configured with multiple different types of sensors 316-329, it is generally not possible to configure a wearable device with every possible sensor that may be needed in different scenarios. For example, wearable devices are advantageously designed for comfortable wear and use, and thus may require a small form factor which cannot accommodate the possible range of sensors and sensor types which may be needed in different scenarios. Further, some types of sensors are large, heavy and / or expensive, and thus are not conducive to being incorporated as part of a wearable device. Nonetheless, different tasks may benefit from the use of contextual and / or environmental information which may be provided using sensor types that are not available in the wearable device 302.
[0176] Consider, as an example, a scenario in which the user 336 is placed in an environment with possible radiation exposure where dosimeter sensors would be advantageous (e.g., for correlating changes in physiologic parameters obtained from the sensing unit 314 of the wearable device 302 with knowledge of an amount and / or type of radiation that the user 336 is exposed to). The wearable device 302 may not be configured with dosimeter sensors, as this may not be practical (e.g., due to the size, power, material and other requirements) or such a potential use case is not expected to come up very often. When the need arises for radiation exposure information, accessory sensing devices 315 that include dosimeter sensors may be leveraged to provide such information which is used for contextual analysis (e.g., implemented by the contextual analysis module 334 on the wearable device 302, on the contextual analysis module 347 of the wireless gateway 340, on the contextual analysis module 387 of the Al wearable device network 348, on contextual analysis modules implemented by the accessory devices 315 and / or one or more of the third-party networks 368, etc.).
[0177] The accessory sensing devices 315 may also or alternatively be used to determine the user 336’ s microenvironmental exposure to light, noise, temperature, humidity, pressure, etc. These and other factors can influence different aspects of the microenvironment of the user 336 which can be correlated with physiologic data obtained from the user 336 via the sensing unit 314 of the wearable device 302. This may include use cases such as impact / fall detection, detecting fatigue of the user 336, etc. Another use case is in determining a “wet-bulb” temperature of the user 336. The wet-bulb temperature of the user 336, which may be determined from microenvironmental monitoring of information such as light, temperature, humidity and pressure, can be correlated with measured physiologic data to determine harmful and potentially life-threatening conditions. Monitoring for the microenvironmental wet-bulb temperature can be useful in various scenarios, including for soldiers which may be equipped with Mission Oriented Protective Posture (MOPP) gear that is heavy and bulky, leading to the soldiers having an increased wet-bulb temperature. The microenvironmental monitoring of the wet-bulb temperature (e.g., via accessory devices 315) may be correlated with physiologic data measured from on-body sensors (e.g., from the sensing unit 314 of the wearable device 302) which characterize, for example, physical activity or exertion. This may be used to provide feedback to the user 336 (e.g., to stop the physical activity or exertion, to remove MOPP gear or other bulky equipment or clothing, etc.). In some embodiments, the microenvironmental monitoring of wet-bulb temperature may be correlated with local weather report information, local sensing of external solar irradiation, as well as measured physiologic data of the user 336 (e.g., to detect risk of heat exhaustion or other conditions).
[0178] The microenvironmental monitoring may also or alternatively utilize microenvironmental noise information to detect exposure to potentially harmful noise levels. This may include monitoring and detecting a microenvironmental infrasound signature, which may be correlated with physiologic data from the user 336 to characterize effects such as nausea, vomiting internal injuries (e.g., organ tearing), etc. Noise exposure information may also be used to detect microenvironmental sound signatures (e.g., to detect exposure to radiofrequency (RF), to detect drones or vehicles in the area, to detect exposure to shots fired / explosions, to detect sounds indicative of coughing, vomiting or choking events, etc.) which may be time-correlated with physiologic data from the user 336 (e.g., core vital signs indicative of being hit by a shot fired, having injuries related to a blast exposure, being sick from dehydration, vomiting, choking, etc.).
[0179] The microenvironmental information and physiologic monitoring data may be used for various types of contextual analysis, where the microenvironmental information and physiologic monitoring data are correlated with knowledge of what the user 336 is doing (e.g., whether the user 336 is awake or asleep, the body posture of the user 336, a physical workload or profile of the user 336, etc.). Noise information, in some cases, may be used for contextual analysis of the activity of multiple users (e.g., the user 336 and one or more of the users in the crowd of users 338) to provide spatial reference information (e.g., detecting where shots / blasts come from, where drones or vehicles are traveling, etc.). In some cases, the contextual analysis includes “friend / foe” detection, where the user 336 has a specific profile (e.g., ECG signature, tone / audio signature, etc.) which may be used to detect when the wearable device 302 associated with the user 336 is being utilized by another user (e.g., a potential “foe”).
[0180] More generally, the accessory sensing devices 315 are leveraged to provide contextual and / or environmental information which is difficult, not possible or not practical to obtain utilizing the wearable device 302 alone. This may be due to the contextual and / or environmental information only being needed in limited use cases, such that the cost of implementing the required sensor types within the wearable device 302 is not practical or cost-effective. Thus, it should be appreciated that the sensor types of the accessory devices 315 which are leveraged to obtain contextual and / or environmental information are not limited solely to sensor types which are difficult to implement within the small form factor or other constraints of the wearable device 302 (e.g., comfortable long-term wear by the user 336, cost, etc.). In some embodiments, the contextual and / or environmental information may be used for detecting presence of personnel and assets (e.g., equipment, such as firearms, MOPP gear, medical equipment, food, survival gear, vehicles, etc.) in particular locations using the personnel and asset accountability module 339, the personnel and asset accountability 349, etc.
[0181] The Al wearable device network 348 is configured to receive data (e.g., sensor data and localization data from the wearable device 302, contextual and / or environmental data from the accessory devices 315, user profile 344, preliminary analysis of the sensor, localization and contextual and / or environmental data, etc.) from the wireless gateway 340 and the crowd of users 338. The Al wearable device network 348 analyzes the received data using various software modules implementing Al algorithms for determining disease states, types of symptoms, risk of infection, contact between users, condition of physiological parameters, occurrence of events, event classification (e.g., including detection of firearm discharges),presence of personnel and / or assets in particular locations at particular times, etc. As shown in FIG. 3D, such modules include a third-party application programming interface (API) module 350, a pandemic response module 352, a vital monitoring module 354, a location tracking module 356, an automated contact tracing module 358, a disease progression module 360, an in-home module 362 and an essential workforce module 364. The Al wearable device network 348 also includes a database 366 configured to store the received data, results of analysis on the received data, data obtained from third-party networks 368, etc. The Al wearable device network 348 further implements contextual analysis module 387 and personnel and asset accountability module 389, which are configured to provide functionality similar to that of the contextual analysis module 334 and the personnel and asset accountability module 339, respectively.
[0182] In some embodiments, the Al wearable device network 348 is implemented as an application or applications running on one or more physical or virtual computing resources. Physical computing resources include, but are not limited to, smartphones, laptops, tablets, desktops, wearable computing devices, servers, etc. Virtual computing resources include, but are not limited to, VMs, software containers, etc. The physical and / or virtual computing resources implementing the Al wearable device network 348, or portions thereof, may be part of a cloud computing platform. A cloud computing platform includes one or more clouds providing a scalable network of computing resources (e.g., including one or more servers and databases). In some embodiments, the clouds of the cloud computing platform implementing the Al wearable device network 348 are accessible via the Internet over network 384. In other embodiments, the clouds of the cloud computing platform implementing the Al wearable device network 348 may be private clouds where access is restricted (e.g., such as to one or more credentialed medical professionals or other authorized users). In these and other embodiments, the Al wearable device network 348 may be considered as forming part of an emergency health network comprising at least one server and at least one database (e.g., the database 366) storing health data pertaining to a plurality of users (e.g., the user 336 and crowd of users 338).
[0183] The database 366 provides a data store for information about patient conditions (e.g., information about the user 336 and crowd of users 338), information relating to diseases including epidemics or pandemics, information related to workflows (e.g., missions) and stages thereof as well as personnel and / or assets that are assigned for use in different stages of theworkflows, etc. Although shown as being implemented internal to the Al wearable device network 348 in FIG. 3D, it should be appreciated that the database 366 may also be implemented at least in part external to the Al wearable device network 348 (e.g., as a standalone server or storage system). The database 366 may be implemented as part of the same cloud computing platform that implements the Al wearable device network 348.
[0184] The Al wearable device network 348 may exchange various information with third-party networks 368. As shown in FIG. 3E, the third-party networks 368 may include any combination of one or more first responder networks 370, one or more essential workforce networks 372, one or more local caregiver networks 374, one or more hospital networks 376, one or more state and local health networks 378, one or more federal health networks 380, one or more world health networks 382, one or more military or other security networks 383, etc. Third-party networks 368 may also include telemedicine networks. For example, in some embodiments one or more of the local caregiver networks 374 may comprise or be associated with one or more telemedicine networks, such that local caregivers of the local caregiver networks 374 may provide care to patients or users via telemedical communications. Under certain circumstances, as permitted by the verification entity 386, one or more of the third-party networks 368 may receive data and analysis from the Al wearable device network 348, for various purposes including but not limited to diagnosis, instruction, pandemic monitoring, disaster response, resource allocation, medical triage, contextual analysis, sensor data reconstruction, any other tracking or intervention and associated logistics, etc. The first responder networks 370 may include any person or team with specialized training who is among the first to arrive and provide assistance at the scene of an emergency, such as an accident, natural disaster, terrorism, etc. First responders include, but are not limited to, paramedics, emergency medical technicians (EMTs), police officers, fire fighters, etc. The essential workforce networks 372 may include networks for employers and employees of essential workforces of any company or government organization that continues operation during times of crises, such as a viral pandemic. Essential workforces include, but are not limited to, police, medical staff, grocery workers, pharmacy workers, other health and safety service workers, etc. The local caregiver networks 374 may include a network of local clinics, family doctors, pediatricians, in-home nurses, nursing home staff, and other local caregivers. The hospital networks 376 allow transfer of data between hospitals and the Al wearable device network 348.
[0185] The exchange of information between the Al wearable device network 348 and third-party networks 368 may involve use of a verification entity 386, which ensures data security in accordance with applicable rules and regulations (e.g., HIPAA). The Al wearable device network 348 utilizes the third-party API module 350 to perform such verification of the third-party networks 368 utilizing the verification entity 386, before providing any data or analysis thereof related to the user 336 or crowd of users 338 to any of the third-party networks 368. It should be noted that, if desired, any data or analysis related to the user 336 or crowd of users 338 may be anonymized prior to being sent to one or more of the third-party networks 368, such as in accordance with privacy settings in user profiles (e.g., user profile 344 associated with the user 336, user profiles associated with respective users in the crowd of users 338, etc.).
[0186] The pandemic response module 352 is configured to execute processes based on receiving pandemic data from one or more of the third-party networks 368 via the third-party API module 350. The pandemic response module 352 may analyze such received information and provide notifications to the user 336 or crowd of users 338 including relevant information about the pandemic. The pandemic response module 352 may further collect and analyze physiological data of the user 336 or crowd of users 338 that may be relevant to the pandemic, and provides instructions to users who may be at risk due to the pandemic. Information about such at-risk users may also be provided to one or more of the third-party networks 368. The pandemic response module 352 may continually update the database 366 with relevant pandemic data including information about at-risk users. The pandemic response module 352, while described herein as processing information related to pandemics, may also be configured to process information related to epidemics and other outbreaks of diseases that do not necessarily reach the level of a pandemic. The pandemic response module 352 may also process information from the user 336 and crowd of users 338 so as to predict that a pandemic, epidemic or other disease outbreak is or is likely to occur. Thus, the functionality of the pandemic response module 352 is not limited solely to use in processing pandemic information.
[0187] The vital monitoring module 354 may monitor and analyze physiological data of the user 336 and crowd of users 338 to detect and mitigate pandemics, epidemics and other outbreaks or potential outbreaks of diseases. The physiological data may be analyzed to determine if there is evidence of a disease associated with a pandemic (e.g., shortness of breath associated with respiratory illness). The vital monitoring module 354 may also be utilized for monitoring user 336 and the crowd of users 338 before, during and after detection of firearmdischarges. Such information, for example, may be provided to various ones of the third-party networks 368, such as the first responder networks 370, the military or other security networks 383, etc.
[0188] The location tracking module 356 is configured to track the location of user 336 and the crowd of users 338, to determine whether any of such users enter or exit regions associated with a pandemic or other outbreak of a disease, to determine or confirm presence of personnel and / or assets in particular locations at particular times for analyzing compliance with the assignment of personnel and / or assets at different stages of one or more workflows, etc. The location tracking module 356, in some embodiments, may alert users who have entered a geographic location or region associated with increased risk of exposure to an infectious disease (e.g., associated with an epidemic, pandemic or other outbreak). In some embodiments, various alerts, notifications and safety instructions are provided to the user 336 and crowd of users 338 based on their location. The threshold for detection of symptoms associated with an infectious disease (e.g., associated with an epidemic, pandemic or other outbreak) may be modified based on location of the user 336 and crowd of users 338. For example, the threshold for detecting a symptom (e.g., shortness of breath) may be lowered if the user 336 or crowd of users 338 are in high-risk locations for contracting an infectious disease. The location tracking module 356 may also be configured to track the locations of the user 336 and the crowd of users 338 before, during and after detection of firearm discharges. The tracked location may bye provided to various ones of the third-party networks 368, such as the first responder networks 370, the military or other security networks 383, etc.
[0189] The automated contact tracing module 358 is configured to use the tracked location of the user 336 and crowd of users 338 (e.g., from the location tracking module 356) so as to determine possible contacts between such users, and also to assess risk of infection on a peruser basis. The automated contact tracing module 358 may also automate the delivery of notifications to the user 336 and crowd of users 338 based on potential exposure to other users or geographic regions associated with a pandemic or other outbreak of a disease. The automated contact tracing module 358 may further provide information regarding contacts between the user 336 and crowd of users 338 to one or more of the third-party networks 368 (e.g., indicating compliance with risk mitigation strategies for pandemic response).
[0190] The disease progression module 360 is configured to analyze physiologic data from the user 336 and crowd of users 338, and to determine whether such physiologic data isindicative of symptoms of a disease. As new physiologic data from the user 336 and crowd of users 338 is received, trends in such data may be used to identify the progression of a pandemic or other outbreak of a disease. The disease progression module 360 may be configured to monitor the progression of specific infectious diseases, such as infectious diseases associated with epidemics, pandemics or other outbreaks, based on any combination of: user indication of a contracted disease; one or more of the third-party networks 368 indicating that users have contracted a disease; the vital monitoring module 354 detecting a user contracting a disease with probability over some designated threshold; etc. The disease progression module 360 is further configured to compare disease progress for different ones of the users 336 and crowd of users 338 with typical disease progress to determine individual user health risk.
[0191] The in-home module 362 is configured to analyze location data from the user 336 and crowd of users 338, and to determine whether any of such users are in locations with stay-at-home or other types of quarantine, social distancing or other self-isolation orders or recommendations in effect. If so, the in-home module 362 may provide notifications or alerts to such users with instructions for complying with the stay-at-home, quarantine, social distancing or other self-isolation orders or recommendations, for mitigating an infectious disease, for preventing spread of the infectious disease, etc. The in-home module 362 may be further configured to provide in-home monitoring of infected patients that are quarantined or self-isolated at home, providing warnings to such users that leave the home, instructions for mitigating the disease, etc. The in-home module 362 may further provide in-home monitoring data to one or more of the third-party networks 368.
[0192] The essential workforce module 364 is configured to identify ones of the user 336 and crowd of users 338 that are considered part of an essential workforce or are otherwise considered essential personnel. Once identified, the essential workforce users’ physiologic data may be analyzed to determine risk profiles for such users, and the algorithms implemented by modules 350 through 362 may be modified accordingly. As one example, the functionality of the in-home module 362 may be modified such that alerts or notifications are not sent to essential workforce users when leaving areas associated with stay-at-home, quarantine, social distancing or other self-isolation orders (e.g., those users would not receive alerts or notifications when traveling to or from their associated essential workplaces). Various other examples are possible, as will be described elsewhere herein.
[0193] Various ones of the pandemic response module 352, the vital monitoring module 354, the location tracking module 356, the automated contact tracing module 358, the disease progression module 360, the in-home module 362 and the essential workforce module 364 can further leverage the contextual and / or environmental data obtained from the accessory devices 315 in performing their various functionality.
[0194] A body area network (BAN) may include several wearable devices and / or accessory devices (e.g., including sensors and auxiliary devices) that connect and communicate over a short-range wireless or wired datalink. Under certain conditions, wearable sensor devices and / or accessory devices may communicate erroneous, corrupt, or contaminated data. In other conditions, sensors of the wearable sensor devices and / or accessory devices may be destroyed, disabled, or otherwise be unable to produce data. In yet other conditions, sensor units may be inherently limited in what data they can produce or convey. When these and other conditions arise, it is beneficial to be able to reconstruct missing data utilizing other sensors that are correctly or fully functioning. Illustrative embodiments provide systems, devices and method for collecting and interpreting sensor data collected from wearable devices and / or accessory devices in a BAN. BAN sensor data is ingested and interpreted, with a final goal of such interpretation being the reconstruction and output of data that would otherwise be missing from the BAN sensor network, either in whole or in part.
[0195] The wearable devices and / or accessory devices of a BAN may communicate utilizing various network technologies, including but not limited to cellular mobile network technologies including Narrowband loT (NB-IoT), low-power wide-area network (LP-WAN) technology such as Long Term Evolution (LTE)-Cat-Ml, 6G, 5G, 4G, 3G, 2G, etc.
[0196] Illustrative embodiments provide techniques for personnel and / or asset accountability management utilizing one or more sensing devices (e.g., including potentially combinations of “on-body” and “off-body” sensing devices). The techniques described herein provide an approach for tracking and visualizing the presence of personnel and / or assets at particular locations and particular times, for use in verifying whether personnel and / or assets which are assigned for use in different stages of one or more workflows (e.g., military missions) are actually present and accounted for, for determining whether personnel and / or assets that are not assigned for use in one or more stages of one or more workflows are present (e.g., representing potentially unauthorized personnel and / or assets), etc.
[0197] In some embodiments, one or more algorithms are configured to combine readings from one or more sensors of one or more sensing devices in a BAN associated with a subject (e.g., on-body or off-body sensing devices) to identify the relationships between one or more physiologic parameters of the subject prior to, during, and / or after one or more events.
[0198] In some embodiments, a plurality of sensors of one or more multiple sensing devices may be placed on one or more locations on a subject, on one or more weapons or other equipment being worn or used by the subject, etc. Such sensing devices may be synchronized in time, such that data from each of the plurality of sensors may be processed in parallel through the various criteria described above, or may be processed sequentially and combined afterwards.
[0199] As noted above, in some embodiments one or more sensing devices may be attached to one or more assets that are used by a subject. Such sensing devices may include one or more sensors, such as one or more accelerometers, gyroscopes, temperature sensors, thermal gradient sensors, vibration sensors, barometers, acoustic sensors, etc. One or more of such sensors may be time synchronized to one or more sensors of one or more sensing devices on the body of the subject.
[0200] Coordinated sensor recordings (e.g., from one or more sensors of sensing devices attached to assets used by the subject and from one or more sensors of sensing devices on the body of the subject) may be entered into at least one machine learning model or algorithm, with the machine learning model or algorithm being configured to generate or otherwise determine relationships therebetween, to analyze redundant or fused sensor data in the coordinated sensor recordings, etc.
[0201] FIG. 4 shows aspects of a physiologic monitoring system 400 including multiple sensing devices in a BAN 410, including primary sensing devices 403 and accessory sensing devices 405. The primary sensing devices 403 in some embodiments are assumed to be “on-body” sensing devices on a user or subject 401 (e.g., patch-module sets as described elsewhere herein), with the accessory sensing devices 405 being “off-body” sensing devices which are mounted on, attached to, or otherwise integrated with an asset 402 (e.g., one or more firearms, heavy weapons, unmanned or robotic systems, MOPP equipment, food, medicine, water, medical equipment, tactical gear, vehicles, etc.) being used by the subject 401. For example, the primary sensing devices 403 may include sensors 430 of a first type that can be used for physiologic monitoring on a patch interface or a module coupling with a patch interface asdescribed elsewhere herein. The accessory sensing devices 405 may include sensors 450 of a second type which can be used for physiologic monitoring and / or for monitoring of a local environment of the BAN 410. More generally, the sensors 450 of the accessory sensing devices 405 are assumed to provide contextual and / or environmental information which can be used in supplementing, augmenting or reconstructing physiologic monitoring data obtained using the sensors 430 of the primary sensing devices 403, for verifying presence and colocation of the user 401 and the asset 402 for personnel and asset accountability management, etc. In some embodiments, this includes sensor data “fusion” from the sensors 430 of the primary sensing devices 403 and the sensors 450 of the accessory sensing device 450.
[0202] Although not shown in FIG. 4, in some embodiments additional accessory sensing devices may be part of the BAN, such as external sensor or accessory units that comprise one or more of the following, either singularly or in an array of multiple (potentially identical) devices: electrophysiological measuring devices, including but not limited to electrooculographs, electroglottographs, electrocardiographs, and electroencephalographs; optical sensors, including but not limited to ambient light sensors, spectrophotometers, closed-circuit television (CCTV), infrared and hyperspectral imagers; rangefinders and mapping devices, including but not limited to light detection and ranging (LIDAR), RADAR, and miniaturized opto-mechanical devices; sensors for body-exogenous and -endogenous biological agents and chemical compounds; dosimeters including but not limited to those configured for evaluating blast overpressure exposure, noise exposure, and radiation exposure; barometers; anemometers; accelerometers; gyroscopes; magnetometers; integrated transceivers for land navigation; audio transducers including speakers and microphones; dedicated machine learning devices for purposes including, but not limited to, sensor fusion, object identification, or threat early warning; and radio frequency transceivers generally.
[0203] The BAN 410 also includes a local BAN controller 407 which is configured to perform management functions for the primary sensing devices 403 and the accessory sensing devices 405 which are part of the BAN 410. Such management functionality may include enabling a modular configuration of the primary sensing devices 403 and the accessory sensing devices 405, for flexible utilization of different ones of the primary sensing devices 403 and the accessory sensing devices 405 as needed for particular tasks. To do so, the BAN controller 407 implements a device pairing module 470 and a data sharing module 472. The device pairing module 470 provides functionality for pairing different ones of the primary sensingdevices 403 and the accessory sensing devices 405 with the BAN 410 associated with the user or subj ect 401. The data sharing module 472 is configured to obtain and transmit data obtained from the sensors 430 of the primary sensing devices 403 and the sensors 450 of the accessory sensing device 405 for use in contextual analysis, personnel and asset accountability management, etc.
[0204] The contextual analysis is performed utilizing contextual analysis module 415 that may be implemented by the local BAN controller 407 and / or by one or more external devices such as a remote BAN controller 409 that is outside the BAN 410 and in communication with the local BAN controller 407. Personnel and asset accountability management is performed utilizing personnel and asset accountability module 417 that may be implemented by the local BAN controller 407 and / or by one or more external devices such as the remote BAN controller 409.
[0205] In the context of the system 200 of FIGS. 2A-2D, as an example, the local BAN controller 407 may be implemented via the host device 230, with the remote BAN controller 409 comprising one or more network-connected devices which are not part of a BAN formed between the sensing device 210, the accessory device 215, the stimulating device 220 and the host device 230. In the context of the system 300 of FIGS. 3A-3E, as an example, the local BAN controller 407 may be implemented via the wireless gateway 340, with the remote BAN controller 409 comprising the Al wearable device network 348 and / or one or more of the third-party networks 368. In some cases, the contextual analysis module 415 and / or the personnel and asset accountability module 417 are also or alternatively implemented utilizing the primary sensing devices 403 and / or the accessory sensing devices 405. It should also be noted that, in some cases, the local BAN controller 407 may be implemented by or as part of one or more of the primary sensing devices 403 and / or one or more of the accessory sensing devices 405.
[0206] The device pairing module 470 of the local BAN controller 407 is configured to wirelessly pair the primary sensing devices 403 and the accessory sensing devices 405 in the BAN 410, such that the local BAN controller 407 can serve as a network host for such devices. This may include, for example, pairing various external sensors and accessory units providing the accessory sensing devices 405, on demand as needed for particular tasks, with an existing BAN formed by the primary sensing devices 403. Consider, for example, a task that utilizes contextual and / or environmental information which cannot or is difficult to capture utilizing the sensors 430 of the primary sensing devices 403, or which utilizes sensor data from one ormore of the sensors 430 of the primary sensing devices 403 and / or one or more of the sensors 450 of the accessory sensing devices 405 for personnel and asset accountability management.
[0207] The contextual analysis module 415, for example, may trigger the local BAN controller 407 to utilize the device pairing module 470 to search for available accessory sensing devices 405 which are equipped with suitable sensors 450 for capturing the needed contextual and / or environmental information. If any suitable accessory sensing devices 405 are found, the device pairing module 470 will add such devices to the BAN 410. The data sharing module 472 can then obtain the needed contextual and / or environmental information from the sensors 450 of such accessory sensing devices 405, and then share such data with the contextual analysis module 415 (which, as discussed above, can be implemented in any combination of the primary sensing devices 403, the accessory sensing devices 405, the local BAN controller 407 and one or more external devices such as the remote BAN controller 409). The device pairing module 470 and the data sharing module 472 may conduct device pairing activities and data transactions using various different networks and network types, including but not limited to UWB, Bluetooth, BLE, LoRA, Wifi, NFC, etc.
[0208] The personnel and asset accountability module 417, as another example, may trigger the local BAN controller 407 to utilize the device pairing module 470 to search for available ones of the sensors 430 of the primary sensing devices 403 and / or sensors 450 of the accessory sensing device 405 which may be used to perform personnel and asset accountability management. If any suitable sensors are found, their associated ones of the primary sensing devices 403 and / or accessory sensing devices 405 may be added to the BAN 410 and the data sharing module 472 can obtain the needed sensor data for the personal and asset accountability management tasks performed by the personnel and asset accountability module 417 (which, as discussed above, can be implemented in any combination of the primary sensing devices 403, the accessory sensing devices 405, the local BAN controller 407 and one or more external devices such as the remote BAN controller 409).
[0209] The entity implementing the contextual analysis module 415 and / or the personnel and asset accountability module 417 may be referred to as a “remote receiver” that further processes both physiologic monitoring data (e.g., obtained from one or more of the sensors 430 of one or more of the primary sensing devices 403, and possibly from one or more the sensors 450 of one or more of the accessory sensing devices 405) as well as the contextual and / or environmental information (e.g., obtained from one or more of the sensors 450 of the accessorysensing devices 405). This may include receiving logistical data from different ones of the sensors 430 and / or the sensors 450 that are associated with the user or subject 401 under study, analyzing the logistical data to derive or reconstruct one or more parameters, and then taking some action.
[0210] FIG. 5 illustrates a use case 500 wherein a user 501 is a soldier carrying a firearm 502 with a plurality of sensing devices 504 mounted or otherwise attached to the user 501 and the firearm 502. Here, the firearm 502 is an example of an “asset” that is to be tracked across one or more stages of one or more workflows (e.g., a military mission, where it is desired to track the disposition of the user 501 and the firearm 502 during different stages of the mission, to detected unauthorized presence of the user 501 and / or the usage of the firearm during different stages of the mission, etc.). Although not shown in FIG. 5, in some embodiments one or more off-body and off-firearm sensing devices may be used in conjunction with the on-body and / or on-firearm sensing devices 504. Further, although FIG. 5 shows an embodiment wherein there are multiple on-body and on-firearm sensing devices 504, in other embodiments there may be only a single on-body and / or a single on-firearm sensing device. It should be noted that, in some embodiments, one or more of the sensing devices 504 may include a patch on a sternum of the user 501. The sensing devices 504 may include patch-module or patch-hub sets. In some cases, at least one of the modules or hubs of the patch-module or patch-hub sets may be placed in a pocket, stuck to or otherwise attached to the firearm 502 or another weapon, placed into a pocket or other storage compartment of the firearm 502 or another weapon, etc.
[0211] FIGS. 6A and 6B show respective systems 600 and 650 including groups of devices (e.g., associated with personnel or assets to be tracked across different stages of one or more workflows). The system 600 of FIG. 6A includes a management user / asset 601-1 associated with a management device 602-1 implementing a personnel and asset accountability module 620-1, along with a set of managed users or assets 601-2, 601-3, . . . 601-M associated with respective managed devices 602-2, 602-3, . . . 602-M implementing personnel and asset accountability modules 620-2, 620-3, . . . 620-M. The management user / asset 601-1 and managed users / assets 601-2, 601-3, . . . 601-M are collectively referred to as users / assets 401, the management device 602-1 and managed devices 602-2, 602-3, . . . 602-M are collectively referred to as devices 602, and the personnel and asset accountability modules 620-1, 620-2, 620-3, . . . 620-M: are collectively referred to as fleet management modules 620. The devices 602 in the system 600 are associated with different users / assets 601, and are interconnected vianetwork 604. In some embodiments, the management user / asset 601-1 may be a leader of the group of users / assets 601 (e.g., a leader of a troop of soldiers, a captain or coach of a sports team, etc,). In some cases, the choice of which of the users / assets 601 is the management user / asset 601-1 may vary depending on context (e.g., such as the user / asset 601 having a best network connection to facilitate data transfer to another system such as the Al wearable device network 348, one or more of the third-party networks 368, etc.). The management user / asset 601-1 may be, for example a medic or other caregiver that is responsible for managing the health of the managed users / assets 601-2, 601-3, . . . 601-M. The personnel and asset accountability modules 620 are configured to provide functionality similar to that described above with respect to the personnel and asset accountability modules 339, 349, 389 and 417.
[0212] The system 650 of FIG. 6B includes a user or asset 605 which is associated with a management device 606-1 and a set of managed devices 606-2, 606-3, . . , 606-M implementing respective personnel and asset accountability modules 660-1, 660-2, 660-3, . . . 660-M (collectively, personnel and asset accountability modules 660). The management device 606-1 and the set of managed devices 606-2, 606-3, . . . 606-M are part of a network 608 (e.g., a BAN or other short- or long-range network associated with the user 605). The personnel and asset accountability modules 660 are configured to provide functionality similar to that described above with respect to the personnel and asset accountability modules 339, 349, 389, 417 and 620. In the system 650 of FIG. 6B, a single user / asset 605 is associated with multiple devices that provide at least a portion of a fleet of devices, with one of such devices (e.g., the management device 606-1) controlling other ones of the devices in the fleet (e.g., the managed devices 606-2, 606-3, . . . 606-M). In some embodiments, the management device 606-1 comprises a wireless gateway (e.g., wireless gateway 340) while the managed devices 606-2, 606-3, . . . 606-M comprise respective wearable devices (e.g., respective instances of the wearable device 302). In other embodiments, the management device 606-1 may comprise a wearable device rather than a wireless gateway.
[0213] It should be noted that, in some embodiments, the systems 600 and 650 may be combined. For example, one or more of the managed users / assets 602-2, 602-3, . , . 602-M: may have a wireless gateway or wearable device that acts as a management device for other wearable devices associated with that managed user / asset. Further, for the group of users 602, or for any individual user 605, there may be multiple management and / or managed devices, or only a single management and / or managed device.
[0214] FIGS. 7A-7C illustrate setup of a workflow for personnel and asset accountability. The workflow setup includes: (1) importing, pulling or creating a workflow personnel / asset listing (e.g., platforms, personnel, equipment, etc. that are to be used as part of the workflow), as illustrated in FIG. 7A which shows an available unit asset pool 701 from which a mission asset listing shown as mission asset pool 703 is pulled in to draw from for building an accountability plan for a particular mission or other workflow; (2) importing, pulling and creating mission stages for the mission or other workflow, shown in FIG. 7B as the mission task workflow 705 including a set of tasks (also referred to as stages) denoted Taskl through Task6; and (3) assigning particular personnel / assets to different tasks or stages of the mission or other workflow, as illustrated in FIG. 7C which shows a personnel / asset-to-task mapping visualization 707 for a particular task (e.g., Taskl) of the mission task workflow 705. It should be noted that assigning particular personnel / assets to a task may also include generating or defining associations between personnel / assets that are assigned to the task.
[0215] In the example of FIG. 7C, for Taskl, a set of personnel and assets are selected from the mission asset pool 703, shown as Troopl which has three vehicles (VAX) and fifteen personnel (PAX). A system in some embodiments provides a GUI enabling drag / drop or transfer list functionality for pulling personnel / assets from the mission asset pool 703 into a mission stage, and for associating personnel / assets with each other based on what is needed for that mission stage. Continuing with the FIG. 7C example, the mission stage for Task! uses 3 vehicles (e.g., VEH1, VEH2 and VEH3), each to be loaded with 5 personnel (where each vehicle may have a maximum capacity in terms of personnel, such as 9 personnel). In this example, vehicles and personnel are assigned under a specific team (e.g., Troopl or Team A) although other associations are possible.
[0216] The workflow setup may further include assigning personnel / assets to one or more “bump” plans (e.g., contingency plans for use in logistical operations for prioritizing the personnel / assets) to mission stages or tasks of mission task workflow 705. The generated workflow may then be checked or reviewed for accuracy, and then exported or saved for briefing, execution, etc.
[0217] Mission or other workflow planning associations enable accountability to be organized in multiple ways, including: a command-based, hierarchical manner (e.g., personnel belonging to teams, squads, troops, etc.); and a container, location-based manner (e.g., personnel, equipment, vehicles, platforms and other assets are associated with each other). Forthe container method of organizing accountability: a large group of subjects could contain smaller groups of subjects, with some of those having even smaller groups of subjects, eventually down to individual personnel and equipment or other assets. Anything in the chain can be assigned a piece of equipment at any level. In some cases, accountability of an asset is assigned to a specific person, though this is not required. Any numbers of smaller things may be associated with one another, within larger things that roll back up so that users viewing an accountability management visualization can see both high-level and lower-level distributions quickly.
[0218] Referring now to FIG. 8 A, a mapping visualization 801 is shown (e.g., a leadership association example) with a 1-level expansion thereof to mapping visualizations 803, 805 and 807. The mapping visualization 801 is for a troop (e.g., Troop A) which has 8 vehicles and 48 personnel assigned, organized into groups including a HQ 1 group of 2 vehicles and 12 personnel, a Squad 1 group of 3 vehicles and 18 personnel, and a Squad 3 group of 3 vehicles and 18 personnel. The mapping visualization 803 is for the HQ 1 group, which is further broken down into HQTMA and HQTMB groups each having one vehicle and 6 personnel assigned thereto. The mapping visualizations 805 and 807 are for the Squad 1 and Squad 2 groups, respectively, each broken down into three teams (e.g., Team A, Team B and Team C for Squad 1, and Team D, Team E and Team F for Squad 2), with each team being assigned one vehicle and 6 personnel. Referring now to FIG. 8B, drill-down visualization of one of the teams, Team C 850, is shown as mapping visualization 809. The mapping visualization 809 lists the specific personnel and assets assigned to Team C, including a vehicle VEH1, and personnel PAX1, PAX2, PAX3, PAX4, PAX5 and PAX6.
[0219] Mission or workflow planning with platform or container hierarchy and nesting will now be described. Platforms can be nested by level, such as: a ship holds a plane, a vehicle and a person; the plane holds a vehicle and a person; the vehicle holds a person; the person holds a piece of equipment. The hierarchy and nesting may be established using NFC tap-in of sensors associated with wearable and / or accessory devices (e.g., patch-module pairs shown in FIG. 1, sensing, stimulating, accessory and / or host devices as shown in FIGS. 2A-2D, wearable device 302, accessory devices 315, wireless gateway 340 shown in FIGS. 3A-3E, sensors 430 of primary sensing device and sensors 450 of accessory sensing devices 405 and / or local BAN controller 407 and remote BAN controller 409 shown in FIG. 4, sensing devices 504 shown in FIG. 5, devices 602 and 606 shown in FIGS. 6A and 6B, etc.). Platforms andcontainers may be anything that can hold people or things. For example, a tunnel or facility such as a hangar can be a platform. There is a distinction between organizational and physical containers, though they behave similarly. Organizational containers, for example, may represent a fireteam, a platoon, etc. Physical containers, for example, may represent a vehicle, a location, etc.
[0220] Referring now to FIG. 9A, a mapping visualization 900 is shown illustrating a platform / container hierarchy and nesting. In the mapping visualization 900, there are four levels: level 3 (hangar), level 2 (cargo plane), level 1 (vehicle) and level 0 (personnel). The lowest level in the hierarchy (level 0) is always an “atomic” container, one that cannot be further divided, although it can have one or more assets assigned to it. In the mapping visualization 900, personnel may be represented by a callsign (e.g., XYZ) and may have a team association via some visual indicator (e.g., a color or shading) and assets may be represented by equipment identifiers (IDs) (e.g., EQI) and may have a personnel or container association. FIG. 9B shows an example of a personnel representation 905 (e.g., XYZ) and an asset representation 910 (e.g., 910). FIG. 9C shows association between personnel (e.g., XYZ) and an asset (e.g., EQI), including an unexpanded association visualization 915 and an expanded association visualization 920. The association visualizations may be expanded and unexpanded through “clicking” or otherwise selecting an association visualization or a designated region thereof.
[0221] For a platform or container, everything may be in an “in / on” or “out / off ’ state. Each container card visualization represents a “thing” (e.g., a container, platform, asset, personnel, etc.) that holds other “things.” Within the larger thing, internal things may have other things in them or associated with them. This is true for a target site, facility or casualty recovery site, natural disaster site, evacuation recovery site, etc., which is an extension of this concept. Thus, a “site” may be created automatically when a starting site marker is turned on (e.g., SITE1, SITE2, etc.) which creates a personnel and / or asset tracking station associated with a site entrance. Then, as assets and / or personnel pile into or leave that site, the SITE station is the traffic controller (e.g., an entity that implements personnel and asset accountability management functionality for tracking the presence of personnel and / or assets at that site).
[0222] FIGS. 10A-10D shows additional mission planning platforms and containers, illustrating the present contents of particular platforms or containers (e.g., as tracked via personnel and asset accountability management logic, such as that provided via personnel andasset accountability modules 339, 349, 389, 417, 620, 660). Referring now to FIG. 10A, a mapping visualization 1000 is shown (e.g., for an “all good” or normal situation, in which the tracked presence of personnel and assets matches the personnel and / or assets which are assigned to a particular, current stage or task of a mission or other workflow). The mapping visualization 1000 includes a platform ID 1001 (e.g., PLAT1), a platform type 1002 (e.g., PLAT TYPE), assigned vehicle status 1003 (e.g., including actual / expected numbers of vehicles) and assigned personnel status 1004 (e.g., including actual / expected number of personnel). In the FIG. 10A example, the assigned vehicle status 1003 indicates that 3 actual out of 3 expected vehicles are onboard the PLAT1 platform and the assigned personnel status 1004 indicates that 20 actual out of 20 expected personnel are onboard the PLAT1 platform.
[0223] Referring now to FIG. 10B, a mapping visualization 1010 is shown (e.g., for a “missing” situation in which the tracked presence of personnel and assets indicates that one or more expected and assigned personnel and / or assets assigned to a particular, current stage or task of a mission or other workflow are not detected to be present). The mapping visualization 1010 includes a platform ID 1011 (e.g., PLAT1), a platform type 1012 (e.g., PLAT TYPE), assigned vehicle status 1013 (e.g., including actual / expected numbers of vehicles) and assigned personnel status 1014 (e.g., including actual / expected number of personnel). In the FIG. 10B example, the assigned vehicle status 1013 indicates that 2 actual out of 3 expected vehicles are onboard the PLAT1 platform and the assigned personnel status 1014 indicates that 13 actual out of 20 expected personnel are onboard the PLAT1 platform. Thus, at a quick glance (e.g., via coloring of shading of the mapping visualization 1010 in some embodiments), a user can determine that something is wrong or unexpected, namely, that one or more expected personnel or assets are missing.
[0224] Referring now to FIG. 10C, a mapping visualization 1020 is shown (e.g., for a “platform empty” situation in which the tracked presence of personnel and assets indicates that no expected and assigned personnel and / or assets assigned to a particular, current stage or task of a mission or other workflow are detected to be present). The mapping visualization 1020 includes a platform ID 1021 (e.g., PLAT1), a platform type 1022 (e.g., PLAT TYPE), assigned vehicle status 1023 (e.g., including actual / expected numbers of vehicles) and assigned personnel status 1024 (e.g., including actual / expected number of personnel). In the FIG. 10C example, the assigned vehicle status 1023 indicates that 0 actual out of 3 expected vehicles are onboard the PLAT1 platform and the assigned personnel status 1024 indicates that 0 actual outof 20 expected personnel are onboard the PLAT1 platform. Thus, at a quick glance (e.g., via coloring of shading of the mapping visualization 1020 in some embodiments), a user can determine that something is wrong or unexpected, namely, that the platform is empty.
[0225] Referring now to FIG. 10D, a mapping visualization 1030 is shown (e.g., for a “platform empty” situation in which the tracked presence of personnel and assets indicates that no expected and assigned personnel and / or assets assigned to a particular, current stage or task of a mission or other workflow are detected to be present, but where the platform is expected to be empty at the current stage or task of the mission or other workflow). The mapping visualization 1030 includes a platform ID 1031 (e.g., PLAT1), a platform type 1032 (e.g., PLAT TYPE), assigned vehicle status 1033 (e.g., including actual / expected numbers of vehicles) and assigned personnel status 1034 (e.g., including actual / expected number of personnel). In the FIG. 10D example, the assigned vehicle status 1033 indicates that 0 actual out of 0 expected vehicles are onboard the PLAT1 platform and the assigned personnel status 1034 indicates that 0 actual out of 0 expected personnel are onboard the PLAT1 platform. Thus, at a quick glance (e.g., via coloring of shading of the mapping visualization 1030 in some embodiments), a user can determine that the platform is empty, but that this is the expected status for the current stage or task of the mission or other workflow (e.g., the platform is supposed to be empty at the current time).
[0226] Platform expanded views will now be described with respect to FIG. 11, which shows a mapping visualization 1100 including a platform ID 1101 (e.g., PLAT1), present contents status information 1102 (e.g., actual / expected vehicles and personnel), and expanded views of vehicle status information 1103, personnel status information 1104 and extra asset status information 1105. Selecting (e.g., touching, clicking or otherwise activating a user interface (UI) feature of the platform ID 1101 expands out the platform view in the mapping visualization 1100 so that the contents and the present state of the platform are shown. In some embodiments, multiple selections (e.g., multiple touches, clicks, etc.) may be used to further expand the mapping visualization 1100 so that the vehicle status information 1102, personnel status information 1104 and / or extra asset status information 1105 are visible, expanding the containers within the platform.
[0227] In the FIG. 11 example, the present contents status information 1102 indicates that 3 actual out of 3 expected vehicles are onboard, and that 20 actual out of 20 expected personnel are onboard. The vehicle status information 1103 gives the maximum number of vehicles of aparticular type (e.g., 2 in the FIG. 11 example) based on the mission or other workflow configuration and the weight that can fit within the platform for transport. The vehicle status information 1103 also gives details on the vehicles on the platform, in this example vehicles with IDs LSV4 and LSV5, both of type DAGOR. Here, both vehicles have 0 actual out of 0 expected personnel present. The personnel status information 1104 gives the maximum number of personnel that can fit on the platform, depending on the mission or other workflow configuration. Individual personnel may be assigned by container (e.g., personnel PAX1, PAX2, PAX3 AND PAX4 in personnel group PGRP1, PAX5, PAX6, PAX7 and PAX8 in personnel group PGRP2) or individually (e.g., personnel PAX9, PAX10, PAX11, PAX12, PAX13, PAX14, PAX15, PAX16, PAX17, PAX18). This illustrates the “containers in containers” mapping and assignment. Details on personnel in the platform may be color-coded to different teams, and may be organized in various ways (e.g., by rank, group, team, ID, alphabetically, etc.). The extra asset status information 1105 shows extra assets which are not associated with personnel or vehicles, which in the FIG. 11 example include a pallet (Pallet 1) with 500 Meal, Ready-to-Eat (MRE) rations.
[0228] FIGS. 12A-12C show example visualizations which may be presented via a GUI 1200. As shown in FIG. 12A, the GUI 1200 includes a map 1201, a mission asset pool 1203 and a drill-down pane 1205 also referred to as a quick tile view 1205. The map 1201 shows two assets 1207-1 and 1207-2 located in a hangar, with a mapping visualization 1209 showing information for the hangar, including actual and expected numbers of hangar vehicles (HAX), other vehicles (VAX) and personnel (PAX), along with expanded information for the two assets shown (e.g., HVEH1 and HVEH2), including detected numbers of vehicles, personnel and other types of assets detected to be present. The quick tile view 1205 shows mapping visualization 1211, with drill-down information for a specific mission or workflow subtask (HAF1) filtered by a specific component of the force (Troop 1). The mapping visualization 1211 represents an “all good” or normal situation (e.g., like the mapping visualization 1000 in FIG. 10 A), where the actual and expected numbers of personnel and assets detected to be present match those that are assigned to the current stage or task of the mission or workflow (HAF1).
[0229] FIG. 12B shows the drill-down pane 1205 updated to a mapping visualization 1213 for a “problem” situation (e.g., like the mapping visualization 1010 shown in FIG. 10B). Here, the mapping visualization 1213 indicates that the actual numbers of vehicles and personnel onthe HVEH2 asset do not match the expected numbers of vehicles and personnel for the current stage or task of the mission or other workflow (e.g., only 3 / 4 vehicles and 15 / 35 personnel). The mapping visualization 1213 shows an additional vehicle, VEH7 with 5 personnel, that is out of position and not on any of the HAX assets (e.g., the missing vehicle for the HVEH2 asset), as well as a number of dismounted personnel (e.g., 15) that are not on their assigned transport vehicle (e.g., vehicles of the HVEH2 asset). The mapping visualization 1213 can thus quickly and easily enable a user to detect the problem situation (e.g., via color-coding or shading of container / platform tiles within the mapping visualization) and determine remedial action (e.g., instructing that VEH7 be loaded onto HVEH2 and that the dismounted personnel board their assigned transport).
[0230] FIG. 12C shows the drill-down pane 1205 updated to include mapping visualizations 1215 and 1217 for another “problem” situation (e.g., like the mapping visualizations 1010 and 1030 shown in FIG. 10B). Here, the mapping visualization 1215 indicates that the actual numbers of vehicles and personnel on the HVEH2 asset do not match the expected numbers of vehicles and personnel for the current stage or task of the mission or other workflow (e.g., only 3 / 4 vehicles and 15 / 35 personnel). The mapping visualization 1217 shows that there are no dismounted personnel that are not their assigned transport vehicle. The mapping visualizations 1215 and 1217 can thus quickly and easily enable a user to detect the problem situation (e.g., via color-coding or shading of container / platform tiles within the mapping visualization) and determine remedial action (e.g., finding the missing vehicle and personnel and, once found, instructing that the missing vehicle be loaded onto HVEH2 and the missing personnel board their assigned transport).
[0231] An exemplary process 1300 for resource accountability management will now be described with reference to the flow diagram of FIG. 13. It should be understood, however, that this particular process is only an example and that other types of processes for resource accountability management may be used in other embodiments as described elsewhere herein. The process 1300 includes steps 1302 through 1306. The process 1300 may be performed, for example, by sensing and / or accessory devices, wireless gateways, BAN controllers, etc.
[0232] In step 1302, for a workflow comprising one or more tasks associated with one or more locations, (i) an assignment of two or more resources of a plurality of resources to the one or more tasks and (ii) hierarchical associations between different ones of the two or more resources assigned to the one or more tasks are determined.
[0233] In step 1304, presence of respective ones of the plurality of resources at a given location associated with a given one of the one or more tasks is monitored utilizing one or more sensor devices associated with the plurality of resources.
[0234] In step 1306, one or more accountability management visualizations for the given task are generated based at least in part on the monitored presence of respective ones of the plurality of resources. The one or more accountability management visualizations characterize whether expected numbers and types of the plurality of resources are present in the given location at a time when the given task of the workflow is to be performed, the expected numbers and types of the plurality of resources being based at least in part on the determined (i) assignment of the two or more resources to the one or more tasks and (ii) the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks.
[0235] The plurality of resources may comprise at least one of: one or more users; and one or more assets. The one or more assets may comprise at least one of: one or more vehicles; one or more equipment containers; and equipment.
[0236] The hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks may comprise one or more command-based hierarchical associations characterizing personnel-based groupings of subsets of the plurality of resources.
[0237] The hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks may comprise one or more container-based hierarchical associations characterizing location-based groupings of subsets of the plurality of resources.
[0238] The hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks may comprise two or more nested levels of containers. The containers may comprise at least one of: organizational containers comprising personnel-based groupings of subsets of the plurality of resources; and physical containers comprising at least one of one or more geographic locations and one or more physical assets configured to hold subsets of the plurality of resources. The two or more nested levels of containers may comprise: a first level comprising atomic containers not capable of subdivision; and one or more additional levels comprising subdividable containers. A given one of the plurality of resources in the first level may be associated with an asset tree comprising one or more additional ones of the plurality of resources assigned to the given resource.
[0239] A given one of the one or more accountability management visualizations may comprise two or more user interface features associated with two or more of the containers, wherein activation of a given one of the two or more activatable user interface features associated with a given one of the two or more containers expands a view of a given subset of the plurality of resources, determined to be present at the given location, which are assigned to the given container.
[0240] A given one of the one or more accountability management visualizations may comprise two or more user interface features associated with two or more of the containers, wherein the two or more user interface features comprise status information for the two or more containers. The status information for the two or more containers may comprise: a first visual encoding for ones of the two or more containers having the expected numbers and types of the plurality of resources present in the given location at the time when the given task of the workflow is to be performed; a second visual encoding for ones of the two or more containers missing at least one resource that is expected to be present in the given location at the time when the given task of the workflow is to be performed; a third visual encoding for ones of the two or more containers that are empty but which are expected to include one or more of the plurality of resources in the given location at the time when the given task of the workflow is to be performed; and a fourth visual encoding for ones of the two or more containers that are empty and are not expected to include one or more of the plurality of resources in the given location at the time when the given task of the workflow is to be performed.
[0241] Monitoring the presence of respective ones of the plurality of resources at the given location associated with the given task may comprise monitoring, via at least one sensor monitoring device at the physical location, ones of the one or more sensor devices associated with the plurality of resources determined to be in range of the at least one sensor monitoring device at the physical location. The at least one sensor monitoring device may comprise a Near Field Communication (NFC) reader and the one or more sensor devices associated with the plurality of resources comprise one or more NFC tags.
[0242] It will be appreciated that additional advantages and modifications will readily occur to those skilled in the art. Therefore, the disclosures presented herein and broader aspects thereof are not limited to the specific details and representative embodiments shown and described herein. Accordingly, many modifications, equivalents, and improvements may beincluded without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.
Claims
ClaimsWhat is claimed is:
1. An apparatus comprising:at least one processing device comprising a processor coupled to a memory;the at least one processing device being configured:to determine, for a workflow comprising one or more tasks associated with one or more locations, (i) an assignment of two or more resources of a plurality of resources to the one or more tasks and (ii) hierarchical associations between different ones of the two or more resources assigned to the one or more tasks;to monitor, at a given location associated with a given one of the one or more tasks, presence of respective ones of the plurality of resources utilizing one or more sensor devices associated with the plurality of resources; andto generate, based at least in part on the monitored presence of respective ones of the plurality of resources, one or more accountability management visualizations for the given task, the one or more accountability management visualizations characterizing whether expected numbers and types of the plurality of resources are present in the given location at a time when the given task of the workflow is to be performed, the expected numbers and types of the plurality of resources being based at least in part on the determined (i) assignment of the two or more resources to the one or more tasks and (ii) the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks.
2. The apparatus of claim 1, wherein the plurality of resources comprise at least one of:one or more users; andone or more assets.
3. The apparatus of claim 2, wherein the one or more assets comprise at least one of:one or more vehicles;one or more equipment containers; andequipment.
4. The apparatus of claim 1, wherein the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks comprise one or more command-based hierarchical associations characterizing personnel-based groupings of subsets of the plurality of resources.
5. The apparatus of claim 1, wherein the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks comprise one or more container-based hierarchical associations characterizing location-based groupings of subsets of the plurality of resources.
6. The apparatus of claim 1, wherein the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks comprise two or more nested levels of containers.
7. The apparatus of claim 6, wherein the containers comprise at least one of: organizational containers comprising personnel-based groupings of subsets of the plurality of resources; andphysical containers comprising at least one of one or more geographic locations and one or more physical assets configured to hold subsets of the plurality of resources.
8. The apparatus of claim 6, wherein the two or more nested levels of containers comprise:a first level comprising atomic containers not capable of subdivision; andone or more additional levels comprising subdividable containers9. The apparatus of claim 8, wherein a given one of the plurality of resources in the first level is associated with an asset tree comprising one or more additional ones of the plurality of resources assigned to the given resource.
10. The apparatus of claim 6, wherein a given one of the one or more accountability management visualizations comprises two or more user interface features associated with two or more of the containers, wherein activation of a given one of the two or more activatable userinterface features associated with a given one of the two or more containers expands a view of a given subset of the plurality of resources, determined to be present at the given location, which are assigned to the given container.
11. The apparatus of claim 6 wherein a given one of the one or more accountability management visualizations comprises two or more user interface features associated with two or more of the containers, wherein the two or more user interface features comprise status information for the two or more containers.
12. The apparatus of claim 11 wherein the status information for the two or more containers comprise:a first visual encoding for ones of the two or more containers having the expected numbers and types of the plurality of resources present in the given location at the time when the given task of the workflow is to be performed;a second visual encoding for ones of the two or more containers missing at least one resource that is expected to be present in the given location at the time when the given task of the workflow is to be performed;a third visual encoding for ones of the two or more containers that are empty but which are expected to include one or more of the plurality of resources in the given location at the time when the given task of the workflow is to be performed; anda fourth visual encoding for ones of the two or more containers that are empty and are not expected to include one or more of the plurality of resources in the given location at the time when the given task of the workflow is to be performed.
13. The apparatus of claim 1, wherein monitoring the presence of respective ones of the plurality of resources at the given location associated with the given task comprises monitoring, via at least one sensor monitoring device at the physical location, ones of the one or more sensor devices associated with the plurality of resources determined to be in range of the at least one sensor monitoring device at the physical location.
14. The apparatus of claim 13, wherein the at least one sensor monitoring device comprises a Near Field Communication (NFC) reader and the one or more sensor devices associated with the plurality of resources comprise one or more NFC tags.
15. A method compri sing :determining, for a workflow comprising one or more tasks associated with one or more locations, (i) an assignment of two or more resources of a plurality of resources to the one or more tasks and (ii) hierarchical associations between different ones of the two or more resources assigned to the one or more tasks;monitoring, at a given location associated with a given one of the one or more tasks, presence of respective ones of the plurality of resources utilizing one or more sensor devices associated with the plurality of resources; andgenerating, based at least in part on the monitored presence of respective ones of the plurality of resources, one or more accountability management visualizations for the given task, the one or more accountability management visualizations characterizing whether expected numbers and types of the plurality of resources are present in the given location at a time when the given task of the workflow is to be performed, the expected numbers and types of the plurality of resources being based at least in part on the determined (i) assignment of the two or more resources to the one or more tasks and (ii) the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks;wherein the method is performed by at least one processing device comprising a processor coupled to a memory.
16. The method of claim 15, wherein the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks comprise two or more nested levels of containers.
17. The method of claim 16, wherein the containers comprise at least one of: organizational containers comprising personnel-based groupings of subsets of the plurality of resources; andphysical containers comprising at least one of one or more geographic locations and one or more physical assets configured to hold subsets of the plurality of resources.
18. A computer program product comprising a non-transitory processor-readable storage medium having stored therein executable program code which, when executed, causes at least one processing device:to determine, for a workflow comprising one or more tasks associated with one or more locations, (i) an assignment of two or more resources of a plurality of resources to the one or more tasks and (ii) hierarchical associations between different ones of the two or more resources assigned to the one or more tasks;to monitor, at a given location associated with a given one of the one or more tasks, presence of respective ones of the plurality of resources utilizing one or more sensor devices associated with the plurality of resources; andto generate, based at least in part on the monitored presence of respective ones of the plurality of resources, one or more accountability management visualizations for the given task, the one or more accountability management visualizations characterizing whether expected numbers and types of the plurality of resources are present in the given location at a time when the given task of the workflow is to be performed, the expected numbers and types of the plurality of resources being based at least in part on the determined (i) assignment of the two or more resources to the one or more tasks and (ii) the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks.
19. The computer program product of claim 18, wherein the hierarchical associations between the different ones of the two or more resources assigned to the one or more tasks comprise two or more nested levels of containers.
20. The computer program product of claim 19, wherein the containers comprise at least one of:organizational containers comprising personnel-based groupings of subsets of the plurality of resources; andphysical containers comprising at least one of one or more geographic locations and one or more physical assets configured to hold subsets of the plurality of resources.