Remote Access Recording Synchronizing Video and Text Logs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current remote access auditing solutions for industrial control systems are inefficient, requiring auditors to review extensive video recordings to find specific user commands, and fail to capture actions that occur outside the visible screen area, such as keystrokes or voice commands not visible on the display.

Innovation Solution

A combined video recording method that synchronizes video of the display window content with text representation of user actions, including keystrokes and voice commands, to create a single output file for easier auditing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If video recording of display window content is used for remote access auditing, then visual record of user actions is obtained, but auditing efficiency deteriorates due to lengthy review time and inability to capture actions outside visible screen area

Engineering Contradiction:
Improveuser actionsVSAvoidauditing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent combines video recording of display window content with text logging of user actions (keystrokes, voice commands) into a synchronized dual-format recording system. This merging allows auditors to simultaneously access visual context and searchable text representations, dramatically reducing auditing time while capturing both visible and invisible user actions.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent adds a textual dimension to the traditional video recording by incorporating transcribed user actions as a separate searchable layer. This dimensional transformation converts unsearchable video content into searchable text data, enabling auditors to quickly locate specific actions without watching entire video sessions.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If traditional video recording is used, then display window content is captured, but actions outside visible screen area (keystrokes, voice commands) are not captured

Engineering Contradiction:
Improveuser actionsVSAvoidrecording system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The recording system is designed to perform multiple functions simultaneously: capturing video of the display window, logging keystrokes, recording voice commands, and synchronizing all these data streams into a unified output. This multi-functionality ensures comprehensive action capture while maintaining a cohesive system architecture.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces a text logging component as an intermediary that captures user actions not visible on screen (keystrokes, voice commands) and synchronizes them with video recording. This intermediary layer bridges the gap between visible and invisible actions, ensuring complete audit coverage without significantly increasing system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If entire video recording is reviewed to find specific commands, then comprehensive audit is performed, but auditing efficiency deteriorates due to extended review period

Engineering Contradiction:
Improveaudit accuracyVSAvoidauditing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system provides feedback in the form of searchable text logs that allow auditors to quickly locate specific user actions without reviewing entire video sessions. This feedback mechanism maintains audit accuracy by allowing targeted verification of specific commands while dramatically improving auditing speed through efficient information retrieval.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary action by transcribing and indexing user actions into searchable text format during or immediately after the remote session. This preliminary processing enables auditors to quickly search for and locate specific commands without having to watch entire video recordings, thereby maintaining comprehensive audit capability while significantly reducing review time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10567436B2Recording remote access actions in video files
Publication Date: 2020.02.18 HONEYWELL INTERNATIONAL INC
  • US10567436B2 patent drawing
  • US10567436B2 patent drawing
  • US10567436B2 patent drawing

AI summary

A method of remote access action includes directing user actions including a first action to a destination device in an industrial control system (ICS) through a terminal server including a memory, a remote access recording component (RARC), and a security center coupled by a communication server through a network connection to the ICS. The terminal server is coupled to a streaming server having a recorded session repository database. The terminal server limits the user to specifically allowed actions and directs actions if allowed enabling user selecting the destination device from a menu that then provides a connection for the first action to be begun. The RARC during the remote session records streams of video of display window content and text representing the first action, combines the text and display window content to generate a combined video output file and stores the file in the session repository database.