Hypervisor Kernel Exploit Detection via SMEP Enforcement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Kernel vulnerabilities are exploited to corrupt memory, leading to potential security breaches, as existing systems lack effective mechanisms to detect and mitigate such threats across different operating systems.

Innovation Solution

A system utilizing a hypervisor to control both user and kernel spaces, employing SMEP bit management, shadow page table entries, and exploitation pattern analysis to detect and prevent malicious code execution from non-executable memory pages, thereby maintaining OS security across various OS platforms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If kernel memory is made executable to allow code execution, then code execution capability is improved, but security against exploitation is worsened

Engineering Contradiction:
Improvecode execution capabilityVSAvoidsecurity vulnerability to exploitation
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent segments memory into distinct executable and non-executable regions, with the hypervisor enforcing strict boundaries. Kernel memory is divided into code segments (executable) and data segments (non-executable), preventing exploits from executing malicious code in protected regions while maintaining legitimate code execution capabilities.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The hypervisor acts as an intermediary layer between user space and kernel space, mediating all memory access and execution requests. It enforces SMEP (Supervisor Mode Execution Protection) to prevent user space code from being executed in kernel mode, thereby blocking exploitation attempts while allowing legitimate kernel code execution.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If memory protection mechanisms are strengthened to prevent exploitation, then security is improved, but system complexity is worsened

Engineering Contradiction:
Improvesecurity protectionVSAvoidsystem architecture complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a universal hypervisor architecture that provides multi-functional security protection across different operating systems and exploitation vectors. The same hypervisor layer handles SMEP enforcement, memory segmentation, exploit detection, and mitigation for various OS platforms, reducing overall system complexity through consolidation rather than requiring separate protection mechanisms for each threat.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system employs self-service mechanisms where the hypervisor automatically detects exploitation attempts through pattern recognition and automatically applies mitigations without requiring manual intervention. The exploit detection and response system operates autonomously, monitoring memory access patterns and automatically enforcing protection rules when threats are detected.

Inventive Principle:
Principle #25Self-service

3Difficulty of detecting and measuring

If exploit detection mechanisms are added to monitor memory access, then detection capability is improved, but processing overhead is worsened

Engineering Contradiction:
Improveexploit detection capabilityVSAvoidprocessing overhead
Core Design Contradiction:
Difficulty of detecting and measuringVSUse of energy by moving object

Solution Approach 1:

The patent implements preliminary action by pre-configuring memory protection attributes and executable bit settings before exploitation can occur. The hypervisor pre-establishes SMEP enforcement and memory segmentation, so when exploitation attempts are made, the damage is already limited and detection is simplified rather than requiring complex real-time analysis of all memory access patterns.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10810309B2Method and system for detecting kernel corruption exploits
Publication Date: 2020.10.20 CHECK POINT SOFTWARE TECH LTD
  • US10810309B2 patent drawing
  • US10810309B2 patent drawing
  • US10810309B2 patent drawing

AI summary

Methods and systems provide for detecting exploitation of kernel vulnerabilities which typically corrupt memory. The methods and systems are implemented, for example, via a host, which includes a hypervisor, which controls the operating system (OS) user space and the OS kernel space.