Image Sensor Verification With Coded Ambient Stimuli
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Devices relying on sensors are vulnerable to deterioration, defects, or malicious attacks, leading to inaccurate data that can compromise decision-making and pose safety risks to humans and property.
Innovation Solution
An edge-device coordinated system modulates ambient variables like lighting or sound in patterns that can be detected by sensors, generating a code through a code generation protocol, and comparing it with an expected code to validate sensor data integrity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If commercial off-the-shelf (COTS) components are used without additional safety features, then device complexity and cost are reduced, but sensor reliability and security are compromised
Solution Approach 1:
The system performs preliminary actions by projecting known test patterns onto the environment before normal operation. These test patterns serve as pre-prepared verification codes that the sensor should detect during routine operation, allowing proactive detection of sensor compromise before it affects critical decisions.
Solution Approach 2:
The system implements feedback by continuously comparing the sensor's detection of test patterns against the known expected patterns. When the sensor fails to detect the test pattern correctly, this feedback loop triggers a flag indicating potential sensor compromise, enabling real-time monitoring of sensor reliability.
2Productivity
If sensor data is used for decision-making without verification, then productivity is maintained, but safety and security are compromised
Solution Approach 1:
The system introduces an intermediary verification layer between the sensor and the decision-making process. This intermediary component (the test pattern verification system) acts as a mediator that checks sensor data integrity before the data influences critical decisions, thereby preventing harmful effects while maintaining overall system productivity.
Solution Approach 2:
The system applies preliminary anti-action by preemptively detecting sensor compromise through test pattern verification before the compromised sensor data can cause harmful effects. The verification process creates a protective barrier that prevents malicious or defective sensor readings from influencing safety-critical decisions.
3Ease of operation
If test patterns are projected using visible light, then ease of operation is improved, but human comfort and safety are compromised
Solution Approach 1:
The system applies parameter changes by transitioning from visible light to infrared wavelengths for projecting test patterns. This parameter change in the electromagnetic spectrum maintains the functionality of the test patterns for sensor verification while eliminating the harmful effects of visible light on human comfort and safety during extended operation.
Data Source
AI summary
A device may include an image sensor, configured to generate image sensor data representing a vicinity of the device; an image processor, configured to generate a first code from the image sensor data using a code generation protocol; an input validity checker, configured to compare the first code to a second code; and if a similarity of the first code and the second code is within a predetermined range, operate according to a first operational mode; and if the similarity of the first code and the second code is not within the predetermined range, operate according to a second operational mode.