Mobile Device Hazard Recognition via Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for detecting hazards in homes or buildings require complex sensor networks, slow algorithms, or significant manpower for manual analysis, making them inefficient and costly.

Innovation Solution

A computer-implemented method using a mobile device with a camera and sensors to detect hazards by generating position and label pairs, applying recognition filters, and assigning scores, with user-selected data and context recognition, to provide real-time hazard identification and recommendations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a network of cameras and computer systems is used to detect hazards, then hazard detection capability is improved, but device complexity increases

Engineering Contradiction:
Improvehazard detection capabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines multiple sensor types (camera, accelerometer, gyroscope, microphone) into a single mobile device to perform hazard detection. This integration reduces system complexity compared to using separate dedicated hazard detection systems while maintaining comprehensive detection capabilities through multi-sensor fusion.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The mobile device is designed to perform multiple functions: hazard detection, navigation assistance, and general computing tasks. By making the hazard detection system universal and applicable to any mobile device, the patent avoids the need for specialized complex hardware while achieving reliable hazard detection through software-based processing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If complex algorithms are used to determine potential hazards, then hazard recognition accuracy is improved, but processing speed decreases

Engineering Contradiction:
Improvehazard recognition accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The system performs preliminary processing of sensor data by generating position and label pairs before final hazard analysis. This pre-processing step organizes raw sensor data into structured formats, making subsequent hazard recognition faster and more accurate by reducing the computational complexity of the main analysis algorithm.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The hazard detection process is divided into distinct segments: sensor data collection, position-label pair generation, hazard recognition, and result display. This segmentation allows each component to be optimized independently, with simple filtering operations in early stages and more complex analysis only when necessary, improving overall processing speed.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If manual analysis of video is used to determine hazardous conditions, then hazard detection accuracy is improved, but productivity decreases

Engineering Contradiction:
Improvehazard detection accuracyVSAvoidanalysis throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system uses automated machine learning algorithms to perform hazard detection without requiring manual video analysis. The mobile device itself processes and analyzes the sensor data, eliminating the need for human operators to manually review footage while maintaining high detection accuracy through trained models.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical video analysis with automated computational algorithms. Machine learning models process sensor data and identify hazards automatically, substituting human cognitive effort with computational processes that are both accurate and highly scalable, thereby improving productivity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Measurement precision

If physically assessing hazardous conditions is performed, then hazard detection accuracy is improved, but loss of time increases

Engineering Contradiction:
Improvehazard detection accuracyVSAvoidassessment time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The mobile device continuously collects and processes sensor data in real-time, providing ongoing hazard detection rather than periodic physical assessments. This continuous monitoring maintains high detection accuracy by constantly analyzing the environment while eliminating the time loss associated with scheduling and performing separate physical assessment visits.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The system uses sensor data as an intermediary to indirectly assess hazardous conditions without requiring physical presence or direct inspection. The mobile device's sensors capture environmental information that serves as a proxy for physical assessment, enabling accurate hazard detection remotely and instantaneously, thus saving time.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11710075B2Hazard recognition
Publication Date: 2023.07.25 BARDAVON HEALTH DIGITIAL INC
  • US11710075B2 patent drawing
  • US11710075B2 patent drawing
  • US11710075B2 patent drawing

AI summary

Methods, systems, and devices are provided for identifying hazards. According to one aspect, a computer-implemented method can include receiving a plurality of sensor data including one or more image files from a mobile device. The method can include generating one or more position and label pairs based on the plurality of sensor data. The method can include assigning a hazard recognition to each of the position and label pairs. The method can include assigning a score associated to each of the hazard recognitions. The method can include displaying a result including one or more image results based on the one or more image files, one or more hazard recognitions, the one or more hazard recognitions associated with at least one of the one or more image results, and one or more scores associated to each of the hazard recognitions.