Range Finding Sensor for Contextual Awareness in IoT Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Consumer IoT devices lack effective input channels and contextual awareness, leading to cumbersome user interactions and limited ability to assist users proactively, due to their limited awareness of surroundings and inability to recognize objects and people.

Innovation Solution

Incorporating range finding sensors like LIDAR into IoT devices to create a sensing plane above a monitored surface, enabling enhanced touch and object sensing, person tracking, and contextual awareness, which provides a complementary input channel and improves interactive opportunities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If range finding sensors like LIDAR are incorporated into IoT devices, then contextual awareness and object recognition capabilities are enhanced, but device complexity and cost increase

Engineering Contradiction:
Improvecontextual awarenessVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies multi-functionality by enabling the range finding sensor to serve multiple purposes: touch input detection, object recognition, person tracking, and contextual awareness. This single sensor replaces what would otherwise require multiple separate sensing systems, thereby enhancing contextual awareness while limiting the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If range finding sensors are used to create a sensing plane above the monitored surface, then touch and object sensing capabilities are enhanced, but device complexity increases

Engineering Contradiction:
Improveinput modalitiesVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a sensing plane in the air above the monitored surface by positioning the range finding sensor to scan a two-dimensional area. This adds a spatial dimension to touch input detection, allowing users to interact with virtual buttons and gestures in mid-air, thereby enhancing adaptability while managing device complexity through efficient sensor utilization.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If LIDAR sensing is implemented for person tracking and object recognition, then interactive opportunities are improved, but manufacturing cost increases

Engineering Contradiction:
Improveinteractive opportunitiesVSAvoidmanufacturing cost
Core Design Contradiction:
Ease of operationVSEase of manufacture

Solution Approach 1:

The patent enables the LIDAR sensor to automatically perform person tracking and object recognition without requiring additional processing hardware or complex algorithms. The sensor system independently identifies and tracks objects and persons within the sensing plane, improving ease of operation while limiting the increase in manufacturing cost through self-contained functionality.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables expressive input modalities such as hand gestures and object recognition, enhances contextual awareness, and allows devices to interact with users and their environment in a more proactive and intuitive manner, significantly improving user experiences.

Implementation Method 1

range finding sensor (e.g., LIDAR)

Methodology Applied
Scientific EffectLIDAR: LIDAR

Implementation Method 2

range finding sensor...configured to provide an input channel and to operate parallel to the host surface area, whereby the range finding sensor can sense at least one input within a predetermined region around the computing device

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS11630569B2System, method and devices for touch, user and object sensing for IoT experiences
Publication Date: 2023.04.18 CARNEGIE MELLON UNIV
  • US11630569B2 patent drawing
  • US11630569B2 patent drawing
  • US11630569B2 patent drawing

AI summary

Internet of Things (“IoT”) appliances are gaining consumer traction, from smart thermostats to smart speakers. These devices generally have limited user interfaces, most often small buttons and touchscreens, or rely on voice control. Further, these devices know little about their surroundings—unaware of objects, people and activities around them. Consequently, interactions with these “smart” devices can be cumbersome and limited. The present invention presents an approach that enriches IoT experiences with rich touch and object sensing, offering a complementary input channel and increased contextual awareness. The present invention incorporates a range sensing technology into the computing devices, providing an expansive ad hoc plane of sensing just above the surface with which a device is associated. Additionally, the present invention can recognize and track a wide array of objects, including finger touches and hand gestures. The present invention can also track people and estimate which way they are facing.