Automatic Semantic Place Labeling via Activity Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current automatic mapping and localization technologies require manual user input for labeling places, which is inefficient and labor-intensive, especially for distinguishing between similar indoor or outdoor locations.

Innovation Solution

An automated method using electronic device sensor data to recognize activities and determine semantic place labels by learning mappings between activities and locations, allowing for the automatic assignment of semantic labels to unlabeled places based on observed and typical mappings from multiple devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual user input is used for labeling places, then labeling accuracy can be ensured, but the process becomes labor-intensive and inefficient

Engineering Contradiction:
Improvelabeling efficiencyVSAvoidmanual effort required
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system performs automatic semantic labeling by having the place labeling system itself gather sensor data, recognize activities, and determine semantic labels without requiring external manual input. The electronic device automatically collects sensor data, the activity recognizer processor determines activities from this data, and the semantic labeler processor assigns labels based on activity-location mappings, making the system self-sufficient.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual labeling process with an automated electronic system. Instead of manual user input, the system uses sensor data collection, activity recognition algorithms, and automated mapping processes to determine semantic labels, substituting human effort with electronic processing and computational analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated labeling is implemented, then productivity increases, but measurement precision of place semantics may deteriorate

Engineering Contradiction:
Improvelabeling efficiencyVSAvoidsemantic labeling accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system uses observed mappings between activities and locations from sensor data as feedback to determine semantic labels. The activity recognizer processor continuously monitors sensor data, determines activities, and feeds this information back to the semantic place labeler processor, which uses the observed activity-location relationships to accurately assign semantic labels, ensuring precision through iterative feedback.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes the parameters used for labeling from manual user input to objective sensor-based activity data. By measuring physical parameters (sensor data) and transforming them into activity classifications, the system achieves accurate semantic labeling through parameter transformation rather than subjective manual input.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If activity recognition is used to differentiate locations, then ability to distinguish similar places improves, but device complexity increases

Engineering Contradiction:
Improvelocation differentiation accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses a multi-functional processor that performs both activity recognition and semantic label determination. The activity recognizer processor and semantic place labeler processor work together as an integrated system, allowing the same electronic device to perform multiple functions (sensor data analysis, activity recognition, location tracking, and semantic labeling) without requiring separate specialized systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20170048660A1Automatic semantic labeling based on activity recognition
Publication Date: 2017.02.16 SAMSUNG ELECTRONICS CO LTD
  • US20170048660A1 patent drawing
  • US20170048660A1 patent drawing
  • US20170048660A1 patent drawing

AI summary

A method and device for automatic semantic labeling of unlabeled places using activity recognition. A method includes determining at least one activity based on analyzing electronic device sensor data. Localization for the electronic device is performed to determine location for an unknown semantic place. An observed mapping between the at least one activity and the location for the unknown semantic place is determined. A typical mapping between the at least one activity and at least one semantic place is determined. Using the observed mapping and the typical mapping from one or more other electronic devices, the unknown semantic place is assigned with a semantic place label representing the at least one semantic place for identifying the unknown semantic place. A semantic place map is updated to include the semantic place label.