Mobile Terminal Walking Detection via Camera and Velocity Sensor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional technologies that prevent accidents by monitoring users of mobile devices fail to accurately determine when a pedestrian is in danger, often incorrectly suppressing device usage, leading to low user convenience.

Innovation Solution

A mobile terminal equipped with a camera, velocity sensor, and controller that determines the user's walking state and direction of gaze, and a danger notification system that alerts both the user and nearby drivers when the pedestrian is in danger, using location information and ultrasonic waves.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional technology changes operation status based on application-user status relation, then user safety is improved, but user convenience deteriorates due to unnecessary suppression

Engineering Contradiction:
Improveuser safetyVSAvoiduser convenience
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The determination process is segmented into multiple independent checks: walking state determination (velocity sensor), screen viewing state determination (camera-based face direction analysis), and danger state determination (integration of multiple factors). This segmentation allows precise control over when notifications are triggered, improving safety without unnecessary suppression of normal usage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes the determination parameters from simple application status to a composite of multiple parameters including moving velocity threshold, screen on state, face direction angle, and presence of vehicles/obstacles. This multi-parameter approach enables accurate distinction between dangerous and safe usage scenarios.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If automatic prevention technology is implemented, then accident prevention is improved, but measurement precision deteriorates due to inaccurate danger determination

Engineering Contradiction:
Improveaccident preventionVSAvoiddanger determination accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The mobile terminal integrates multiple sensors and functions into a unified danger determination system: velocity sensor for walking detection, camera for face direction and obstacle detection, GPS for location-based vehicle detection, and screen sensor for viewing state. This multi-functional approach enables comprehensive and precise danger assessment.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system continuously monitors multiple parameters and provides feedback loops: velocity sensor feedback for walking state, camera feedback for face direction, vehicle/obstacle detection feedback, and dynamic adjustment of determination thresholds based on environmental context. This feedback mechanism ensures high precision in danger determination.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9319860B2Mobile terminal that determine whether the user is walking while watching the mobile terminal
Publication Date: 2016.04.19 FUJITSU TEN LTD
  • US9319860B2 patent drawing
  • US9319860B2 patent drawing
  • US9319860B2 patent drawing

AI summary

A mobile terminal includes a display screen, a first camera that is installed on a side of the mobile terminal having the display screen, a velocity sensor that derives moving velocity of the mobile terminal, and a controller configured to (i) determine a starting state of the display screen, (ii) determine a direction of a face of a user based on a shot image obtained from the first camera, and (iii) determine whether the user is walking while watching the mobile terminal based on the moving velocity, the starting state and the direction of the face of the user.