Foot Detection for Forgotten Object Notification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems face challenges in accurately notifying users when they forget to take an object due to issues with face detection accuracy, particularly when the user's face is captured with backlight, and the difficulty in determining the appropriate camera mounting position and angle.

Innovation Solution

An image processing system that captures images of a user's feet and specifies the direction of their toes to determine if an object is present in a predetermined place, allowing for more accurate notifications by analyzing the toe direction and adjusting the notification timing based on the type, quantity, and character information of the object.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If face detection is used to notify users of forgotten objects, then the notification system can be implemented, but the detection accuracy degrades due to backlight effects and varying face positions

Engineering Contradiction:
Improvenotification accuracyVSAvoidface detection accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent inverts the detection approach by switching from face detection to foot detection. Instead of capturing the user's face which is affected by backlight and position variations, the system captures images of the user's feet and analyzes toe direction. This inversion resolves the technical contradiction by eliminating the harmful effects of backlight and position variability that plague face detection, while maintaining the ability to determine user presence and orientation for accurate notifications.

Inventive Principle:
Principle #13The other way round (Inversion)

2Measurement precision

If camera is mounted to capture user's face at center of image, then face detection can be optimized, but other users with different heights have their faces captured at image edges reducing detection accuracy

Engineering Contradiction:
Improveface detection accuracyVSAvoiduser height adaptability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies universality by using foot detection instead of face detection. The foot detection system is universally applicable to users of all heights because feet are positioned at a consistent location relative to the ground and the camera's field of view. This eliminates the need to adjust camera mounting position or angle for different user heights, making the system universally adaptable while maintaining detection accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Use of energy by moving object

If face detection is used in power saving mode transitions, then energy saving can be achieved, but false notifications occur due to degraded detection accuracy

Engineering Contradiction:
Improvepower savingVSAvoidnotification reliability
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The patent inverts the detection method from face-based to foot-based detection to resolve the contradiction between power saving and notification reliability. Foot detection provides more consistent and reliable results because feet are not affected by backlight effects or position variations that plague face detection. This allows the system to maintain high notification reliability while operating in power saving mode, as the foot detection algorithm produces fewer false positives.

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentEP3211563B1Information processing apparatus
Publication Date: 2020.05.20 FUJIFILM BUSINESS INNOVATION CORP
  • EP3211563B1 patent drawingFigure 1~2
  • EP3211563B1 patent drawingFigure 3~4
  • EP3211563B1 patent drawingFigure 5A~6

AI summary

There is provided an information processing apparatus. A determination unit determines whether an object is present in a predetermined place. A specification unit specifies a direction of a toe of a user who uses the information processing apparatus. A notification unit performs a notification to the user in a case where a predetermined direction of the toe is specified and it is determined that the object is present in the place.