Physical Object Control for Electronic Devices Through Motion Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies lack efficient methods for controlling electronic devices using physical objects without direct communication or interaction, limiting user convenience and flexibility.

Innovation Solution

Electronic devices detect changes in the physical environment using sensors to interpret movements of physical objects, enabling actions such as volume control and system toggling through enrollment processes that associate objects with specific actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional input devices (mouse, touch sensor, proximity sensor) are used for user interaction, then direct control capability is achieved, but user convenience and flexibility are limited

Engineering Contradiction:
Improveuser convenienceVSAvoidinteraction method complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces physical objects as intermediaries between the user and the electronic device. Instead of direct interaction through traditional input devices, users manipulate physical objects that the system detects through sensors (camera, microphone, etc.), translating physical manipulation into control signals. This mediator approach enhances convenience by allowing indirect, more natural control while maintaining system functionality.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical input devices (mouse, keyboard, touch screen) with sensor-based detection systems. The camera and microphone detect physical object manipulation and convert it into digital control signals, substituting the mechanical interaction paradigm with optical and acoustic sensing. This reduces the need for dedicated input hardware while maintaining control capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If physical objects are used for control without direct communication, then user convenience is enhanced, but detection accuracy and reliability may be compromised

Engineering Contradiction:
Improveuser convenienceVSAvoiddetection reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system incorporates feedback mechanisms where the electronic device detects the physical object's state through sensors, processes this information, and provides appropriate responses (visual, auditory, or haptic feedback). This feedback loop ensures reliable detection by continuously monitoring the physical object's position and state, adjusting interpretation based on contextual information, and confirming understanding through feedback to the user.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent makes the detection system universal by enabling the same sensor suite (camera, microphone) to detect multiple types of physical objects and manipulation methods for different control functions. This multi-functionality approach improves reliability by using robust, general-purpose sensing rather than specialized detectors for each control mode, allowing the system to adapt to various physical objects and interaction styles.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12405661B2Devices and methods for controlling electronic devices or systems with physical objects
Publication Date: 2025.09.02 APPLE INC
  • US12405661B2 patent drawing
  • US12405661B2 patent drawing
  • US12405661B2 patent drawing

AI summary

Some examples described in this disclosure are performed at a first electronic device (e.g., a computer system) that is in communication with a display and one or more input devices. In some examples, the first electronic device detects a change in a physical environment of the first electronic device due to movement of one or more physical objects in the physical environment indicative of a user input. In some examples, the first electronic device performs a first action at the first electronic device or at a second electronic device in communication with the first electronic device in accordance with the change in the physical environment due to movement of the one or more physical objects in the physical environment.