Artificial Reality Labels for MIDI Controller Mode Adaptation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

MIDI controllers have limited flexibility in function changes and poor labeling, making it difficult for users to operate, especially in varying modes, as they rely on hardware labels that are often insufficient or not responsive to the current operating mode.

Innovation Solution

An artificial reality system is used to provide virtual indications based on control events and media signals, allowing flexible and extensive information display to assist user operation, enabling retrofitting of existing hardware and eliminating the need for labels on the controller.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If hardware labels are used on controller elements, then users can identify control functions, but the labeling is insufficient and not responsive to current operating mode

Engineering Contradiction:

Improvecontrol function informationVSAvoidoperating mode adaptability

Core Design Contradiction:

Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent transitions from two-dimensional static hardware labels to three-dimensional virtual reality labels that can be positioned in spatial relationship to control elements. The VR labels exist in a virtual dimension that allows dynamic repositioning, scaling, and reconfiguration based on operating mode, while physical labels remain fixed on the controller surface.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent implements dynamic labeling where VR labels can change position, size, content, and visibility based on current operating mode. Unlike static hardware labels, the virtual labels are responsive and adaptive, automatically updating to reflect the active function of each control element in different contexts.

Inventive Principle:

Principle #15Dynamics

2Adaptability or versatility

If universal control elements are used to increase flexibility, then function changes are enabled, but the elements are difficult to find and operate due to poor labeling

Engineering Contradiction:

Improvefunction flexibilityVSAvoidcontrol element operability

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent implements feedback by having VR labels continuously display the current function assignment of each control element. Users receive immediate visual feedback about what function a control element serves in the current operating mode, eliminating the need to remember or guess the function of universal control elements.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent introduces VR labels as an intermediary between the user and universal control elements. The labels mediate the interaction by providing contextual information about control element functions, making the universal elements easier to operate without requiring physical modification to the controller.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Adaptability or versatility

If integrated displays are added to label control elements, then labeling flexibility is improved, but controller costs increase

Engineering Contradiction:

Improvelabeling flexibilityVSAvoidcontroller manufacturing cost

Core Design Contradiction:

Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent creates a virtual copy of the labeling function in the VR environment rather than implementing physical displays on each control element. The VR labels are rendered software-based representations that mimic the functionality of physical displays without the hardware cost, allowing flexible labeling without manufacturing complexity.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent implements a universal VR labeling system that serves all control elements through a single software-based approach. Rather than requiring individual displays for each control element, the system uses a unified VR labeling mechanism that can dynamically assign labels to any control element, reducing overall system complexity and cost.

Inventive Principle:

Principle #6Universality (Multi-functionality)

4Ease of manufacture

If static labels are used on controller, then manufacturing is simple, but the labels cannot respond to temporary unavailability of operating parameters

Engineering Contradiction:

Improvelabeling implementationVSAvoidcurrent operating state information

Core Design Contradiction:

Ease of manufactureVSLoss of information

Solution Approach 1:

The patent replaces static labels with dynamic VR labels that can update in real-time to reflect current operating state. The virtual labels respond to changes in operating parameters, temporarily hiding or modifying labels when parameters are unavailable, and updating when parameters become available, providing accurate current state information.

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS20240402983A1Artificial reality based processing of media data using a controller, in particular a MIDI controller

Publication Date: 2024.12.05 ALGORIDDIM GMBH

AI summary

The present invention provides a system for processing media signals, comprising a controller having at least one control element to be operated by a user to set an operating mode of the controller, a media processing unit for processing a media signal depending on the operating mode of the controller, and an artificial reality apparatus adapted to provide visual input for the user to create an artificial reality environment, wherein the artificial reality apparatus is adapted to display a virtual indication based on the current operating mode of the controller as set by the user.