Dynamic User Interface Control for Collaborative Large Screen Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing information processing systems with large screens struggle to facilitate collaborative actions among multiple users, provide user-friendly manipulation regardless of user position or state, display objects in suitable sizes, and correctly show image contents from multiple sources simultaneously, especially when the screen is rotated.

Innovation Solution

An information processing apparatus that includes a control unit to adjust the user interface based on user position and state, using sensors to detect user input and optimize the display and input methods, ensuring correct size and position relationships of images, and rotating objects to face users appropriately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a large screen is used to display multiple objects in various orientations, then the display area is improved, but the ease of rotational manipulation deteriorates

Engineering Contradiction:
Improvedisplay areaVSAvoidrotational manipulation
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The screen is divided into multiple independent manipulation regions, each associated with specific objects. Users can manipulate objects in different regions independently without rotating the entire screen, as each region can be individually oriented or accessed through localized interactions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of rotating the screen in the horizontal plane to change object orientation, the system introduces a virtual rotation dimension through software. Objects can be rotated visually within their regions while the screen itself remains stationary, adding a layer of virtual manipulation dimension.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If individual manipulation rights are assigned to each user for each object, then the reliability of object manipulation is improved, but the ease of collaborative action deteriorates

Engineering Contradiction:
Improveobject manipulation controlVSAvoidcollaborative action
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

Manipulation rights are made dynamic rather than static. The system automatically adjusts which user has control over which objects based on real-time factors such as user position relative to the screen, current interaction state, and object importance. This allows seamless transitions of control between users without requiring manual rights management.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system continuously monitors user positions, interaction patterns, and object states to provide feedback for automatic rights allocation. When a user approaches the screen or begins interacting with an object, the system detects these changes and adjusts manipulation rights accordingly, enabling intuitive collaborative behavior.

Inventive Principle:
Principle #23Feedback

3Device complexity

If the GUI and input unit are kept constant, then the device complexity is reduced, but the adaptability to different user positions and states deteriorates

Engineering Contradiction:
Improveinterface consistencyVSAvoiduser position adaptation
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The GUI and input units are made dynamically adaptable based on detected user positions and states. The system automatically adjusts interface elements, their positions, sizes, and types of input accepted according to where users are located relative to the screen and what they are currently doing, all through automated detection and adjustment mechanisms.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10261589B2Information processing apparatus, information processing method, and computer program
Publication Date: 2019.04.16 SATURN LICENSING LLC
  • US10261589B2 patent drawing
  • US10261589B2 patent drawing
  • US10261589B2 patent drawing

AI summary

An information processing apparatus may include a control unit to control a user interface based on a determination of (i) a change in position of a user and (ii) a state of the user, by detecting at least one information signal input to the apparatus from outside of the apparatus.