Mobile Device Visual Content Orientation via Sensor Context

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mobile devices face challenges in maintaining optimal user experience when the orientation of visual content is not aligned with the user's field of view, especially in flat orientations where gravity-based alignment is ineffective, and in environments where face detection is hindered by darkness or obstructions.

Innovation Solution

The solution involves determining the context and movement of the mobile device using sensors like accelerometers, GPS, and cameras to align the visual content orientation with the device's movement or a fixed direction based on the detected activity, ensuring optimal rendering even in flat orientations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If gravity-based alignment is used to determine visual content orientation, then the orientation can be automatically adjusted, but it fails in flat orientations where gravity is not effective

Engineering Contradiction:
Improveorientation alignment effectivenessVSAvoidalignment accuracy in flat orientations
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system changes the parameter used for orientation determination from gravity-based to movement-based. When the device detects a flat orientation (where gravity is ineffective), it switches to using movement data from sensors to determine the appropriate visual content orientation, thereby maintaining reliability across different device orientations

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system introduces movement data as an intermediary to bridge the gap between device orientation and visual content alignment. Instead of directly using gravity (which fails in flat orientations), the system uses movement information from sensors as an intermediate to determine orientation when gravity-based methods are ineffective

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If face detection is used to determine visual content orientation, then the user's field of view can be accurately identified, but it fails in dark environments or when faces are obstructed

Engineering Contradiction:
Improveuser field of view detection accuracyVSAvoiddarkness and obstructions
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system uses movement data as an intermediary to determine visual content orientation when face detection fails. Instead of directly relying on face detection (which is affected by darkness and obstructions), the system uses sensor-based movement information as an intermediate to infer the appropriate orientation, thereby overcoming the limitations of face detection in challenging environments

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system continuously monitors device movement and uses this feedback to adjust visual content orientation. When face detection is unavailable (due to darkness or obstructions), the movement feedback from sensors provides continuous orientation information, ensuring the visual content remains properly aligned with the user's field of view

Inventive Principle:
Principle #23Feedback

3Ease of operation

If visual content orientation is continuously updated based on device movement, then optimal user experience is maintained, but processing resources and energy are consumed

Engineering Contradiction:
Improveuser experience qualityVSAvoidprocessing energy consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

Instead of continuously updating visual content orientation, the system uses periodic action by updating orientation based on significant movement events detected by sensors. This periodic approach maintains optimal user experience during active use while reducing processing energy consumption during static periods

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach ensures that the visual content remains optimally aligned with the user's field of view, providing a consistent and improved user experience across various activities and environments, including those where traditional gravity-based alignment fails.

Implementation Method 1

determining an orientation of the mobile device based on an orientation of the display device and a direction of movement of the mobile device

Methodology Applied
Scientific EffectGravitation: Gravitation

Implementation Method 2

The solution involves determining the context and movement of the mobile device using sensors like accelerometers

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Data Source

PatentEP4040262B1Orientation of visual content rendered on a display of a mobile device
Publication Date: 2024.10.09 NOKIA TECHNOLOGIES OY
  • EP4040262B1 patent drawingFigure 1A~1B
  • EP4040262B1 patent drawingFigure 2A~2B
  • EP4040262B1 patent drawingFigure 3A~3B

AI summary

A method comprising determining that an orientation of a mobile device is a flat orientation, determining a context of the mobile device, determining movement of the mobile device, and based on the orientation, context and movement of the device, determining orientation of visual content rendered on a display of the mobile device.