Adaptive Sub-picture Layout for Mobile Video Conferencing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video conference technologies on mobile terminals require user participation for picture rotation and fail to adjust the layout of sub-pictures during multipoint video conferences, leading to poor display on small screens with multiple participants.

Innovation Solution

A self-adaptive display method and device that determines and adjusts the number of sub-pictures displayed on a mobile terminal based on its placement state, using a multipoint control terminal to select and send the appropriate sub-pictures for display, enhancing user experience by dynamically adjusting the layout and content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the entire image is regarded as the processing unit during picture rotation, then the picture rotation function is simple to implement, but it is unable to adjust the layout of each subpicture in the multi-pictures

Engineering Contradiction:
Improvepicture rotation implementationVSAvoidlayout adjustment capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent segments the entire picture into multiple subpictures, each of which can be independently processed and positioned. This allows the system to adjust the layout of individual subpictures within the multi-picture display, rather than treating the entire image as a single unit. The segmentation enables flexible arrangement of video feeds from different participants while maintaining overall display coherence.

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If more sub-pictures are displayed on the mobile terminal, then more participants can be viewed, but the display screen cannot display clearly the contents of various pictures due to limited screen area

Engineering Contradiction:
Improvenumber of displayed sub-picturesVSAvoiddisplay clarity
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent implements dynamic adjustment of the number of displayed sub-pictures based on the mobile terminal's placement state (portrait or landscape mode). When the terminal is in portrait mode, fewer sub-pictures are displayed to maintain clarity, while in landscape mode, more sub-pictures can be displayed. The system dynamically determines the optimal number of sub-pictures to balance quantity and display quality according to the current orientation and screen dimensions.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If the picture rotation request sent by the terminal requires user participation, then the rotation can be controlled by the user, but it is not self-adaptive to the terminal's placement state

Engineering Contradiction:
Improveuser controlVSAvoidself-adaptive rotation
Core Design Contradiction:
Ease of operationVSExtent of automation

Solution Approach 1:

The patent enables the system to automatically detect the mobile terminal's placement state and autonomously determine the appropriate number and arrangement of sub-pictures without requiring user intervention. The system self-adjusts the display configuration based on whether the terminal is in portrait or landscape mode, making the picture rotation and layout adjustment fully automated and self-adaptive to the terminal's current state.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3163866B1Self-adaptive display method and device for image of mobile terminal, and computer storage medium
Publication Date: 2020.05.06 ZTE CORP
  • EP3163866B1 patent drawingFigure 1~3
  • EP3163866B1 patent drawingFigure 4~5
  • EP3163866B1 patent drawingFigure 6

AI summary

The present invention discloses a self-adaptive display method for an image of a mobile terminal. The method includes: determining, by a multipoint control terminal, the number K of sub-pictures which are permitted to be displayed by a mobile terminal in a current placement state; and selecting and sending K sub-pictures to the mobile terminal for display. The present invention further discloses a self-adaptive display device for an image of a mobile terminal, and a computer storage medium at the same time.