Browser Gesture Zoom Recognition via DOM Element Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing browser technologies on touch screens frequently misinterpret user gestures on mobile terminals, leading to unnecessary zoom operations and re-layout disturbances, particularly in gaming and non-text regions, which disrupt user experiences.

Innovation Solution

A method and device for intelligently recognizing gesture-based zoom instructions by detecting user inputs, identifying web page elements associated with touch points, and performing corresponding operations such as discarding or performing re-layout or zoom operations based on the identified elements, using a DOM tree to determine the type of web page elements and their positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If gesture-based zoom instructions are uniformly applied to all web page regions, then zoom functionality is consistently available, but unnecessary zoom operations occur in gaming regions and text regions causing user experience degradation

Engineering Contradiction:
Improvezoom functionality availabilityVSAvoiduser experience
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent applies different gesture recognition rules to different regions of the web page. Specifically, it identifies canvas elements (gaming regions) and text regions, then applies localized policies: disabling zoom gestures in canvas regions to prevent interference with game operations, disabling zoom in text regions to avoid unnecessary re-layout operations, and enabling zoom only in appropriate non-text, non-canvas regions. This local differentiation resolves the contradiction by making zoom functionality adaptive to regional requirements.

Inventive Principle:
Principle #3Local quality

2Ease of operation

If zoom operations are performed frequently on web pages, then users can easily view content at different scales, but gaming operations are disturbed due to misinterpretation of tap gestures as zoom instructions

Engineering Contradiction:
Improvecontent viewing convenienceVSAvoidgaming operation accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces an intermediary layer (the gesture recognition system) that sits between user input and web page response. This intermediary analyzes the context of each gesture by identifying the underlying HTML element (canvas vs. other elements) and mediates the gesture interpretation accordingly. For canvas elements, it prevents zoom gesture recognition, allowing game taps to pass through unchanged. For other elements, it enables normal zoom recognition. This intermediary mechanism resolves the contradiction by intelligently filtering gestures based on contextual information.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If re-layout operations are performed during zoom to adapt text regions to window width, then text display is optimized, but vision disturbance and performance overhead increase due to repeated re-drawing and coordinate adjustment

Engineering Contradiction:
Improvetext display adaptabilityVSAvoidoperation complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies preliminary anti-action by proactively preventing zoom operations in text regions before they can trigger harmful re-layout effects. The system identifies text regions (through element type detection or sampling surrounding elements) and blocks zoom gestures targeting these regions. This preemptive measure avoids the subsequent chain of harmful operations (re-layout, re-drawing, coordinate adjustment) that would cause vision disturbance and performance overhead, while still allowing zoom in appropriate regions where it is beneficial.

Inventive Principle:
Principle #9Preliminary anti-action

Data Source

PatentUS11137897B2Method and device for intelligently recognizing gesture-based zoom instruction by browser
Publication Date: 2021.10.05 ZTE CORP
  • US11137897B2 patent drawing
  • US11137897B2 patent drawing

AI summary

A method and a device for implementation of a browser for intelligently recognizing a gesture-based zoom instruction are provided, relating to the browser technologies. The method includes: detecting, by a mobile terminal, a gesture-based instruction input by a user (S101); finding a web page element associated with a position of a touch point of the gesture-based zoom instruction if the detected gesture-based instruction is a gesture-based zoom instruction for zooming a browser page (S102); and performing a corresponding operation according to the web page element (S103). The method and the device determine, according to the web page element associated with the position of the touch point, whether to perform a zoom operation of the browser page or a re-layout operation of a text region, being capable of improving the user experience.