Web Page Image Conversion for Mobile UI Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current website browsing systems for mobile devices struggle to effectively handle all types of user interface (UI) information, such as text entry forms and check boxes, and suffer from high server load due to frequent communication between the client terminal and server during user operations, leading to longer communication times and potential design deterioration when converting websites from PC to mobile formats.
Innovation Solution
A website browsing system that includes a server with a page content acquisition device, an image converter, a UI information analyzer, and a device for transmitting converted images and metadata to a client terminal, which then displays and controls the image and UI information based on the metadata, allowing for rapid browsing and operation of PC websites on mobile devices without design deterioration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conversion into markup language for mobile phone is adopted, then website can be displayed on mobile phone, but design quality deteriorates
Solution Approach 1:
The patent captures the visual appearance of the PC website as an image and transmits it to the mobile phone. This copying approach preserves the original design quality while enabling mobile display, avoiding the need to convert markup language which would degrade the design.
Solution Approach 2:
The patent separates the website into two components: the visual display (captured as image) and the interactive elements (identified through UI information analysis). This segmentation allows the image to maintain design quality while the metadata enables mobile-optimized interaction.
2Ease of operation
If frequent communication between client terminal and server is performed, then user operations can be supported, but server load increases and communication time lengthens
Solution Approach 1:
The patent performs preliminary analysis of UI information and generates metadata before transmitting the website image to the mobile phone. This preliminary action enables the client terminal to handle user operations locally using the pre-generated metadata, avoiding frequent server communication and reducing communication time.
Solution Approach 2:
The patent introduces UI information metadata as an intermediary between the server and client terminal. This metadata contains pre-analyzed interaction information that mediates between server resources and client operations, enabling local processing without continuous server communication.
3Adaptability or versatility
If UI information analysis is performed, then all user interface elements can be handled, but processing complexity increases
Solution Approach 1:
The patent extracts only the essential UI information from the website content and represents it as structured metadata. This extraction approach handles diverse UI elements (forms, buttons, links) without requiring complex processing, as the metadata captures only the necessary interaction information.
Data Source
AI summary
Web contents prepared for browsing by a PC is converted into an image showing a view when the webpage is browsed using a PC. Pieces of UI information are extracted from the web contents and XY coordinate values of each piece of UI information are acquired. This information indicates positions where the pieces of UI information are arranged on the image. A mobile terminal displaying the image controls these pieces of UI information. Accordingly, web contents for a PC are rapidly browsed and operated on a mobile terminal and so on, without deterioration in design of the web contents.