POI Label Rendering on Captured Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face difficulties in intuitively identifying nearby points of interest (POIs) when obtaining information offline, as existing technologies primarily display POI information on electronic maps without clear location indicators, leading to poor user experience.
Innovation Solution
An information display method and apparatus that determine the image capturing direction and geographic location of an end-user device, identify the POI pointed to by the device when capturing an image, and render labeled data corresponding to that POI onto the image, enhancing user experience by providing intuitive and convenient information access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If POI information is displayed on electronic maps, then information about nearby points of interest can be obtained, but the location indicators are not clear and user experience is poor
Solution Approach 1:
The patent transitions POI information display from the traditional 2D electronic map dimension to a 3D augmented reality dimension by rendering labeled POI data directly onto captured images. This dimensional change allows users to view POI information in the context of the actual physical environment, providing clear location indicators overlaid on the real-world view, thereby resolving the contradiction between information accessibility and ease of operation.
2Adaptability or versatility
If traditional offline information methods are used, then information can be obtained without network, but the methods are not intuitive and convenient
Solution Approach 1:
The patent introduces an intermediary system that combines offline map data with real-time camera imaging. The labeled POI data is rendered as visual overlays on captured images, serving as an intermediary between the user and the physical environment. This allows intuitive and convenient information access by directly annotating the visual field with relevant POI information, maintaining offline adaptability while dramatically improving ease of operation.
Data Source
AI summary
One or more implementations shown in the present specification provide an information display method. An image capturing direction of an end-user device is determined. When the end-user device captures a first image, a geographic location of the end-user device is determined. Based on the geographic location and the image capturing direction of the end-user device and a geographic location of at least one point of interest (POI), a first POI that the end-user device points to when capturing the first image is determined. Using the geographic location of the end-user device as an origin of a coordinate system, a space model is established. Based on the space model, coordinates of a virtual camera is determined. Labeled data corresponding to the first POI are rendered onto the first image by using a second image simulated by the virtual camera.