Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

System, method and medium for information gain and display

A technology of information gain and object information, applied in the field of AR scene application, can solve problems such as large computing and storage resources, inability to guarantee real-time performance and correlation between frames, and achieve the effect of solving correlation problems

Active Publication Date: 2021-09-07
上海影创信息科技有限公司
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

AR devices are usually wearable mobile devices. The current mobile related technologies can only locate, identify and track a small number of objects, and adding new categories requires retraining; large-scale object recognition technology cannot guarantee real-time and Inter-frame correlation, and takes up more computing and storage resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System, method and medium for information gain and display

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] The system for information gain and display according to the present invention includes: a sensor: used to continuously acquire scene information, and transmit the acquired information to the mobile computing unit; the mobile computing unit: screen the acquired information, Comparing and calculating to obtain the 3D position and attitude of the object; data exchange unit: responsible for the data exchange between the mobile terminal and the cloud, uploading the salient image and time stamp from the mobile terminal to the cloud computing unit, and downloading the results of cloud computing to the mobile terminal ; Cloud computing unit: take images as input, output feature vectors through neural network training, and then obtain corresponding object information based on retrieval methods; rendering display unit: render object information to corresponding 3D position and displayed on the display device.

[0047] The sensors include single or multiple color cameras, monochr...

Embodiment 2

[0062] Embodiment 2 is a preferred example of Embodiment 1.

[0063] The system for information gain and display provided according to the present invention includes:

[0064] Sensor: Used to continuously acquire scene information, which can be a combination of single or multiple color cameras, monochrome cameras, depth cameras, radars, etc., and the acquired information is transmitted to the mobile terminal computing unit.

[0065] Mobile computing unit, including:

[0066] (1) Information preprocessing

[0067] If the information acquired by the sensor does not meet the input requirements of the neural network, it needs to be preprocessed through steps such as noise reduction, optimization, and formatting, and then passed to the saliency detection neural network.

[0068] (2) Significance detection unit

[0069] A saliency detection unit can be,

[0070] A. There are a large number of categories, with label boxes, but the label category can be a detection neural network ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a system, method and medium for information gain and display, including: a sensor: used to continuously acquire scene information, and transmit the acquired information to a mobile computing unit; a mobile computing unit: The information is screened, compared and calculated to obtain the 3D position and attitude of the object; data exchange unit: responsible for the data exchange between the mobile terminal and the cloud, uploading the salient image and time stamp from the mobile terminal to the cloud computing unit, and at the same time uploading the cloud computing The result is downloaded to the mobile terminal; cloud computing unit: takes the image as input, trains the neural network, outputs the feature vector, and then obtains the corresponding object information based on the retrieval method; rendering display unit: according to the object information, object 3D position and posture The information is rendered to the corresponding 3D position and displayed on the display device. The invention adopts the visual tracking technology of the mobile terminal, and solves the problem of the relevance of the positions of large-scale objects on the terminal in the time domain.

Description

technical field [0001] The present invention relates to the technical field of AR scene application, in particular, to a system, method and medium for information gain and display. Background technique [0002] Information gain and display are very important components of AR application scenarios, and one of its underlying technologies is object positioning, recognition, and tracking. AR devices are usually wearable mobile devices. The current mobile related technologies can only locate, identify and track a small number of objects, and adding new categories requires retraining; large-scale object recognition technology cannot guarantee real-time and Inter-frame correlation, and takes up more computing and storage resources. [0003] Patent document CN102905153B (application number: CN201210166773.8) discloses a stereoscopic image display device and a driving method thereof. A stereoscopic image display device according to an embodiment of the present invention includes: a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/14G06N3/08G06T7/73G06T15/00G06T19/00H04L29/08
CPCG06F3/14G06N3/08G06T15/005G06T19/006G06T2207/10016G06T2207/10024G06T2207/10028G06T2207/10044G06T2207/20081G06T2207/20084G06T7/73H04L67/06H04L67/10
Inventor 张旭毛文涛吕四凯李向阳
Owner 上海影创信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com