System, method and medium for information gain and display
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
A technology of information gain and object information, applied in the field of AR scene application, can solve problems such as large computing and storage resources, inability to guarantee real-time performance and correlation between frames, and achieve the effect of solving correlation problems
Active Publication Date: 2021-09-07
上海影创信息科技有限公司
View PDF13 Cites 0 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
AR devices are usually wearable mobile devices. The current mobile related technologies can only locate, identify and track a small number of objects, and adding new categories requires retraining; large-scale object recognition technology cannot guarantee real-time and Inter-frame correlation, and takes up more computing and storage resources
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0046] The system for information gain and display according to the present invention includes: a sensor: used to continuously acquire scene information, and transmit the acquired information to the mobile computing unit; the mobile computing unit: screen the acquired information, Comparing and calculating to obtain the 3D position and attitude of the object; data exchange unit: responsible for the data exchange between the mobile terminal and the cloud, uploading the salient image and time stamp from the mobile terminal to the cloud computing unit, and downloading the results of cloud computing to the mobile terminal ; Cloud computing unit: take images as input, output feature vectors through neural network training, and then obtain corresponding object information based on retrieval methods; rendering display unit: render object information to corresponding 3D position and displayed on the display device.
[0047] The sensors include single or multiple color cameras, monochr...
Embodiment 2
[0062] Embodiment 2 is a preferred example of Embodiment 1.
[0063] The system for information gain and display provided according to the present invention includes:
[0064] Sensor: Used to continuously acquire scene information, which can be a combination of single or multiple color cameras, monochrome cameras, depth cameras, radars, etc., and the acquired information is transmitted to the mobile terminal computing unit.
[0065] Mobile computing unit, including:
[0066] (1) Information preprocessing
[0067] If the information acquired by the sensor does not meet the input requirements of the neural network, it needs to be preprocessed through steps such as noise reduction, optimization, and formatting, and then passed to the saliency detection neural network.
[0068] (2) Significance detection unit
[0069] A saliency detection unit can be,
[0070] A. There are a large number of categories, with label boxes, but the label category can be a detection neural network ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
PUM
Login to view more
Abstract
The present invention provides a system, method and medium for information gain and display, including: a sensor: used to continuously acquire scene information, and transmit the acquired information to a mobile computing unit; a mobile computing unit: The information is screened, compared and calculated to obtain the 3D position and attitude of the object; data exchange unit: responsible for the data exchange between the mobile terminal and the cloud, uploading the salient image and time stamp from the mobile terminal to the cloud computing unit, and at the same time uploading the cloud computing The result is downloaded to the mobile terminal; cloud computing unit: takes the image as input, trains the neural network, outputs the feature vector, and then obtains the corresponding object information based on the retrieval method; rendering display unit: according to the object information, object 3D position and posture The information is rendered to the corresponding 3D position and displayed on the display device. The invention adopts the visual tracking technology of the mobile terminal, and solves the problem of the relevance of the positions of large-scale objects on the terminal in the time domain.
Description
technical field [0001] The present invention relates to the technical field of AR scene application, in particular, to a system, method and medium for information gain and display. Background technique [0002] Information gain and display are very important components of AR application scenarios, and one of its underlying technologies is object positioning, recognition, and tracking. AR devices are usually wearable mobile devices. The current mobile related technologies can only locate, identify and track a small number of objects, and adding new categories requires retraining; large-scale object recognition technology cannot guarantee real-time and Inter-frame correlation, and takes up more computing and storage resources. [0003] Patent document CN102905153B (application number: CN201210166773.8) discloses a stereoscopic image display device and a driving method thereof. A stereoscopic image display device according to an embodiment of the present invention includes: a...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to view more 
Login to view more