AR-based information processing method, apparatus, AR device, and storage medium

An information processing method and related information technology, applied in the field of augmented reality, can solve problems such as object-related information that cannot provide unbound virtual information, single virtual information, etc.

Inactive Publication Date: 2019-02-01
BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
View PDF5 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide an AR-based information processing method, device, AR device, and storage medium to solve the problem that the current AR device can only be bound to the AR scene or objects in the AR scene in advance. The virtual information is superimposed on the AR scene, and the displayed virtual information is single, and it is unable to provide information about objects that are not bound to virtual information.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • AR-based information processing method, apparatus, AR device, and storage medium
  • AR-based information processing method, apparatus, AR device, and storage medium
  • AR-based information processing method, apparatus, AR device, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] figure 1 It is a flow chart of the AR-based information processing method provided by Embodiment 1 of the present invention. The embodiment of the present invention aims at that when the current AR device is in use, it can only superimpose the fixed virtual information bound to the AR scene or objects in the AR scene in advance to the AR scene, and the displayed virtual information is single, and it cannot provide unbound virtual information. For the problem of related information of virtual information objects, an information processing method based on AR is provided. The method in this embodiment is applied to AR devices, for example, AR glasses, AR helmets and the like. The subject of execution of the method may be a processor of the AR device. Such as figure 1 As shown, the specific steps of the method are as follows:

[0031] Step S101 , during the user's use of the AR device, acquire the location information of the gaze point of the user's eyeballs.

[0032] ...

Embodiment 2

[0054] figure 2 It is a flow chart of the AR-based information processing method provided by Embodiment 2 of the present invention. On the basis of the first embodiment above, in this embodiment, when the user is using the AR device, acquiring the position information of the gaze point of the user's eyeballs includes: acquiring the user's eye image in real time while the user is using the AR device Information; according to the user's eye image information, identify the user's eyeball and track the movement state of the user's eyeball; if the user's eyeball stays longer than the preset time, determine the position of the gaze point of the user's eyeball in the AR scene image. According to the image information of the target object, the relevant information of the target object is obtained, including: sending the image information of the target object to the search server, so that the search server searches and feeds back the relevant information of the target object; receivin...

Embodiment approach

[0071] Optionally, another feasible implementation manner of acquiring the image information of the target object corresponding to the gaze point of the user's eyeball is:

[0072] According to the position of the gaze point of the user's eye in the AR scene image, image segmentation processing is performed on the AR scene image to obtain the image information of the segmented area where the gaze point is located in the AR scene image.

[0073] For example, an AR scene image is usually a depth image. According to the position of the gaze point of the user's eye in the AR scene image, the area around the gaze point that is consistent with the depth information of the gaze point can be segmented in the AR scene image to obtain the gaze point. The image information of the segmented region where the point is located.

[0074] Step S205, sending the image information of the target object to the search server, so that the search server searches and feeds back relevant information of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the present invention provide an AR-based information processing method, apparatus, AR device, and storage medium. According to the invention, during a process that a user uses an AR device, when a user's eyeball looks at the target object, the image information of the target object being watched by the user's eyeball can be obtained, according to the image information of the targetobject, and superimposing the relevant information of the target object on the AR scene image within the range of the user's field of vision, so that any relevant information of the object searched by the user can be superimposed on the AR scene image according to the user's fixation point in real time, thereby greatly enriching the virtual information superimposed on the AR scene; and accordingto the different concerns of users, users can display the relevant information of the objects of interest to users, without binding the corresponding virtual information for AR scene or part of the objects in AR scene, which can realize the personalized superposition of virtual information in AR scene.

Description

technical field [0001] Embodiments of the present invention relate to the field of augmented reality technology, and in particular, to an AR-based information processing method, device, AR device, and storage medium. Background technique [0002] Augmented Reality (AR for short) is a technology that calculates the position and angle of camera images in real time and adds corresponding images, videos, and 3D models. The goal of this technology is to put the virtual world on the screen. the real world and interact with it. [0003] AR equipment is an important application of augmented reality technology, which can superimpose virtual information and real-world information, and present virtual information in an AR scene composed of a real environment. However, the current AR device binds corresponding virtual information to the AR scene or some objects in the AR scene in advance when building the AR device model. When using an AR device, only the fixed virtual information bou...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06T19/00
CPCG06F3/013G06T19/006
Inventor 贾晓博
Owner BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap