Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Augmented reality method and device

An augmented reality and real technology, applied in the computer field, can solve the problems of affecting the effect of augmented reality, unable to display virtual information of users' emotions, age and gender, and low user experience, so as to improve the effect of augmented reality and user experience

Active Publication Date: 2019-06-18
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 1. In the existing technology, it is difficult to achieve accurate user portraits, so the virtual information used for superimposed display often does not match the current state of the user, resulting in low user experience
[0006] 2. In the existing augmented reality technology, it is impossible to display suitable virtual information according to the user's emotion, age and gender
For example, when the user is a young woman in a happy mood, the virtual information is a wreath image and a smiley face sticker; when the user changes to an older man who is depressed, the virtual information is still a wreath image and a smiley face sticker, which seriously affects the augmented reality effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Augmented reality method and device
  • Augmented reality method and device
  • Augmented reality method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0038]The technical solution of the embodiment of the present invention realizes the identification of emotion, age, and gender based on images by performing key point detection, tilt correction, and feature extraction on user image information, and inputting the extracted features into a pre-established image classification model; Feature extraction and feature clustering...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an augmented reality method and device, and relates to the technical field of computers. A specific embodiment of the method comprises the steps of collecting video informationof a target, and obtaining real image information and real sound information of the target from the video information; determining at least one target state data based on the image by using the realimage information, and determining at least one target state data based on the sound by using the real sound information; fusing the same target state data based on the image and the sound to obtain target portrait data; and obtaining virtual information corresponding to the target portrait data, and superposing the virtual information into the target video information for display. According to the embodiment, the current state of the target can be recognized according to the image information and the sound information of the target, recognition results of the two aspects are fused to obtain the accurate target portrait, virtual information matched with the user state can be displayed on the basis of the target portrait, and therefore the augmented reality effect and the user experience are improved.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to an augmented reality method and device. Background technique [0002] Augmented reality is a technology that calculates the position and angle of images in real time to add corresponding images, videos, and three-dimensional models. It can apply virtual information that is difficult to experience in the real world to the real world, thereby producing effects beyond reality. [0003] In practical applications, augmented reality technology is widely used in environments such as webcasting, and is used to superimpose various virtual information with user images to enrich image content and increase interactive fun. figure 1 Several application examples of augmented reality technology in webcasting are shown. exist figure 1 In , the virtual images superimposed on the user's image are: rabbit ears, glasses, garlands, hairpins and stars. [0004] In the process of realizing...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/00G06K9/00G06K9/32G06K9/62
CPCG06F3/01G06T11/00G06T19/006A63F13/655A63F13/213A63F13/53G06T7/70G06V40/166G06F18/23213
Inventor 张伟华吴江旭李凡彭刚林张洪光孔磊锋
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products