Unlock instant, AI-driven research and patent intelligence for your innovation.

Augmented reality (AR) communication system and AR-based communication method

A technology of augmented reality and enhanced processing, applied in the field of communication, can solve problems such as no implementation method

Active Publication Date: 2021-05-11
HUAWEI TECH CO LTD
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

How to integrate AR into voice and video calls, there is currently no effective way to achieve it

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Augmented reality (AR) communication system and AR-based communication method
  • Augmented reality (AR) communication system and AR-based communication method
  • Augmented reality (AR) communication system and AR-based communication method

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0069] Example 1, one-way AR augmented scene. For example, scenes such as beauty, stickers, super-score, and expression-driven calls. This scenario can be applied to the case where both ends of the call support AR. It can also be applied to a case where AR is supported on one side.

[0070] see Figure 8 As shown, it is assumed that the first terminal device needs to perform AR processing during a video call with the second terminal device. The input of the AR media server includes the first media stream of the first terminal device. The first media stream is sent by the first terminal device to the AR media server through the first SBC. Exemplarily, the first media stream may include video collected by the first terminal device through a camera, and may also include voice collected through a microphone.

[0071] The AR media server outputs the downlink media stream of the second terminal device after performing media enhancement processing on the first media stream. Opt...

example 2

[0074] Example 2, operating interactive call scenarios, such as advertising promotion, distance education, etc. This scenario can be applied to the case where both ends of the call support AR. It can also be applied to a case where AR is supported on one side.

[0075] see Figure 9 As shown, it is taken as an example that user 1's first terminal device needs to perform AR processing during a video call with user 2's second terminal device. The input of the AR media server includes the first media stream of the first terminal device. The first media stream is sent by the first terminal device to the AR media server through the first SBC. The input of the AR media server also includes real-time operation instructions, such as operations such as model rotation, model movement or model scaling, and spatial annotation. The real-time operation instruction may be generated by user 1's operation, that is, sent to the AR media server by the first terminal device through the applic...

example 3

[0078] Example 3, image interactive call scene, such as AR holographic call scene, etc. This scenario applies to both ends of the call supporting AR. exist image 3 or Figure 5 In the deployment mode shown, the AR media server can deploy at least two media processing instances, taking two as an example, see Figure 10 As shown, they are media processing instance 1 and media processing instance 2 respectively. Input and output on media processing instance 1, and input and output on media processing instance 2 see Figure 10 shown. The input of media processing instance 1 includes the first media stream and the second auxiliary media stream. The first media stream can be sent to media processing instance 1 by the first terminal device through the first SBC, and the second auxiliary media stream can be the second terminal device. The AR control on the above is sent to media processing instance 1 through the auxiliary transmission channel. The input of the media processing ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an AR (Augmented Reality) communication system and an AR-based communication method, and provides an implementation mode of integrating AR into a voice and video call so as to improve user experience. An AR media server is deployed in a communication system, and a media stream channel is opened between the AR media server and an SBC to which terminal devices on two sides of a call belong, so that a media stream transmitted between the terminal devices on two sides of the call reaches the AR media server after being sent out from the SBC, and then the AR media server executes media enhancement processing. The AR processing is fused in the video call process.

Description

technical field [0001] The embodiments of the present application relate to the field of communication technologies, and in particular to an augmented reality AR communication system and an AR-based communication method. Background technique [0002] Voice over long term evolution (VoLTE) is an end-to-end voice solution based on the all-IP condition of the fourth generation (4th generation, 4G) network. VoLTE enables users to communicate with each other with shorter waiting time and higher quality of voice and video calls. Augmented Reality (Augmented Reality, AR) is a technology that ingeniously integrates virtual information with the real world. It uses multimedia, 3D modeling, real-time tracking and registration, intelligent interaction, sensing and other technical means to transform computer-generated After simulating and simulating virtual information such as text, images, 3D models, music, and video, it is applied to the real world, and the two kinds of information co...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N7/14H04N21/4788H04N21/234H04N21/235
CPCH04N7/141H04N21/4788H04N21/234H04N21/235H04N7/14
Inventor 高扬
Owner HUAWEI TECH CO LTD