Enhanced audiovisual multiuser communication

A user, audiovisual technology, applied in the field of computer readable media, audiovisual recording processor system, enhanced audiovisual recording

Active Publication Date: 2020-07-28
KONINK KPN NV +1
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On the other hand, if the microphone has a static position relative to the user, audio characteristics such as sound level or frequency distribution may change, but these changes are not fully conveyed when the recorded audio data is played to other user(s) change in face orientation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Enhanced audiovisual multiuser communication
  • Enhanced audiovisual multiuser communication
  • Enhanced audiovisual multiuser communication

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0149] Figure 1A to Figure 4B Known examples of audiovisual multi-user communication in the context of VR are described, while problems associated with such known examples are indicated. The figures and description that follow detail embodiments of the invention that are also described in the context of VR, but are equally applicable to other types of audiovisual multi-user communication, such as AR or video conferencing that do not use a virtual environment ( such as Skype, Facetime, etc.).

[0150] Figure 1A The "capture side" of the audio-visual multi-user communication showing audio-visual recordings of users 10 is shown on the left. In this and subsequent figures (including Figure 5Apreviously described embodiments of the invention), the visual data is acquired by a camera 20 which captures video data of the user 10 in his / her physical environment (eg in 2D or stereoscopic 3D). Alternatively, any other suitable visual recording technique based eg on point clouds, g...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Systems and methods are provided for generating and rendering an enhanced audiovisual recording of a user, which may be used for multiuser communication, e.g., in Virtual Reality. Such an enhanced recording may be generated by determining a face orientation of the user in the audiovisual recording, and generating orientation data specifying an orientation which represents said determined face orientation. During rendering, the audio data may be rendered based on the orientation data, namely by rendering the audio data as a spatial audio source having a spatial direction which is congruent withthe face orientation of the user in a visual representation of the user. Accordingly, the spatial direction of the voice of the user may better match the user's face direction in the user's visual representation.

Description

technical field [0001] The present invention relates to a method of rendering an audiovisual recording of a user and to a processor system configured for rendering an audiovisual recording of a user. The invention further relates to a method of generating an enhanced audiovisual recording of a user and to a processor system configured for generating an enhanced audiovisual recording of a user. The invention further relates to a computer program comprising instructions for causing a processor system to perform any method. The invention further relates to a computer readable medium comprising metadata. Background technique [0002] Audiovisual multi-user communication is common today. In this type of multi-user communication, it is often recorded by an audiovisual recording device, such as a webcam with an integrated microphone, or by separate visual recording devices (e.g., a camera) and audio recording devices (e.g., a microphone) ( multiple) users, and then play the user...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04S7/00G06F3/01
CPCG06F3/165G06F3/011G06F3/012G06F3/0304H04S7/30H04S2400/15H04S2420/11H04N7/157H04S7/303H04S2400/13
Inventor M·普林斯H·M·斯托金S·N·B·冈克尔H·N·欣里克斯
Owner KONINK KPN NV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap