Method and device for realizing visual and auditory synchronous perception

By obtaining the relative position information and room type between the video image and the audience, and dynamically adjusting the volume to achieve synchronous perception of vision and hearing, the problem of sound and picture being out of sync in scenes such as video conferences is solved, and the immersion of the video experience is improved.

CN119697415AActive Publication Date: 2025-03-25CHINA TELECOM CLOUD TECH CO LTD
12 Cites 3 Cited by

Patent Information

Application Number
CN202411705478.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-26
Publication Date
2025-03-25
Estimated Expiration
2044-11-26

AI Technical Summary

Technical Problem

In scenes such as video conferences, video speeches, and remote teaching, the direction and size of the sound perceived by the audience are fixed and out of sync with the dynamic changes of the image on the screen, resulting in auditory fatigue and the sense of separation between the sound and the picture in space.

Method used

By obtaining relative position information and room type between the video image and the audience, the volume is dynamically adjusted to achieve synchronous perception of visual and auditory perception. Specific methods include determining relative position information using optical reversibility principles, parallax principles, or combining the audience's orientation and angle in front of the display screen, and selecting an appropriate sound pressure attenuation function according to the room type to calculate the volume adjustment gain.

Benefits of technology

It realizes the audience's auditory and visual synchronization of auditory and visual in video applications, and increases the immersion of the video experience.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention provides a method and device for realizing visual and auditory synchronous perception, and the method comprises the steps: obtaining the relative position information between a played video image and an audience and the type of a room where the audience is located under the condition that a video application is started; determining a volume adjustment gain based on the acquired relative position information and the type of the room where the audience is located; adjusting the sound to be played of the video application according to the volume adjustment gain; when the video is played, the relative orientation and distance between the image and the audience can be obtained, the type of the room can be judged, the audio signal to be played is dynamically adjusted according to the orientation and distance between the audience and the image and the type of the room, and the virtual sound image synchronously changing with the image is generated. The audience can obtain the same spatial perception in auditory sense and visual sense, and the immersion of video application is increased.
Need to check novelty before this filing date? Find Prior Art